2023-10-08T12:32:08.121 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-08T12:32:08.121 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --owner scheduled_pdonnell@teuthology --name pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi --archive /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417949 -- /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417949/orig.config.yaml 2023-10-08T12:32:08.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-08T12:32:08.250 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417949 branch: wip-batrick-testing-20231007.154158 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: pdonnell@redhat.com first_in_suite: false job_id: '7417949' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-batrick-testing-20231007.154158 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' global: ms die on skipped message: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20231007.154158 sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 8022 sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de sleep_before_teardown: 0 subset: 128/256 suite: fs suite_branch: wip-batrick-testing-20231007.154158 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi045.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi078.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-07_20:01:29 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-08T12:32:08.250 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa; will attempt to use it 2023-10-08T12:32:08.251 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks 2023-10-08T12:32:08.251 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-08T12:32:08.253 INFO:teuthology.task.internal:Checking packages... 2023-10-08T12:32:08.274 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de' 2023-10-08T12:32:08.274 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-08T12:32:08.274 INFO:teuthology.packaging:ref: None 2023-10-08T12:32:08.274 INFO:teuthology.packaging:tag: None 2023-10-08T12:32:08.274 INFO:teuthology.packaging:branch: wip-batrick-testing-20231007.154158 2023-10-08T12:32:08.274 INFO:teuthology.packaging:sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:32:08.275 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-batrick-testing-20231007.154158 2023-10-08T12:32:08.409 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6639.g7b3143ba 2023-10-08T12:32:08.409 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-08T12:32:08.416 INFO:teuthology.task.internal:no buildpackages task found 2023-10-08T12:32:08.416 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-08T12:32:08.421 INFO:teuthology.task.internal:Saving configuration 2023-10-08T12:32:08.438 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-08T12:32:08.444 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T12:32:08.470 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417949', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 12:27:25.033273', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T12:32:08.491 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417949', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 12:27:25.035152', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T12:32:08.491 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-08T12:32:08.497 INFO:teuthology.task.internal:roles: ubuntu@smithi045.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-08T12:32:08.497 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-08T12:32:08.497 INFO:teuthology.run_tasks:Running task console_log... 2023-10-08T12:32:08.568 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa0e0ed5b80>, signals=[15]) 2023-10-08T12:32:08.569 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-08T12:32:08.574 INFO:teuthology.task.internal:Opening connections... 2023-10-08T12:32:08.575 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi045.front.sepia.ceph.com 2023-10-08T12:32:08.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T12:32:08.644 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi078.front.sepia.ceph.com 2023-10-08T12:32:08.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T12:32:08.710 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-08T12:32:08.716 DEBUG:teuthology.orchestra.run.smithi045:> uname -m 2023-10-08T12:32:08.738 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2023-10-08T12:32:08.738 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2023-10-08T12:32:08.798 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T12:32:08.798 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="8.6 (Ootpa)" 2023-10-08T12:32:08.799 INFO:teuthology.orchestra.run.smithi045.stdout:ID="rhel" 2023-10-08T12:32:08.799 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="fedora" 2023-10-08T12:32:08.799 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="8.6" 2023-10-08T12:32:08.799 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el8" 2023-10-08T12:32:08.799 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-08T12:32:08.799 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2023-10-08T12:32:08.799 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-08T12:32:08.799 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T12:32:08.800 INFO:teuthology.orchestra.run.smithi045.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T12:32:08.800 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T12:32:08.800 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:32:08.800 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T12:32:08.800 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-08T12:32:08.800 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T12:32:08.800 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-08T12:32:08.801 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2023-10-08T12:32:08.830 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2023-10-08T12:32:08.851 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2023-10-08T12:32:08.851 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2023-10-08T12:32:08.911 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T12:32:08.911 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8.6 (Ootpa)" 2023-10-08T12:32:08.911 INFO:teuthology.orchestra.run.smithi078.stdout:ID="rhel" 2023-10-08T12:32:08.911 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="fedora" 2023-10-08T12:32:08.912 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8.6" 2023-10-08T12:32:08.912 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8" 2023-10-08T12:32:08.912 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-08T12:32:08.912 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2023-10-08T12:32:08.912 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-08T12:32:08.912 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T12:32:08.912 INFO:teuthology.orchestra.run.smithi078.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T12:32:08.912 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T12:32:08.912 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:32:08.912 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T12:32:08.912 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-08T12:32:08.912 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T12:32:08.913 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-08T12:32:08.913 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2023-10-08T12:32:08.938 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-08T12:32:08.947 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-08T12:32:08.952 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-08T12:32:08.953 DEBUG:teuthology.orchestra.run.smithi045:> test '!' -e /home/ubuntu/cephtest 2023-10-08T12:32:08.955 DEBUG:teuthology.orchestra.run.smithi078:> test '!' -e /home/ubuntu/cephtest 2023-10-08T12:32:08.974 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-08T12:32:08.980 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-08T12:32:08.980 DEBUG:teuthology.orchestra.run.smithi045:> test -z $(ls -A /var/lib/ceph) 2023-10-08T12:32:09.015 DEBUG:teuthology.orchestra.run.smithi078:> test -z $(ls -A /var/lib/ceph) 2023-10-08T12:32:09.052 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-08T12:32:09.105 INFO:teuthology.run_tasks:Running task kernel... 2023-10-08T12:32:09.122 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-10-08T12:32:09.122 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-10-08T12:32:09.123 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-10-08T12:32:09.123 DEBUG:teuthology.orchestra.run.smithi045:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T12:32:09.123 DEBUG:teuthology.orchestra.run.smithi078:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T12:32:09.142 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:32:09.142 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2023-10-08T12:32:09.143 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:32:09.144 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2023-10-08T12:32:09.203 INFO:teuthology.orchestra.run.smithi078.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-08T12:32:09.203 INFO:teuthology.task.kernel:Running kernel on smithi078: 4.18.0-372.9.1.el8.x86_64 2023-10-08T12:32:09.203 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum install -y kernel 2023-10-08T12:32:09.204 INFO:teuthology.orchestra.run.smithi045.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-08T12:32:09.204 INFO:teuthology.task.kernel:Running kernel on smithi045: 4.18.0-372.9.1.el8.x86_64 2023-10-08T12:32:09.204 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum install -y kernel 2023-10-08T12:32:10.391 INFO:teuthology.orchestra.run.smithi045.stdout:Updating Subscription Management repositories. 2023-10-08T12:32:10.391 INFO:teuthology.orchestra.run.smithi045.stdout:Unable to read consumer identity 2023-10-08T12:32:10.470 INFO:teuthology.orchestra.run.smithi078.stdout:Updating Subscription Management repositories. 2023-10-08T12:32:10.470 INFO:teuthology.orchestra.run.smithi078.stdout:Unable to read consumer identity 2023-10-08T12:32:11.852 INFO:teuthology.orchestra.run.smithi045.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2023-10-08T12:32:11.924 INFO:teuthology.orchestra.run.smithi078.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2023-10-08T12:32:12.528 INFO:teuthology.orchestra.run.smithi045.stdout:Extra Packages for Enterprise Linux 24 MB/s | 16 MB 00:00 2023-10-08T12:32:13.016 INFO:teuthology.orchestra.run.smithi078.stdout:Extra Packages for Enterprise Linux 15 MB/s | 16 MB 00:01 2023-10-08T12:32:16.178 INFO:teuthology.orchestra.run.smithi045.stdout:lab-extras 639 kB/s | 24 kB 00:00 2023-10-08T12:32:16.508 INFO:teuthology.orchestra.run.smithi078.stdout:lab-extras 394 kB/s | 24 kB 00:00 2023-10-08T12:32:16.914 INFO:teuthology.orchestra.run.smithi045.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-08T12:32:16.976 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2023-10-08T12:32:16.977 INFO:teuthology.orchestra.run.smithi045.stdout:Nothing to do. 2023-10-08T12:32:16.977 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2023-10-08T12:32:17.093 DEBUG:teuthology.orchestra.run.smithi045:> echo no | sudo yum reinstall kernel || true 2023-10-08T12:32:17.219 INFO:teuthology.orchestra.run.smithi078.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-08T12:32:17.265 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2023-10-08T12:32:17.266 INFO:teuthology.orchestra.run.smithi078.stdout:Nothing to do. 2023-10-08T12:32:17.267 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2023-10-08T12:32:17.379 DEBUG:teuthology.orchestra.run.smithi078:> echo no | sudo yum reinstall kernel || true 2023-10-08T12:32:17.443 INFO:teuthology.orchestra.run.smithi045.stdout:Updating Subscription Management repositories. 2023-10-08T12:32:17.443 INFO:teuthology.orchestra.run.smithi045.stdout:Unable to read consumer identity 2023-10-08T12:32:17.707 INFO:teuthology.orchestra.run.smithi078.stdout:Updating Subscription Management repositories. 2023-10-08T12:32:17.708 INFO:teuthology.orchestra.run.smithi078.stdout:Unable to read consumer identity 2023-10-08T12:32:17.725 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:00:01 ago on Sun 08 Oct 2023 12:32:16 PM UTC. 2023-10-08T12:32:17.771 INFO:teuthology.orchestra.run.smithi045.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T12:32:17.812 INFO:teuthology.orchestra.run.smithi045.stderr:Error: No packages marked for reinstall. 2023-10-08T12:32:17.860 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum reinstall -y kernel || true 2023-10-08T12:32:17.970 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:00:02 ago on Sun 08 Oct 2023 12:32:16 PM UTC. 2023-10-08T12:32:18.010 INFO:teuthology.orchestra.run.smithi078.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T12:32:18.108 INFO:teuthology.orchestra.run.smithi078.stderr:Error: No packages marked for reinstall. 2023-10-08T12:32:18.154 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum reinstall -y kernel || true 2023-10-08T12:32:18.207 INFO:teuthology.orchestra.run.smithi045.stdout:Updating Subscription Management repositories. 2023-10-08T12:32:18.207 INFO:teuthology.orchestra.run.smithi045.stdout:Unable to read consumer identity 2023-10-08T12:32:18.477 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:00:02 ago on Sun 08 Oct 2023 12:32:16 PM UTC. 2023-10-08T12:32:18.483 INFO:teuthology.orchestra.run.smithi078.stdout:Updating Subscription Management repositories. 2023-10-08T12:32:18.483 INFO:teuthology.orchestra.run.smithi078.stdout:Unable to read consumer identity 2023-10-08T12:32:18.519 INFO:teuthology.orchestra.run.smithi045.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T12:32:18.552 INFO:teuthology.orchestra.run.smithi045.stderr:Error: No packages marked for reinstall. 2023-10-08T12:32:18.598 DEBUG:teuthology.orchestra.run.smithi045:> rpm -q kernel | sort -rV | head -n 1 2023-10-08T12:32:18.681 INFO:teuthology.orchestra.run.smithi045.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-08T12:32:18.681 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-08T12:32:18.681 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-08T12:32:18.682 DEBUG:teuthology.parallel:result is None 2023-10-08T12:32:18.743 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:00:02 ago on Sun 08 Oct 2023 12:32:16 PM UTC. 2023-10-08T12:32:18.783 INFO:teuthology.orchestra.run.smithi078.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T12:32:18.806 INFO:teuthology.orchestra.run.smithi078.stderr:Error: No packages marked for reinstall. 2023-10-08T12:32:18.851 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q kernel | sort -rV | head -n 1 2023-10-08T12:32:18.931 INFO:teuthology.orchestra.run.smithi078.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-08T12:32:18.932 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-08T12:32:18.932 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-08T12:32:18.932 DEBUG:teuthology.parallel:result is None 2023-10-08T12:32:18.932 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-08T12:32:18.939 INFO:teuthology.task.internal:Creating test directory... 2023-10-08T12:32:18.939 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T12:32:18.941 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T12:32:18.958 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-08T12:32:18.964 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-08T12:32:18.970 INFO:teuthology.task.internal:Creating archive directory... 2023-10-08T12:32:18.970 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T12:32:18.999 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T12:32:19.022 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-08T12:32:19.028 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-08T12:32:19.029 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T12:32:19.057 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T12:32:19.100 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T12:32:19.106 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T12:32:19.120 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T12:32:19.121 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T12:32:19.122 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-08T12:32:19.129 INFO:teuthology.task.internal:Configuring sudo... 2023-10-08T12:32:19.129 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T12:32:19.131 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T12:32:19.158 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-08T12:32:19.166 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-08T12:32:19.166 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T12:32:19.199 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T12:32:19.215 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T12:32:19.298 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T12:32:19.346 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T12:32:19.431 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T12:32:19.472 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:32:19.472 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T12:32:19.540 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T12:32:19.577 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T12:32:19.652 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T12:32:19.694 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T12:32:19.737 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T12:32:19.737 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T12:32:19.805 DEBUG:teuthology.orchestra.run.smithi045:> sudo service rsyslog restart 2023-10-08T12:32:19.807 DEBUG:teuthology.orchestra.run.smithi078:> sudo service rsyslog restart 2023-10-08T12:32:19.855 INFO:teuthology.orchestra.run.smithi045.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T12:32:19.905 INFO:teuthology.orchestra.run.smithi078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T12:32:20.286 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-08T12:32:20.294 INFO:teuthology.task.internal:Starting timer... 2023-10-08T12:32:20.294 INFO:teuthology.run_tasks:Running task pcp... 2023-10-08T12:32:20.303 INFO:teuthology.run_tasks:Running task selinux... 2023-10-08T12:32:20.312 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-10-08T12:32:20.312 DEBUG:teuthology.orchestra.run.smithi045:> sudo service auditd rotate 2023-10-08T12:32:20.381 INFO:teuthology.orchestra.run.smithi045.stdout:Rotating logs: 2023-10-08T12:32:20.383 DEBUG:teuthology.orchestra.run.smithi078:> sudo service auditd rotate 2023-10-08T12:32:20.453 INFO:teuthology.orchestra.run.smithi078.stdout:Rotating logs: 2023-10-08T12:32:20.455 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-08T12:32:20.455 DEBUG:teuthology.orchestra.run.smithi045:> /usr/sbin/getenforce 2023-10-08T12:32:20.480 INFO:teuthology.orchestra.run.smithi045.stdout:Permissive 2023-10-08T12:32:20.481 DEBUG:teuthology.orchestra.run.smithi078:> /usr/sbin/getenforce 2023-10-08T12:32:20.505 INFO:teuthology.orchestra.run.smithi078.stdout:Permissive 2023-10-08T12:32:20.505 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi045.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi078.front.sepia.ceph.com': 'permissive'} 2023-10-08T12:32:20.505 DEBUG:teuthology.orchestra.run.smithi045:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T12:32:20.548 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:32:20.549 DEBUG:teuthology.orchestra.run.smithi078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T12:32:20.575 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:32:20.576 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-08T12:32:20.576 DEBUG:teuthology.orchestra.run.smithi045:> sudo /usr/sbin/setenforce permissive 2023-10-08T12:32:20.617 DEBUG:teuthology.orchestra.run.smithi078:> sudo /usr/sbin/setenforce permissive 2023-10-08T12:32:20.643 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-08T12:32:20.653 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-08T12:32:20.653 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-08T12:32:20.668 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-08T12:32:20.669 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi045.front.sepia.ceph.com,smithi078.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-08T12:42:02.557 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi045.front.sepia.ceph.com'), Remote(name='ubuntu@smithi078.front.sepia.ceph.com')] 2023-10-08T12:42:02.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-10-08T12:42:02.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T12:42:02.633 DEBUG:teuthology.orchestra.run.smithi045:> true 2023-10-08T12:42:02.704 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-10-08T12:42:02.704 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-10-08T12:42:02.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T12:42:02.773 DEBUG:teuthology.orchestra.run.smithi078:> true 2023-10-08T12:42:02.844 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-10-08T12:42:02.844 INFO:teuthology.run_tasks:Running task clock... 2023-10-08T12:42:02.856 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-08T12:42:02.857 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T12:42:02.857 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T12:42:02.860 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T12:42:02.860 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T12:42:02.892 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T12:42:02.908 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T12:42:02.915 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T12:42:02.930 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T12:42:02.976 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: ntpd: command not found 2023-10-08T12:42:02.989 INFO:teuthology.orchestra.run.smithi045.stdout:506 Cannot talk to daemon 2023-10-08T12:42:02.993 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: ntpd: command not found 2023-10-08T12:42:03.003 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T12:42:03.004 INFO:teuthology.orchestra.run.smithi078.stdout:506 Cannot talk to daemon 2023-10-08T12:42:03.018 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T12:42:03.018 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T12:42:03.033 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T12:42:03.102 INFO:teuthology.orchestra.run.smithi078.stderr:bash: ntpq: command not found 2023-10-08T12:42:03.105 INFO:teuthology.orchestra.run.smithi078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T12:42:03.105 INFO:teuthology.orchestra.run.smithi078.stdout:=============================================================================== 2023-10-08T12:42:03.105 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:42:03.105 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:42:03.105 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:42:03.106 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:42:03.106 INFO:teuthology.orchestra.run.smithi045.stderr:bash: ntpq: command not found 2023-10-08T12:42:03.109 INFO:teuthology.orchestra.run.smithi045.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T12:42:03.109 INFO:teuthology.orchestra.run.smithi045.stdout:=============================================================================== 2023-10-08T12:42:03.109 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:42:03.110 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:42:03.110 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:42:03.110 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:42:03.110 INFO:teuthology.run_tasks:Running task install... 2023-10-08T12:42:03.120 DEBUG:teuthology.task.install:project ceph 2023-10-08T12:42:03.120 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de'}} 2023-10-08T12:42:03.120 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de'} 2023-10-08T12:42:03.120 INFO:teuthology.task.install:Using flavor: default 2023-10-08T12:42:03.126 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-08T12:42:03.126 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-08T12:42:03.126 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'tag': None, 'wait_for_package': False} 2023-10-08T12:42:03.127 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:42:03.129 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'tag': None, 'wait_for_package': False} 2023-10-08T12:42:03.129 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:42:03.271 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/ 2023-10-08T12:42:03.271 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6639.g7b3143ba 2023-10-08T12:42:03.276 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/ 2023-10-08T12:42:03.276 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6639.g7b3143ba 2023-10-08T12:42:03.444 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T12:42:03.445 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:42:03.445 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T12:42:03.462 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T12:42:03.463 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T12:42:03.463 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T12:42:03.475 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-08T12:42:03.475 DEBUG:teuthology.orchestra.run.smithi045:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T12:42:03.491 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-08T12:42:03.492 DEBUG:teuthology.orchestra.run.smithi078:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T12:42:03.545 DEBUG:teuthology.orchestra.run.smithi045:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T12:42:03.559 DEBUG:teuthology.orchestra.run.smithi078:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T12:42:03.624 DEBUG:teuthology.orchestra.run.smithi045:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T12:42:03.636 DEBUG:teuthology.orchestra.run.smithi078:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T12:42:03.691 INFO:teuthology.orchestra.run.smithi045.stdout:check_obsoletes = 1 2023-10-08T12:42:03.693 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum clean all 2023-10-08T12:42:03.701 INFO:teuthology.orchestra.run.smithi078.stdout:check_obsoletes = 1 2023-10-08T12:42:03.703 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum clean all 2023-10-08T12:42:04.072 INFO:teuthology.orchestra.run.smithi078.stdout:Updating Subscription Management repositories. 2023-10-08T12:42:04.083 INFO:teuthology.orchestra.run.smithi045.stdout:Updating Subscription Management repositories. 2023-10-08T12:42:04.957 INFO:teuthology.orchestra.run.smithi078.stdout:44 files removed 2023-10-08T12:42:04.997 INFO:teuthology.orchestra.run.smithi045.stdout:44 files removed 2023-10-08T12:42:05.007 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-08T12:42:05.049 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-08T12:42:05.335 INFO:teuthology.orchestra.run.smithi078.stdout:Updating Subscription Management repositories. 2023-10-08T12:42:05.400 INFO:teuthology.orchestra.run.smithi045.stdout:Updating Subscription Management repositories. 2023-10-08T12:42:06.657 INFO:teuthology.orchestra.run.smithi078.stdout:ceph packages for x86_64 261 kB/s | 81 kB 00:00 2023-10-08T12:42:06.807 INFO:teuthology.orchestra.run.smithi045.stdout:ceph packages for x86_64 208 kB/s | 81 kB 00:00 2023-10-08T12:42:07.050 INFO:teuthology.orchestra.run.smithi078.stdout:ceph noarch packages 26 kB/s | 9.4 kB 00:00 2023-10-08T12:42:07.191 INFO:teuthology.orchestra.run.smithi045.stdout:ceph noarch packages 27 kB/s | 9.4 kB 00:00 2023-10-08T12:42:07.493 INFO:teuthology.orchestra.run.smithi045.stdout:ceph source packages 5.4 kB/s | 1.5 kB 00:00 2023-10-08T12:42:07.551 INFO:teuthology.orchestra.run.smithi078.stdout:ceph source packages 3.1 kB/s | 1.5 kB 00:00 2023-10-08T12:42:07.626 INFO:teuthology.orchestra.run.smithi045.stdout:Copr repo for python3-asyncssh owned by ceph 31 kB/s | 3.5 kB 00:00 2023-10-08T12:42:07.702 INFO:teuthology.orchestra.run.smithi078.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-10-08T12:42:08.518 INFO:teuthology.orchestra.run.smithi045.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2023-10-08T12:42:08.731 INFO:teuthology.orchestra.run.smithi078.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:01 2023-10-08T12:42:12.184 INFO:teuthology.orchestra.run.smithi045.stdout:lab-extras 420 kB/s | 24 kB 00:00 2023-10-08T12:42:12.194 INFO:teuthology.orchestra.run.smithi078.stdout:lab-extras 367 kB/s | 24 kB 00:00 2023-10-08T12:42:13.363 INFO:teuthology.orchestra.run.smithi078.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 43 MB/s | 47 MB 00:01 2023-10-08T12:42:13.440 INFO:teuthology.orchestra.run.smithi045.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 40 MB/s | 47 MB 00:01 2023-10-08T12:42:21.422 INFO:teuthology.orchestra.run.smithi078.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 51 MB/s | 53 MB 00:01 2023-10-08T12:42:22.103 INFO:teuthology.orchestra.run.smithi045.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 50 MB/s | 53 MB 00:01 2023-10-08T12:42:32.478 INFO:teuthology.orchestra.run.smithi078.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T12:42:32.479 INFO:teuthology.orchestra.run.smithi078.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T12:42:32.493 INFO:teuthology.orchestra.run.smithi078.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-08T12:42:32.494 INFO:teuthology.orchestra.run.smithi078.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-08T12:42:32.495 INFO:teuthology.orchestra.run.smithi078.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-08T12:42:32.496 INFO:teuthology.orchestra.run.smithi078.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-08T12:42:32.503 INFO:teuthology.orchestra.run.smithi078.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-08T12:42:32.503 INFO:teuthology.orchestra.run.smithi078.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-08T12:42:32.503 INFO:teuthology.orchestra.run.smithi078.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-08T12:42:32.631 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2023-10-08T12:42:32.644 INFO:teuthology.orchestra.run.smithi078.stdout:=========================================================================================================================== 2023-10-08T12:42:32.644 INFO:teuthology.orchestra.run.smithi078.stdout: Package Arch Version Repository Size 2023-10-08T12:42:32.644 INFO:teuthology.orchestra.run.smithi078.stdout:=========================================================================================================================== 2023-10-08T12:42:32.644 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2023-10-08T12:42:32.644 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-08T12:42:32.644 INFO:teuthology.orchestra.run.smithi078.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T12:42:32.644 INFO:teuthology.orchestra.run.smithi078.stdout: ceph x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.4 k 2023-10-08T12:42:32.644 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 5.4 M 2023-10-08T12:42:32.645 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 918 k 2023-10-08T12:42:32.645 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 167 k 2023-10-08T12:42:32.645 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 1.6 M 2023-10-08T12:42:32.645 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 132 k 2023-10-08T12:42:32.645 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 1.8 M 2023-10-08T12:42:32.645 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 7.4 M 2023-10-08T12:42:32.645 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-rook noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 47 k 2023-10-08T12:42:32.645 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 14 M 2023-10-08T12:42:32.645 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 49 M 2023-10-08T12:42:32.645 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-volume noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 261 k 2023-10-08T12:42:32.645 INFO:teuthology.orchestra.run.smithi078.stdout: cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 190 k 2023-10-08T12:42:32.645 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 261 k 2023-10-08T12:42:32.646 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-top noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 18 k 2023-10-08T12:42:32.646 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-08T12:42:32.646 INFO:teuthology.orchestra.run.smithi078.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T12:42:32.646 INFO:teuthology.orchestra.run.smithi078.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T12:42:32.646 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 31 k 2023-10-08T12:42:32.646 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 840 k 2023-10-08T12:42:32.646 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 139 k 2023-10-08T12:42:32.646 INFO:teuthology.orchestra.run.smithi078.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T12:42:32.646 INFO:teuthology.orchestra.run.smithi078.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-08T12:42:32.646 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T12:42:32.646 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-08T12:42:32.646 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-08T12:42:32.647 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-08T12:42:32.647 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 197 k 2023-10-08T12:42:32.647 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 371 k 2023-10-08T12:42:32.647 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 365 k 2023-10-08T12:42:32.647 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 107 k 2023-10-08T12:42:32.647 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 94 k 2023-10-08T12:42:32.647 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.6 M 2023-10-08T12:42:32.647 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 179 k 2023-10-08T12:42:32.647 INFO:teuthology.orchestra.run.smithi078.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-08T12:42:32.647 INFO:teuthology.orchestra.run.smithi078.stdout:Upgrading: 2023-10-08T12:42:32.647 INFO:teuthology.orchestra.run.smithi078.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-08T12:42:32.648 INFO:teuthology.orchestra.run.smithi078.stdout: librados2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T12:42:32.648 INFO:teuthology.orchestra.run.smithi078.stdout: librbd1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T12:42:32.648 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2023-10-08T12:42:32.648 INFO:teuthology.orchestra.run.smithi078.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T12:42:32.648 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 23 M 2023-10-08T12:42:32.648 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 23 k 2023-10-08T12:42:32.648 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 2.3 M 2023-10-08T12:42:32.648 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 242 k 2023-10-08T12:42:32.648 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 4.6 M 2023-10-08T12:42:32.648 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 18 M 2023-10-08T12:42:32.648 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 15 k 2023-10-08T12:42:32.648 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-selinux x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 24 k 2023-10-08T12:42:32.648 INFO:teuthology.orchestra.run.smithi078.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T12:42:32.649 INFO:teuthology.orchestra.run.smithi078.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T12:42:32.649 INFO:teuthology.orchestra.run.smithi078.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-08T12:42:32.649 INFO:teuthology.orchestra.run.smithi078.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T12:42:32.649 INFO:teuthology.orchestra.run.smithi078.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-08T12:42:32.649 INFO:teuthology.orchestra.run.smithi078.stdout: libcephsqlite x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 184 k 2023-10-08T12:42:32.649 INFO:teuthology.orchestra.run.smithi078.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-08T12:42:32.649 INFO:teuthology.orchestra.run.smithi078.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-08T12:42:32.649 INFO:teuthology.orchestra.run.smithi078.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T12:42:32.649 INFO:teuthology.orchestra.run.smithi078.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-08T12:42:32.649 INFO:teuthology.orchestra.run.smithi078.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-08T12:42:32.649 INFO:teuthology.orchestra.run.smithi078.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T12:42:32.649 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 518 k 2023-10-08T12:42:32.650 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-08T12:42:32.650 INFO:teuthology.orchestra.run.smithi078.stdout: librgw2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.9 M 2023-10-08T12:42:32.650 INFO:teuthology.orchestra.run.smithi078.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T12:42:32.650 INFO:teuthology.orchestra.run.smithi078.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-08T12:42:32.650 INFO:teuthology.orchestra.run.smithi078.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T12:42:32.650 INFO:teuthology.orchestra.run.smithi078.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T12:42:32.650 INFO:teuthology.orchestra.run.smithi078.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T12:42:32.650 INFO:teuthology.orchestra.run.smithi078.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T12:42:32.650 INFO:teuthology.orchestra.run.smithi078.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T12:42:32.650 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-08T12:42:32.650 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T12:42:32.651 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T12:42:32.651 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T12:42:32.651 INFO:teuthology.orchestra.run.smithi078.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T12:42:32.651 INFO:teuthology.orchestra.run.smithi078.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T12:42:32.651 INFO:teuthology.orchestra.run.smithi078.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T12:42:32.651 INFO:teuthology.orchestra.run.smithi078.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T12:42:32.651 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T12:42:32.651 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 45 k 2023-10-08T12:42:32.651 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 125 k 2023-10-08T12:42:32.651 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T12:42:32.651 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-08T12:42:32.652 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T12:42:32.652 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T12:42:32.652 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T12:42:32.652 INFO:teuthology.orchestra.run.smithi078.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T12:42:32.652 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T12:42:32.652 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T12:42:32.652 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T12:42:32.652 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T12:42:32.652 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T12:42:32.652 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T12:42:32.652 INFO:teuthology.orchestra.run.smithi078.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T12:42:32.653 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T12:42:32.653 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T12:42:32.653 INFO:teuthology.orchestra.run.smithi078.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T12:42:32.653 INFO:teuthology.orchestra.run.smithi078.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T12:42:32.653 INFO:teuthology.orchestra.run.smithi078.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T12:42:32.653 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T12:42:32.653 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T12:42:32.653 INFO:teuthology.orchestra.run.smithi078.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T12:42:32.653 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T12:42:32.653 INFO:teuthology.orchestra.run.smithi078.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T12:42:32.653 INFO:teuthology.orchestra.run.smithi078.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T12:42:32.654 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-08T12:42:32.654 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T12:42:32.654 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T12:42:32.654 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-08T12:42:32.654 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T12:42:32.654 INFO:teuthology.orchestra.run.smithi078.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T12:42:32.654 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T12:42:32.654 INFO:teuthology.orchestra.run.smithi078.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T12:42:32.654 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T12:42:32.654 INFO:teuthology.orchestra.run.smithi078.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-08T12:42:32.655 INFO:teuthology.orchestra.run.smithi078.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T12:42:32.655 INFO:teuthology.orchestra.run.smithi078.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T12:42:32.655 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T12:42:32.655 INFO:teuthology.orchestra.run.smithi078.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T12:42:32.655 INFO:teuthology.orchestra.run.smithi078.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T12:42:32.655 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T12:42:32.655 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T12:42:32.655 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T12:42:32.655 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T12:42:32.655 INFO:teuthology.orchestra.run.smithi078.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T12:42:32.655 INFO:teuthology.orchestra.run.smithi078.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-08T12:42:32.656 INFO:teuthology.orchestra.run.smithi078.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T12:42:32.656 INFO:teuthology.orchestra.run.smithi078.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-08T12:42:32.656 INFO:teuthology.orchestra.run.smithi078.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T12:42:32.656 INFO:teuthology.orchestra.run.smithi078.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T12:42:32.656 INFO:teuthology.orchestra.run.smithi078.stdout:Enabling module streams: 2023-10-08T12:42:32.656 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql 10 2023-10-08T12:42:32.656 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:42:32.656 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2023-10-08T12:42:32.656 INFO:teuthology.orchestra.run.smithi078.stdout:=========================================================================================================================== 2023-10-08T12:42:32.656 INFO:teuthology.orchestra.run.smithi078.stdout:Install 128 Packages 2023-10-08T12:42:32.656 INFO:teuthology.orchestra.run.smithi078.stdout:Upgrade 3 Packages 2023-10-08T12:42:32.656 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:42:32.657 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 209 M 2023-10-08T12:42:32.657 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2023-10-08T12:42:32.898 INFO:teuthology.orchestra.run.smithi078.stdout:(1/131): ceph-18.0.0-6639.g7b3143ba.el8.x86_64. 50 kB/s | 6.4 kB 00:00 2023-10-08T12:42:33.131 INFO:teuthology.orchestra.run.smithi078.stdout:(2/131): ceph-fuse-18.0.0-6639.g7b3143ba.el8.x8 3.8 MB/s | 918 kB 00:00 2023-10-08T12:42:33.198 INFO:teuthology.orchestra.run.smithi078.stdout:(3/131): ceph-immutable-object-cache-18.0.0-663 2.5 MB/s | 167 kB 00:00 2023-10-08T12:42:33.557 INFO:teuthology.orchestra.run.smithi078.stdout:(4/131): ceph-mds-18.0.0-6639.g7b3143ba.el8.x86 6.5 MB/s | 2.3 MB 00:00 2023-10-08T12:42:33.816 INFO:teuthology.orchestra.run.smithi078.stdout:(5/131): ceph-mgr-18.0.0-6639.g7b3143ba.el8.x86 6.3 MB/s | 1.6 MB 00:00 2023-10-08T12:42:34.038 INFO:teuthology.orchestra.run.smithi045.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T12:42:34.040 INFO:teuthology.orchestra.run.smithi045.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T12:42:34.055 INFO:teuthology.orchestra.run.smithi045.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-08T12:42:34.056 INFO:teuthology.orchestra.run.smithi045.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-08T12:42:34.058 INFO:teuthology.orchestra.run.smithi045.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-08T12:42:34.059 INFO:teuthology.orchestra.run.smithi045.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-08T12:42:34.061 INFO:teuthology.orchestra.run.smithi045.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-08T12:42:34.065 INFO:teuthology.orchestra.run.smithi045.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-08T12:42:34.066 INFO:teuthology.orchestra.run.smithi045.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-08T12:42:34.212 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2023-10-08T12:42:34.225 INFO:teuthology.orchestra.run.smithi045.stdout:=========================================================================================================================== 2023-10-08T12:42:34.225 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2023-10-08T12:42:34.225 INFO:teuthology.orchestra.run.smithi045.stdout:=========================================================================================================================== 2023-10-08T12:42:34.225 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2023-10-08T12:42:34.226 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-08T12:42:34.226 INFO:teuthology.orchestra.run.smithi045.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T12:42:34.226 INFO:teuthology.orchestra.run.smithi045.stdout: ceph x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.4 k 2023-10-08T12:42:34.226 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 5.4 M 2023-10-08T12:42:34.226 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 918 k 2023-10-08T12:42:34.226 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 167 k 2023-10-08T12:42:34.226 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 1.6 M 2023-10-08T12:42:34.226 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 132 k 2023-10-08T12:42:34.226 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 1.8 M 2023-10-08T12:42:34.226 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 7.4 M 2023-10-08T12:42:34.226 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-rook noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 47 k 2023-10-08T12:42:34.227 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-radosgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 14 M 2023-10-08T12:42:34.227 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-test x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 49 M 2023-10-08T12:42:34.227 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-volume noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 261 k 2023-10-08T12:42:34.227 INFO:teuthology.orchestra.run.smithi045.stdout: cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 190 k 2023-10-08T12:42:34.227 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 261 k 2023-10-08T12:42:34.227 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-top noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 18 k 2023-10-08T12:42:34.227 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-08T12:42:34.227 INFO:teuthology.orchestra.run.smithi045.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T12:42:34.227 INFO:teuthology.orchestra.run.smithi045.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T12:42:34.227 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 31 k 2023-10-08T12:42:34.227 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 840 k 2023-10-08T12:42:34.227 INFO:teuthology.orchestra.run.smithi045.stdout: librados-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 139 k 2023-10-08T12:42:34.228 INFO:teuthology.orchestra.run.smithi045.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T12:42:34.228 INFO:teuthology.orchestra.run.smithi045.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-08T12:42:34.228 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T12:42:34.228 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-08T12:42:34.228 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-08T12:42:34.228 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-08T12:42:34.228 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cephfs x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 197 k 2023-10-08T12:42:34.228 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rados x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 371 k 2023-10-08T12:42:34.228 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 365 k 2023-10-08T12:42:34.228 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 107 k 2023-10-08T12:42:34.228 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 94 k 2023-10-08T12:42:34.228 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.6 M 2023-10-08T12:42:34.229 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-nbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 179 k 2023-10-08T12:42:34.229 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-08T12:42:34.229 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrading: 2023-10-08T12:42:34.229 INFO:teuthology.orchestra.run.smithi045.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-08T12:42:34.229 INFO:teuthology.orchestra.run.smithi045.stdout: librados2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T12:42:34.229 INFO:teuthology.orchestra.run.smithi045.stdout: librbd1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T12:42:34.229 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2023-10-08T12:42:34.229 INFO:teuthology.orchestra.run.smithi045.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T12:42:34.229 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 23 M 2023-10-08T12:42:34.229 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 23 k 2023-10-08T12:42:34.229 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mds x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 2.3 M 2023-10-08T12:42:34.229 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 242 k 2023-10-08T12:42:34.230 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mon x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 4.6 M 2023-10-08T12:42:34.230 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-osd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 18 M 2023-10-08T12:42:34.230 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 15 k 2023-10-08T12:42:34.230 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-selinux x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 24 k 2023-10-08T12:42:34.230 INFO:teuthology.orchestra.run.smithi045.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T12:42:34.230 INFO:teuthology.orchestra.run.smithi045.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T12:42:34.230 INFO:teuthology.orchestra.run.smithi045.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-08T12:42:34.230 INFO:teuthology.orchestra.run.smithi045.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T12:42:34.230 INFO:teuthology.orchestra.run.smithi045.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-08T12:42:34.230 INFO:teuthology.orchestra.run.smithi045.stdout: libcephsqlite x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 184 k 2023-10-08T12:42:34.230 INFO:teuthology.orchestra.run.smithi045.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-08T12:42:34.230 INFO:teuthology.orchestra.run.smithi045.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-08T12:42:34.231 INFO:teuthology.orchestra.run.smithi045.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T12:42:34.231 INFO:teuthology.orchestra.run.smithi045.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-08T12:42:34.231 INFO:teuthology.orchestra.run.smithi045.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-08T12:42:34.231 INFO:teuthology.orchestra.run.smithi045.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T12:42:34.231 INFO:teuthology.orchestra.run.smithi045.stdout: libradosstriper1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 518 k 2023-10-08T12:42:34.231 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-08T12:42:34.231 INFO:teuthology.orchestra.run.smithi045.stdout: librgw2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.9 M 2023-10-08T12:42:34.231 INFO:teuthology.orchestra.run.smithi045.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T12:42:34.231 INFO:teuthology.orchestra.run.smithi045.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-08T12:42:34.231 INFO:teuthology.orchestra.run.smithi045.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T12:42:34.231 INFO:teuthology.orchestra.run.smithi045.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T12:42:34.231 INFO:teuthology.orchestra.run.smithi045.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T12:42:34.232 INFO:teuthology.orchestra.run.smithi045.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T12:42:34.232 INFO:teuthology.orchestra.run.smithi045.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T12:42:34.232 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-08T12:42:34.232 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T12:42:34.232 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T12:42:34.232 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T12:42:34.232 INFO:teuthology.orchestra.run.smithi045.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T12:42:34.232 INFO:teuthology.orchestra.run.smithi045.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T12:42:34.232 INFO:teuthology.orchestra.run.smithi045.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T12:42:34.232 INFO:teuthology.orchestra.run.smithi045.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T12:42:34.232 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T12:42:34.233 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-argparse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 45 k 2023-10-08T12:42:34.233 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 125 k 2023-10-08T12:42:34.233 INFO:teuthology.orchestra.run.smithi045.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T12:42:34.233 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-08T12:42:34.233 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T12:42:34.233 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T12:42:34.233 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T12:42:34.233 INFO:teuthology.orchestra.run.smithi045.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T12:42:34.233 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T12:42:34.233 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T12:42:34.233 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T12:42:34.233 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T12:42:34.234 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T12:42:34.234 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T12:42:34.234 INFO:teuthology.orchestra.run.smithi045.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T12:42:34.234 INFO:teuthology.orchestra.run.smithi045.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T12:42:34.234 INFO:teuthology.orchestra.run.smithi045.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T12:42:34.234 INFO:teuthology.orchestra.run.smithi045.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T12:42:34.234 INFO:teuthology.orchestra.run.smithi045.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T12:42:34.234 INFO:teuthology.orchestra.run.smithi045.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T12:42:34.234 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T12:42:34.234 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T12:42:34.234 INFO:teuthology.orchestra.run.smithi045.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T12:42:34.235 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T12:42:34.235 INFO:teuthology.orchestra.run.smithi045.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T12:42:34.235 INFO:teuthology.orchestra.run.smithi045.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T12:42:34.235 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-08T12:42:34.235 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T12:42:34.235 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T12:42:34.235 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-08T12:42:34.235 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T12:42:34.235 INFO:teuthology.orchestra.run.smithi045.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T12:42:34.235 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T12:42:34.235 INFO:teuthology.orchestra.run.smithi045.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T12:42:34.235 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T12:42:34.236 INFO:teuthology.orchestra.run.smithi045.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-08T12:42:34.236 INFO:teuthology.orchestra.run.smithi045.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T12:42:34.236 INFO:teuthology.orchestra.run.smithi045.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T12:42:34.237 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T12:42:34.237 INFO:teuthology.orchestra.run.smithi045.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T12:42:34.237 INFO:teuthology.orchestra.run.smithi045.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T12:42:34.237 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T12:42:34.237 INFO:teuthology.orchestra.run.smithi045.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T12:42:34.237 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T12:42:34.237 INFO:teuthology.orchestra.run.smithi045.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T12:42:34.237 INFO:teuthology.orchestra.run.smithi045.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T12:42:34.237 INFO:teuthology.orchestra.run.smithi045.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-08T12:42:34.237 INFO:teuthology.orchestra.run.smithi045.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T12:42:34.237 INFO:teuthology.orchestra.run.smithi045.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-08T12:42:34.238 INFO:teuthology.orchestra.run.smithi045.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T12:42:34.238 INFO:teuthology.orchestra.run.smithi045.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T12:42:34.238 INFO:teuthology.orchestra.run.smithi045.stdout:Enabling module streams: 2023-10-08T12:42:34.238 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql 10 2023-10-08T12:42:34.238 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:42:34.238 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2023-10-08T12:42:34.238 INFO:teuthology.orchestra.run.smithi045.stdout:=========================================================================================================================== 2023-10-08T12:42:34.238 INFO:teuthology.orchestra.run.smithi045.stdout:Install 128 Packages 2023-10-08T12:42:34.238 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrade 3 Packages 2023-10-08T12:42:34.238 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:42:34.239 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 209 M 2023-10-08T12:42:34.239 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2023-10-08T12:42:34.258 INFO:teuthology.orchestra.run.smithi078.stdout:(6/131): ceph-mon-18.0.0-6639.g7b3143ba.el8.x86 10 MB/s | 4.6 MB 00:00 2023-10-08T12:42:34.755 INFO:teuthology.orchestra.run.smithi045.stdout:(1/131): ceph-18.0.0-6639.g7b3143ba.el8.x86_64. 19 kB/s | 6.4 kB 00:00 2023-10-08T12:42:35.108 INFO:teuthology.orchestra.run.smithi078.stdout:(7/131): ceph-base-18.0.0-6639.g7b3143ba.el8.x8 2.3 MB/s | 5.4 MB 00:02 2023-10-08T12:42:35.414 INFO:teuthology.orchestra.run.smithi045.stdout:(2/131): ceph-fuse-18.0.0-6639.g7b3143ba.el8.x8 1.4 MB/s | 918 kB 00:00 2023-10-08T12:42:35.506 INFO:teuthology.orchestra.run.smithi045.stdout:(3/131): ceph-immutable-object-cache-18.0.0-663 1.8 MB/s | 167 kB 00:00 2023-10-08T12:42:35.933 INFO:teuthology.orchestra.run.smithi078.stdout:(8/131): ceph-osd-18.0.0-6639.g7b3143ba.el8.x86 11 MB/s | 18 MB 00:01 2023-10-08T12:42:35.984 INFO:teuthology.orchestra.run.smithi078.stdout:(9/131): ceph-selinux-18.0.0-6639.g7b3143ba.el8 488 kB/s | 24 kB 00:00 2023-10-08T12:42:35.990 INFO:teuthology.orchestra.run.smithi045.stdout:(4/131): ceph-mds-18.0.0-6639.g7b3143ba.el8.x86 4.8 MB/s | 2.3 MB 00:00 2023-10-08T12:42:36.398 INFO:teuthology.orchestra.run.smithi045.stdout:(5/131): ceph-mgr-18.0.0-6639.g7b3143ba.el8.x86 4.0 MB/s | 1.6 MB 00:00 2023-10-08T12:42:37.473 INFO:teuthology.orchestra.run.smithi045.stdout:(6/131): ceph-mon-18.0.0-6639.g7b3143ba.el8.x86 4.3 MB/s | 4.6 MB 00:01 2023-10-08T12:42:38.551 INFO:teuthology.orchestra.run.smithi078.stdout:(10/131): ceph-radosgw-18.0.0-6639.g7b3143ba.el 4.0 MB/s | 14 MB 00:03 2023-10-08T12:42:38.635 INFO:teuthology.orchestra.run.smithi078.stdout:(11/131): cephfs-mirror-18.0.0-6639.g7b3143ba.e 3.1 MB/s | 261 kB 00:00 2023-10-08T12:42:38.709 INFO:teuthology.orchestra.run.smithi078.stdout:(12/131): libcephfs-devel-18.0.0-6639.g7b3143ba 413 kB/s | 31 kB 00:00 2023-10-08T12:42:38.910 INFO:teuthology.orchestra.run.smithi078.stdout:(13/131): libcephfs2-18.0.0-6639.g7b3143ba.el8. 4.1 MB/s | 840 kB 00:00 2023-10-08T12:42:38.994 INFO:teuthology.orchestra.run.smithi078.stdout:(14/131): libcephsqlite-18.0.0-6639.g7b3143ba.e 2.2 MB/s | 184 kB 00:00 2023-10-08T12:42:39.077 INFO:teuthology.orchestra.run.smithi078.stdout:(15/131): librados-devel-18.0.0-6639.g7b3143ba. 1.6 MB/s | 139 kB 00:00 2023-10-08T12:42:39.219 INFO:teuthology.orchestra.run.smithi078.stdout:(16/131): libradosstriper1-18.0.0-6639.g7b3143b 3.6 MB/s | 518 kB 00:00 2023-10-08T12:42:40.040 INFO:teuthology.orchestra.run.smithi045.stdout:(7/131): ceph-osd-18.0.0-6639.g7b3143ba.el8.x86 7.0 MB/s | 18 MB 00:02 2023-10-08T12:42:40.332 INFO:teuthology.orchestra.run.smithi045.stdout:(8/131): ceph-base-18.0.0-6639.g7b3143ba.el8.x8 934 kB/s | 5.4 MB 00:05 2023-10-08T12:42:40.415 INFO:teuthology.orchestra.run.smithi045.stdout:(9/131): ceph-selinux-18.0.0-6639.g7b3143ba.el8 293 kB/s | 24 kB 00:00 2023-10-08T12:42:40.528 INFO:teuthology.orchestra.run.smithi078.stdout:(17/131): librgw2-18.0.0-6639.g7b3143ba.el8.x86 5.3 MB/s | 6.9 MB 00:01 2023-10-08T12:42:40.986 INFO:teuthology.orchestra.run.smithi078.stdout:(18/131): ceph-test-18.0.0-6639.g7b3143ba.el8.x 9.8 MB/s | 49 MB 00:05 2023-10-08T12:42:41.004 INFO:teuthology.orchestra.run.smithi078.stdout:(19/131): python3-ceph-argparse-18.0.0-6639.g7b 94 kB/s | 45 kB 00:00 2023-10-08T12:42:41.045 INFO:teuthology.orchestra.run.smithi078.stdout:(20/131): python3-ceph-common-18.0.0-6639.g7b31 2.1 MB/s | 125 kB 00:00 2023-10-08T12:42:41.104 INFO:teuthology.orchestra.run.smithi078.stdout:(21/131): python3-cephfs-18.0.0-6639.g7b3143ba. 1.9 MB/s | 197 kB 00:00 2023-10-08T12:42:41.138 INFO:teuthology.orchestra.run.smithi078.stdout:(22/131): python3-rados-18.0.0-6639.g7b3143ba.e 3.9 MB/s | 371 kB 00:00 2023-10-08T12:42:41.188 INFO:teuthology.orchestra.run.smithi078.stdout:(23/131): python3-rgw-18.0.0-6639.g7b3143ba.el8 2.1 MB/s | 107 kB 00:00 2023-10-08T12:42:41.214 INFO:teuthology.orchestra.run.smithi078.stdout:(24/131): python3-rbd-18.0.0-6639.g7b3143ba.el8 3.3 MB/s | 365 kB 00:00 2023-10-08T12:42:41.238 INFO:teuthology.orchestra.run.smithi078.stdout:(25/131): rbd-fuse-18.0.0-6639.g7b3143ba.el8.x8 1.8 MB/s | 94 kB 00:00 2023-10-08T12:42:41.289 INFO:teuthology.orchestra.run.smithi078.stdout:(26/131): rbd-nbd-18.0.0-6639.g7b3143ba.el8.x86 3.5 MB/s | 179 kB 00:00 2023-10-08T12:42:41.347 INFO:teuthology.orchestra.run.smithi078.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6639.g 395 kB/s | 23 kB 00:00 2023-10-08T12:42:41.406 INFO:teuthology.orchestra.run.smithi078.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6639.g7b3143b 2.2 MB/s | 132 kB 00:00 2023-10-08T12:42:41.632 INFO:teuthology.orchestra.run.smithi078.stdout:(29/131): ceph-common-18.0.0-6639.g7b3143ba.el8 2.5 MB/s | 23 MB 00:08 2023-10-08T12:42:41.715 INFO:teuthology.orchestra.run.smithi078.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6639.g7b314 5.7 MB/s | 1.8 MB 00:00 2023-10-08T12:42:41.716 INFO:teuthology.orchestra.run.smithi045.stdout:(10/131): ceph-radosgw-18.0.0-6639.g7b3143ba.el 8.3 MB/s | 14 MB 00:01 2023-10-08T12:42:41.765 INFO:teuthology.orchestra.run.smithi078.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6639.g7b 4.8 MB/s | 242 kB 00:00 2023-10-08T12:42:41.799 INFO:teuthology.orchestra.run.smithi045.stdout:(11/131): cephfs-mirror-18.0.0-6639.g7b3143ba.e 3.1 MB/s | 261 kB 00:00 2023-10-08T12:42:41.807 INFO:teuthology.orchestra.run.smithi078.stdout:(32/131): ceph-mgr-rook-18.0.0-6639.g7b3143ba.e 1.1 MB/s | 47 kB 00:00 2023-10-08T12:42:41.858 INFO:teuthology.orchestra.run.smithi045.stdout:(12/131): libcephfs-devel-18.0.0-6639.g7b3143ba 532 kB/s | 31 kB 00:00 2023-10-08T12:42:41.866 INFO:teuthology.orchestra.run.smithi078.stdout:(33/131): rbd-mirror-18.0.0-6639.g7b3143ba.el8. 5.5 MB/s | 3.6 MB 00:00 2023-10-08T12:42:41.892 INFO:teuthology.orchestra.run.smithi078.stdout:(34/131): ceph-prometheus-alerts-18.0.0-6639.g7 173 kB/s | 15 kB 00:00 2023-10-08T12:42:41.917 INFO:teuthology.orchestra.run.smithi078.stdout:(35/131): ceph-volume-18.0.0-6639.g7b3143ba.el8 5.1 MB/s | 261 kB 00:00 2023-10-08T12:42:41.959 INFO:teuthology.orchestra.run.smithi078.stdout:(36/131): cephadm-18.0.0-6639.g7b3143ba.el8.noa 2.8 MB/s | 190 kB 00:00 2023-10-08T12:42:41.984 INFO:teuthology.orchestra.run.smithi078.stdout:(37/131): cephfs-top-18.0.0-6639.g7b3143ba.el8. 271 kB/s | 18 kB 00:00 2023-10-08T12:42:42.009 INFO:teuthology.orchestra.run.smithi045.stdout:(13/131): libcephfs2-18.0.0-6639.g7b3143ba.el8. 5.4 MB/s | 840 kB 00:00 2023-10-08T12:42:42.075 INFO:teuthology.orchestra.run.smithi045.stdout:(14/131): libcephsqlite-18.0.0-6639.g7b3143ba.e 2.7 MB/s | 184 kB 00:00 2023-10-08T12:42:42.084 INFO:teuthology.orchestra.run.smithi078.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 588 kB/s | 59 kB 00:00 2023-10-08T12:42:42.126 INFO:teuthology.orchestra.run.smithi078.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.8 MB/s | 306 kB 00:00 2023-10-08T12:42:42.133 INFO:teuthology.orchestra.run.smithi045.stdout:(15/131): librados-devel-18.0.0-6639.g7b3143ba. 2.3 MB/s | 139 kB 00:00 2023-10-08T12:42:42.143 INFO:teuthology.orchestra.run.smithi078.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.3 MB/s | 75 kB 00:00 2023-10-08T12:42:42.185 INFO:teuthology.orchestra.run.smithi078.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.0 MB/s | 44 kB 00:00 2023-10-08T12:42:42.211 INFO:teuthology.orchestra.run.smithi078.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 5.5 MB/s | 476 kB 00:00 2023-10-08T12:42:42.234 INFO:teuthology.orchestra.run.smithi045.stdout:(16/131): libradosstriper1-18.0.0-6639.g7b3143b 5.1 MB/s | 518 kB 00:00 2023-10-08T12:42:42.244 INFO:teuthology.orchestra.run.smithi078.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 3.1 MB/s | 185 kB 00:00 2023-10-08T12:42:42.269 INFO:teuthology.orchestra.run.smithi078.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 563 kB/s | 33 kB 00:00 2023-10-08T12:42:42.286 INFO:teuthology.orchestra.run.smithi078.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 388 kB/s | 16 kB 00:00 2023-10-08T12:42:42.312 INFO:teuthology.orchestra.run.smithi078.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 4.0 MB/s | 173 kB 00:00 2023-10-08T12:42:42.346 INFO:teuthology.orchestra.run.smithi078.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 6.4 MB/s | 384 kB 00:00 2023-10-08T12:42:42.371 INFO:teuthology.orchestra.run.smithi078.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 1.4 MB/s | 81 kB 00:00 2023-10-08T12:42:42.429 INFO:teuthology.orchestra.run.smithi078.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 133 kB/s | 11 kB 00:00 2023-10-08T12:42:42.446 INFO:teuthology.orchestra.run.smithi078.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 234 kB/s | 18 kB 00:00 2023-10-08T12:42:42.480 INFO:teuthology.orchestra.run.smithi078.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 1.4 MB/s | 49 kB 00:00 2023-10-08T12:42:42.522 INFO:teuthology.orchestra.run.smithi078.stdout:(52/131): python3-kubernetes-11.0.0-6.el8.noarc 13 MB/s | 1.2 MB 00:00 2023-10-08T12:42:42.539 INFO:teuthology.orchestra.run.smithi078.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 1.0 MB/s | 59 kB 00:00 2023-10-08T12:42:42.564 INFO:teuthology.orchestra.run.smithi078.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.4 MB/s | 60 kB 00:00 2023-10-08T12:42:42.590 INFO:teuthology.orchestra.run.smithi078.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 5.5 MB/s | 283 kB 00:00 2023-10-08T12:42:42.606 INFO:teuthology.orchestra.run.smithi078.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 371 kB/s | 16 kB 00:00 2023-10-08T12:42:42.632 INFO:teuthology.orchestra.run.smithi078.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 800 kB/s | 34 kB 00:00 2023-10-08T12:42:42.665 INFO:teuthology.orchestra.run.smithi078.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 3.3 MB/s | 196 kB 00:00 2023-10-08T12:42:42.699 INFO:teuthology.orchestra.run.smithi078.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 957 kB/s | 64 kB 00:00 2023-10-08T12:42:42.716 INFO:teuthology.orchestra.run.smithi078.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 370 kB/s | 19 kB 00:00 2023-10-08T12:42:42.733 INFO:teuthology.orchestra.run.smithi078.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 713 kB/s | 24 kB 00:00 2023-10-08T12:42:42.784 INFO:teuthology.orchestra.run.smithi078.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 436 kB/s | 29 kB 00:00 2023-10-08T12:42:42.801 INFO:teuthology.orchestra.run.smithi078.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 410 kB/s | 27 kB 00:00 2023-10-08T12:42:42.834 INFO:teuthology.orchestra.run.smithi078.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 5.0 MB/s | 255 kB 00:00 2023-10-08T12:42:42.859 INFO:teuthology.orchestra.run.smithi078.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 4.2 MB/s | 251 kB 00:00 2023-10-08T12:42:42.885 INFO:teuthology.orchestra.run.smithi078.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2023-10-08T12:42:42.909 INFO:teuthology.orchestra.run.smithi045.stdout:(17/131): librgw2-18.0.0-6639.g7b3143ba.el8.x86 10 MB/s | 6.9 MB 00:00 2023-10-08T12:42:42.910 INFO:teuthology.orchestra.run.smithi078.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.7 MB/s | 85 kB 00:00 2023-10-08T12:42:42.944 INFO:teuthology.orchestra.run.smithi078.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 391 kB/s | 23 kB 00:00 2023-10-08T12:42:42.969 INFO:teuthology.orchestra.run.smithi078.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-10-08T12:42:42.976 INFO:teuthology.orchestra.run.smithi045.stdout:(18/131): python3-ceph-argparse-18.0.0-6639.g7b 673 kB/s | 45 kB 00:00 2023-10-08T12:42:43.011 INFO:teuthology.orchestra.run.smithi078.stdout:(70/131): thrift-0.13.0-2.el8.x86_64.rpm 17 MB/s | 1.7 MB 00:00 2023-10-08T12:42:43.035 INFO:teuthology.orchestra.run.smithi045.stdout:(19/131): python3-ceph-common-18.0.0-6639.g7b31 2.1 MB/s | 125 kB 00:00 2023-10-08T12:42:43.102 INFO:teuthology.orchestra.run.smithi045.stdout:(20/131): python3-cephfs-18.0.0-6639.g7b3143ba. 2.9 MB/s | 197 kB 00:00 2023-10-08T12:42:43.169 INFO:teuthology.orchestra.run.smithi045.stdout:(21/131): python3-rados-18.0.0-6639.g7b3143ba.e 5.5 MB/s | 371 kB 00:00 2023-10-08T12:42:43.244 INFO:teuthology.orchestra.run.smithi045.stdout:(22/131): python3-rbd-18.0.0-6639.g7b3143ba.el8 4.8 MB/s | 365 kB 00:00 2023-10-08T12:42:43.303 INFO:teuthology.orchestra.run.smithi078.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 385 kB/s | 110 kB 00:00 2023-10-08T12:42:43.311 INFO:teuthology.orchestra.run.smithi045.stdout:(23/131): python3-rgw-18.0.0-6639.g7b3143ba.el8 1.6 MB/s | 107 kB 00:00 2023-10-08T12:42:43.354 INFO:teuthology.orchestra.run.smithi078.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2023-10-08T12:42:43.361 INFO:teuthology.orchestra.run.smithi045.stdout:(24/131): rbd-fuse-18.0.0-6639.g7b3143ba.el8.x8 1.8 MB/s | 94 kB 00:00 2023-10-08T12:42:43.581 INFO:teuthology.orchestra.run.smithi078.stdout:(73/131): ceph-mgr-diskprediction-local-18.0.0- 3.8 MB/s | 7.4 MB 00:01 2023-10-08T12:42:43.604 INFO:teuthology.orchestra.run.smithi078.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.0 MB/s | 259 kB 00:00 2023-10-08T12:42:43.796 INFO:teuthology.orchestra.run.smithi078.stdout:(75/131): python3-scipy-1.0.0-21.module+el8.5.0 17 MB/s | 14 MB 00:00 2023-10-08T12:42:43.803 INFO:teuthology.orchestra.run.smithi045.stdout:(25/131): rbd-mirror-18.0.0-6639.g7b3143ba.el8. 8.1 MB/s | 3.6 MB 00:00 2023-10-08T12:42:43.821 INFO:teuthology.orchestra.run.smithi078.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 179 kB/s | 39 kB 00:00 2023-10-08T12:42:43.863 INFO:teuthology.orchestra.run.smithi078.stdout:(77/131): socat-1.7.4.1-1.el8.x86_64.rpm 1.1 MB/s | 323 kB 00:00 2023-10-08T12:42:43.870 INFO:teuthology.orchestra.run.smithi045.stdout:(26/131): rbd-nbd-18.0.0-6639.g7b3143ba.el8.x86 2.6 MB/s | 179 kB 00:00 2023-10-08T12:42:43.929 INFO:teuthology.orchestra.run.smithi045.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6639.g 395 kB/s | 23 kB 00:00 2023-10-08T12:42:43.947 INFO:teuthology.orchestra.run.smithi078.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 4.2 MB/s | 538 kB 00:00 2023-10-08T12:42:43.981 INFO:teuthology.orchestra.run.smithi078.stdout:(79/131): bison-3.0.4-10.el8.x86_64.rpm 3.7 MB/s | 688 kB 00:00 2023-10-08T12:42:43.997 INFO:teuthology.orchestra.run.smithi078.stdout:(80/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.1 MB/s | 157 kB 00:00 2023-10-08T12:42:44.026 INFO:teuthology.orchestra.run.smithi045.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6639.g7b3143b 1.3 MB/s | 132 kB 00:00 2023-10-08T12:42:44.073 INFO:teuthology.orchestra.run.smithi078.stdout:(81/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.5 MB/s | 187 kB 00:00 2023-10-08T12:42:44.115 INFO:teuthology.orchestra.run.smithi078.stdout:(82/131): automake-1.16.1-7.el8.noarch.rpm 5.2 MB/s | 713 kB 00:00 2023-10-08T12:42:44.173 INFO:teuthology.orchestra.run.smithi078.stdout:(83/131): python3-jsonpatch-1.21-2.el8.noarch.r 265 kB/s | 27 kB 00:00 2023-10-08T12:42:44.207 INFO:teuthology.orchestra.run.smithi078.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 3.4 MB/s | 320 kB 00:00 2023-10-08T12:42:44.221 INFO:teuthology.orchestra.run.smithi045.stdout:(29/131): ceph-mgr-dashboard-18.0.0-6639.g7b314 9.1 MB/s | 1.8 MB 00:00 2023-10-08T12:42:44.324 INFO:teuthology.orchestra.run.smithi078.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 15 MB/s | 4.8 MB 00:00 2023-10-08T12:42:44.358 INFO:teuthology.orchestra.run.smithi078.stdout:(86/131): python3-prettytable-0.7.2-14.el8.noar 239 kB/s | 44 kB 00:00 2023-10-08T12:42:44.450 INFO:teuthology.orchestra.run.smithi078.stdout:(87/131): python3-numpy-1.14.3-10.el8.x86_64.rp 15 MB/s | 3.7 MB 00:00 2023-10-08T12:42:44.483 INFO:teuthology.orchestra.run.smithi078.stdout:(88/131): python3-werkzeug-0.12.2-4.el8.noarch. 2.8 MB/s | 457 kB 00:00 2023-10-08T12:42:44.508 INFO:teuthology.orchestra.run.smithi078.stdout:(89/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.5 MB/s | 225 kB 00:00 2023-10-08T12:42:44.584 INFO:teuthology.orchestra.run.smithi078.stdout:(90/131): uuid-1.6.2-43.el8.x86_64.rpm 479 kB/s | 64 kB 00:00 2023-10-08T12:42:44.601 INFO:teuthology.orchestra.run.smithi078.stdout:(91/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2023-10-08T12:42:44.618 INFO:teuthology.orchestra.run.smithi078.stdout:(92/131): python3-jsonpointer-1.10-11.el8.noarc 183 kB/s | 20 kB 00:00 2023-10-08T12:42:44.718 INFO:teuthology.orchestra.run.smithi078.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 5.9 MB/s | 709 kB 00:00 2023-10-08T12:42:44.743 INFO:teuthology.orchestra.run.smithi078.stdout:(94/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 650 kB/s | 103 kB 00:00 2023-10-08T12:42:44.852 INFO:teuthology.orchestra.run.smithi078.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 21 MB/s | 4.9 MB 00:00 2023-10-08T12:42:44.886 INFO:teuthology.orchestra.run.smithi078.stdout:(96/131): libpq-13.5-1.el8.x86_64.rpm 1.2 MB/s | 198 kB 00:00 2023-10-08T12:42:44.913 INFO:teuthology.orchestra.run.smithi045.stdout:(30/131): ceph-mgr-diskprediction-local-18.0.0- 11 MB/s | 7.4 MB 00:00 2023-10-08T12:42:44.928 INFO:teuthology.orchestra.run.smithi078.stdout:(97/131): jq-1.6-3.el8.x86_64.rpm 2.6 MB/s | 202 kB 00:00 2023-10-08T12:42:44.980 INFO:teuthology.orchestra.run.smithi045.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6639.g7b 3.6 MB/s | 242 kB 00:00 2023-10-08T12:42:45.024 INFO:teuthology.orchestra.run.smithi078.stdout:(98/131): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-10-08T12:42:45.038 INFO:teuthology.orchestra.run.smithi045.stdout:(32/131): ceph-mgr-rook-18.0.0-6639.g7b3143ba.e 813 kB/s | 47 kB 00:00 2023-10-08T12:42:45.062 INFO:teuthology.orchestra.run.smithi078.stdout:(99/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.0 MB/s | 354 kB 00:00 2023-10-08T12:42:45.089 INFO:teuthology.orchestra.run.smithi045.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6639.g7 291 kB/s | 15 kB 00:00 2023-10-08T12:42:45.156 INFO:teuthology.orchestra.run.smithi045.stdout:(34/131): ceph-volume-18.0.0-6639.g7b3143ba.el8 3.8 MB/s | 261 kB 00:00 2023-10-08T12:42:45.178 INFO:teuthology.orchestra.run.smithi078.stdout:(100/131): postgresql-server-10.21-2.module+el8 20 MB/s | 5.1 MB 00:00 2023-10-08T12:42:45.212 INFO:teuthology.orchestra.run.smithi078.stdout:(101/131): postgresql-contrib-10.21-2.module+el 4.2 MB/s | 808 kB 00:00 2023-10-08T12:42:45.223 INFO:teuthology.orchestra.run.smithi045.stdout:(35/131): cephadm-18.0.0-6639.g7b3143ba.el8.noa 2.8 MB/s | 190 kB 00:00 2023-10-08T12:42:45.273 INFO:teuthology.orchestra.run.smithi045.stdout:(36/131): cephfs-top-18.0.0-6639.g7b3143ba.el8. 363 kB/s | 18 kB 00:00 2023-10-08T12:42:45.279 INFO:teuthology.orchestra.run.smithi078.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 6.9 MB/s | 1.5 MB 00:00 2023-10-08T12:42:45.304 INFO:teuthology.orchestra.run.smithi078.stdout:(103/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 373 kB/s | 47 kB 00:00 2023-10-08T12:42:45.330 INFO:teuthology.orchestra.run.smithi078.stdout:(104/131): libselinux-devel-2.9-5.el8.x86_64.rp 1.7 MB/s | 200 kB 00:00 2023-10-08T12:42:45.430 INFO:teuthology.orchestra.run.smithi078.stdout:(105/131): python3-jwt-1.6.1-2.el8.noarch.rpm 283 kB/s | 43 kB 00:00 2023-10-08T12:42:45.455 INFO:teuthology.orchestra.run.smithi078.stdout:(106/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.4 MB/s | 220 kB 00:00 2023-10-08T12:42:45.481 INFO:teuthology.orchestra.run.smithi078.stdout:(107/131): keyutils-libs-devel-1.5.10-9.el8.x86 319 kB/s | 48 kB 00:00 2023-10-08T12:42:45.531 INFO:teuthology.orchestra.run.smithi078.stdout:(108/131): libsepol-devel-2.9-3.el8.x86_64.rpm 866 kB/s | 87 kB 00:00 2023-10-08T12:42:45.556 INFO:teuthology.orchestra.run.smithi078.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 1.4 MB/s | 109 kB 00:00 2023-10-08T12:42:45.590 INFO:teuthology.orchestra.run.smithi078.stdout:(110/131): python3-requests-oauthlib-1.0.0-1.el 318 kB/s | 43 kB 00:00 2023-10-08T12:42:45.666 INFO:teuthology.orchestra.run.smithi078.stdout:(111/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.7 MB/s | 229 kB 00:00 2023-10-08T12:42:45.690 INFO:teuthology.orchestra.run.smithi078.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 186 kB/s | 19 kB 00:00 2023-10-08T12:42:45.724 INFO:teuthology.orchestra.run.smithi078.stdout:(113/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.3 MB/s | 560 kB 00:00 2023-10-08T12:42:45.791 INFO:teuthology.orchestra.run.smithi078.stdout:(114/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.2 MB/s | 155 kB 00:00 2023-10-08T12:42:45.807 INFO:teuthology.orchestra.run.smithi045.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 574 kB/s | 306 kB 00:00 2023-10-08T12:42:45.825 INFO:teuthology.orchestra.run.smithi078.stdout:(115/131): python3-cryptography-3.2.1-5.el8.x86 4.1 MB/s | 559 kB 00:00 2023-10-08T12:42:45.892 INFO:teuthology.orchestra.run.smithi078.stdout:(116/131): libverto-devel-0.3.0-5.el8.x86_64.rp 107 kB/s | 18 kB 00:00 2023-10-08T12:42:45.925 INFO:teuthology.orchestra.run.smithi078.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.3 MB/s | 238 kB 00:00 2023-10-08T12:42:45.967 INFO:teuthology.orchestra.run.smithi078.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 3.4 MB/s | 605 kB 00:00 2023-10-08T12:42:46.057 INFO:teuthology.orchestra.run.smithi045.stdout:(38/131): ceph-common-18.0.0-6639.g7b3143ba.el8 1.9 MB/s | 23 MB 00:11 2023-10-08T12:42:46.074 INFO:teuthology.orchestra.run.smithi045.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 220 kB/s | 59 kB 00:00 2023-10-08T12:42:46.076 INFO:teuthology.orchestra.run.smithi078.stdout:(119/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 13 MB/s | 2.3 MB 00:00 2023-10-08T12:42:46.134 INFO:teuthology.orchestra.run.smithi078.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 496 kB/s | 83 kB 00:00 2023-10-08T12:42:46.151 INFO:teuthology.orchestra.run.smithi078.stdout:(121/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 320 kB/s | 72 kB 00:00 2023-10-08T12:42:46.210 INFO:teuthology.orchestra.run.smithi078.stdout:(122/131): elfutils-libelf-devel-0.186-1.el8.x8 448 kB/s | 60 kB 00:00 2023-10-08T12:42:46.252 INFO:teuthology.orchestra.run.smithi078.stdout:(123/131): libuuid-devel-2.32.1-35.el8.x86_64.r 836 kB/s | 98 kB 00:00 2023-10-08T12:42:46.266 INFO:teuthology.orchestra.run.smithi045.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.4 MB/s | 476 kB 00:00 2023-10-08T12:42:46.294 INFO:teuthology.orchestra.run.smithi078.stdout:(124/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 405 kB/s | 58 kB 00:00 2023-10-08T12:42:46.319 INFO:teuthology.orchestra.run.smithi078.stdout:(125/131): libcom_err-devel-1.45.6-4.el8.x86_64 354 kB/s | 39 kB 00:00 2023-10-08T12:42:46.366 INFO:teuthology.orchestra.run.smithi045.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 437 kB/s | 44 kB 00:00 2023-10-08T12:42:46.403 INFO:teuthology.orchestra.run.smithi078.stdout:(126/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 4.2 MB/s | 644 kB 00:00 2023-10-08T12:42:46.424 INFO:teuthology.orchestra.run.smithi045.stdout:(42/131): libunwind-1.3.1-3.el8.x86_64.rpm 204 kB/s | 75 kB 00:00 2023-10-08T12:42:46.445 INFO:teuthology.orchestra.run.smithi078.stdout:(127/131): NetworkManager-initscripts-updown-1. 1.1 MB/s | 138 kB 00:00 2023-10-08T12:42:46.467 INFO:teuthology.orchestra.run.smithi045.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.8 MB/s | 185 kB 00:00 2023-10-08T12:42:46.512 INFO:teuthology.orchestra.run.smithi078.stdout:(128/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 787 kB/s | 171 kB 00:00 2023-10-08T12:42:46.567 INFO:teuthology.orchestra.run.smithi045.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 232 kB/s | 33 kB 00:00 2023-10-08T12:42:46.592 INFO:teuthology.orchestra.run.smithi045.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 130 kB/s | 16 kB 00:00 2023-10-08T12:42:46.620 INFO:teuthology.orchestra.run.smithi078.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 7.2 MB/s | 798 kB 00:00 2023-10-08T12:42:46.717 INFO:teuthology.orchestra.run.smithi045.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 3.0 MB/s | 384 kB 00:00 2023-10-08T12:42:46.801 INFO:teuthology.orchestra.run.smithi045.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 739 kB/s | 173 kB 00:00 2023-10-08T12:42:46.813 INFO:teuthology.orchestra.run.smithi078.stdout:(130/131): librados2-18.0.0-6639.g7b3143ba.el8. 9.2 MB/s | 3.7 MB 00:00 2023-10-08T12:42:46.826 INFO:teuthology.orchestra.run.smithi045.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 748 kB/s | 81 kB 00:00 2023-10-08T12:42:46.902 INFO:teuthology.orchestra.run.smithi045.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 111 kB/s | 11 kB 00:00 2023-10-08T12:42:46.927 INFO:teuthology.orchestra.run.smithi045.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 175 kB/s | 18 kB 00:00 2023-10-08T12:42:47.069 INFO:teuthology.orchestra.run.smithi045.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 344 kB/s | 49 kB 00:00 2023-10-08T12:42:47.162 INFO:teuthology.orchestra.run.smithi078.stdout:(131/131): librbd1-18.0.0-6639.g7b3143ba.el8.x8 5.2 MB/s | 3.7 MB 00:00 2023-10-08T12:42:47.165 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2023-10-08T12:42:47.165 INFO:teuthology.orchestra.run.smithi078.stdout:Total 14 MB/s | 209 MB 00:14 2023-10-08T12:42:47.169 INFO:teuthology.orchestra.run.smithi045.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 587 kB/s | 59 kB 00:00 2023-10-08T12:42:47.220 INFO:teuthology.orchestra.run.smithi045.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 3.7 MB/s | 1.2 MB 00:00 2023-10-08T12:42:47.270 INFO:teuthology.orchestra.run.smithi045.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 599 kB/s | 60 kB 00:00 2023-10-08T12:42:47.328 INFO:teuthology.orchestra.run.smithi045.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.5 MB/s | 283 kB 00:00 2023-10-08T12:42:47.370 INFO:teuthology.orchestra.run.smithi045.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 156 kB/s | 16 kB 00:00 2023-10-08T12:42:47.429 INFO:teuthology.orchestra.run.smithi045.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 335 kB/s | 34 kB 00:00 2023-10-08T12:42:47.479 INFO:teuthology.orchestra.run.smithi045.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.8 MB/s | 196 kB 00:00 2023-10-08T12:42:47.550 INFO:teuthology.orchestra.run.smithi045.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 533 kB/s | 64 kB 00:00 2023-10-08T12:42:47.580 INFO:teuthology.orchestra.run.smithi045.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 187 kB/s | 19 kB 00:00 2023-10-08T12:42:47.646 INFO:teuthology.orchestra.run.smithi045.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 247 kB/s | 24 kB 00:00 2023-10-08T12:42:47.680 INFO:teuthology.orchestra.run.smithi045.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 292 kB/s | 29 kB 00:00 2023-10-08T12:42:47.747 INFO:teuthology.orchestra.run.smithi045.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 274 kB/s | 27 kB 00:00 2023-10-08T12:42:47.797 INFO:teuthology.orchestra.run.smithi045.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 2.1 MB/s | 255 kB 00:00 2023-10-08T12:42:47.856 INFO:teuthology.orchestra.run.smithi045.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.3 MB/s | 251 kB 00:00 2023-10-08T12:42:47.890 INFO:teuthology.orchestra.run.smithi045.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 667 kB/s | 61 kB 00:00 2023-10-08T12:42:47.957 INFO:teuthology.orchestra.run.smithi045.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 852 kB/s | 85 kB 00:00 2023-10-08T12:42:47.988 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2023-10-08T12:42:47.990 INFO:teuthology.orchestra.run.smithi045.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 228 kB/s | 23 kB 00:00 2023-10-08T12:42:48.015 INFO:teuthology.orchestra.run.smithi045.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-10-08T12:42:48.106 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2023-10-08T12:42:48.106 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2023-10-08T12:42:48.141 INFO:teuthology.orchestra.run.smithi045.stdout:(70/131): thrift-0.13.0-2.el8.x86_64.rpm 9.5 MB/s | 1.7 MB 00:00 2023-10-08T12:42:48.307 INFO:teuthology.orchestra.run.smithi045.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 661 kB/s | 110 kB 00:00 2023-10-08T12:42:48.533 INFO:teuthology.orchestra.run.smithi045.stdout:(72/131): python3-scipy-1.0.0-21.module+el8.5.0 26 MB/s | 14 MB 00:00 2023-10-08T12:42:48.583 INFO:teuthology.orchestra.run.smithi045.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 197 kB/s | 54 kB 00:00 2023-10-08T12:42:48.642 INFO:teuthology.orchestra.run.smithi045.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.3 MB/s | 259 kB 00:00 2023-10-08T12:42:48.701 INFO:teuthology.orchestra.run.smithi045.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 668 kB/s | 39 kB 00:00 2023-10-08T12:42:48.725 INFO:teuthology.orchestra.run.smithi045.stdout:(76/131): socat-1.7.4.1-1.el8.x86_64.rpm 2.2 MB/s | 323 kB 00:00 2023-10-08T12:42:48.884 INFO:teuthology.orchestra.run.smithi045.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 3.3 MB/s | 538 kB 00:00 2023-10-08T12:42:48.918 INFO:teuthology.orchestra.run.smithi045.stdout:(78/131): bison-3.0.4-10.el8.x86_64.rpm 3.1 MB/s | 688 kB 00:00 2023-10-08T12:42:49.001 INFO:teuthology.orchestra.run.smithi045.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.3 MB/s | 157 kB 00:00 2023-10-08T12:42:49.085 INFO:teuthology.orchestra.run.smithi045.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.1 MB/s | 187 kB 00:00 2023-10-08T12:42:49.169 INFO:teuthology.orchestra.run.smithi045.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 4.2 MB/s | 713 kB 00:00 2023-10-08T12:42:49.231 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2023-10-08T12:42:49.235 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2023-10-08T12:42:49.477 INFO:teuthology.orchestra.run.smithi045.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 86 kB/s | 27 kB 00:00 2023-10-08T12:42:49.563 INFO:teuthology.orchestra.run.smithi045.stdout:(83/131): python3-babel-2.5.1-7.el8.noarch.rpm 10 MB/s | 4.8 MB 00:00 2023-10-08T12:42:49.611 INFO:teuthology.orchestra.run.smithi045.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 2.3 MB/s | 320 kB 00:00 2023-10-08T12:42:49.687 INFO:teuthology.orchestra.run.smithi045.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 357 kB/s | 44 kB 00:00 2023-10-08T12:42:49.795 INFO:teuthology.orchestra.run.smithi045.stdout:(86/131): python3-numpy-1.14.3-10.el8.x86_64.rp 20 MB/s | 3.7 MB 00:00 2023-10-08T12:42:49.829 INFO:teuthology.orchestra.run.smithi045.stdout:(87/131): python3-werkzeug-0.12.2-4.el8.noarch. 3.2 MB/s | 457 kB 00:00 2023-10-08T12:42:49.887 INFO:teuthology.orchestra.run.smithi045.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.4 MB/s | 225 kB 00:00 2023-10-08T12:42:49.904 INFO:teuthology.orchestra.run.smithi045.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 853 kB/s | 64 kB 00:00 2023-10-08T12:42:49.996 INFO:teuthology.orchestra.run.smithi045.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2023-10-08T12:42:50.013 INFO:teuthology.orchestra.run.smithi045.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 184 kB/s | 20 kB 00:00 2023-10-08T12:42:50.138 INFO:teuthology.orchestra.run.smithi045.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 729 kB/s | 103 kB 00:00 2023-10-08T12:42:50.172 INFO:teuthology.orchestra.run.smithi045.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 4.4 MB/s | 709 kB 00:00 2023-10-08T12:42:50.264 INFO:teuthology.orchestra.run.smithi045.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 2.1 MB/s | 198 kB 00:00 2023-10-08T12:42:50.356 INFO:teuthology.orchestra.run.smithi045.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 22 MB/s | 4.9 MB 00:00 2023-10-08T12:42:50.423 INFO:teuthology.orchestra.run.smithi045.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 3.0 MB/s | 202 kB 00:00 2023-10-08T12:42:50.507 INFO:teuthology.orchestra.run.smithi045.stdout:(97/131): openblas-0.3.15-3.el8.x86_64.rpm 20 MB/s | 4.7 MB 00:00 2023-10-08T12:42:50.587 INFO:teuthology.orchestra.run.smithi045.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.1 MB/s | 354 kB 00:00 2023-10-08T12:42:50.749 INFO:teuthology.orchestra.run.smithi045.stdout:(99/131): postgresql-server-10.21-2.module+el8. 21 MB/s | 5.1 MB 00:00 2023-10-08T12:42:50.782 INFO:teuthology.orchestra.run.smithi045.stdout:(100/131): postgresql-contrib-10.21-2.module+el 4.0 MB/s | 808 kB 00:00 2023-10-08T12:42:50.832 INFO:teuthology.orchestra.run.smithi045.stdout:(101/131): postgresql-10.21-2.module+el8.6.0+15 18 MB/s | 1.5 MB 00:00 2023-10-08T12:42:50.933 INFO:teuthology.orchestra.run.smithi045.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 311 kB/s | 47 kB 00:00 2023-10-08T12:42:50.967 INFO:teuthology.orchestra.run.smithi045.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 1.5 MB/s | 200 kB 00:00 2023-10-08T12:42:51.033 INFO:teuthology.orchestra.run.smithi045.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 425 kB/s | 43 kB 00:00 2023-10-08T12:42:51.117 INFO:teuthology.orchestra.run.smithi045.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.4 MB/s | 220 kB 00:00 2023-10-08T12:42:51.585 INFO:teuthology.orchestra.run.smithi045.stdout:(106/131): ceph-test-18.0.0-6639.g7b3143ba.el8. 4.4 MB/s | 49 MB 00:11 2023-10-08T12:42:51.618 INFO:teuthology.orchestra.run.smithi045.stdout:(107/131): keyutils-libs-devel-1.5.10-9.el8.x86 82 kB/s | 48 kB 00:00 2023-10-08T12:42:51.651 INFO:teuthology.orchestra.run.smithi045.stdout:(108/131): libsepol-devel-2.9-3.el8.x86_64.rpm 163 kB/s | 87 kB 00:00 2023-10-08T12:42:51.727 INFO:teuthology.orchestra.run.smithi045.stdout:(109/131): python3-requests-oauthlib-1.0.0-1.el 303 kB/s | 43 kB 00:00 2023-10-08T12:42:51.752 INFO:teuthology.orchestra.run.smithi045.stdout:(110/131): python3-pycparser-2.14-14.el8.noarch 872 kB/s | 109 kB 00:00 2023-10-08T12:42:51.785 INFO:teuthology.orchestra.run.smithi045.stdout:(111/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.7 MB/s | 229 kB 00:00 2023-10-08T12:42:51.810 INFO:teuthology.orchestra.run.smithi045.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 319 kB/s | 19 kB 00:00 2023-10-08T12:42:51.894 INFO:teuthology.orchestra.run.smithi045.stdout:(113/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.3 MB/s | 560 kB 00:00 2023-10-08T12:42:51.920 INFO:teuthology.orchestra.run.smithi045.stdout:(114/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.1 MB/s | 155 kB 00:00 2023-10-08T12:42:51.953 INFO:teuthology.orchestra.run.smithi045.stdout:(115/131): python3-cryptography-3.2.1-5.el8.x86 3.8 MB/s | 559 kB 00:00 2023-10-08T12:42:52.028 INFO:teuthology.orchestra.run.smithi045.stdout:(116/131): libverto-devel-0.3.0-5.el8.x86_64.rp 134 kB/s | 18 kB 00:00 2023-10-08T12:42:52.104 INFO:teuthology.orchestra.run.smithi045.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 3.2 MB/s | 605 kB 00:00 2023-10-08T12:42:52.204 INFO:teuthology.orchestra.run.smithi045.stdout:(118/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 13 MB/s | 2.3 MB 00:00 2023-10-08T12:42:52.230 INFO:teuthology.orchestra.run.smithi045.stdout:(119/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 862 kB/s | 238 kB 00:00 2023-10-08T12:42:52.313 INFO:teuthology.orchestra.run.smithi045.stdout:(120/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 346 kB/s | 72 kB 00:00 2023-10-08T12:42:52.338 INFO:teuthology.orchestra.run.smithi045.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 552 kB/s | 60 kB 00:00 2023-10-08T12:42:52.371 INFO:teuthology.orchestra.run.smithi045.stdout:(122/131): fuse-2.9.7-15.el8.x86_64.rpm 494 kB/s | 83 kB 00:00 2023-10-08T12:42:52.455 INFO:teuthology.orchestra.run.smithi045.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 493 kB/s | 58 kB 00:00 2023-10-08T12:42:52.480 INFO:teuthology.orchestra.run.smithi045.stdout:(124/131): libuuid-devel-2.32.1-35.el8.x86_64.r 586 kB/s | 98 kB 00:00 2023-10-08T12:42:52.590 INFO:teuthology.orchestra.run.smithi045.stdout:(125/131): libcom_err-devel-1.45.6-4.el8.x86_64 178 kB/s | 39 kB 00:00 2023-10-08T12:42:52.623 INFO:teuthology.orchestra.run.smithi045.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 1.2 MB/s | 171 kB 00:00 2023-10-08T12:42:52.656 INFO:teuthology.orchestra.run.smithi045.stdout:(127/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 3.1 MB/s | 644 kB 00:00 2023-10-08T12:42:52.748 INFO:teuthology.orchestra.run.smithi045.stdout:(128/131): NetworkManager-initscripts-updown-1. 867 kB/s | 138 kB 00:00 2023-10-08T12:42:52.923 INFO:teuthology.orchestra.run.smithi045.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 4.5 MB/s | 798 kB 00:00 2023-10-08T12:42:53.673 INFO:teuthology.orchestra.run.smithi045.stdout:(130/131): librados2-18.0.0-6639.g7b3143ba.el8. 3.6 MB/s | 3.7 MB 00:01 2023-10-08T12:42:53.790 INFO:teuthology.orchestra.run.smithi045.stdout:(131/131): librbd1-18.0.0-6639.g7b3143ba.el8.x8 3.3 MB/s | 3.7 MB 00:01 2023-10-08T12:42:53.793 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2023-10-08T12:42:53.793 INFO:teuthology.orchestra.run.smithi045.stdout:Total 11 MB/s | 209 MB 00:19 2023-10-08T12:42:54.328 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2023-10-08T12:42:54.558 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-08T12:42:54.637 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2023-10-08T12:42:54.745 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-08T12:42:54.770 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2023-10-08T12:42:54.770 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2023-10-08T12:42:54.983 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-08T12:42:55.160 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-08T12:42:55.321 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-08T12:42:55.526 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-08T12:42:55.965 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2023-10-08T12:42:55.967 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-08T12:42:55.969 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2023-10-08T12:42:56.168 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:42:56.577 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:42:56.810 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:42:56.927 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:42:57.136 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T12:42:57.227 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T12:42:57.466 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 9/134 2023-10-08T12:42:57.713 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-08T12:42:57.946 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-08T12:42:58.360 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-08T12:42:58.650 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-08T12:42:58.834 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T12:42:58.963 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T12:42:59.151 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T12:42:59.228 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T12:42:59.426 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-08T12:42:59.833 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-08T12:42:59.984 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-08T12:43:00.609 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-08T12:43:00.792 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-08T12:43:01.048 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2023-10-08T12:43:01.246 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-08T12:43:01.372 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-08T12:43:01.406 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-08T12:43:01.592 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-08T12:43:01.624 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-08T12:43:01.790 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-08T12:43:01.914 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-08T12:43:02.156 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-08T12:43:02.303 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-08T12:43:02.570 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-08T12:43:02.604 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-08T12:43:02.819 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-08T12:43:02.831 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:43:03.062 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-08T12:43:03.257 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-08T12:43:03.271 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:43:03.456 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:43:03.482 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-08T12:43:03.592 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:43:03.702 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-08T12:43:03.798 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T12:43:03.881 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T12:43:03.906 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 26/134 2023-10-08T12:43:04.062 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 27/134 2023-10-08T12:43:04.074 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 9/134 2023-10-08T12:43:04.355 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-08T12:43:04.560 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-08T12:43:05.003 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 28/134 2023-10-08T12:43:05.005 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-08T12:43:05.290 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-08T12:43:05.373 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-08T12:43:05.456 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T12:43:05.566 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T12:43:05.693 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-08T12:43:05.956 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T12:43:05.985 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-08T12:43:06.037 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T12:43:06.156 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-08T12:43:06.158 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-08T12:43:06.292 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-08T12:43:06.414 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-08T12:43:07.076 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-08T12:43:07.264 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-08T12:43:07.887 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-08T12:43:07.903 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-08T12:43:08.055 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-08T12:43:08.235 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-08T12:43:08.428 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-08T12:43:08.668 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-08T12:43:08.829 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-08T12:43:08.897 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 36/134 2023-10-08T12:43:09.037 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 37/134 2023-10-08T12:43:09.079 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-08T12:43:09.235 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-08T12:43:09.298 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-08T12:43:09.403 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-08T12:43:09.502 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-08T12:43:09.602 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-08T12:43:09.688 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-08T12:43:09.745 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-08T12:43:09.927 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-08T12:43:09.973 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-08T12:43:10.137 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-08T12:43:10.172 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-08T12:43:10.312 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 26/134 2023-10-08T12:43:10.443 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 27/134 2023-10-08T12:43:10.863 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-08T12:43:11.169 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-08T12:43:11.368 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-08T12:43:11.412 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 28/134 2023-10-08T12:43:11.606 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-08T12:43:11.736 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-08T12:43:11.821 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-08T12:43:12.003 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-08T12:43:12.142 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-08T12:43:12.252 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-08T12:43:12.407 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-08T12:43:12.438 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-08T12:43:12.627 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-08T12:43:12.865 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-08T12:43:13.081 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-08T12:43:13.270 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-08T12:43:13.646 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-08T12:43:13.923 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-08T12:43:14.187 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-08T12:43:14.345 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-08T12:43:14.455 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-08T12:43:14.639 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-08T12:43:14.650 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-08T12:43:14.859 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-08T12:43:14.887 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-08T12:43:15.068 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-08T12:43:15.082 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-08T12:43:15.175 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-08T12:43:15.270 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 36/134 2023-10-08T12:43:15.393 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-08T12:43:15.410 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 37/134 2023-10-08T12:43:15.574 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-08T12:43:15.618 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-08T12:43:15.766 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-08T12:43:15.774 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-08T12:43:15.837 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-08T12:43:15.924 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-08T12:43:16.077 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-08T12:43:16.078 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-08T12:43:16.273 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-08T12:43:16.307 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-08T12:43:16.457 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-08T12:43:16.516 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-08T12:43:16.668 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-08T12:43:16.884 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-08T12:43:16.959 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-08T12:43:17.167 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-08T12:43:17.189 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-08T12:43:17.369 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-08T12:43:17.399 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-08T12:43:17.509 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-08T12:43:17.631 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-08T12:43:17.683 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-08T12:43:17.869 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-08T12:43:17.886 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-08T12:43:18.094 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-08T12:43:18.181 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-08T12:43:18.252 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-08T12:43:18.396 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-08T12:43:18.421 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-08T12:43:18.619 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-08T12:43:18.619 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-08T12:43:18.852 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-08T12:43:18.853 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-08T12:43:19.032 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-08T12:43:19.046 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-08T12:43:19.200 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-08T12:43:19.342 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-08T12:43:19.532 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-08T12:43:19.589 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-08T12:43:19.746 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-08T12:43:19.794 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-08T12:43:19.964 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-08T12:43:20.021 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-08T12:43:20.236 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-08T12:43:20.429 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-08T12:43:20.598 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-08T12:43:20.782 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-08T12:43:20.861 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-08T12:43:21.011 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-08T12:43:21.103 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-08T12:43:21.251 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-08T12:43:21.287 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-08T12:43:21.437 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-08T12:43:21.515 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-08T12:43:21.531 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-08T12:43:21.736 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-08T12:43:21.849 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-08T12:43:21.922 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-08T12:43:22.070 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-08T12:43:22.140 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-08T12:43:22.267 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-08T12:43:22.324 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-08T12:43:22.598 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-08T12:43:22.853 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-08T12:43:23.000 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-08T12:43:23.150 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-08T12:43:23.173 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-08T12:43:23.348 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T12:43:23.384 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-08T12:43:23.418 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T12:43:23.577 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-08T12:43:23.632 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 93/134 2023-10-08T12:43:23.751 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-08T12:43:23.932 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-08T12:43:24.068 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-08T12:43:24.264 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-08T12:43:24.492 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-08T12:43:24.668 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-08T12:43:24.976 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-08T12:43:25.195 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-08T12:43:25.413 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-08T12:43:25.643 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-08T12:43:26.819 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-08T12:43:27.109 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-08T12:43:27.296 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:43:27.338 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-08T12:43:27.539 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:43:27.656 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-08T12:43:27.943 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-08T12:43:28.125 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-08T12:43:28.134 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:43:28.421 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T12:43:28.503 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T12:43:28.689 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T12:43:28.971 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-08T12:43:29.127 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T12:43:29.203 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T12:43:29.395 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 93/134 2023-10-08T12:43:33.335 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:43:33.561 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:43:34.193 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:43:34.487 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T12:43:34.557 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T12:43:34.676 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T12:43:47.470 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T12:43:47.470 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /sys 2023-10-08T12:43:47.471 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /proc 2023-10-08T12:43:47.471 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /dev 2023-10-08T12:43:47.471 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /run 2023-10-08T12:43:47.471 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /mnt 2023-10-08T12:43:47.471 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /var/tmp 2023-10-08T12:43:47.471 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /home 2023-10-08T12:43:47.471 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /tmp 2023-10-08T12:43:47.471 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /dev 2023-10-08T12:43:47.471 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:43:47.845 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T12:43:49.430 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T12:43:49.609 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T12:43:49.828 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T12:43:49.978 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T12:43:50.442 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T12:43:50.661 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T12:43:50.677 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T12:43:52.335 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T12:43:52.536 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T12:43:52.650 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 102/134 2023-10-08T12:43:52.843 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 103/134 2023-10-08T12:43:53.019 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T12:43:53.241 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T12:43:53.558 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T12:43:54.328 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T12:43:54.328 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /sys 2023-10-08T12:43:54.328 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /proc 2023-10-08T12:43:54.329 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /dev 2023-10-08T12:43:54.329 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /run 2023-10-08T12:43:54.329 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /mnt 2023-10-08T12:43:54.329 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /var/tmp 2023-10-08T12:43:54.329 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /home 2023-10-08T12:43:54.329 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /tmp 2023-10-08T12:43:54.329 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /dev 2023-10-08T12:43:54.329 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:43:54.516 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T12:43:54.702 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T12:43:54.749 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T12:43:54.793 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T12:43:55.184 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 107/134 2023-10-08T12:43:55.384 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T12:43:55.418 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T12:43:55.610 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T12:43:55.621 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T12:43:56.451 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T12:43:56.684 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T12:43:56.920 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T12:43:56.975 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 110/134 2023-10-08T12:43:57.065 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T12:43:57.227 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T12:43:57.261 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T12:43:57.393 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T12:43:57.435 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T12:43:57.610 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T12:43:57.633 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T12:43:57.790 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T12:43:57.809 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T12:43:57.981 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T12:43:58.118 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T12:43:59.624 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T12:43:59.819 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T12:43:59.971 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 102/134 2023-10-08T12:44:00.166 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 103/134 2023-10-08T12:44:00.348 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T12:44:00.577 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T12:44:00.858 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T12:44:01.887 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T12:44:02.072 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T12:44:02.169 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T12:44:02.555 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 107/134 2023-10-08T12:44:02.725 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T12:44:02.762 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T12:44:02.776 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T12:44:02.956 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T12:44:02.967 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T12:44:03.073 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 115/134 2023-10-08T12:44:03.259 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-08T12:44:03.448 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-08T12:44:04.364 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 110/134 2023-10-08T12:44:04.371 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-08T12:44:04.631 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T12:44:04.667 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T12:44:04.696 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-08T12:44:04.806 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T12:44:04.856 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T12:44:04.897 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 119/134 2023-10-08T12:44:05.022 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T12:44:05.105 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-08T12:44:05.305 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 121/134 2023-10-08T12:44:05.414 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T12:44:05.460 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-08T12:44:05.589 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T12:44:07.639 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:44:07.901 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:44:07.918 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:44:08.133 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 124/134 2023-10-08T12:44:08.410 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 125/134 2023-10-08T12:44:08.685 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 126/134 2023-10-08T12:44:09.010 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-08T12:44:09.200 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-08T12:44:09.209 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-08T12:44:09.412 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-08T12:44:09.610 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-08T12:44:09.690 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-08T12:44:09.925 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-08T12:44:09.937 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-08T12:44:09.938 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:44:10.145 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:44:10.145 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T12:44:10.405 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T12:44:10.567 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T12:44:10.590 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:44:10.844 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 115/134 2023-10-08T12:44:11.004 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-08T12:44:11.119 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:44:11.120 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 1/134 2023-10-08T12:44:11.120 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2/134 2023-10-08T12:44:11.120 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 3/134 2023-10-08T12:44:11.120 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 4/134 2023-10-08T12:44:11.120 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 5/134 2023-10-08T12:44:11.120 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:44:11.120 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:44:11.120 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T12:44:11.120 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 9/134 2023-10-08T12:44:11.120 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 10/134 2023-10-08T12:44:11.120 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 11/134 2023-10-08T12:44:11.121 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 12/134 2023-10-08T12:44:11.121 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 13/134 2023-10-08T12:44:11.121 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 14/134 2023-10-08T12:44:11.121 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 15/134 2023-10-08T12:44:11.121 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 16/134 2023-10-08T12:44:11.121 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 17/134 2023-10-08T12:44:11.121 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 18/134 2023-10-08T12:44:11.121 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 19/134 2023-10-08T12:44:11.121 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 20/134 2023-10-08T12:44:11.121 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 21/134 2023-10-08T12:44:11.121 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 22/134 2023-10-08T12:44:11.121 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 23/134 2023-10-08T12:44:11.122 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 24/134 2023-10-08T12:44:11.122 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 25/134 2023-10-08T12:44:11.122 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 26/134 2023-10-08T12:44:11.122 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 27/134 2023-10-08T12:44:11.122 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 28/134 2023-10-08T12:44:11.122 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 29/134 2023-10-08T12:44:11.122 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 30/134 2023-10-08T12:44:11.131 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 31/134 2023-10-08T12:44:11.131 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 32/134 2023-10-08T12:44:11.131 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 33/134 2023-10-08T12:44:11.131 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 34/134 2023-10-08T12:44:11.131 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 35/134 2023-10-08T12:44:11.131 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 36/134 2023-10-08T12:44:11.131 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 37/134 2023-10-08T12:44:11.131 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 38/134 2023-10-08T12:44:11.131 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-08T12:44:11.131 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-08T12:44:11.132 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-08T12:44:11.132 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-08T12:44:11.132 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-08T12:44:11.132 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-08T12:44:11.132 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-08T12:44:11.132 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-08T12:44:11.132 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-08T12:44:11.132 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-08T12:44:11.132 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-08T12:44:11.132 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-08T12:44:11.132 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-08T12:44:11.133 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-08T12:44:11.133 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-08T12:44:11.133 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-08T12:44:11.133 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-08T12:44:11.133 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-08T12:44:11.133 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-08T12:44:11.133 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-08T12:44:11.133 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-08T12:44:11.133 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-08T12:44:11.133 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-08T12:44:11.133 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-08T12:44:11.133 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-08T12:44:11.133 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-08T12:44:11.134 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-08T12:44:11.134 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-08T12:44:11.134 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-08T12:44:11.134 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-08T12:44:11.134 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-08T12:44:11.134 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-08T12:44:11.134 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-08T12:44:11.134 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-08T12:44:11.134 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-08T12:44:11.134 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-08T12:44:11.134 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-08T12:44:11.135 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-08T12:44:11.135 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-08T12:44:11.135 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-08T12:44:11.135 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-08T12:44:11.135 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-08T12:44:11.135 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-08T12:44:11.135 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-08T12:44:11.135 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-08T12:44:11.135 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-08T12:44:11.135 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-08T12:44:11.135 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-08T12:44:11.135 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-08T12:44:11.136 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-08T12:44:11.136 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-08T12:44:11.136 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-08T12:44:11.136 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-08T12:44:11.136 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-08T12:44:11.136 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-08T12:44:11.136 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-08T12:44:11.136 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-08T12:44:11.136 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-08T12:44:11.136 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-08T12:44:11.136 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-08T12:44:11.136 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-08T12:44:11.136 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-08T12:44:11.137 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-08T12:44:11.137 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-08T12:44:11.137 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-08T12:44:11.137 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-08T12:44:11.137 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-08T12:44:11.137 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-08T12:44:11.137 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-08T12:44:11.137 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-08T12:44:11.137 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-08T12:44:11.137 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-08T12:44:11.137 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-08T12:44:11.137 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-08T12:44:11.138 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-08T12:44:11.138 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-08T12:44:11.138 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-08T12:44:11.138 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-08T12:44:11.138 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-08T12:44:11.138 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-08T12:44:11.138 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-08T12:44:11.138 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-08T12:44:11.138 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-08T12:44:11.138 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-08T12:44:11.138 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-08T12:44:11.138 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-08T12:44:11.139 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-08T12:44:11.139 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-08T12:44:11.139 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-08T12:44:11.139 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-08T12:44:11.139 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 129/134 2023-10-08T12:44:11.139 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-08T12:44:11.139 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 131/134 2023-10-08T12:44:11.139 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:44:11.139 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-08T12:44:11.211 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-08T12:44:12.192 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-08T12:44:12.563 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-08T12:44:12.721 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 119/134 2023-10-08T12:44:12.917 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-08T12:44:13.126 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 121/134 2023-10-08T12:44:13.255 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-08T12:44:13.963 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:44:13.963 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:01:52 ago on Sun 08 Oct 2023 12:42:21 PM UTC. 2023-10-08T12:44:15.582 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:44:15.829 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:44:15.848 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:44:16.055 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 124/134 2023-10-08T12:44:16.288 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 125/134 2023-10-08T12:44:16.574 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 126/134 2023-10-08T12:44:16.847 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-08T12:44:17.020 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-08T12:44:17.029 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-08T12:44:17.197 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-08T12:44:17.353 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-08T12:44:17.444 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-08T12:44:17.679 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-08T12:44:17.692 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-08T12:44:17.692 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:44:17.882 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:44:17.882 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T12:44:18.140 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T12:44:18.311 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:44:18.833 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:44:18.833 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 1/134 2023-10-08T12:44:18.834 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2/134 2023-10-08T12:44:18.834 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 3/134 2023-10-08T12:44:18.834 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 4/134 2023-10-08T12:44:18.834 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 5/134 2023-10-08T12:44:18.834 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:44:18.834 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:44:18.834 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T12:44:18.834 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 9/134 2023-10-08T12:44:18.834 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 10/134 2023-10-08T12:44:18.834 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 11/134 2023-10-08T12:44:18.834 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 12/134 2023-10-08T12:44:18.835 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 13/134 2023-10-08T12:44:18.835 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 14/134 2023-10-08T12:44:18.835 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 15/134 2023-10-08T12:44:18.835 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 16/134 2023-10-08T12:44:18.835 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 17/134 2023-10-08T12:44:18.835 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 18/134 2023-10-08T12:44:18.835 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 19/134 2023-10-08T12:44:18.835 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 20/134 2023-10-08T12:44:18.835 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 21/134 2023-10-08T12:44:18.835 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 22/134 2023-10-08T12:44:18.836 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 23/134 2023-10-08T12:44:18.836 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 24/134 2023-10-08T12:44:18.836 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 25/134 2023-10-08T12:44:18.836 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 26/134 2023-10-08T12:44:18.836 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 27/134 2023-10-08T12:44:18.847 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 28/134 2023-10-08T12:44:18.847 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 29/134 2023-10-08T12:44:18.847 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 30/134 2023-10-08T12:44:18.848 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 31/134 2023-10-08T12:44:18.848 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 32/134 2023-10-08T12:44:18.848 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 33/134 2023-10-08T12:44:18.848 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 34/134 2023-10-08T12:44:18.848 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 35/134 2023-10-08T12:44:18.848 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 36/134 2023-10-08T12:44:18.848 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 37/134 2023-10-08T12:44:18.848 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 38/134 2023-10-08T12:44:18.848 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-08T12:44:18.848 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-08T12:44:18.849 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-08T12:44:18.849 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-08T12:44:18.849 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-08T12:44:18.849 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-08T12:44:18.849 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-08T12:44:18.849 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-08T12:44:18.849 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-08T12:44:18.849 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-08T12:44:18.849 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-08T12:44:18.849 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-08T12:44:18.849 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-08T12:44:18.850 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-08T12:44:18.850 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-08T12:44:18.850 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-08T12:44:18.850 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-08T12:44:18.850 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-08T12:44:18.850 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-08T12:44:18.850 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-08T12:44:18.850 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-08T12:44:18.850 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-08T12:44:18.850 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-08T12:44:18.850 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-08T12:44:18.851 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-08T12:44:18.851 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-08T12:44:18.851 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-08T12:44:18.851 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-08T12:44:18.851 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-08T12:44:18.851 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-08T12:44:18.851 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-08T12:44:18.851 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-08T12:44:18.851 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-08T12:44:18.851 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-08T12:44:18.851 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-08T12:44:18.851 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-08T12:44:18.852 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-08T12:44:18.852 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-08T12:44:18.852 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-08T12:44:18.852 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-08T12:44:18.852 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-08T12:44:18.852 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-08T12:44:18.852 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-08T12:44:18.852 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-08T12:44:18.852 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-08T12:44:18.852 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-08T12:44:18.853 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-08T12:44:18.853 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-08T12:44:18.853 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-08T12:44:18.853 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-08T12:44:18.853 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-08T12:44:18.853 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-08T12:44:18.853 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-08T12:44:18.853 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-08T12:44:18.853 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-08T12:44:18.853 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-08T12:44:18.853 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-08T12:44:18.854 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-08T12:44:18.854 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-08T12:44:18.854 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-08T12:44:18.854 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-08T12:44:18.854 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-08T12:44:18.854 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-08T12:44:18.854 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-08T12:44:18.854 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-08T12:44:18.854 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-08T12:44:18.854 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-08T12:44:18.855 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-08T12:44:18.855 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-08T12:44:18.855 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-08T12:44:18.855 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-08T12:44:18.855 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-08T12:44:18.855 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-08T12:44:18.855 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-08T12:44:18.855 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-08T12:44:18.855 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-08T12:44:18.855 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-08T12:44:18.855 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-08T12:44:18.856 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-08T12:44:18.856 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-08T12:44:18.856 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-08T12:44:18.856 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-08T12:44:18.856 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-08T12:44:18.856 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-08T12:44:18.856 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-08T12:44:18.856 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-08T12:44:18.856 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-08T12:44:18.857 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-08T12:44:18.857 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-08T12:44:18.857 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-08T12:44:18.857 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 129/134 2023-10-08T12:44:18.857 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-08T12:44:18.857 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 131/134 2023-10-08T12:44:18.857 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:44:18.857 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-08T12:44:21.573 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:44:21.573 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:02:00 ago on Sun 08 Oct 2023 12:42:21 PM UTC. 2023-10-08T12:44:24.600 INFO:teuthology.orchestra.run.smithi078.stdout:Installed products updated. 2023-10-08T12:44:24.814 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:44:24.814 INFO:teuthology.orchestra.run.smithi078.stdout:Upgraded: 2023-10-08T12:44:24.814 INFO:teuthology.orchestra.run.smithi078.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-08T12:44:24.814 INFO:teuthology.orchestra.run.smithi078.stdout: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:24.814 INFO:teuthology.orchestra.run.smithi078.stdout: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:24.814 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2023-10-08T12:44:24.814 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-08T12:44:24.815 INFO:teuthology.orchestra.run.smithi078.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T12:44:24.815 INFO:teuthology.orchestra.run.smithi078.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T12:44:24.815 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:24.815 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:24.815 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:24.815 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:24.815 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:44:24.815 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-immutable-object-cache-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:24.815 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:24.815 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:24.815 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:44:24.815 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:44:24.816 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:44:24.816 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:44:24.816 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:44:24.816 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:24.816 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:24.816 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:44:24.816 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:24.816 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:24.816 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:24.816 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:44:24.816 INFO:teuthology.orchestra.run.smithi078.stdout: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:44:24.816 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:24.817 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:44:24.817 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-08T12:44:24.817 INFO:teuthology.orchestra.run.smithi078.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T12:44:24.817 INFO:teuthology.orchestra.run.smithi078.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-08T12:44:24.817 INFO:teuthology.orchestra.run.smithi078.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T12:44:24.817 INFO:teuthology.orchestra.run.smithi078.stdout: jq-1.6-3.el8.x86_64 2023-10-08T12:44:24.817 INFO:teuthology.orchestra.run.smithi078.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-08T12:44:24.817 INFO:teuthology.orchestra.run.smithi078.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-08T12:44:24.817 INFO:teuthology.orchestra.run.smithi078.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T12:44:24.817 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:24.817 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:24.817 INFO:teuthology.orchestra.run.smithi078.stdout: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:24.818 INFO:teuthology.orchestra.run.smithi078.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-08T12:44:24.818 INFO:teuthology.orchestra.run.smithi078.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-08T12:44:24.818 INFO:teuthology.orchestra.run.smithi078.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T12:44:24.818 INFO:teuthology.orchestra.run.smithi078.stdout: libpq-13.5-1.el8.x86_64 2023-10-08T12:44:24.818 INFO:teuthology.orchestra.run.smithi078.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-08T12:44:24.818 INFO:teuthology.orchestra.run.smithi078.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T12:44:24.818 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:24.818 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:24.818 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-08T12:44:24.818 INFO:teuthology.orchestra.run.smithi078.stdout: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:24.818 INFO:teuthology.orchestra.run.smithi078.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T12:44:24.818 INFO:teuthology.orchestra.run.smithi078.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-08T12:44:24.819 INFO:teuthology.orchestra.run.smithi078.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T12:44:24.819 INFO:teuthology.orchestra.run.smithi078.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T12:44:24.819 INFO:teuthology.orchestra.run.smithi078.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-08T12:44:24.819 INFO:teuthology.orchestra.run.smithi078.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T12:44:24.819 INFO:teuthology.orchestra.run.smithi078.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T12:44:24.819 INFO:teuthology.orchestra.run.smithi078.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T12:44:24.819 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-08T12:44:24.819 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-08T12:44:24.819 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-08T12:44:24.819 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T12:44:24.819 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T12:44:24.819 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T12:44:24.820 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:44:24.820 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:44:24.820 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:44:24.820 INFO:teuthology.orchestra.run.smithi078.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T12:44:24.820 INFO:teuthology.orchestra.run.smithi078.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-08T12:44:24.820 INFO:teuthology.orchestra.run.smithi078.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T12:44:24.820 INFO:teuthology.orchestra.run.smithi078.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T12:44:24.820 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T12:44:24.820 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:24.820 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:24.820 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:24.821 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T12:44:24.821 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-08T12:44:24.821 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T12:44:24.821 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T12:44:24.821 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-08T12:44:24.821 INFO:teuthology.orchestra.run.smithi078.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T12:44:24.821 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T12:44:24.821 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T12:44:24.821 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-08T12:44:24.821 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T12:44:24.821 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T12:44:24.821 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T12:44:24.822 INFO:teuthology.orchestra.run.smithi078.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T12:44:24.822 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T12:44:24.822 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T12:44:24.822 INFO:teuthology.orchestra.run.smithi078.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T12:44:24.822 INFO:teuthology.orchestra.run.smithi078.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T12:44:24.822 INFO:teuthology.orchestra.run.smithi078.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T12:44:24.822 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-08T12:44:24.822 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-08T12:44:24.822 INFO:teuthology.orchestra.run.smithi078.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T12:44:24.822 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T12:44:24.822 INFO:teuthology.orchestra.run.smithi078.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T12:44:24.822 INFO:teuthology.orchestra.run.smithi078.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T12:44:24.823 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-08T12:44:24.823 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T12:44:24.823 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T12:44:24.823 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-08T12:44:24.823 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T12:44:24.823 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:24.823 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:24.823 INFO:teuthology.orchestra.run.smithi078.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T12:44:24.823 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T12:44:24.823 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:24.823 INFO:teuthology.orchestra.run.smithi078.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T12:44:24.824 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T12:44:24.824 INFO:teuthology.orchestra.run.smithi078.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-08T12:44:24.824 INFO:teuthology.orchestra.run.smithi078.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T12:44:24.824 INFO:teuthology.orchestra.run.smithi078.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T12:44:24.824 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T12:44:24.824 INFO:teuthology.orchestra.run.smithi078.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T12:44:24.824 INFO:teuthology.orchestra.run.smithi078.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T12:44:24.824 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T12:44:24.824 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T12:44:24.824 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T12:44:24.824 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T12:44:24.824 INFO:teuthology.orchestra.run.smithi078.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T12:44:24.825 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:24.825 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:24.825 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:24.825 INFO:teuthology.orchestra.run.smithi078.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-08T12:44:24.825 INFO:teuthology.orchestra.run.smithi078.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T12:44:24.825 INFO:teuthology.orchestra.run.smithi078.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-08T12:44:24.825 INFO:teuthology.orchestra.run.smithi078.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-08T12:44:24.825 INFO:teuthology.orchestra.run.smithi078.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T12:44:24.825 INFO:teuthology.orchestra.run.smithi078.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-08T12:44:24.826 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:44:24.826 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2023-10-08T12:44:24.986 DEBUG:teuthology.parallel:result is None 2023-10-08T12:44:30.117 INFO:teuthology.orchestra.run.smithi045.stdout:Installed products updated. 2023-10-08T12:44:30.447 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:44:30.447 INFO:teuthology.orchestra.run.smithi045.stdout:Upgraded: 2023-10-08T12:44:30.447 INFO:teuthology.orchestra.run.smithi045.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-08T12:44:30.447 INFO:teuthology.orchestra.run.smithi045.stdout: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:30.448 INFO:teuthology.orchestra.run.smithi045.stdout: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:30.448 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2023-10-08T12:44:30.448 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-08T12:44:30.448 INFO:teuthology.orchestra.run.smithi045.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T12:44:30.448 INFO:teuthology.orchestra.run.smithi045.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T12:44:30.448 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:30.448 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:30.448 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:30.448 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:30.448 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:44:30.448 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-immutable-object-cache-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:30.448 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:30.449 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:30.449 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:44:30.449 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:44:30.449 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:44:30.449 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:44:30.449 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:44:30.449 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:30.449 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:30.449 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:44:30.449 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:30.449 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:30.449 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:30.450 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:44:30.450 INFO:teuthology.orchestra.run.smithi045.stdout: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:44:30.450 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:30.450 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:44:30.450 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-08T12:44:30.450 INFO:teuthology.orchestra.run.smithi045.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T12:44:30.450 INFO:teuthology.orchestra.run.smithi045.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-08T12:44:30.450 INFO:teuthology.orchestra.run.smithi045.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T12:44:30.450 INFO:teuthology.orchestra.run.smithi045.stdout: jq-1.6-3.el8.x86_64 2023-10-08T12:44:30.450 INFO:teuthology.orchestra.run.smithi045.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-08T12:44:30.450 INFO:teuthology.orchestra.run.smithi045.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-08T12:44:30.450 INFO:teuthology.orchestra.run.smithi045.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T12:44:30.451 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:30.451 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:30.451 INFO:teuthology.orchestra.run.smithi045.stdout: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:30.451 INFO:teuthology.orchestra.run.smithi045.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-08T12:44:30.451 INFO:teuthology.orchestra.run.smithi045.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-08T12:44:30.451 INFO:teuthology.orchestra.run.smithi045.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T12:44:30.451 INFO:teuthology.orchestra.run.smithi045.stdout: libpq-13.5-1.el8.x86_64 2023-10-08T12:44:30.451 INFO:teuthology.orchestra.run.smithi045.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-08T12:44:30.451 INFO:teuthology.orchestra.run.smithi045.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T12:44:30.451 INFO:teuthology.orchestra.run.smithi045.stdout: librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:30.451 INFO:teuthology.orchestra.run.smithi045.stdout: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:30.451 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-08T12:44:30.452 INFO:teuthology.orchestra.run.smithi045.stdout: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:30.452 INFO:teuthology.orchestra.run.smithi045.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T12:44:30.452 INFO:teuthology.orchestra.run.smithi045.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-08T12:44:30.452 INFO:teuthology.orchestra.run.smithi045.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T12:44:30.452 INFO:teuthology.orchestra.run.smithi045.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T12:44:30.452 INFO:teuthology.orchestra.run.smithi045.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-08T12:44:30.452 INFO:teuthology.orchestra.run.smithi045.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T12:44:30.452 INFO:teuthology.orchestra.run.smithi045.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T12:44:30.452 INFO:teuthology.orchestra.run.smithi045.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T12:44:30.452 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-08T12:44:30.452 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-08T12:44:30.452 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-08T12:44:30.453 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T12:44:30.453 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T12:44:30.453 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T12:44:30.453 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:44:30.453 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:44:30.453 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:44:30.453 INFO:teuthology.orchestra.run.smithi045.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T12:44:30.453 INFO:teuthology.orchestra.run.smithi045.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-08T12:44:30.453 INFO:teuthology.orchestra.run.smithi045.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T12:44:30.453 INFO:teuthology.orchestra.run.smithi045.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T12:44:30.453 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T12:44:30.453 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:30.453 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:30.454 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:30.454 INFO:teuthology.orchestra.run.smithi045.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T12:44:30.454 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-08T12:44:30.454 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T12:44:30.454 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T12:44:30.454 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-08T12:44:30.454 INFO:teuthology.orchestra.run.smithi045.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T12:44:30.454 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T12:44:30.454 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T12:44:30.454 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-08T12:44:30.454 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T12:44:30.454 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T12:44:30.455 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T12:44:30.455 INFO:teuthology.orchestra.run.smithi045.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T12:44:30.455 INFO:teuthology.orchestra.run.smithi045.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T12:44:30.455 INFO:teuthology.orchestra.run.smithi045.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T12:44:30.455 INFO:teuthology.orchestra.run.smithi045.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T12:44:30.455 INFO:teuthology.orchestra.run.smithi045.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T12:44:30.455 INFO:teuthology.orchestra.run.smithi045.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T12:44:30.455 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-08T12:44:30.455 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-08T12:44:30.455 INFO:teuthology.orchestra.run.smithi045.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T12:44:30.455 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T12:44:30.455 INFO:teuthology.orchestra.run.smithi045.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T12:44:30.455 INFO:teuthology.orchestra.run.smithi045.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T12:44:30.456 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-08T12:44:30.456 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T12:44:30.456 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T12:44:30.456 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-08T12:44:30.456 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T12:44:30.456 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:30.456 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:30.456 INFO:teuthology.orchestra.run.smithi045.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T12:44:30.456 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T12:44:30.456 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:30.456 INFO:teuthology.orchestra.run.smithi045.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T12:44:30.457 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T12:44:30.457 INFO:teuthology.orchestra.run.smithi045.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-08T12:44:30.457 INFO:teuthology.orchestra.run.smithi045.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T12:44:30.457 INFO:teuthology.orchestra.run.smithi045.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T12:44:30.457 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T12:44:30.457 INFO:teuthology.orchestra.run.smithi045.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T12:44:30.457 INFO:teuthology.orchestra.run.smithi045.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T12:44:30.457 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T12:44:30.457 INFO:teuthology.orchestra.run.smithi045.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T12:44:30.457 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T12:44:30.457 INFO:teuthology.orchestra.run.smithi045.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T12:44:30.457 INFO:teuthology.orchestra.run.smithi045.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T12:44:30.457 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:30.458 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:30.458 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:44:30.458 INFO:teuthology.orchestra.run.smithi045.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-08T12:44:30.458 INFO:teuthology.orchestra.run.smithi045.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T12:44:30.458 INFO:teuthology.orchestra.run.smithi045.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-08T12:44:30.458 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-08T12:44:30.458 INFO:teuthology.orchestra.run.smithi045.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T12:44:30.458 INFO:teuthology.orchestra.run.smithi045.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-08T12:44:30.459 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:44:30.459 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2023-10-08T12:44:30.799 DEBUG:teuthology.parallel:result is None 2023-10-08T12:44:30.799 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:44:30.949 DEBUG:teuthology.orchestra.run.smithi045:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T12:44:30.973 INFO:teuthology.orchestra.run.smithi045.stdout:18.0.0-6639.g7b3143ba.el8 2023-10-08T12:44:30.973 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6639.g7b3143ba.el8 2023-10-08T12:44:30.973 INFO:teuthology.task.install:The correct ceph version 18.0.0-6639.g7b3143ba is installed. 2023-10-08T12:44:30.974 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:44:31.116 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T12:44:31.144 INFO:teuthology.orchestra.run.smithi078.stdout:18.0.0-6639.g7b3143ba.el8 2023-10-08T12:44:31.144 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6639.g7b3143ba.el8 2023-10-08T12:44:31.145 INFO:teuthology.task.install:The correct ceph version 18.0.0-6639.g7b3143ba is installed. 2023-10-08T12:44:31.145 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-08T12:44:31.145 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:44:31.145 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T12:44:31.189 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T12:44:31.190 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T12:44:31.237 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-08T12:44:31.238 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:44:31.238 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T12:44:31.265 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T12:44:31.333 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T12:44:31.333 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T12:44:31.365 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T12:44:31.436 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-08T12:44:31.436 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:44:31.436 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T12:44:31.464 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T12:44:31.531 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T12:44:31.531 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T12:44:31.561 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T12:44:31.629 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-08T12:44:31.630 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:44:31.630 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T12:44:31.656 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T12:44:31.723 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T12:44:31.723 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T12:44:31.752 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T12:44:31.821 INFO:teuthology.run_tasks:Running task ceph... 2023-10-08T12:44:31.893 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-08T12:44:31.893 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 777 /var/log/ceph 2023-10-08T12:44:31.895 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 777 /var/log/ceph 2023-10-08T12:44:31.923 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-08T12:44:31.923 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T12:44:31.963 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T12:44:31.992 INFO:tasks.ceph:Creating extra log directories... 2023-10-08T12:44:31.992 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T12:44:32.030 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T12:44:32.068 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-08T12:44:32.068 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-08T12:44:32.068 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-08T12:44:32.068 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:44:32.068 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-08T12:44:32.112 DEBUG:teuthology.orchestra.run.smithi045:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-08T12:44:32.245 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-08T12:44:32.272 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T12:44:32.273 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-08T12:44:32.290 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-08T12:44:32.420 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-08T12:44:32.451 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-08T12:44:32.451 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-08T12:44:32.452 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417949', 'branch': 'wip-batrick-testing-20231007.154158', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7417949', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-batrick-testing-20231007.154158'}, 'ceph': {'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-batrick-testing-20231007.154158', 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 8022, 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'sleep_before_teardown': 0, 'subset': '128/256', 'suite': 'fs', 'suite_branch': 'wip-batrick-testing-20231007.154158', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi045.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi078.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de'}}, {'ceph': {'create_rbd_pool': False, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-07_20:01:29', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-08T12:44:32.452 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T12:44:32.455 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T12:44:32.502 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T12:44:32.511 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T12:44:32.568 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:44:32.568 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T12:44:32.594 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T12:44:32.595 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_1 2023-10-08T12:44:32.652 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T12:44:32.652 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:44:32.652 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 6h/6d Inode: 390891 Links: 1 2023-10-08T12:44:32.652 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:44:32.652 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:44:32.652 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-10-08 12:44:18.518401523 +0000 2023-10-08T12:44:32.652 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-10-08 12:41:33.292315606 +0000 2023-10-08T12:44:32.652 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-10-08 12:41:33.292315606 +0000 2023-10-08T12:44:32.652 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2023-10-08T12:44:32.653 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T12:44:32.718 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-10-08T12:44:32.718 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-10-08T12:44:32.718 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.00012011 s, 4.3 MB/s 2023-10-08T12:44:32.719 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T12:44:32.778 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_2 2023-10-08T12:44:32.835 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T12:44:32.835 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:44:32.835 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 6h/6d Inode: 388572 Links: 1 2023-10-08T12:44:32.835 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:44:32.835 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:44:32.835 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-10-08 12:44:18.518401523 +0000 2023-10-08T12:44:32.835 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-10-08 12:41:33.820307507 +0000 2023-10-08T12:44:32.835 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-10-08 12:41:33.820307507 +0000 2023-10-08T12:44:32.835 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2023-10-08T12:44:32.836 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T12:44:32.900 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-10-08T12:44:32.900 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-10-08T12:44:32.900 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.00010256 s, 5.0 MB/s 2023-10-08T12:44:32.901 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T12:44:32.959 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_3 2023-10-08T12:44:33.017 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T12:44:33.017 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:44:33.017 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 6h/6d Inode: 388018 Links: 1 2023-10-08T12:44:33.017 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:44:33.017 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:44:33.017 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-10-08 12:44:18.518401523 +0000 2023-10-08T12:44:33.017 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-10-08 12:41:34.326299745 +0000 2023-10-08T12:44:33.018 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-10-08 12:41:34.326299745 +0000 2023-10-08T12:44:33.018 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2023-10-08T12:44:33.018 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T12:44:33.083 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-10-08T12:44:33.083 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-10-08T12:44:33.083 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000135313 s, 3.8 MB/s 2023-10-08T12:44:33.084 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T12:44:33.142 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_4 2023-10-08T12:44:33.199 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T12:44:33.200 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:44:33.200 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 6h/6d Inode: 393635 Links: 1 2023-10-08T12:44:33.200 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:44:33.200 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:44:33.200 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-10-08 12:44:18.518401523 +0000 2023-10-08T12:44:33.200 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-10-08 12:41:34.836291922 +0000 2023-10-08T12:44:33.201 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-10-08 12:41:34.836291922 +0000 2023-10-08T12:44:33.201 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2023-10-08T12:44:33.201 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T12:44:33.265 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-10-08T12:44:33.265 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-10-08T12:44:33.265 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000109814 s, 4.7 MB/s 2023-10-08T12:44:33.266 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T12:44:33.324 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T12:44:33.325 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T12:44:33.325 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T12:44:33.343 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T12:44:33.344 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_1 2023-10-08T12:44:33.402 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T12:44:33.402 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:44:33.403 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 6h/6d Inode: 393561 Links: 1 2023-10-08T12:44:33.403 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:44:33.403 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:44:33.403 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-10-08 12:44:10.824418488 +0000 2023-10-08T12:44:33.403 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-10-08 12:41:06.377464891 +0000 2023-10-08T12:44:33.403 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-10-08 12:41:06.377464891 +0000 2023-10-08T12:44:33.403 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2023-10-08T12:44:33.404 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T12:44:33.469 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-10-08T12:44:33.469 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-10-08T12:44:33.469 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000277362 s, 1.8 MB/s 2023-10-08T12:44:33.470 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T12:44:33.529 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_2 2023-10-08T12:44:33.586 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T12:44:33.587 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:44:33.587 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 6h/6d Inode: 392445 Links: 1 2023-10-08T12:44:33.587 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:44:33.587 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:44:33.587 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-10-08 12:44:10.824418488 +0000 2023-10-08T12:44:33.587 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-10-08 12:41:06.900455841 +0000 2023-10-08T12:44:33.587 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-10-08 12:41:06.900455841 +0000 2023-10-08T12:44:33.587 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2023-10-08T12:44:33.587 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T12:44:33.653 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-10-08T12:44:33.653 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-10-08T12:44:33.653 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000228004 s, 2.2 MB/s 2023-10-08T12:44:33.654 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T12:44:33.712 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_3 2023-10-08T12:44:33.769 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T12:44:33.769 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:44:33.769 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 6h/6d Inode: 386986 Links: 1 2023-10-08T12:44:33.769 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:44:33.770 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:44:33.770 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-10-08 12:44:10.824418488 +0000 2023-10-08T12:44:33.770 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-10-08 12:41:07.417446894 +0000 2023-10-08T12:44:33.770 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-10-08 12:41:07.417446894 +0000 2023-10-08T12:44:33.770 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2023-10-08T12:44:33.770 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T12:44:33.834 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-10-08T12:44:33.834 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-10-08T12:44:33.834 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000241394 s, 2.1 MB/s 2023-10-08T12:44:33.835 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T12:44:33.893 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_4 2023-10-08T12:44:33.950 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T12:44:33.950 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:44:33.950 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 6h/6d Inode: 395057 Links: 1 2023-10-08T12:44:33.950 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:44:33.951 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:44:33.951 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-10-08 12:44:10.825418470 +0000 2023-10-08T12:44:33.951 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-10-08 12:41:07.920438190 +0000 2023-10-08T12:44:33.951 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-10-08 12:41:07.920438190 +0000 2023-10-08T12:44:33.951 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2023-10-08T12:44:33.951 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T12:44:34.015 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-10-08T12:44:34.016 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-10-08T12:44:34.016 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000194755 s, 2.6 MB/s 2023-10-08T12:44:34.017 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T12:44:34.074 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T12:44:34.074 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi045.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-08T12:44:34.074 INFO:tasks.ceph:Generating config... 2023-10-08T12:44:34.076 INFO:tasks.ceph:[client] pid file = 2023-10-08T12:44:34.076 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-08T12:44:34.076 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-08T12:44:34.076 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-08T12:44:34.076 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-08T12:44:34.076 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-08T12:44:34.076 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-08T12:44:34.076 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-08T12:44:34.076 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-08T12:44:34.076 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-08T12:44:34.076 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-08T12:44:34.077 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-08T12:44:34.077 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-08T12:44:34.077 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-08T12:44:34.077 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-08T12:44:34.077 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-08T12:44:34.077 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-08T12:44:34.077 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-08T12:44:34.077 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-08T12:44:34.077 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-08T12:44:34.077 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-08T12:44:34.077 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-08T12:44:34.078 INFO:tasks.ceph:Setting up mon.a... 2023-10-08T12:44:34.078 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-08T12:44:34.162 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.keyring 2023-10-08T12:44:34.165 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-08T12:44:34.213 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T12:44:34.241 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.45'), ('mon.b', '172.21.15.78'), ('mon.c', '[v2:172.21.15.78:3301,v1:172.21.15.78:6790]')] 2023-10-08T12:44:34.242 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.45,172.21.15.78,[v2:172.21.15.78:3301,v1:172.21.15.78:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2023-10-08T12:44:34.242 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:44:34.242 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-08T12:44:34.299 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.45 --add b 172.21.15.78 --addv c '[v2:172.21.15.78:3301,v1:172.21.15.78:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-08T12:44:34.390 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-08T12:44:34.390 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: generated fsid 3c5c3516-8181-4382-8205-f21bea7ad4b3 2023-10-08T12:44:34.390 INFO:teuthology.orchestra.run.smithi045.stdout:setting min_mon_release = pacific 2023-10-08T12:44:34.390 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 0 2023-10-08T12:44:34.390 INFO:teuthology.orchestra.run.smithi045.stdout:fsid 3c5c3516-8181-4382-8205-f21bea7ad4b3 2023-10-08T12:44:34.390 INFO:teuthology.orchestra.run.smithi045.stdout:last_changed 2023-10-08T12:44:34.390746+0000 2023-10-08T12:44:34.391 INFO:teuthology.orchestra.run.smithi045.stdout:created 2023-10-08T12:44:34.390746+0000 2023-10-08T12:44:34.391 INFO:teuthology.orchestra.run.smithi045.stdout:min_mon_release 16 (pacific) 2023-10-08T12:44:34.391 INFO:teuthology.orchestra.run.smithi045.stdout:election_strategy: 1 2023-10-08T12:44:34.391 INFO:teuthology.orchestra.run.smithi045.stdout:0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2023-10-08T12:44:34.391 INFO:teuthology.orchestra.run.smithi045.stdout:1: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.b 2023-10-08T12:44:34.391 INFO:teuthology.orchestra.run.smithi045.stdout:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2023-10-08T12:44:34.391 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-08T12:44:34.392 DEBUG:teuthology.orchestra.run.smithi045:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-08T12:44:34.409 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3c5c3516-8181-4382-8205-f21bea7ad4b3... 2023-10-08T12:44:34.410 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T12:44:34.452 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T12:44:34.496 INFO:teuthology.orchestra.run.smithi045.stdout:[global] 2023-10-08T12:44:34.497 INFO:teuthology.orchestra.run.smithi045.stdout: chdir = "" 2023-10-08T12:44:34.497 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T12:44:34.497 INFO:teuthology.orchestra.run.smithi045.stdout: auth supported = cephx 2023-10-08T12:44:34.497 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:44:34.497 INFO:teuthology.orchestra.run.smithi045.stdout: filestore xattr use omap = true 2023-10-08T12:44:34.497 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:44:34.497 INFO:teuthology.orchestra.run.smithi045.stdout: mon clock drift allowed = 1.000 2023-10-08T12:44:34.498 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:44:34.498 INFO:teuthology.orchestra.run.smithi045.stdout: osd crush chooseleaf type = 0 2023-10-08T12:44:34.498 INFO:teuthology.orchestra.run.smithi045.stdout: auth debug = true 2023-10-08T12:44:34.498 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:44:34.498 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on old message = true 2023-10-08T12:44:34.498 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on bug = true 2023-10-08T12:44:34.498 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:44:34.498 INFO:teuthology.orchestra.run.smithi045.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T12:44:34.499 INFO:teuthology.orchestra.run.smithi045.stdout: mon pg warn max object skew = 0 2023-10-08T12:44:34.499 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:44:34.499 INFO:teuthology.orchestra.run.smithi045.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T12:44:34.499 INFO:teuthology.orchestra.run.smithi045.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T12:44:34.499 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:44:34.499 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default size = 2 2023-10-08T12:44:34.499 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:44:34.499 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow primary affinity = true 2023-10-08T12:44:34.499 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow pg remap = true 2023-10-08T12:44:34.499 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on legacy crush tunables = false 2023-10-08T12:44:34.500 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on crush straw calc version zero = false 2023-10-08T12:44:34.500 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on no sortbitwise = false 2023-10-08T12:44:34.500 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on osd down out interval zero = false 2023-10-08T12:44:34.500 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on too few osds = false 2023-10-08T12:44:34.500 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T12:44:34.500 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T12:44:34.500 INFO:teuthology.orchestra.run.smithi045.stdout: mon_allow_pool_size_one = true 2023-10-08T12:44:34.500 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:44:34.500 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T12:44:34.500 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:44:34.500 INFO:teuthology.orchestra.run.smithi045.stdout: osd default data pool replay window = 5 2023-10-08T12:44:34.501 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:44:34.501 INFO:teuthology.orchestra.run.smithi045.stdout: mon allow pool delete = true 2023-10-08T12:44:34.501 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:44:34.501 INFO:teuthology.orchestra.run.smithi045.stdout: mon cluster log file level = debug 2023-10-08T12:44:34.501 INFO:teuthology.orchestra.run.smithi045.stdout: debug asserts on shutdown = true 2023-10-08T12:44:34.501 INFO:teuthology.orchestra.run.smithi045.stdout: mon health detail to clog = false 2023-10-08T12:44:34.501 INFO:teuthology.orchestra.run.smithi045.stdout: mon host = "172.21.15.45,172.21.15.78,[v2:172.21.15.78:3301,v1:172.21.15.78:6790]" 2023-10-08T12:44:34.501 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on skipped message = False 2023-10-08T12:44:34.501 INFO:teuthology.orchestra.run.smithi045.stdout: fsid = 3c5c3516-8181-4382-8205-f21bea7ad4b3 2023-10-08T12:44:34.501 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:44:34.502 INFO:teuthology.orchestra.run.smithi045.stdout:[osd] 2023-10-08T12:44:34.502 INFO:teuthology.orchestra.run.smithi045.stdout: osd journal size = 100 2023-10-08T12:44:34.502 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:44:34.502 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub load threshold = 5.0 2023-10-08T12:44:34.502 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub max interval = 600 2023-10-08T12:44:34.502 INFO:teuthology.orchestra.run.smithi045.stdout: osd mclock profile = high_recovery_ops 2023-10-08T12:44:34.502 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:44:34.502 INFO:teuthology.orchestra.run.smithi045.stdout: osd recover clone overlap = true 2023-10-08T12:44:34.502 INFO:teuthology.orchestra.run.smithi045.stdout: osd recovery max chunk = 1048576 2023-10-08T12:44:34.503 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:44:34.503 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug shutdown = true 2023-10-08T12:44:34.503 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug op order = true 2023-10-08T12:44:34.503 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug verify stray on activate = true 2023-10-08T12:44:34.503 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:44:34.503 INFO:teuthology.orchestra.run.smithi045.stdout: osd open classes on start = true 2023-10-08T12:44:34.503 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug pg log writeout = true 2023-10-08T12:44:34.503 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:44:34.503 INFO:teuthology.orchestra.run.smithi045.stdout: osd deep scrub update digest min age = 30 2023-10-08T12:44:34.504 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:44:34.504 INFO:teuthology.orchestra.run.smithi045.stdout: osd map max advance = 10 2023-10-08T12:44:34.504 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:44:34.504 INFO:teuthology.orchestra.run.smithi045.stdout: journal zero on create = true 2023-10-08T12:44:34.504 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:44:34.504 INFO:teuthology.orchestra.run.smithi045.stdout: filestore ondisk finisher threads = 3 2023-10-08T12:44:34.504 INFO:teuthology.orchestra.run.smithi045.stdout: filestore apply finisher threads = 3 2023-10-08T12:44:34.504 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:44:34.504 INFO:teuthology.orchestra.run.smithi045.stdout: bdev debug aio = true 2023-10-08T12:44:34.504 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug misdirected ops = true 2023-10-08T12:44:34.505 INFO:teuthology.orchestra.run.smithi045.stdout: bdev async discard = True 2023-10-08T12:44:34.505 INFO:teuthology.orchestra.run.smithi045.stdout: bdev enable discard = True 2023-10-08T12:44:34.505 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore allocator = bitmap 2023-10-08T12:44:34.505 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore block size = 96636764160 2023-10-08T12:44:34.505 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore fsck on mount = True 2023-10-08T12:44:34.505 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluefs = 1/20 2023-10-08T12:44:34.505 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluestore = 1/20 2023-10-08T12:44:34.505 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-10-08T12:44:34.505 INFO:teuthology.orchestra.run.smithi045.stdout: debug osd = 20 2023-10-08T12:44:34.505 INFO:teuthology.orchestra.run.smithi045.stdout: debug rocksdb = 4/10 2023-10-08T12:44:34.506 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T12:44:34.506 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd full ratio = 0.9 2023-10-08T12:44:34.506 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd nearfull ratio = 0.8 2023-10-08T12:44:34.506 INFO:teuthology.orchestra.run.smithi045.stdout: osd failsafe full ratio = 0.95 2023-10-08T12:44:34.506 INFO:teuthology.orchestra.run.smithi045.stdout: osd objectstore = bluestore 2023-10-08T12:44:34.506 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:44:34.506 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr] 2023-10-08T12:44:34.506 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-10-08T12:44:34.507 INFO:teuthology.orchestra.run.smithi045.stdout: debug mgr = 20 2023-10-08T12:44:34.507 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-10-08T12:44:34.507 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-10-08T12:44:34.507 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-10-08T12:44:34.507 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-10-08T12:44:34.507 INFO:teuthology.orchestra.run.smithi045.stdout: mgr/telemetry/nag = false 2023-10-08T12:44:34.507 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:44:34.507 INFO:teuthology.orchestra.run.smithi045.stdout:[mon] 2023-10-08T12:44:34.507 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-10-08T12:44:34.510 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-10-08T12:44:34.510 INFO:teuthology.orchestra.run.smithi045.stdout: debug paxos = 20 2023-10-08T12:44:34.510 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-10-08T12:44:34.510 INFO:teuthology.orchestra.run.smithi045.stdout: mon data avail warn = 5 2023-10-08T12:44:34.510 INFO:teuthology.orchestra.run.smithi045.stdout: mon mgr mkfs grace = 240 2023-10-08T12:44:34.511 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-10-08T12:44:34.511 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd reporter subtree level = osd 2023-10-08T12:44:34.511 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd prime pg temp = true 2023-10-08T12:44:34.511 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-10-08T12:44:34.511 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:44:34.511 INFO:teuthology.orchestra.run.smithi045.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T12:44:34.511 INFO:teuthology.orchestra.run.smithi045.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T12:44:34.511 INFO:teuthology.orchestra.run.smithi045.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T12:44:34.511 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:44:34.511 INFO:teuthology.orchestra.run.smithi045.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T12:44:34.511 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T12:44:34.512 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T12:44:34.512 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:44:34.512 INFO:teuthology.orchestra.run.smithi045.stdout: # 1m isn't quite enough 2023-10-08T12:44:34.512 INFO:teuthology.orchestra.run.smithi045.stdout: mon_down_mkfs_grace = 2m 2023-10-08T12:44:34.512 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:44:34.512 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_filestore_osds = false 2023-10-08T12:44:34.512 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:44:34.512 INFO:teuthology.orchestra.run.smithi045.stdout:[client] 2023-10-08T12:44:34.512 INFO:teuthology.orchestra.run.smithi045.stdout: rgw cache enabled = true 2023-10-08T12:44:34.512 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable ops log = true 2023-10-08T12:44:34.512 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable usage log = true 2023-10-08T12:44:34.512 INFO:teuthology.orchestra.run.smithi045.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T12:44:34.512 INFO:teuthology.orchestra.run.smithi045.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T12:44:34.513 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = "" 2023-10-08T12:44:34.513 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.a] 2023-10-08T12:44:34.513 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.b] 2023-10-08T12:44:34.513 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.c] 2023-10-08T12:44:34.513 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-10-08T12:44:34.513 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-10-08T12:44:34.513 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-10-08T12:44:34.513 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2023-10-08T12:44:34.515 INFO:teuthology.orchestra.run.smithi078.stdout:[global] 2023-10-08T12:44:34.515 INFO:teuthology.orchestra.run.smithi078.stdout: chdir = "" 2023-10-08T12:44:34.515 INFO:teuthology.orchestra.run.smithi078.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T12:44:34.515 INFO:teuthology.orchestra.run.smithi078.stdout: auth supported = cephx 2023-10-08T12:44:34.515 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:44:34.515 INFO:teuthology.orchestra.run.smithi078.stdout: filestore xattr use omap = true 2023-10-08T12:44:34.515 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:44:34.515 INFO:teuthology.orchestra.run.smithi078.stdout: mon clock drift allowed = 1.000 2023-10-08T12:44:34.515 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:44:34.515 INFO:teuthology.orchestra.run.smithi078.stdout: osd crush chooseleaf type = 0 2023-10-08T12:44:34.515 INFO:teuthology.orchestra.run.smithi078.stdout: auth debug = true 2023-10-08T12:44:34.516 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:44:34.516 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on old message = true 2023-10-08T12:44:34.516 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on bug = true 2023-10-08T12:44:34.516 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:44:34.516 INFO:teuthology.orchestra.run.smithi078.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T12:44:34.516 INFO:teuthology.orchestra.run.smithi078.stdout: mon pg warn max object skew = 0 2023-10-08T12:44:34.516 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:44:34.516 INFO:teuthology.orchestra.run.smithi078.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T12:44:34.516 INFO:teuthology.orchestra.run.smithi078.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T12:44:34.516 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:44:34.516 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default size = 2 2023-10-08T12:44:34.516 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:44:34.517 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow primary affinity = true 2023-10-08T12:44:34.517 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow pg remap = true 2023-10-08T12:44:34.517 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on legacy crush tunables = false 2023-10-08T12:44:34.517 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on crush straw calc version zero = false 2023-10-08T12:44:34.517 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on no sortbitwise = false 2023-10-08T12:44:34.517 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on osd down out interval zero = false 2023-10-08T12:44:34.517 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on too few osds = false 2023-10-08T12:44:34.517 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T12:44:34.517 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T12:44:34.517 INFO:teuthology.orchestra.run.smithi078.stdout: mon_allow_pool_size_one = true 2023-10-08T12:44:34.517 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:44:34.517 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T12:44:34.518 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:44:34.518 INFO:teuthology.orchestra.run.smithi078.stdout: osd default data pool replay window = 5 2023-10-08T12:44:34.518 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:44:34.518 INFO:teuthology.orchestra.run.smithi078.stdout: mon allow pool delete = true 2023-10-08T12:44:34.518 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:44:34.518 INFO:teuthology.orchestra.run.smithi078.stdout: mon cluster log file level = debug 2023-10-08T12:44:34.518 INFO:teuthology.orchestra.run.smithi078.stdout: debug asserts on shutdown = true 2023-10-08T12:44:34.518 INFO:teuthology.orchestra.run.smithi078.stdout: mon health detail to clog = false 2023-10-08T12:44:34.518 INFO:teuthology.orchestra.run.smithi078.stdout: mon host = "172.21.15.45,172.21.15.78,[v2:172.21.15.78:3301,v1:172.21.15.78:6790]" 2023-10-08T12:44:34.518 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on skipped message = False 2023-10-08T12:44:34.518 INFO:teuthology.orchestra.run.smithi078.stdout: fsid = 3c5c3516-8181-4382-8205-f21bea7ad4b3 2023-10-08T12:44:34.518 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:44:34.519 INFO:teuthology.orchestra.run.smithi078.stdout:[osd] 2023-10-08T12:44:34.519 INFO:teuthology.orchestra.run.smithi078.stdout: osd journal size = 100 2023-10-08T12:44:34.519 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:44:34.519 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub load threshold = 5.0 2023-10-08T12:44:34.519 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub max interval = 600 2023-10-08T12:44:34.519 INFO:teuthology.orchestra.run.smithi078.stdout: osd mclock profile = high_recovery_ops 2023-10-08T12:44:34.519 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:44:34.519 INFO:teuthology.orchestra.run.smithi078.stdout: osd recover clone overlap = true 2023-10-08T12:44:34.519 INFO:teuthology.orchestra.run.smithi078.stdout: osd recovery max chunk = 1048576 2023-10-08T12:44:34.519 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:44:34.520 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug shutdown = true 2023-10-08T12:44:34.520 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug op order = true 2023-10-08T12:44:34.520 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug verify stray on activate = true 2023-10-08T12:44:34.520 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:44:34.521 INFO:teuthology.orchestra.run.smithi078.stdout: osd open classes on start = true 2023-10-08T12:44:34.521 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug pg log writeout = true 2023-10-08T12:44:34.521 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:44:34.522 INFO:teuthology.orchestra.run.smithi078.stdout: osd deep scrub update digest min age = 30 2023-10-08T12:44:34.522 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:44:34.522 INFO:teuthology.orchestra.run.smithi078.stdout: osd map max advance = 10 2023-10-08T12:44:34.522 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:44:34.522 INFO:teuthology.orchestra.run.smithi078.stdout: journal zero on create = true 2023-10-08T12:44:34.522 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:44:34.522 INFO:teuthology.orchestra.run.smithi078.stdout: filestore ondisk finisher threads = 3 2023-10-08T12:44:34.522 INFO:teuthology.orchestra.run.smithi078.stdout: filestore apply finisher threads = 3 2023-10-08T12:44:34.523 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:44:34.523 INFO:teuthology.orchestra.run.smithi078.stdout: bdev debug aio = true 2023-10-08T12:44:34.523 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug misdirected ops = true 2023-10-08T12:44:34.523 INFO:teuthology.orchestra.run.smithi078.stdout: bdev async discard = True 2023-10-08T12:44:34.523 INFO:teuthology.orchestra.run.smithi078.stdout: bdev enable discard = True 2023-10-08T12:44:34.523 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore allocator = bitmap 2023-10-08T12:44:34.523 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore block size = 96636764160 2023-10-08T12:44:34.523 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore fsck on mount = True 2023-10-08T12:44:34.523 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluefs = 1/20 2023-10-08T12:44:34.523 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluestore = 1/20 2023-10-08T12:44:34.523 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-10-08T12:44:34.523 INFO:teuthology.orchestra.run.smithi078.stdout: debug osd = 20 2023-10-08T12:44:34.523 INFO:teuthology.orchestra.run.smithi078.stdout: debug rocksdb = 4/10 2023-10-08T12:44:34.524 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T12:44:34.524 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd full ratio = 0.9 2023-10-08T12:44:34.524 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd nearfull ratio = 0.8 2023-10-08T12:44:34.524 INFO:teuthology.orchestra.run.smithi078.stdout: osd failsafe full ratio = 0.95 2023-10-08T12:44:34.524 INFO:teuthology.orchestra.run.smithi078.stdout: osd objectstore = bluestore 2023-10-08T12:44:34.524 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:44:34.524 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr] 2023-10-08T12:44:34.524 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-10-08T12:44:34.524 INFO:teuthology.orchestra.run.smithi078.stdout: debug mgr = 20 2023-10-08T12:44:34.524 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2023-10-08T12:44:34.525 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2023-10-08T12:44:34.525 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2023-10-08T12:44:34.525 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2023-10-08T12:44:34.525 INFO:teuthology.orchestra.run.smithi078.stdout: mgr/telemetry/nag = false 2023-10-08T12:44:34.525 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:44:34.525 INFO:teuthology.orchestra.run.smithi078.stdout:[mon] 2023-10-08T12:44:34.525 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-10-08T12:44:34.525 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2023-10-08T12:44:34.525 INFO:teuthology.orchestra.run.smithi078.stdout: debug paxos = 20 2023-10-08T12:44:34.525 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2023-10-08T12:44:34.525 INFO:teuthology.orchestra.run.smithi078.stdout: mon data avail warn = 5 2023-10-08T12:44:34.526 INFO:teuthology.orchestra.run.smithi078.stdout: mon mgr mkfs grace = 240 2023-10-08T12:44:34.526 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2023-10-08T12:44:34.526 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd reporter subtree level = osd 2023-10-08T12:44:34.526 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd prime pg temp = true 2023-10-08T12:44:34.526 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2023-10-08T12:44:34.526 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:44:34.526 INFO:teuthology.orchestra.run.smithi078.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T12:44:34.526 INFO:teuthology.orchestra.run.smithi078.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T12:44:34.526 INFO:teuthology.orchestra.run.smithi078.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T12:44:34.526 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:44:34.526 INFO:teuthology.orchestra.run.smithi078.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T12:44:34.527 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T12:44:34.527 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T12:44:34.527 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:44:34.527 INFO:teuthology.orchestra.run.smithi078.stdout: # 1m isn't quite enough 2023-10-08T12:44:34.527 INFO:teuthology.orchestra.run.smithi078.stdout: mon_down_mkfs_grace = 2m 2023-10-08T12:44:34.527 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:44:34.527 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_filestore_osds = false 2023-10-08T12:44:34.527 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-08T12:44:34.527 INFO:teuthology.orchestra.run.smithi078.stdout:[client] 2023-10-08T12:44:34.527 INFO:teuthology.orchestra.run.smithi078.stdout: rgw cache enabled = true 2023-10-08T12:44:34.528 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable ops log = true 2023-10-08T12:44:34.528 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable usage log = true 2023-10-08T12:44:34.528 INFO:teuthology.orchestra.run.smithi078.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T12:44:34.528 INFO:teuthology.orchestra.run.smithi078.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T12:44:34.528 INFO:teuthology.orchestra.run.smithi078.stdout: pid file = "" 2023-10-08T12:44:34.528 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.a] 2023-10-08T12:44:34.528 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.b] 2023-10-08T12:44:34.528 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.c] 2023-10-08T12:44:34.528 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2023-10-08T12:44:34.528 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.c] 2023-10-08T12:44:34.528 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.b] 2023-10-08T12:44:34.528 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.d] 2023-10-08T12:44:34.529 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-08T12:44:34.529 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-08T12:44:34.613 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-08T12:44:34.613 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:44:34.613 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-08T12:44:34.631 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:44:34.631 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-08T12:44:34.688 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi045.front.sepia.ceph.com 2023-10-08T12:44:34.688 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:44:34.688 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T12:44:34.688 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T12:44:34.766 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:44:34.766 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T12:44:34.823 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi078.front.sepia.ceph.com 2023-10-08T12:44:34.823 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T12:44:34.824 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T12:44:34.824 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T12:44:34.865 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T12:44:34.865 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T12:44:34.923 INFO:tasks.ceph:Setting up mon nodes... 2023-10-08T12:44:34.923 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-08T12:44:34.923 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-08T12:44:34.979 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-08T12:44:34.981 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-08T12:44:35.193 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-08T12:44:35.196 INFO:tasks.ceph:Setting up mds nodes... 2023-10-08T12:44:35.196 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-08T12:44:35.251 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-08T12:44:35.254 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-08T12:44:35.280 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-08T12:44:35.376 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-08T12:44:35.378 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-08T12:44:35.404 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-08T12:44:35.469 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-08T12:44:35.472 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-08T12:44:35.504 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-08T12:44:35.609 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-08T12:44:35.612 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-08T12:44:35.640 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-08T12:44:35.640 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-08T12:44:35.686 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-08T12:44:35.699 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-08T12:44:35.743 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-08T12:44:35.756 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-08T12:44:35.803 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-08T12:44:35.817 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-08T12:44:35.860 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-08T12:44:35.873 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-08T12:44:35.873 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi045.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-08T12:44:35.873 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-08T12:44:35.901 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T12:44:35.901 INFO:tasks.ceph:role: osd.0 2023-10-08T12:44:35.901 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi045.front.sepia.ceph.com 2023-10-08T12:44:35.901 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-08T12:44:35.968 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T12:44:35.968 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T12:44:35.968 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T12:44:35.969 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-08T12:44:35.969 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T12:44:35.969 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-10-08T12:44:35.969 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T12:44:35.969 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T12:44:35.969 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T12:44:35.969 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T12:44:35.991 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-10-08T12:44:36.057 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-10-08T12:44:36.058 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-08T12:44:36.139 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-08T12:44:36.212 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-08T12:44:36.279 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T12:44:36.280 INFO:tasks.ceph:role: osd.1 2023-10-08T12:44:36.280 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi045.front.sepia.ceph.com 2023-10-08T12:44:36.280 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-08T12:44:36.346 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T12:44:36.346 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T12:44:36.347 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T12:44:36.347 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-08T12:44:36.347 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T12:44:36.347 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-10-08T12:44:36.347 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T12:44:36.347 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T12:44:36.348 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T12:44:36.348 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T12:44:36.369 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-10-08T12:44:36.371 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-10-08T12:44:36.371 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-08T12:44:36.452 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-08T12:44:36.523 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-08T12:44:36.591 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T12:44:36.591 INFO:tasks.ceph:role: osd.2 2023-10-08T12:44:36.591 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi045.front.sepia.ceph.com 2023-10-08T12:44:36.591 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-08T12:44:36.658 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T12:44:36.658 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T12:44:36.658 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T12:44:36.659 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-08T12:44:36.659 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T12:44:36.659 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-10-08T12:44:36.659 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T12:44:36.659 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T12:44:36.659 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T12:44:36.659 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T12:44:36.681 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-10-08T12:44:36.683 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-10-08T12:44:36.683 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-08T12:44:36.763 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-08T12:44:36.834 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-08T12:44:36.902 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T12:44:36.902 INFO:tasks.ceph:role: osd.3 2023-10-08T12:44:36.902 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi045.front.sepia.ceph.com 2023-10-08T12:44:36.902 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-08T12:44:36.969 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T12:44:36.969 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T12:44:36.969 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T12:44:36.970 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-08T12:44:36.970 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T12:44:36.970 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-10-08T12:44:36.970 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T12:44:36.970 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T12:44:36.970 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T12:44:36.970 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T12:44:36.991 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-10-08T12:44:36.993 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-10-08T12:44:36.993 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-08T12:44:37.074 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-08T12:44:37.145 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T12:44:37.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:44:37.404+0000 7f71100d6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-08T12:44:37.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:44:37.404+0000 7f71100d6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-08T12:44:37.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:44:37.404+0000 7f71100d6640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-08T12:44:37.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:44:37.404+0000 7f71100d6640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-08T12:44:37.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:44:37.404+0000 7f71100d6640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-08T12:44:37.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:44:37.404+0000 7f71100d6640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-08T12:44:40.270 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-08T12:44:40.303 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T12:44:40.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:44:40.395+0000 7fb933f65640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-08T12:44:40.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:44:40.395+0000 7fb933f65640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-08T12:44:40.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:44:40.395+0000 7fb933f65640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-08T12:44:40.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:44:40.395+0000 7fb933f65640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-08T12:44:40.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:44:40.395+0000 7fb933f65640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-08T12:44:40.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:44:40.396+0000 7fb933f65640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-08T12:44:43.266 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-08T12:44:43.299 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T12:44:43.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:44:43.392+0000 7f5847f00640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-08T12:44:43.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:44:43.392+0000 7f5847f00640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-08T12:44:43.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:44:43.392+0000 7f5847f00640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-08T12:44:43.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:44:43.392+0000 7f5847f00640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-08T12:44:43.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:44:43.392+0000 7f5847f00640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-08T12:44:43.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:44:43.393+0000 7f5847f00640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-08T12:44:46.265 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-08T12:44:46.297 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T12:44:46.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:44:46.391+0000 7f067012e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-08T12:44:46.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:44:46.391+0000 7f067012e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-08T12:44:46.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:44:46.391+0000 7f067012e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-08T12:44:46.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:44:46.391+0000 7f067012e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-08T12:44:46.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:44:46.391+0000 7f067012e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-08T12:44:46.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:44:46.391+0000 7f067012e640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-08T12:44:49.250 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-08T12:44:49.283 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-08T12:44:49.318 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T12:44:49.318 INFO:tasks.ceph:role: osd.4 2023-10-08T12:44:49.318 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com 2023-10-08T12:44:49.319 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-08T12:44:49.399 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T12:44:49.399 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T12:44:49.399 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T12:44:49.400 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-08T12:44:49.400 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T12:44:49.400 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-10-08T12:44:49.400 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T12:44:49.400 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T12:44:49.400 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T12:44:49.400 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T12:44:49.827 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2023-10-08T12:44:49.829 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-10-08T12:44:49.829 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-08T12:44:50.007 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-08T12:44:50.043 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-08T12:44:50.112 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T12:44:50.112 INFO:tasks.ceph:role: osd.5 2023-10-08T12:44:50.112 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com 2023-10-08T12:44:50.112 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-08T12:44:50.187 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T12:44:50.187 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T12:44:50.187 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T12:44:50.188 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-08T12:44:50.188 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T12:44:50.188 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-10-08T12:44:50.188 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T12:44:50.188 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T12:44:50.188 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T12:44:50.188 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T12:44:50.614 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2023-10-08T12:44:50.615 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-10-08T12:44:50.616 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-08T12:44:50.722 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-08T12:44:50.753 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-08T12:44:50.821 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T12:44:50.821 INFO:tasks.ceph:role: osd.6 2023-10-08T12:44:50.821 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com 2023-10-08T12:44:50.821 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-08T12:44:50.895 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T12:44:50.895 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T12:44:50.896 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T12:44:50.896 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-08T12:44:50.896 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T12:44:50.896 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-10-08T12:44:50.896 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T12:44:50.896 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T12:44:50.896 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T12:44:50.896 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T12:44:51.348 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2023-10-08T12:44:51.351 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-10-08T12:44:51.351 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-08T12:44:51.505 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-08T12:44:51.539 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-08T12:44:51.605 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T12:44:51.606 INFO:tasks.ceph:role: osd.7 2023-10-08T12:44:51.606 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com 2023-10-08T12:44:51.606 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-08T12:44:51.680 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T12:44:51.680 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T12:44:51.680 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T12:44:51.680 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-08T12:44:51.680 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T12:44:51.680 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-10-08T12:44:51.680 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T12:44:51.681 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T12:44:51.681 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T12:44:51.681 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T12:44:52.119 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2023-10-08T12:44:52.121 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-10-08T12:44:52.121 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-08T12:44:52.307 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-08T12:44:52.343 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T12:44:52.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:44:52.442+0000 7f6b9bfd7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-08T12:44:52.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:44:52.442+0000 7f6b9bfd7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-08T12:44:52.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:44:52.442+0000 7f6b9bfd7640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-08T12:44:52.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:44:52.442+0000 7f6b9bfd7640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-08T12:44:52.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:44:52.442+0000 7f6b9bfd7640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-08T12:44:52.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:44:52.443+0000 7f6b9bfd7640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-08T12:44:55.317 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-08T12:44:55.349 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T12:44:55.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:44:55.444+0000 7f8d72f57640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-08T12:44:55.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:44:55.444+0000 7f8d72f57640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-08T12:44:55.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:44:55.444+0000 7f8d72f57640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-08T12:44:55.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:44:55.444+0000 7f8d72f57640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-08T12:44:55.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:44:55.444+0000 7f8d72f57640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-08T12:44:55.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:44:55.445+0000 7f8d72f57640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-08T12:44:58.310 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-08T12:44:58.343 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T12:44:58.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:44:58.439+0000 7f4c4ecef640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-08T12:44:58.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:44:58.439+0000 7f4c4ecef640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-08T12:44:58.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:44:58.439+0000 7f4c4ecef640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-08T12:44:58.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:44:58.439+0000 7f4c4ecef640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-08T12:44:58.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:44:58.439+0000 7f4c4ecef640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-08T12:44:58.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:44:58.439+0000 7f4c4ecef640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-08T12:45:01.307 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-08T12:45:01.339 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T12:45:01.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:01.433+0000 7fef679e6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-08T12:45:01.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:01.433+0000 7fef679e6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-08T12:45:01.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:01.433+0000 7fef679e6640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-08T12:45:01.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:01.433+0000 7fef679e6640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-08T12:45:01.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:01.433+0000 7fef679e6640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-08T12:45:01.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:01.434+0000 7fef679e6640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-08T12:45:02.453 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:45:02.456 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:45:04.301 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-08T12:45:04.333 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-08T12:45:04.333 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:45:04.334 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-08T12:45:04.366 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:45:04.366 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-08T12:45:04.437 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:45:04.437 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-08T12:45:04.507 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:45:04.508 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-08T12:45:04.577 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:45:04.577 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-08T12:45:04.647 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:45:04.647 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-08T12:45:04.717 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:45:04.717 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-08T12:45:04.787 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T12:45:04.787 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-08T12:45:04.819 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T12:45:04.819 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-08T12:45:04.892 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T12:45:04.892 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-08T12:45:04.964 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T12:45:04.964 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-08T12:45:05.036 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T12:45:05.036 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-08T12:45:05.108 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T12:45:05.108 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-08T12:45:05.180 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T12:45:05.180 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-08T12:45:05.249 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:45:05.250 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-08T12:45:05.270 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:45:05.271 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-08T12:45:05.331 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T12:45:05.331 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-08T12:45:05.349 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T12:45:05.349 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-08T12:45:05.407 INFO:tasks.ceph:Adding keys to all mons... 2023-10-08T12:45:05.407 DEBUG:teuthology.orchestra.run.smithi045:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-08T12:45:05.409 DEBUG:teuthology.orchestra.run.smithi078:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-08T12:45:05.450 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr.y] 2023-10-08T12:45:05.451 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAypCJlBbJiOhAA2g7jj3lt5TdjUAnIJDTmQA== 2023-10-08T12:45:05.451 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-10-08T12:45:05.451 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAzpCJlc+UFDxAAAMHkpwnDYkbgIR4kUpPkTw== 2023-10-08T12:45:05.451 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-10-08T12:45:05.451 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAzpCJlXW9vFhAAWPTunfAJhHNwtQjNCxe9Kg== 2023-10-08T12:45:05.451 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.0] 2023-10-08T12:45:05.451 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQA1pCJlNwksGBAAdjaWjTcNe4FHEWmXjZxDPQ== 2023-10-08T12:45:05.451 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.1] 2023-10-08T12:45:05.451 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQA4pCJle9qmFxAAYAUFc2wHo8OdqaS1SIu/Vg== 2023-10-08T12:45:05.451 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.2] 2023-10-08T12:45:05.452 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQA7pCJlCBl2FxAAxD9Ud7clh2N8GhTHmL+1JQ== 2023-10-08T12:45:05.452 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.3] 2023-10-08T12:45:05.452 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQA+pCJlCateFxAAeSHMrnpEimeOS+iiAmf3BA== 2023-10-08T12:45:05.452 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr.x] 2023-10-08T12:45:05.452 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAzpCJl2JKJCxAAY84sn4d2TS/oQSVsxMRaOw== 2023-10-08T12:45:05.452 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-10-08T12:45:05.452 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAzpCJlyxX+GxAAtph5U6we17gVl3I/UmX1bw== 2023-10-08T12:45:05.452 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2023-10-08T12:45:05.452 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAzpCJlhvdXJBAAvhgxHr6hgoFt2ivG8Y0yDg== 2023-10-08T12:45:05.452 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.4] 2023-10-08T12:45:05.452 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBEpCJlS7dqGhAAGboQm+4YVm5bjoU5xcA+Qw== 2023-10-08T12:45:05.452 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.5] 2023-10-08T12:45:05.453 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBHpCJlcfaGGhAAp8zA/0m78ixdz+1wQREg4w== 2023-10-08T12:45:05.453 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.6] 2023-10-08T12:45:05.453 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBKpCJlIuI4GhAAWKHlm8wl0c3xxzu7ZOUSmQ== 2023-10-08T12:45:05.453 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.7] 2023-10-08T12:45:05.453 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBNpCJlgYPgGRAAxCNzKEMJ8o7rRaBvrSMWjg== 2023-10-08T12:45:05.453 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2023-10-08T12:45:05.453 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAzpCJli2jsKBAA5aEs8srGibREq3jyZkPnvA== 2023-10-08T12:45:05.453 INFO:teuthology.orchestra.run.smithi045.stdout:[client.2] 2023-10-08T12:45:05.453 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAzpCJlbr1ZLBAA6Ynm8b6XR0xC82fYfH+daQ== 2023-10-08T12:45:05.453 INFO:teuthology.orchestra.run.smithi045.stdout:[client.1] 2023-10-08T12:45:05.453 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAzpCJls2juLxAA0viRgFTgsppNsr8IjgAuhw== 2023-10-08T12:45:05.453 INFO:teuthology.orchestra.run.smithi045.stdout:[client.3] 2023-10-08T12:45:05.453 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAzpCJloOlLMxAAqNsTRZDNdi5Pqx8pABy09g== 2023-10-08T12:45:05.474 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.y] 2023-10-08T12:45:05.474 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQAypCJlBbJiOhAA2g7jj3lt5TdjUAnIJDTmQA== 2023-10-08T12:45:05.474 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2023-10-08T12:45:05.475 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQAzpCJlc+UFDxAAAMHkpwnDYkbgIR4kUpPkTw== 2023-10-08T12:45:05.475 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.c] 2023-10-08T12:45:05.475 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQAzpCJlXW9vFhAAWPTunfAJhHNwtQjNCxe9Kg== 2023-10-08T12:45:05.475 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.0] 2023-10-08T12:45:05.475 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQA1pCJlNwksGBAAdjaWjTcNe4FHEWmXjZxDPQ== 2023-10-08T12:45:05.475 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.1] 2023-10-08T12:45:05.475 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQA4pCJle9qmFxAAYAUFc2wHo8OdqaS1SIu/Vg== 2023-10-08T12:45:05.475 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.2] 2023-10-08T12:45:05.475 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQA7pCJlCBl2FxAAxD9Ud7clh2N8GhTHmL+1JQ== 2023-10-08T12:45:05.475 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.3] 2023-10-08T12:45:05.475 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQA+pCJlCateFxAAeSHMrnpEimeOS+iiAmf3BA== 2023-10-08T12:45:05.475 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.x] 2023-10-08T12:45:05.476 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQAzpCJl2JKJCxAAY84sn4d2TS/oQSVsxMRaOw== 2023-10-08T12:45:05.476 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.b] 2023-10-08T12:45:05.476 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQAzpCJlyxX+GxAAtph5U6we17gVl3I/UmX1bw== 2023-10-08T12:45:05.476 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.d] 2023-10-08T12:45:05.476 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQAzpCJlhvdXJBAAvhgxHr6hgoFt2ivG8Y0yDg== 2023-10-08T12:45:05.476 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.4] 2023-10-08T12:45:05.476 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBEpCJlS7dqGhAAGboQm+4YVm5bjoU5xcA+Qw== 2023-10-08T12:45:05.476 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.5] 2023-10-08T12:45:05.476 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBHpCJlcfaGGhAAp8zA/0m78ixdz+1wQREg4w== 2023-10-08T12:45:05.476 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.6] 2023-10-08T12:45:05.476 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBKpCJlIuI4GhAAWKHlm8wl0c3xxzu7ZOUSmQ== 2023-10-08T12:45:05.476 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.7] 2023-10-08T12:45:05.477 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBNpCJlgYPgGRAAxCNzKEMJ8o7rRaBvrSMWjg== 2023-10-08T12:45:05.477 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2023-10-08T12:45:05.477 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQAzpCJli2jsKBAA5aEs8srGibREq3jyZkPnvA== 2023-10-08T12:45:05.477 INFO:teuthology.orchestra.run.smithi078.stdout:[client.2] 2023-10-08T12:45:05.477 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQAzpCJlbr1ZLBAA6Ynm8b6XR0xC82fYfH+daQ== 2023-10-08T12:45:05.477 INFO:teuthology.orchestra.run.smithi078.stdout:[client.1] 2023-10-08T12:45:05.477 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQAzpCJls2juLxAA0viRgFTgsppNsr8IjgAuhw== 2023-10-08T12:45:05.477 INFO:teuthology.orchestra.run.smithi078.stdout:[client.3] 2023-10-08T12:45:05.477 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQAzpCJloOlLMxAAqNsTRZDNdi5Pqx8pABy09g== 2023-10-08T12:45:05.478 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T12:45:05.497 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T12:45:05.574 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T12:45:05.577 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T12:45:05.637 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T12:45:05.640 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T12:45:05.697 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T12:45:05.699 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T12:45:05.752 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T12:45:05.754 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T12:45:05.807 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T12:45:05.809 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T12:45:05.862 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T12:45:05.864 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T12:45:05.918 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T12:45:05.920 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T12:45:05.972 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T12:45:05.974 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T12:45:06.031 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T12:45:06.033 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T12:45:06.089 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T12:45:06.091 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T12:45:06.144 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T12:45:06.147 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T12:45:06.200 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T12:45:06.202 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T12:45:06.255 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T12:45:06.257 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T12:45:06.310 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T12:45:06.312 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T12:45:06.368 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T12:45:06.371 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T12:45:06.426 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T12:45:06.428 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T12:45:06.485 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T12:45:06.487 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T12:45:06.543 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-08T12:45:06.543 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-08T12:45:06.570 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T12:45:06.669 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-08T12:45:06.696 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-08T12:45:06.723 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T12:45:06.821 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-08T12:45:06.846 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-08T12:45:06.912 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T12:45:07.009 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-08T12:45:07.036 DEBUG:teuthology.orchestra.run.smithi045:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-08T12:45:07.038 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-08T12:45:07.092 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-08T12:45:07.092 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-08T12:45:07.093 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-08T12:45:07.095 INFO:tasks.ceph.mon.a:Started 2023-10-08T12:45:07.096 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-08T12:45:07.096 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-08T12:45:07.134 INFO:tasks.ceph.mon.b:Started 2023-10-08T12:45:07.135 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-08T12:45:07.135 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-08T12:45:07.136 INFO:tasks.ceph.mon.c:Started 2023-10-08T12:45:07.137 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-08T12:45:07.137 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-08T12:45:07.137 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-08T12:45:07.139 INFO:tasks.ceph.mgr.y:Started 2023-10-08T12:45:07.139 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-08T12:45:07.139 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-08T12:45:07.141 INFO:tasks.ceph.mgr.x:Started 2023-10-08T12:45:07.141 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2023-10-08T12:45:07.141 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2023-10-08T12:45:07.143 INFO:tasks.ceph:setting config [client] debug_client = 20 2023-10-08T12:45:07.143 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set client debug_client 20 2023-10-08T12:45:07.185 INFO:tasks.ceph:setting config [client] debug_ms = 1 2023-10-08T12:45:07.185 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set client debug_ms 1 2023-10-08T12:45:07.228 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2023-10-08T12:45:07.228 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2023-10-08T12:45:07.271 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2023-10-08T12:45:07.271 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2023-10-08T12:45:07.314 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2023-10-08T12:45:07.315 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set mds debug_mds 20 2023-10-08T12:45:07.357 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2023-10-08T12:45:07.357 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2023-10-08T12:45:07.400 INFO:tasks.ceph:setting config [mds] debug_ms = 1 2023-10-08T12:45:07.400 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set mds debug_ms 1 2023-10-08T12:45:07.443 INFO:tasks.ceph:setting config [mds] mds_bal_fragment_size_max = 10000 2023-10-08T12:45:07.443 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set mds mds_bal_fragment_size_max 10000 2023-10-08T12:45:07.487 INFO:tasks.ceph:setting config [mds] mds_bal_merge_size = 5 2023-10-08T12:45:07.487 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set mds mds_bal_merge_size 5 2023-10-08T12:45:07.531 INFO:tasks.ceph:setting config [mds] mds_bal_split_bits = 3 2023-10-08T12:45:07.532 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set mds mds_bal_split_bits 3 2023-10-08T12:45:07.574 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-10-08T12:45:07.573+0000 7fd6ecad2200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T12:45:07.590 INFO:tasks.ceph:setting config [mds] mds_bal_split_size = 100 2023-10-08T12:45:07.590 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set mds mds_bal_split_size 100 2023-10-08T12:45:07.641 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-10-08T12:45:07.641+0000 7fd6ecad2200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T12:45:07.650 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2023-10-08T12:45:07.651 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2023-10-08T12:45:07.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.647+0000 7f45007af700 1 -- 172.21.15.45:0/1915337726 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) v1 -- 0x7f44d4005160 con 0x7f44f81ec9c0 2023-10-08T12:45:07.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.640+0000 7f79b7d8d700 1 -- 172.21.15.45:0/3486629752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) v1 -- 0x7f7998000e80 con 0x7f79b01f1500 2023-10-08T12:45:07.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.652+0000 7f0013e97700 1 -- 172.21.15.45:0/524530532 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f000c0b3b60 msgr2=0x7f000c0c29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:07.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.652+0000 7f0013e97700 1 --2- 172.21.15.45:0/524530532 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f000c0b3b60 0x7f000c0c29b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efffc00e6d0 tx=0x7efffc00ea90 comp rx=0 tx=0).stop 2023-10-08T12:45:07.654 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2023-10-08T12:45:07.655 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2023-10-08T12:45:07.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.653+0000 7f0013e97700 1 -- 172.21.15.45:0/524530532 shutdown_connections 2023-10-08T12:45:07.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.653+0000 7f0013e97700 1 --2- 172.21.15.45:0/524530532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f000c0c2ef0 0x7f000c0b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.653+0000 7f0013e97700 1 --2- 172.21.15.45:0/524530532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efff8003a00 0x7f000c0b2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.653+0000 7f0013e97700 1 --2- 172.21.15.45:0/524530532 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f000c0b3b60 0x7f000c0c29b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.653+0000 7f0013e97700 1 -- 172.21.15.45:0/524530532 >> 172.21.15.45:0/524530532 conn(0x7f000c097a20 msgr2=0x7f000c15f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:07.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.654+0000 7f0013e97700 1 -- 172.21.15.45:0/524530532 shutdown_connections 2023-10-08T12:45:07.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.654+0000 7f0013e97700 1 -- 172.21.15.45:0/524530532 wait complete. 2023-10-08T12:45:07.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.656+0000 7f364d7fa700 1 -- 172.21.15.45:0/2901918181 <== mon.1 v2:172.21.15.78:3300/0 8 ==== config(2 keys) v1 ==== 48+0+0 (secure 0 0 0) 0x7f363c045b20 con 0x7f36500ca5c0 2023-10-08T12:45:07.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.656+0000 7f364d7fa700 1 -- 172.21.15.45:0/2901918181 <== mon.1 v2:172.21.15.78:3300/0 9 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v3)=0 v3) v1 ==== 114+0+0 (secure 0 0 0) 0x7f363c037070 con 0x7f36500ca5c0 2023-10-08T12:45:07.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.656+0000 7f8184ff9700 1 -- 172.21.15.45:0/51271651 <== mon.0 v2:172.21.15.45:3300/0 8 ==== config(2 keys) v1 ==== 48+0+0 (secure 0 0 0) 0x7f81800279c0 con 0x7f81880c3630 2023-10-08T12:45:07.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.656+0000 7f79a67fc700 1 -- 172.21.15.45:0/3486629752 <== mon.1 v2:172.21.15.78:3300/0 8 ==== config(2 keys) v1 ==== 48+0+0 (secure 0 0 0) 0x7f79a8004170 con 0x7f79b01f1500 2023-10-08T12:45:07.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.656+0000 7f5b5e7fc700 1 -- 172.21.15.45:0/974119111 <== mon.0 v2:172.21.15.45:3300/0 8 ==== config(2 keys) v1 ==== 48+0+0 (secure 0 0 0) 0x7f5b60010640 con 0x7f5b6815f240 2023-10-08T12:45:07.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.657+0000 7f44eeffd700 1 -- 172.21.15.45:0/1915337726 <== mon.0 v2:172.21.15.45:3300/0 8 ==== config(2 keys) v1 ==== 48+0+0 (secure 0 0 0) 0x7f44f4003b50 con 0x7f44f81ec9c0 2023-10-08T12:45:07.661 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2023-10-08T12:45:07.661 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2023-10-08T12:45:07.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.657+0000 7f800ffff700 1 -- 172.21.15.45:0/1557290731 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f801c018420 con 0x7f80280b1fe0 2023-10-08T12:45:07.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.657+0000 7f800ffff700 1 -- 172.21.15.45:0/1557290731 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f801c014070 con 0x7f80280b1fe0 2023-10-08T12:45:07.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.660+0000 7f802d8d9700 1 -- 172.21.15.45:0/1557290731 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80280cca70 con 0x7f80280b1fe0 2023-10-08T12:45:07.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.662+0000 7f800ffff700 1 -- 172.21.15.45:0/1557290731 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f801c026060 con 0x7f80280b1fe0 2023-10-08T12:45:07.670 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2023-10-08T12:45:07.670 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2023-10-08T12:45:07.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.666+0000 7f3656b02700 1 -- 172.21.15.45:0/2901918181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36500ca5c0 msgr2=0x7f36500caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:07.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.666+0000 7f3656b02700 1 --2- 172.21.15.45:0/2901918181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36500ca5c0 0x7f36500caa40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f363c003e70 tx=0x7f363c001540 comp rx=0 tx=0).stop 2023-10-08T12:45:07.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.666+0000 7f3656b02700 1 -- 172.21.15.45:0/2901918181 shutdown_connections 2023-10-08T12:45:07.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.666+0000 7f3656b02700 1 --2- 172.21.15.45:0/2901918181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3650150130 0x7f36501505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.666+0000 7f3656b02700 1 --2- 172.21.15.45:0/2901918181 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3640003a00 0x7f3650138850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.666+0000 7f3656b02700 1 --2- 172.21.15.45:0/2901918181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36500ca5c0 0x7f36500caa40 secure :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f363c003e70 tx=0x7f363c001540 comp rx=0 tx=0).stop 2023-10-08T12:45:07.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.666+0000 7f3656b02700 1 -- 172.21.15.45:0/2901918181 >> 172.21.15.45:0/2901918181 conn(0x7f36500cddb0 msgr2=0x7f365006cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:07.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.667+0000 7f3656b02700 1 -- 172.21.15.45:0/2901918181 shutdown_connections 2023-10-08T12:45:07.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.670+0000 7f3656b02700 1 -- 172.21.15.45:0/2901918181 wait complete. 2023-10-08T12:45:07.686 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2023-10-08T12:45:07.686 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2023-10-08T12:45:07.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.681+0000 7f818e6b7700 1 -- 172.21.15.45:0/51271651 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) v1 -- 0x7f8160005160 con 0x7f81880c3630 2023-10-08T12:45:07.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.690+0000 7f8184ff9700 1 -- 172.21.15.45:0/51271651 <== mon.0 v2:172.21.15.45:3300/0 9 ==== config(3 keys) v1 ==== 79+0+0 (secure 0 0 0) 0x7f8180027be0 con 0x7f81880c3630 2023-10-08T12:45:07.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.691+0000 7f5b5e7fc700 1 -- 172.21.15.45:0/974119111 <== mon.0 v2:172.21.15.45:3300/0 9 ==== config(3 keys) v1 ==== 79+0+0 (secure 0 0 0) 0x7f5b600108a0 con 0x7f5b6815f240 2023-10-08T12:45:07.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.693+0000 7f800ffff700 1 -- 172.21.15.45:0/1557290731 <== mon.2 v2:172.21.15.78:3301/0 7 ==== config(3 keys) v1 ==== 79+0+0 (secure 0 0 0) 0x7f801c018910 con 0x7f80280b1fe0 2023-10-08T12:45:07.703 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2023-10-08T12:45:07.703 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2023-10-08T12:45:07.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.690+0000 7f44eeffd700 1 -- 172.21.15.45:0/1915337726 <== mon.0 v2:172.21.15.45:3300/0 9 ==== config(3 keys) v1 ==== 79+0+0 (secure 0 0 0) 0x7f44f4003d40 con 0x7f44f81ec9c0 2023-10-08T12:45:07.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.693+0000 7f79a67fc700 1 -- 172.21.15.45:0/3486629752 <== mon.1 v2:172.21.15.78:3300/0 9 ==== config(3 keys) v1 ==== 79+0+0 (secure 0 0 0) 0x7f79a8029430 con 0x7f79b01f1500 2023-10-08T12:45:07.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.693+0000 7f79a67fc700 1 -- 172.21.15.45:0/3486629752 <== mon.1 v2:172.21.15.78:3300/0 10 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v4)=0 v4) v1 ==== 123+0+0 (secure 0 0 0) 0x7f79a8029620 con 0x7f79b01f1500 2023-10-08T12:45:07.704 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-08T12:45:07.696+0000 7facc4800200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T12:45:07.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.697+0000 7f44eeffd700 1 -- 172.21.15.45:0/1915337726 <== mon.0 v2:172.21.15.45:3300/0 10 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v5)=0 v5) v1 ==== 123+0+0 (secure 0 0 0) 0x7f44f4010af0 con 0x7f44f81ec9c0 2023-10-08T12:45:07.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.699+0000 7f44eeffd700 1 -- 172.21.15.45:0/1915337726 <== mon.0 v2:172.21.15.45:3300/0 11 ==== config(4 keys) v1 ==== 110+0+0 (secure 0 0 0) 0x7f44f4010e70 con 0x7f44f81ec9c0 2023-10-08T12:45:07.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.699+0000 7f8184ff9700 1 -- 172.21.15.45:0/51271651 <== mon.0 v2:172.21.15.45:3300/0 10 ==== config(4 keys) v1 ==== 110+0+0 (secure 0 0 0) 0x7f818001d710 con 0x7f81880c3630 2023-10-08T12:45:07.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.699+0000 7f5b5e7fc700 1 -- 172.21.15.45:0/974119111 <== mon.0 v2:172.21.15.45:3300/0 10 ==== config(4 keys) v1 ==== 110+0+0 (secure 0 0 0) 0x7f5b6000e440 con 0x7f5b6815f240 2023-10-08T12:45:07.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.702+0000 7f79a67fc700 1 -- 172.21.15.45:0/3486629752 <== mon.1 v2:172.21.15.78:3300/0 11 ==== config(4 keys) v1 ==== 110+0+0 (secure 0 0 0) 0x7f79a8029880 con 0x7f79b01f1500 2023-10-08T12:45:07.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.704+0000 7f44eeffd700 1 -- 172.21.15.45:0/1915337726 <== mon.0 v2:172.21.15.45:3300/0 12 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f44f4026470 con 0x7f44f81ec9c0 2023-10-08T12:45:07.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.705+0000 7f8184ff9700 1 -- 172.21.15.45:0/51271651 <== mon.0 v2:172.21.15.45:3300/0 11 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v6)=0 v6) v1 ==== 123+0+0 (secure 0 0 0) 0x7f818001d970 con 0x7f81880c3630 2023-10-08T12:45:07.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.705+0000 7f8184ff9700 1 -- 172.21.15.45:0/51271651 <== mon.0 v2:172.21.15.45:3300/0 12 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f818001dbe0 con 0x7f81880c3630 2023-10-08T12:45:07.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.704+0000 7f5b5e7fc700 1 -- 172.21.15.45:0/974119111 <== mon.0 v2:172.21.15.45:3300/0 11 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5b6000e890 con 0x7f5b6815f240 2023-10-08T12:45:07.709 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2023-10-08T12:45:07.709 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2023-10-08T12:45:07.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.708+0000 7f45007af700 1 -- 172.21.15.45:0/1915337726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44f81ec9c0 msgr2=0x7f44f8154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:07.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.708+0000 7f45007af700 1 --2- 172.21.15.45:0/1915337726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44f81ec9c0 0x7f44f8154b80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f44f4000fb0 tx=0x7f44f4000fe0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.707+0000 7f79a67fc700 1 -- 172.21.15.45:0/3486629752 <== mon.1 v2:172.21.15.78:3300/0 12 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f79a8029ae0 con 0x7f79b01f1500 2023-10-08T12:45:07.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.708+0000 7f800ffff700 1 -- 172.21.15.45:0/1557290731 <== mon.2 v2:172.21.15.78:3301/0 8 ==== config(4 keys) v1 ==== 110+0+0 (secure 0 0 0) 0x7f801c018b90 con 0x7f80280b1fe0 2023-10-08T12:45:07.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.708+0000 7f800ffff700 1 -- 172.21.15.45:0/1557290731 <== mon.2 v2:172.21.15.78:3301/0 9 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f801c00f5a0 con 0x7f80280b1fe0 2023-10-08T12:45:07.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.709+0000 7f45007af700 1 -- 172.21.15.45:0/1915337726 shutdown_connections 2023-10-08T12:45:07.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.709+0000 7f45007af700 1 --2- 172.21.15.45:0/1915337726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44f80cd890 0x7f44f80cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.709+0000 7f45007af700 1 --2- 172.21.15.45:0/1915337726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44f81ec9c0 0x7f44f8154b80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.709+0000 7f45007af700 1 --2- 172.21.15.45:0/1915337726 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f44f8152350 0x7f44f8148420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.709+0000 7f45007af700 1 -- 172.21.15.45:0/1915337726 >> 172.21.15.45:0/1915337726 conn(0x7f44f80af690 msgr2=0x7f44f8065fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:07.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.709+0000 7f45007af700 1 -- 172.21.15.45:0/1915337726 shutdown_connections 2023-10-08T12:45:07.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.709+0000 7f45007af700 1 -- 172.21.15.45:0/1915337726 wait complete. 2023-10-08T12:45:07.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.721+0000 7f79b7d8d700 1 -- 172.21.15.45:0/3486629752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79b01f1500 msgr2=0x7f79b01f1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:07.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.721+0000 7f79b7d8d700 1 --2- 172.21.15.45:0/3486629752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79b01f1500 0x7f79b01f1980 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f79b0071060 tx=0x7f79a800f430 comp rx=0 tx=0).stop 2023-10-08T12:45:07.722 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-10-08T12:45:07.722+0000 7fd6ecad2200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T12:45:07.761 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2023-10-08T12:45:07.763 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2023-10-08T12:45:07.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.725+0000 7f818e6b7700 1 -- 172.21.15.45:0/51271651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81880c3630 msgr2=0x7f818809c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:07.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.725+0000 7f818e6b7700 1 --2- 172.21.15.45:0/51271651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81880c3630 0x7f818809c0b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f81880cbb20 tx=0x7f81800065e0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.725+0000 7f818e6b7700 1 -- 172.21.15.45:0/51271651 shutdown_connections 2023-10-08T12:45:07.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.725+0000 7f818e6b7700 1 --2- 172.21.15.45:0/51271651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81880c3630 0x7f818809c0b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.725+0000 7f818e6b7700 1 --2- 172.21.15.45:0/51271651 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f81881593c0 0x7f81880c30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.725+0000 7f818e6b7700 1 --2- 172.21.15.45:0/51271651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81881597a0 0x7f818809bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.725+0000 7f818e6b7700 1 -- 172.21.15.45:0/51271651 >> 172.21.15.45:0/51271651 conn(0x7f8188097a20 msgr2=0x7f81880ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:07.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.726+0000 7f818e6b7700 1 -- 172.21.15.45:0/51271651 shutdown_connections 2023-10-08T12:45:07.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.726+0000 7f818e6b7700 1 -- 172.21.15.45:0/51271651 wait complete. 2023-10-08T12:45:07.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.724+0000 7f79b7d8d700 1 -- 172.21.15.45:0/3486629752 shutdown_connections 2023-10-08T12:45:07.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.724+0000 7f79b7d8d700 1 --2- 172.21.15.45:0/3486629752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79b01f1500 0x7f79b01f1980 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.724+0000 7f79b7d8d700 1 --2- 172.21.15.45:0/3486629752 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f79b0147130 0x7f79b0147510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.724+0000 7f79b7d8d700 1 --2- 172.21.15.45:0/3486629752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79b01f2110 0x7f79b00c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.724+0000 7f79b7d8d700 1 -- 172.21.15.45:0/3486629752 >> 172.21.15.45:0/3486629752 conn(0x7f79b0097a20 msgr2=0x7f79b006e940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:07.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.729+0000 7f79b7d8d700 1 -- 172.21.15.45:0/3486629752 shutdown_connections 2023-10-08T12:45:07.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.729+0000 7f79b7d8d700 1 -- 172.21.15.45:0/3486629752 wait complete. 2023-10-08T12:45:07.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.742+0000 7f5b6fba4700 1 -- 172.21.15.45:0/974119111 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) v1 -- 0x7f5b44005350 con 0x7f5b6815f240 2023-10-08T12:45:07.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.758+0000 7f5b5e7fc700 1 -- 172.21.15.45:0/974119111 <== mon.0 v2:172.21.15.45:3300/0 12 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v7)=0 v7) v1 ==== 108+0+0 (secure 0 0 0) 0x7f5b6000ebe0 con 0x7f5b6815f240 2023-10-08T12:45:07.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.749+0000 7f9356103700 1 -- 172.21.15.45:0/366741438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9350070d00 msgr2=0x7f93500b1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:07.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.749+0000 7f9356103700 1 --2- 172.21.15.45:0/366741438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9350070d00 0x7f93500b1aa0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f93500ce530 tx=0x7f9344009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:07.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.750+0000 7f9356103700 1 -- 172.21.15.45:0/366741438 shutdown_connections 2023-10-08T12:45:07.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.750+0000 7f9356103700 1 --2- 172.21.15.45:0/366741438 >> v2:172.21.15.45:3300/0 conn(0x7f93500b1fe0 0x7f93500ab720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.750+0000 7f9356103700 1 --2- 172.21.15.45:0/366741438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9350070d00 0x7f93500b1aa0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.750+0000 7f9356103700 1 -- 172.21.15.45:0/366741438 >> 172.21.15.45:0/366741438 conn(0x7f93500cd4b0 msgr2=0x7f93500cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:07.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.760+0000 7f9356103700 1 -- 172.21.15.45:0/366741438 shutdown_connections 2023-10-08T12:45:07.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.761+0000 7f9356103700 1 -- 172.21.15.45:0/366741438 wait complete. 2023-10-08T12:45:07.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.763+0000 7f9356103700 1 Processor -- start 2023-10-08T12:45:07.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.764+0000 7f9356103700 1 -- start start 2023-10-08T12:45:07.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.765+0000 7f9356103700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9350070920 0x7f93500ae630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:07.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.765+0000 7f9356103700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9350070d00 0x7f935006d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:07.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.765+0000 7f9356103700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f93500b1fe0 0x7f935014a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:07.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.765+0000 7f9356103700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935006e090 con 0x7f9350070d00 2023-10-08T12:45:07.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.765+0000 7f9356103700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935014ac10 con 0x7f9350070920 2023-10-08T12:45:07.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.765+0000 7f9356103700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93500ae3f0 con 0x7f93500b1fe0 2023-10-08T12:45:07.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.767+0000 7f934ffff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f93500b1fe0 0x7f935014a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:07.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.767+0000 7f934ffff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f93500b1fe0 0x7f935014a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.45:36006/0 (socket says 172.21.15.45:36006) 2023-10-08T12:45:07.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.767+0000 7f934ffff700 1 -- 172.21.15.45:0/1956463178 learned_addr learned my addr 172.21.15.45:0/1956463178 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:07.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.767+0000 7f934f7fe700 1 --2- 172.21.15.45:0/1956463178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9350070920 0x7f93500ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:07.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.769+0000 7f934f7fe700 1 -- 172.21.15.45:0/1956463178 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f93500b1fe0 msgr2=0x7f935014a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:07.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.769+0000 7f934f7fe700 1 --2- 172.21.15.45:0/1956463178 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f93500b1fe0 0x7f935014a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.769+0000 7f934f7fe700 1 -- 172.21.15.45:0/1956463178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9350070d00 msgr2=0x7f935006d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:07.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.769+0000 7f934f7fe700 1 --2- 172.21.15.45:0/1956463178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9350070d00 0x7f935006d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.769+0000 7f934f7fe700 1 -- 172.21.15.45:0/1956463178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93440095f0 con 0x7f9350070920 2023-10-08T12:45:07.783 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2023-10-08T12:45:07.783 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2023-10-08T12:45:07.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.769+0000 7f934f7fe700 1 --2- 172.21.15.45:0/1956463178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9350070920 0x7f93500ae630 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f934000c3e0 tx=0x7f934000c6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:07.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.779+0000 7f5b6fba4700 1 -- 172.21.15.45:0/974119111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b6815f240 msgr2=0x7f5b680ad010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:07.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.779+0000 7f5b6fba4700 1 --2- 172.21.15.45:0/974119111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b6815f240 0x7f5b680ad010 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5b6000c680 tx=0x7f5b6000c990 comp rx=0 tx=0).stop 2023-10-08T12:45:07.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.779+0000 7f5b6fba4700 1 -- 172.21.15.45:0/974119111 shutdown_connections 2023-10-08T12:45:07.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.779+0000 7f5b6fba4700 1 --2- 172.21.15.45:0/974119111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b6815f240 0x7f5b680ad010 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.779+0000 7f5b6fba4700 1 --2- 172.21.15.45:0/974119111 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5b6806d440 0x7f5b6815d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.779+0000 7f5b6fba4700 1 --2- 172.21.15.45:0/974119111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b68070bf0 0x7f5b681514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.779+0000 7f5b6fba4700 1 -- 172.21.15.45:0/974119111 >> 172.21.15.45:0/974119111 conn(0x7f5b680cd4b0 msgr2=0x7f5b68155520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:07.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.779+0000 7f5b6fba4700 1 -- 172.21.15.45:0/974119111 shutdown_connections 2023-10-08T12:45:07.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.779+0000 7f5b6fba4700 1 -- 172.21.15.45:0/974119111 wait complete. 2023-10-08T12:45:07.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.794+0000 7f802d8d9700 1 -- 172.21.15.45:0/1557290731 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) v1 -- 0x7f8000005350 con 0x7f80280b1fe0 2023-10-08T12:45:07.803 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-10-08T12:45:07.803+0000 7fd6ecad2200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T12:45:07.829 DEBUG:tasks.ceph:set 21 configs 2023-10-08T12:45:07.829 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi045') 2023-10-08T12:45:07.830 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi045') 2023-10-08T12:45:07.830 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi045') 2023-10-08T12:45:07.830 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi045') 2023-10-08T12:45:07.830 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi045') 2023-10-08T12:45:07.831 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi045') 2023-10-08T12:45:07.831 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi045') 2023-10-08T12:45:07.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.800+0000 7f9337fff700 1 -- 172.21.15.45:0/1956463178 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934000cea0 con 0x7f9350070920 2023-10-08T12:45:07.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.800+0000 7f9337fff700 1 -- 172.21.15.45:0/1956463178 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f93400054e0 con 0x7f9350070920 2023-10-08T12:45:07.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.800+0000 7f9337fff700 1 -- 172.21.15.45:0/1956463178 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93400038e0 con 0x7f9350070920 2023-10-08T12:45:07.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.808+0000 7f9356103700 1 -- 172.21.15.45:0/1956463178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93500ae110 con 0x7f9350070920 2023-10-08T12:45:07.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.808+0000 7f9356103700 1 -- 172.21.15.45:0/1956463178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9350149ed0 con 0x7f9350070920 2023-10-08T12:45:07.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.810+0000 7f9356103700 1 -- 172.21.15.45:0/1956463178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93300052f0 con 0x7f9350070920 2023-10-08T12:45:07.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.816+0000 7f9337fff700 1 -- 172.21.15.45:0/1956463178 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9340003d40 con 0x7f9350070920 2023-10-08T12:45:07.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.816+0000 7f9337fff700 1 -- 172.21.15.45:0/1956463178 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9340007670 con 0x7f9350070920 2023-10-08T12:45:07.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.816+0000 7f9337fff700 1 -- 172.21.15.45:0/1956463178 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f9340017070 con 0x7f9350070920 2023-10-08T12:45:07.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.850+0000 7f800ffff700 1 -- 172.21.15.45:0/1557290731 <== mon.2 v2:172.21.15.78:3301/0 10 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v8)=0 v8) v1 ==== 117+0+0 (secure 0 0 0) 0x7f801c00f9e0 con 0x7f80280b1fe0 2023-10-08T12:45:07.861 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-08T12:45:07.849+0000 7facc4800200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T12:45:07.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.874+0000 7f802d8d9700 1 -- 172.21.15.45:0/1557290731 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80280b1fe0 msgr2=0x7f80281532b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:07.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.874+0000 7f802d8d9700 1 --2- 172.21.15.45:0/1557290731 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80280b1fe0 0x7f80281532b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f802806c350 tx=0x7f801c00ec20 comp rx=0 tx=0).stop 2023-10-08T12:45:07.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.884+0000 7f802d8d9700 1 -- 172.21.15.45:0/1557290731 shutdown_connections 2023-10-08T12:45:07.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.884+0000 7f802d8d9700 1 --2- 172.21.15.45:0/1557290731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f802814b840 0x7f80281374d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.884+0000 7f802d8d9700 1 --2- 172.21.15.45:0/1557290731 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80280b1fe0 0x7f80281532b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.884+0000 7f802d8d9700 1 --2- 172.21.15.45:0/1557290731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f802814b3c0 0x7f8028136f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.884+0000 7f802d8d9700 1 -- 172.21.15.45:0/1557290731 >> 172.21.15.45:0/1557290731 conn(0x7f80280cd4b0 msgr2=0x7f80280b02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:07.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.885+0000 7f802d8d9700 1 -- 172.21.15.45:0/1557290731 shutdown_connections 2023-10-08T12:45:07.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.885+0000 7f802d8d9700 1 -- 172.21.15.45:0/1557290731 wait complete. 2023-10-08T12:45:07.939 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '1'], check_status=True, hostname='smithi045') 2023-10-08T12:45:07.948 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-10-08T12:45:07.948+0000 7fd6ecad2200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T12:45:07.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.986+0000 7f47301a9700 1 -- 172.21.15.45:0/2005293088 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4728070d00 msgr2=0x7f47280b1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:07.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.986+0000 7f47301a9700 1 --2- 172.21.15.45:0/2005293088 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4728070d00 0x7f47280b1aa0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4720009f90 tx=0x7f472000b330 comp rx=0 tx=0).stop 2023-10-08T12:45:07.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.987+0000 7f47301a9700 1 -- 172.21.15.45:0/2005293088 shutdown_connections 2023-10-08T12:45:07.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.987+0000 7f47301a9700 1 --2- 172.21.15.45:0/2005293088 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4728070d00 0x7f47280b1aa0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.987+0000 7f47301a9700 1 -- 172.21.15.45:0/2005293088 >> 172.21.15.45:0/2005293088 conn(0x7f47280cd4b0 msgr2=0x7f47280cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:07.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.987+0000 7f47301a9700 1 -- 172.21.15.45:0/2005293088 shutdown_connections 2023-10-08T12:45:07.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.987+0000 7f47301a9700 1 -- 172.21.15.45:0/2005293088 wait complete. 2023-10-08T12:45:07.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.989+0000 7f47301a9700 1 Processor -- start 2023-10-08T12:45:07.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.990+0000 7f47301a9700 1 -- start start 2023-10-08T12:45:07.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.991+0000 7f47301a9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4728070920 0x7f4728153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:07.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.991+0000 7f47301a9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4728070d00 0x7f4728153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:07.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.991+0000 7f47301a9700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f47280b1fe0 0x7f4728159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:07.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.991+0000 7f47301a9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47281598f0 con 0x7f4728070920 2023-10-08T12:45:07.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.991+0000 7f47301a9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4728158ce0 con 0x7f4728070d00 2023-10-08T12:45:07.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.991+0000 7f47301a9700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4728158fc0 con 0x7f47280b1fe0 2023-10-08T12:45:07.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.991+0000 7f472e746700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f47280b1fe0 0x7f4728159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:07.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.991+0000 7f472e746700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f47280b1fe0 0x7f4728159d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.45:36028/0 (socket says 172.21.15.45:36028) 2023-10-08T12:45:07.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.991+0000 7f472e746700 1 -- 172.21.15.45:0/687369116 learned_addr learned my addr 172.21.15.45:0/687369116 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:07.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.992+0000 7f472d744700 1 --2- 172.21.15.45:0/687369116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4728070d00 0x7f4728153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:07.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.992+0000 7f472e746700 1 -- 172.21.15.45:0/687369116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4728070d00 msgr2=0x7f4728153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:07.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.992+0000 7f472e746700 1 --2- 172.21.15.45:0/687369116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4728070d00 0x7f4728153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.992+0000 7f472e746700 1 -- 172.21.15.45:0/687369116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4728070920 msgr2=0x7f4728153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:07.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.992+0000 7f472e746700 1 --2- 172.21.15.45:0/687369116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4728070920 0x7f4728153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:07.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.992+0000 7f472e746700 1 -- 172.21.15.45:0/687369116 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4720009c40 con 0x7f47280b1fe0 2023-10-08T12:45:07.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.994+0000 7f52b97ee700 1 -- 172.21.15.45:0/1750093157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52b4070d00 msgr2=0x7f52b40b1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:07.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.994+0000 7f52b97ee700 1 --2- 172.21.15.45:0/1750093157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52b4070d00 0x7f52b40b1aa0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f52b40aa860 tx=0x7f52ac00b380 comp rx=0 tx=0).stop 2023-10-08T12:45:07.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.999+0000 7fc25759e700 1 -- 172.21.15.45:0/1122451243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2580ac4f0 msgr2=0x7fc2580c7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:07.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:07.999+0000 7fc25759e700 1 --2- 172.21.15.45:0/1122451243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2580ac4f0 0x7fc2580c7910 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc250009fd0 tx=0x7fc25000b380 comp rx=0 tx=0).stop 2023-10-08T12:45:08.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.001+0000 7f472e746700 1 --2- 172.21.15.45:0/687369116 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f47280b1fe0 0x7f4728159d80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f472400c390 tx=0x7f472400c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:08.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.002+0000 7f52b97ee700 1 -- 172.21.15.45:0/1750093157 shutdown_connections 2023-10-08T12:45:08.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.002+0000 7f52b97ee700 1 --2- 172.21.15.45:0/1750093157 >> v2:172.21.15.78:3300/0 conn(0x7f52b40b1fe0 0x7f52b40ab720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.002+0000 7f52b97ee700 1 --2- 172.21.15.45:0/1750093157 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f52b4070920 0x7f52b406cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.002+0000 7f52b97ee700 1 --2- 172.21.15.45:0/1750093157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52b4070d00 0x7f52b40b1aa0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.002+0000 7f52b97ee700 1 -- 172.21.15.45:0/1750093157 >> 172.21.15.45:0/1750093157 conn(0x7f52b40cd4b0 msgr2=0x7f52b40cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.003+0000 7f471e7fc700 1 -- 172.21.15.45:0/687369116 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4724004230 con 0x7f47280b1fe0 2023-10-08T12:45:08.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.003+0000 7f471e7fc700 1 -- 172.21.15.45:0/687369116 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f47240044a0 con 0x7f47280b1fe0 2023-10-08T12:45:08.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.003+0000 7f471e7fc700 1 -- 172.21.15.45:0/687369116 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47240038e0 con 0x7f47280b1fe0 2023-10-08T12:45:08.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.003+0000 7f47301a9700 1 -- 172.21.15.45:0/687369116 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47281592a0 con 0x7f47280b1fe0 2023-10-08T12:45:08.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.003+0000 7f47301a9700 1 -- 172.21.15.45:0/687369116 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4728154640 con 0x7f47280b1fe0 2023-10-08T12:45:08.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.008+0000 7fc25759e700 1 -- 172.21.15.45:0/1122451243 shutdown_connections 2023-10-08T12:45:08.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.008+0000 7fc25759e700 1 --2- 172.21.15.45:0/1122451243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2580ac4f0 0x7fc2580c7910 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.008+0000 7fc25759e700 1 -- 172.21.15.45:0/1122451243 >> 172.21.15.45:0/1122451243 conn(0x7fc2580cd2c0 msgr2=0x7fc2580cd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.008+0000 7fc25759e700 1 -- 172.21.15.45:0/1122451243 shutdown_connections 2023-10-08T12:45:08.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.008+0000 7fc25759e700 1 -- 172.21.15.45:0/1122451243 wait complete. 2023-10-08T12:45:08.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.010+0000 7f471e7fc700 1 -- 172.21.15.45:0/687369116 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4724003d40 con 0x7f47280b1fe0 2023-10-08T12:45:08.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.010+0000 7f471e7fc700 1 -- 172.21.15.45:0/687369116 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f472401c780 con 0x7f47280b1fe0 2023-10-08T12:45:08.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.010+0000 7fc25759e700 1 Processor -- start 2023-10-08T12:45:08.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.010+0000 7fc25759e700 1 -- start start 2023-10-08T12:45:08.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.012+0000 7fc25759e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc2580ac4f0 0x7fc25809a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.012+0000 7fc25759e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2580c9a80 0x7fc25806c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.012+0000 7fc25759e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2580ccdf0 0x7fc25806ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.012+0000 7fc25759e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2581ff180 con 0x7fc2580c9a80 2023-10-08T12:45:08.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.012+0000 7fc25759e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2581fe8c0 con 0x7fc2580ccdf0 2023-10-08T12:45:08.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.012+0000 7fc25759e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2581feb30 con 0x7fc2580ac4f0 2023-10-08T12:45:08.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.012+0000 7fc25659c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc2580ac4f0 0x7fc25809a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.013+0000 7fc25659c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc2580ac4f0 0x7fc25809a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.45:36034/0 (socket says 172.21.15.45:36034) 2023-10-08T12:45:08.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.013+0000 7fc25659c700 1 -- 172.21.15.45:0/3921290710 learned_addr learned my addr 172.21.15.45:0/3921290710 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:08.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.013+0000 7fc256d9d700 1 --2- 172.21.15.45:0/3921290710 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2580ccdf0 0x7fc25806ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.013+0000 7fc255d9b700 1 --2- 172.21.15.45:0/3921290710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2580c9a80 0x7fc25806c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.013+0000 7fc25659c700 1 -- 172.21.15.45:0/3921290710 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2580ccdf0 msgr2=0x7fc25806ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.013+0000 7fc25659c700 1 --2- 172.21.15.45:0/3921290710 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2580ccdf0 0x7fc25806ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.013+0000 7fc25659c700 1 -- 172.21.15.45:0/3921290710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2580c9a80 msgr2=0x7fc25806c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.013+0000 7fc25659c700 1 --2- 172.21.15.45:0/3921290710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2580c9a80 0x7fc25806c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.013+0000 7fc25659c700 1 -- 172.21.15.45:0/3921290710 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc250009d00 con 0x7fc2580ac4f0 2023-10-08T12:45:08.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.014+0000 7fc25659c700 1 --2- 172.21.15.45:0/3921290710 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc2580ac4f0 0x7fc25809a3f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc24800c510 tx=0x7fc24800c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:08.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.014+0000 7fc246ffd700 1 -- 172.21.15.45:0/3921290710 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2480052d0 con 0x7fc2580ac4f0 2023-10-08T12:45:08.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.014+0000 7fc246ffd700 1 -- 172.21.15.45:0/3921290710 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc248005520 con 0x7fc2580ac4f0 2023-10-08T12:45:08.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.014+0000 7fc246ffd700 1 -- 172.21.15.45:0/3921290710 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2480038e0 con 0x7fc2580ac4f0 2023-10-08T12:45:08.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.015+0000 7fc25759e700 1 -- 172.21.15.45:0/3921290710 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2581fee10 con 0x7fc2580ac4f0 2023-10-08T12:45:08.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.015+0000 7fc25759e700 1 -- 172.21.15.45:0/3921290710 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2580b0d60 con 0x7fc2580ac4f0 2023-10-08T12:45:08.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.020+0000 7f9356103700 1 -- 172.21.15.45:0/1956463178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) v1 -- 0x7f9330005640 con 0x7f9350070920 2023-10-08T12:45:08.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.020+0000 7fc246ffd700 1 -- 172.21.15.45:0/3921290710 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc248003d40 con 0x7fc2580ac4f0 2023-10-08T12:45:08.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.020+0000 7fc246ffd700 1 -- 172.21.15.45:0/3921290710 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc24801c780 con 0x7fc2580ac4f0 2023-10-08T12:45:08.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.022+0000 7fc25759e700 1 -- 172.21.15.45:0/3921290710 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc23c0052f0 con 0x7fc2580ac4f0 2023-10-08T12:45:08.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.020+0000 7f52b97ee700 1 -- 172.21.15.45:0/1750093157 shutdown_connections 2023-10-08T12:45:08.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.021+0000 7f52b97ee700 1 -- 172.21.15.45:0/1750093157 wait complete. 2023-10-08T12:45:08.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.023+0000 7f52b97ee700 1 Processor -- start 2023-10-08T12:45:08.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.020+0000 7f47301a9700 1 -- 172.21.15.45:0/687369116 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47100052f0 con 0x7f47280b1fe0 2023-10-08T12:45:08.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.023+0000 7f52b97ee700 1 -- start start 2023-10-08T12:45:08.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.024+0000 7f52b97ee700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f52b4070920 0x7f52b41f4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.024+0000 7f52b97ee700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52b4070d00 0x7f52b4140f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.024+0000 7f52b97ee700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b40b1fe0 0x7f52b40a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.024+0000 7f52b97ee700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b413fc00 con 0x7f52b4070d00 2023-10-08T12:45:08.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.024+0000 7f52b97ee700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b413eca0 con 0x7f52b40b1fe0 2023-10-08T12:45:08.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.024+0000 7f52b97ee700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b413ef80 con 0x7f52b4070920 2023-10-08T12:45:08.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.024+0000 7f52b37fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b40b1fe0 0x7f52b40a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.024+0000 7f52b37fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b40b1fe0 0x7f52b40a7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.45:45658/0 (socket says 172.21.15.45:45658) 2023-10-08T12:45:08.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.024+0000 7f52b37fe700 1 -- 172.21.15.45:0/1072650700 learned_addr learned my addr 172.21.15.45:0/1072650700 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:08.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.025+0000 7f52b27fc700 1 --2- 172.21.15.45:0/1072650700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52b4070d00 0x7f52b4140f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.025+0000 7fc246ffd700 1 -- 172.21.15.45:0/3921290710 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fc248017070 con 0x7fc2580ac4f0 2023-10-08T12:45:08.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.028+0000 7f52b2ffd700 1 --2- 172.21.15.45:0/1072650700 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f52b4070920 0x7f52b41f4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.030+0000 7f471e7fc700 1 -- 172.21.15.45:0/687369116 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f4724017070 con 0x7f47280b1fe0 2023-10-08T12:45:08.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.029+0000 7f52b37fe700 1 -- 172.21.15.45:0/1072650700 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f52b4070920 msgr2=0x7f52b41f4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.029+0000 7f52b37fe700 1 --2- 172.21.15.45:0/1072650700 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f52b4070920 0x7f52b41f4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.029+0000 7f52b37fe700 1 -- 172.21.15.45:0/1072650700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52b4070d00 msgr2=0x7f52b4140f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.029+0000 7f52b37fe700 1 --2- 172.21.15.45:0/1072650700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52b4070d00 0x7f52b4140f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.029+0000 7f52b37fe700 1 -- 172.21.15.45:0/1072650700 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ac009d00 con 0x7f52b40b1fe0 2023-10-08T12:45:08.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.030+0000 7f52b37fe700 1 --2- 172.21.15.45:0/1072650700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b40b1fe0 0x7f52b40a7d70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f52a400c970 tx=0x7f52a400cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:08.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.030+0000 7f529b7fe700 1 -- 172.21.15.45:0/1072650700 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a4004a30 con 0x7f52b40b1fe0 2023-10-08T12:45:08.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.030+0000 7f529b7fe700 1 -- 172.21.15.45:0/1072650700 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f52a4004c80 con 0x7f52b40b1fe0 2023-10-08T12:45:08.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.030+0000 7f529b7fe700 1 -- 172.21.15.45:0/1072650700 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a4005280 con 0x7f52b40b1fe0 2023-10-08T12:45:08.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.039+0000 7f95e4b67700 1 -- 172.21.15.45:0/2578296194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95e0070920 msgr2=0x7f95e006cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.039+0000 7f95e4b67700 1 --2- 172.21.15.45:0/2578296194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95e0070920 0x7f95e006cf00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f95d801c0e0 tx=0x7f95d8009f90 comp rx=0 tx=0).stop 2023-10-08T12:45:08.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.042+0000 7f95e4b67700 1 -- 172.21.15.45:0/2578296194 shutdown_connections 2023-10-08T12:45:08.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.042+0000 7f95e4b67700 1 --2- 172.21.15.45:0/2578296194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95e0070920 0x7f95e006cf00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.042+0000 7f95e4b67700 1 --2- 172.21.15.45:0/2578296194 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f95e0070d00 0x7f95e00b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.042+0000 7f95e4b67700 1 -- 172.21.15.45:0/2578296194 >> 172.21.15.45:0/2578296194 conn(0x7f95e00cd4b0 msgr2=0x7f95e00cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.050+0000 7f9337fff700 1 -- 172.21.15.45:0/1956463178 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v9)=0 v9) v1 ==== 106+0+0 (secure 0 0 0) 0x7f93400068f0 con 0x7f9350070920 2023-10-08T12:45:08.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.042+0000 7f52b97ee700 1 -- 172.21.15.45:0/1072650700 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b413f260 con 0x7f52b40b1fe0 2023-10-08T12:45:08.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.042+0000 7f52b97ee700 1 -- 172.21.15.45:0/1072650700 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b413f820 con 0x7f52b40b1fe0 2023-10-08T12:45:08.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.046+0000 7f529b7fe700 1 -- 172.21.15.45:0/1072650700 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f52a40053e0 con 0x7f52b40b1fe0 2023-10-08T12:45:08.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.046+0000 7f529b7fe700 1 -- 172.21.15.45:0/1072650700 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f52a4007d70 con 0x7f52b40b1fe0 2023-10-08T12:45:08.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.052+0000 7f9356103700 1 -- 172.21.15.45:0/1956463178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9350070920 msgr2=0x7f93500ae630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.052+0000 7f9356103700 1 --2- 172.21.15.45:0/1956463178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9350070920 0x7f93500ae630 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f934000c3e0 tx=0x7f934000c6f0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.046+0000 7f0f7ea68700 1 -- 172.21.15.45:0/1161607575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f78070920 msgr2=0x7f0f7806cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.046+0000 7f0f7ea68700 1 --2- 172.21.15.45:0/1161607575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f78070920 0x7f0f7806cf00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0f7806f240 tx=0x7f0f6c009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:08.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.050+0000 7f0f7ea68700 1 -- 172.21.15.45:0/1161607575 shutdown_connections 2023-10-08T12:45:08.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.050+0000 7f0f7ea68700 1 --2- 172.21.15.45:0/1161607575 >> v2:172.21.15.78:3300/0 conn(0x7f0f780ab720 0x7f0f780abbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.050+0000 7f0f7ea68700 1 --2- 172.21.15.45:0/1161607575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f78070920 0x7f0f7806cf00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.050+0000 7f0f7ea68700 1 -- 172.21.15.45:0/1161607575 >> 172.21.15.45:0/1161607575 conn(0x7f0f780cd4b0 msgr2=0x7f0f780cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.050+0000 7f0f7ea68700 1 -- 172.21.15.45:0/1161607575 shutdown_connections 2023-10-08T12:45:08.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.050+0000 7f0f7ea68700 1 -- 172.21.15.45:0/1161607575 wait complete. 2023-10-08T12:45:08.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.052+0000 7f0f7ea68700 1 Processor -- start 2023-10-08T12:45:08.054 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-08T12:45:08.043+0000 7facc4800200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T12:45:08.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.053+0000 7f0f7ea68700 1 -- start start 2023-10-08T12:45:08.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.054+0000 7f0f7ea68700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f78070920 0x7f0f78132ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.054+0000 7f0f7ea68700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f78070d00 0x7f0f781335c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.054+0000 7f0f7ea68700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0f780ab720 0x7f0f7813e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.054+0000 7f0f7ea68700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f781357e0 con 0x7f0f78070d00 2023-10-08T12:45:08.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.054+0000 7f0f7ea68700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f781333e0 con 0x7f0f78070920 2023-10-08T12:45:08.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.054+0000 7f0f7ea68700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f781513d0 con 0x7f0f780ab720 2023-10-08T12:45:08.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.056+0000 7f95e4b67700 1 -- 172.21.15.45:0/2578296194 shutdown_connections 2023-10-08T12:45:08.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.056+0000 7f0f7c804700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f78070920 0x7f0f78132ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.056+0000 7f0f7d005700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0f780ab720 0x7f0f7813e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.056+0000 7f0f7d005700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0f780ab720 0x7f0f7813e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.45:36056/0 (socket says 172.21.15.45:36056) 2023-10-08T12:45:08.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.056+0000 7f0f7d005700 1 -- 172.21.15.45:0/3040864770 learned_addr learned my addr 172.21.15.45:0/3040864770 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:08.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.056+0000 7f0f77fff700 1 --2- 172.21.15.45:0/3040864770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f78070d00 0x7f0f781335c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.057+0000 7f0f77fff700 1 -- 172.21.15.45:0/3040864770 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0f780ab720 msgr2=0x7f0f7813e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.057+0000 7f0f77fff700 1 --2- 172.21.15.45:0/3040864770 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0f780ab720 0x7f0f7813e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.057+0000 7f0f77fff700 1 -- 172.21.15.45:0/3040864770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f78070920 msgr2=0x7f0f78132ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.057+0000 7f0f77fff700 1 --2- 172.21.15.45:0/3040864770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f78070920 0x7f0f78132ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.057+0000 7f0f77fff700 1 -- 172.21.15.45:0/3040864770 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6c0095f0 con 0x7f0f78070d00 2023-10-08T12:45:08.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.057+0000 7f0f77fff700 1 --2- 172.21.15.45:0/3040864770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f78070d00 0x7f0f781335c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0f7806c3a0 tx=0x7f0f6800b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:08.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.061+0000 7f95e4b67700 1 -- 172.21.15.45:0/2578296194 wait complete. 2023-10-08T12:45:08.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.063+0000 7f95e4b67700 1 Processor -- start 2023-10-08T12:45:08.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.063+0000 7f52b97ee700 1 -- 172.21.15.45:0/1072650700 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b413fd40 con 0x7f52b40b1fe0 2023-10-08T12:45:08.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.064+0000 7f9356103700 1 -- 172.21.15.45:0/1956463178 shutdown_connections 2023-10-08T12:45:08.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.064+0000 7f9356103700 1 --2- 172.21.15.45:0/1956463178 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f93500b1fe0 0x7f935014a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.064+0000 7f9356103700 1 --2- 172.21.15.45:0/1956463178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9350070920 0x7f93500ae630 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.064+0000 7f9356103700 1 --2- 172.21.15.45:0/1956463178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9350070d00 0x7f935006d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.064+0000 7f9356103700 1 -- 172.21.15.45:0/1956463178 >> 172.21.15.45:0/1956463178 conn(0x7f93500cd4b0 msgr2=0x7f93500cc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.066+0000 7f9356103700 1 -- 172.21.15.45:0/1956463178 shutdown_connections 2023-10-08T12:45:08.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.066+0000 7f9356103700 1 -- 172.21.15.45:0/1956463178 wait complete. 2023-10-08T12:45:08.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.063+0000 7f0f757fa700 1 -- 172.21.15.45:0/3040864770 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f68011830 con 0x7f0f78070d00 2023-10-08T12:45:08.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.063+0000 7f0f757fa700 1 -- 172.21.15.45:0/3040864770 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0f68011a80 con 0x7f0f78070d00 2023-10-08T12:45:08.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.063+0000 7f0f757fa700 1 -- 172.21.15.45:0/3040864770 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f68011e70 con 0x7f0f78070d00 2023-10-08T12:45:08.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.063+0000 7f0f7ea68700 1 -- 172.21.15.45:0/3040864770 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f780b2330 con 0x7f0f78070d00 2023-10-08T12:45:08.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.063+0000 7f0f7ea68700 1 -- 172.21.15.45:0/3040864770 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f78151990 con 0x7f0f78070d00 2023-10-08T12:45:08.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.063+0000 7f95e4b67700 1 -- start start 2023-10-08T12:45:08.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.064+0000 7f95e4b67700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95e0070920 0x7f95e013eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.064+0000 7f95e4b67700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95e0070d00 0x7f95e00a66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.064+0000 7f95e4b67700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f95e00b1fe0 0x7f95e00ae560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.064+0000 7f95e4b67700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e00a7db0 con 0x7f95e0070920 2023-10-08T12:45:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.064+0000 7f95e4b67700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e00a71a0 con 0x7f95e0070d00 2023-10-08T12:45:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.064+0000 7f95e4b67700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e00a7480 con 0x7f95e00b1fe0 2023-10-08T12:45:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.067+0000 7f95ddd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95e0070d00 0x7f95e00a66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.067+0000 7f95ddd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95e0070d00 0x7f95e00a66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.45:45672/0 (socket says 172.21.15.45:45672) 2023-10-08T12:45:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.067+0000 7f95ddd9b700 1 -- 172.21.15.45:0/246492329 learned_addr learned my addr 172.21.15.45:0/246492329 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.067+0000 7f95de59c700 1 --2- 172.21.15.45:0/246492329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95e0070920 0x7f95e013eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.067+0000 7f95de59c700 1 -- 172.21.15.45:0/246492329 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f95e00b1fe0 msgr2=0x7f95e00ae560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.067+0000 7f95de59c700 1 --2- 172.21.15.45:0/246492329 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f95e00b1fe0 0x7f95e00ae560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.067+0000 7f95de59c700 1 -- 172.21.15.45:0/246492329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95e0070d00 msgr2=0x7f95e00a66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.067+0000 7f95de59c700 1 --2- 172.21.15.45:0/246492329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95e0070d00 0x7f95e00a66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.067+0000 7f95de59c700 1 -- 172.21.15.45:0/246492329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d8009d00 con 0x7f95e0070920 2023-10-08T12:45:08.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.068+0000 7f95de59c700 1 --2- 172.21.15.45:0/246492329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95e0070920 0x7f95e013eff0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f95d8025000 tx=0x7f95d8003cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:08.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.072+0000 7f95ceffd700 1 -- 172.21.15.45:0/246492329 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d80079d0 con 0x7f95e0070920 2023-10-08T12:45:08.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.073+0000 7f95ceffd700 1 -- 172.21.15.45:0/246492329 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f95d8007c40 con 0x7f95e0070920 2023-10-08T12:45:08.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.073+0000 7f95ceffd700 1 -- 172.21.15.45:0/246492329 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d80096a0 con 0x7f95e0070920 2023-10-08T12:45:08.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.073+0000 7f95e4b67700 1 -- 172.21.15.45:0/246492329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e00a7760 con 0x7f95e0070920 2023-10-08T12:45:08.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.073+0000 7f95e4b67700 1 -- 172.21.15.45:0/246492329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e0153980 con 0x7f95e0070920 2023-10-08T12:45:08.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.076+0000 7f95ceffd700 1 -- 172.21.15.45:0/246492329 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f95d8004330 con 0x7f95e0070920 2023-10-08T12:45:08.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.076+0000 7f95ceffd700 1 -- 172.21.15.45:0/246492329 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f95d802f7c0 con 0x7f95e0070920 2023-10-08T12:45:08.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.078+0000 7f529b7fe700 1 -- 172.21.15.45:0/1072650700 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f52b413fd40 con 0x7f52b40b1fe0 2023-10-08T12:45:08.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.087+0000 7f95e4b67700 1 -- 172.21.15.45:0/246492329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c40052f0 con 0x7f95e0070920 2023-10-08T12:45:08.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.080+0000 7f0f757fa700 1 -- 172.21.15.45:0/3040864770 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0f6801a700 con 0x7f0f78070d00 2023-10-08T12:45:08.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.080+0000 7f0f757fa700 1 -- 172.21.15.45:0/3040864770 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0f68019850 con 0x7f0f78070d00 2023-10-08T12:45:08.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.091+0000 7f95ceffd700 1 -- 172.21.15.45:0/246492329 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f95d8033020 con 0x7f95e0070920 2023-10-08T12:45:08.102 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi045') 2023-10-08T12:45:08.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.103+0000 7fb9a1b6c700 1 -- 172.21.15.45:0/3287139705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb99c0ab720 msgr2=0x7fb99c0abb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.103+0000 7fb9a1b6c700 1 --2- 172.21.15.45:0/3287139705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb99c0ab720 0x7fb99c0abb80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb994009f60 tx=0x7fb994009f90 comp rx=0 tx=0).stop 2023-10-08T12:45:08.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.105+0000 7fb9a1b6c700 1 -- 172.21.15.45:0/3287139705 shutdown_connections 2023-10-08T12:45:08.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.105+0000 7fb9a1b6c700 1 --2- 172.21.15.45:0/3287139705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb99c0ab720 0x7fb99c0abb80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.105+0000 7fb9a1b6c700 1 --2- 172.21.15.45:0/3287139705 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb99c070920 0x7fb99c06cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.105+0000 7fb9a1b6c700 1 -- 172.21.15.45:0/3287139705 >> 172.21.15.45:0/3287139705 conn(0x7fb99c0cd4b0 msgr2=0x7fb99c0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.106+0000 7fb9a1b6c700 1 -- 172.21.15.45:0/3287139705 shutdown_connections 2023-10-08T12:45:08.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.116+0000 7fb9a1b6c700 1 -- 172.21.15.45:0/3287139705 wait complete. 2023-10-08T12:45:08.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.118+0000 7fb9a1b6c700 1 Processor -- start 2023-10-08T12:45:08.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.120+0000 7f0f7ea68700 1 -- 172.21.15.45:0/3040864770 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f580052f0 con 0x7f0f78070d00 2023-10-08T12:45:08.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.122+0000 7fb9a1b6c700 1 -- start start 2023-10-08T12:45:08.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.123+0000 7fb9a1b6c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb99c070920 0x7fb99c0a9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.123+0000 7fb9a1b6c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb99c070d00 0x7fb99c1f44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.123+0000 7fb9a1b6c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb99c0ab720 0x7fb99c14f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.123+0000 7fb9a1b6c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c1f2c70 con 0x7fb99c070d00 2023-10-08T12:45:08.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.123+0000 7fb9a1b6c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c1f4020 con 0x7fb99c0ab720 2023-10-08T12:45:08.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.123+0000 7fb9a1b6c700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c1f2990 con 0x7fb99c070920 2023-10-08T12:45:08.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.124+0000 7fb99affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb99c070d00 0x7fb99c1f44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.124+0000 7fb99affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb99c070d00 0x7fb99c1f44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34232/0 (socket says 172.21.15.45:34232) 2023-10-08T12:45:08.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.124+0000 7fb99affd700 1 -- 172.21.15.45:0/1781010440 learned_addr learned my addr 172.21.15.45:0/1781010440 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:08.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.124+0000 7fb99b7fe700 1 --2- 172.21.15.45:0/1781010440 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb99c070920 0x7fb99c0a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.124+0000 7fb99b7fe700 1 -- 172.21.15.45:0/1781010440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb99c0ab720 msgr2=0x7fb99c14f010 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T12:45:08.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.124+0000 7fb99b7fe700 1 --2- 172.21.15.45:0/1781010440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb99c0ab720 0x7fb99c14f010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.124+0000 7fb99b7fe700 1 -- 172.21.15.45:0/1781010440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb99c070d00 msgr2=0x7fb99c1f44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.124+0000 7fb99b7fe700 1 --2- 172.21.15.45:0/1781010440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb99c070d00 0x7fb99c1f44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.124+0000 7fb99b7fe700 1 -- 172.21.15.45:0/1781010440 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb994009c40 con 0x7fb99c070920 2023-10-08T12:45:08.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.125+0000 7fb99b7fe700 1 --2- 172.21.15.45:0/1781010440 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb99c070920 0x7fb99c0a9e60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00e9f0 tx=0x7fb98c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:08.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.125+0000 7f0f757fa700 1 -- 172.21.15.45:0/3040864770 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f0f68039b40 con 0x7f0f78070d00 2023-10-08T12:45:08.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.137+0000 7fb98bfff700 1 -- 172.21.15.45:0/1781010440 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c00c9c0 con 0x7fb99c070920 2023-10-08T12:45:08.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.137+0000 7fb98bfff700 1 -- 172.21.15.45:0/1781010440 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb98c00cc10 con 0x7fb99c070920 2023-10-08T12:45:08.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.137+0000 7fb98bfff700 1 -- 172.21.15.45:0/1781010440 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c010430 con 0x7fb99c070920 2023-10-08T12:45:08.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.138+0000 7fb9a1b6c700 1 -- 172.21.15.45:0/1781010440 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb99c0b2330 con 0x7fb99c070920 2023-10-08T12:45:08.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.138+0000 7fb9a1b6c700 1 -- 172.21.15.45:0/1781010440 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb99c1f3cb0 con 0x7fb99c070920 2023-10-08T12:45:08.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.138+0000 7fb98bfff700 1 -- 172.21.15.45:0/1781010440 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb98c0107a0 con 0x7fb99c070920 2023-10-08T12:45:08.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.138+0000 7fb98bfff700 1 -- 172.21.15.45:0/1781010440 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb98c014070 con 0x7fb99c070920 2023-10-08T12:45:08.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.139+0000 7fb9a1b6c700 1 -- 172.21.15.45:0/1781010440 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb99c1f3e70 con 0x7fb99c070920 2023-10-08T12:45:08.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.141+0000 7fb98bfff700 1 -- 172.21.15.45:0/1781010440 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fb98c026060 con 0x7fb99c070920 2023-10-08T12:45:08.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.153+0000 7f4e77f38700 1 -- 172.21.15.45:0/2614816998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e700b14d0 msgr2=0x7f4e70158ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.153+0000 7f4e77f38700 1 --2- 172.21.15.45:0/2614816998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e700b14d0 0x7f4e70158ce0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000a9d0 tx=0x7f4e6000ace0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.162+0000 7f4e77f38700 1 -- 172.21.15.45:0/2614816998 shutdown_connections 2023-10-08T12:45:08.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.162+0000 7f4e77f38700 1 --2- 172.21.15.45:0/2614816998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e700b14d0 0x7f4e70158ce0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.162+0000 7f4e77f38700 1 --2- 172.21.15.45:0/2614816998 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e70071650 0x7f4e701587a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.162+0000 7f4e77f38700 1 -- 172.21.15.45:0/2614816998 >> 172.21.15.45:0/2614816998 conn(0x7f4e700cd4b0 msgr2=0x7f4e700cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.162+0000 7f4e77f38700 1 -- 172.21.15.45:0/2614816998 shutdown_connections 2023-10-08T12:45:08.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.162+0000 7f4e77f38700 1 -- 172.21.15.45:0/2614816998 wait complete. 2023-10-08T12:45:08.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.164+0000 7f4e77f38700 1 Processor -- start 2023-10-08T12:45:08.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.164+0000 7f4e77f38700 1 -- start start 2023-10-08T12:45:08.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.165+0000 7f4e77f38700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e70071650 0x7f4e70168ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.165+0000 7f4e77f38700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e700b14d0 0x7f4e701f6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.166+0000 7f4e77f38700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e70152690 0x7f4e701597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.166+0000 7f4e77f38700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e70159fd0 con 0x7f4e70152690 2023-10-08T12:45:08.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.166+0000 7f4e77f38700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e70159d00 con 0x7f4e700b14d0 2023-10-08T12:45:08.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.166+0000 7f4e77f38700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e701651b0 con 0x7f4e70071650 2023-10-08T12:45:08.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.166+0000 7f4e754d3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e700b14d0 0x7f4e701f6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.166+0000 7f4e75cd4700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e70071650 0x7f4e70168ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.166+0000 7f4e754d3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e700b14d0 0x7f4e701f6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.45:45694/0 (socket says 172.21.15.45:45694) 2023-10-08T12:45:08.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.166+0000 7f4e754d3700 1 -- 172.21.15.45:0/2073615160 learned_addr learned my addr 172.21.15.45:0/2073615160 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:08.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.166+0000 7f4e764d5700 1 --2- 172.21.15.45:0/2073615160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e70152690 0x7f4e701597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.167+0000 7f4e754d3700 1 -- 172.21.15.45:0/2073615160 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e70071650 msgr2=0x7f4e70168ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.167+0000 7f4e754d3700 1 --2- 172.21.15.45:0/2073615160 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e70071650 0x7f4e70168ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.167+0000 7f4e754d3700 1 -- 172.21.15.45:0/2073615160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e70152690 msgr2=0x7f4e701597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.167+0000 7f4e754d3700 1 --2- 172.21.15.45:0/2073615160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e70152690 0x7f4e701597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.167+0000 7f4e754d3700 1 -- 172.21.15.45:0/2073615160 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6000a630 con 0x7f4e700b14d0 2023-10-08T12:45:08.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.167+0000 7f4e754d3700 1 --2- 172.21.15.45:0/2073615160 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e700b14d0 0x7f4e701f6680 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4e68007f10 tx=0x7f4e6800d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:08.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.169+0000 7fc25759e700 1 -- 172.21.15.45:0/3921290710 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) v1 -- 0x7fc23c005870 con 0x7fc2580ac4f0 2023-10-08T12:45:08.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.205+0000 7f4e667fc700 1 -- 172.21.15.45:0/2073615160 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6800dd20 con 0x7f4e700b14d0 2023-10-08T12:45:08.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.205+0000 7f4e667fc700 1 -- 172.21.15.45:0/2073615160 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4e6800f040 con 0x7f4e700b14d0 2023-10-08T12:45:08.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.205+0000 7f4e667fc700 1 -- 172.21.15.45:0/2073615160 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e68013650 con 0x7f4e700b14d0 2023-10-08T12:45:08.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.205+0000 7f4e77f38700 1 -- 172.21.15.45:0/2073615160 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e70165490 con 0x7f4e700b14d0 2023-10-08T12:45:08.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.205+0000 7f4e77f38700 1 -- 172.21.15.45:0/2073615160 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e70165a50 con 0x7f4e700b14d0 2023-10-08T12:45:08.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.210+0000 7fc246ffd700 1 -- 172.21.15.45:0/3921290710 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v10)=0 v10) v1 ==== 127+0+0 (secure 0 0 0) 0x7fc24801c990 con 0x7fc2580ac4f0 2023-10-08T12:45:08.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.211+0000 7f0764275700 1 -- 172.21.15.45:0/2316849032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f075c070920 msgr2=0x7f075c06cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.211+0000 7f0764275700 1 --2- 172.21.15.45:0/2316849032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f075c070920 0x7f075c06cf00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f075c1609f0 tx=0x7f0758009ba0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.216+0000 7f4e667fc700 1 -- 172.21.15.45:0/2073615160 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4e68013ab0 con 0x7f4e700b14d0 2023-10-08T12:45:08.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.216+0000 7f4e667fc700 1 -- 172.21.15.45:0/2073615160 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f4e6801db70 con 0x7f4e700b14d0 2023-10-08T12:45:08.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.222+0000 7f0764275700 1 -- 172.21.15.45:0/2316849032 shutdown_connections 2023-10-08T12:45:08.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.222+0000 7f0764275700 1 --2- 172.21.15.45:0/2316849032 >> v2:172.21.15.45:3300/0 conn(0x7f075c0ab720 0x7f075c0abbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.222+0000 7f0764275700 1 --2- 172.21.15.45:0/2316849032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f075c070920 0x7f075c06cf00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.222+0000 7f0764275700 1 -- 172.21.15.45:0/2316849032 >> 172.21.15.45:0/2316849032 conn(0x7f075c0cd4b0 msgr2=0x7f075c0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.229+0000 7f0764275700 1 -- 172.21.15.45:0/2316849032 shutdown_connections 2023-10-08T12:45:08.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.229+0000 7f0764275700 1 -- 172.21.15.45:0/2316849032 wait complete. 2023-10-08T12:45:08.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.231+0000 7f0764275700 1 Processor -- start 2023-10-08T12:45:08.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.231+0000 7f4e77f38700 1 -- 172.21.15.45:0/2073615160 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e580052f0 con 0x7f4e700b14d0 2023-10-08T12:45:08.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.232+0000 7f0764275700 1 -- start start 2023-10-08T12:45:08.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.233+0000 7f0764275700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f075c070920 0x7f075c1350e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.233+0000 7f0764275700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f075c070d00 0x7f075c14c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.233+0000 7f0764275700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f075c0ab720 0x7f075c148830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.233+0000 7f0764275700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075c147790 con 0x7f075c0ab720 2023-10-08T12:45:08.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.233+0000 7f0764275700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075c147a70 con 0x7f075c070d00 2023-10-08T12:45:08.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.233+0000 7f0764275700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075c147d50 con 0x7f075c070920 2023-10-08T12:45:08.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.233+0000 7f0762812700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f075c0ab720 0x7f075c148830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.233+0000 7f0762812700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f075c0ab720 0x7f075c148830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34252/0 (socket says 172.21.15.45:34252) 2023-10-08T12:45:08.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.233+0000 7f0762812700 1 -- 172.21.15.45:0/74721448 learned_addr learned my addr 172.21.15.45:0/74721448 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:08.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.234+0000 7f0762812700 1 -- 172.21.15.45:0/74721448 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f075c070920 msgr2=0x7f075c1350e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T12:45:08.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.234+0000 7f0762812700 1 --2- 172.21.15.45:0/74721448 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f075c070920 0x7f075c1350e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.234+0000 7f0762812700 1 -- 172.21.15.45:0/74721448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f075c070d00 msgr2=0x7f075c14c690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T12:45:08.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.234+0000 7f0762812700 1 --2- 172.21.15.45:0/74721448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f075c070d00 0x7f075c14c690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.234+0000 7f0762812700 1 -- 172.21.15.45:0/74721448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0758009520 con 0x7f075c0ab720 2023-10-08T12:45:08.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.234+0000 7f0762812700 1 --2- 172.21.15.45:0/74721448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f075c0ab720 0x7f075c148830 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0754007c60 tx=0x7f075400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:08.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.242+0000 7fc25759e700 1 -- 172.21.15.45:0/3921290710 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc2580ac4f0 msgr2=0x7fc25809a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.242+0000 7fc25759e700 1 --2- 172.21.15.45:0/3921290710 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc2580ac4f0 0x7fc25809a3f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc24800c510 tx=0x7fc24800c820 comp rx=0 tx=0).stop 2023-10-08T12:45:08.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.242+0000 7f4e667fc700 1 -- 172.21.15.45:0/2073615160 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f4e6801d460 con 0x7f4e700b14d0 2023-10-08T12:45:08.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.246+0000 7fc25759e700 1 -- 172.21.15.45:0/3921290710 shutdown_connections 2023-10-08T12:45:08.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.246+0000 7fc25759e700 1 --2- 172.21.15.45:0/3921290710 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2580ccdf0 0x7fc25806ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.246+0000 7fc25759e700 1 --2- 172.21.15.45:0/3921290710 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc2580ac4f0 0x7fc25809a3f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.246+0000 7fc25759e700 1 --2- 172.21.15.45:0/3921290710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2580c9a80 0x7fc25806c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.246+0000 7fc25759e700 1 -- 172.21.15.45:0/3921290710 >> 172.21.15.45:0/3921290710 conn(0x7fc2580cd2c0 msgr2=0x7fc2580c7660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.258+0000 7fc25759e700 1 -- 172.21.15.45:0/3921290710 shutdown_connections 2023-10-08T12:45:08.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.258+0000 7fc25759e700 1 -- 172.21.15.45:0/3921290710 wait complete. 2023-10-08T12:45:08.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.263+0000 7f47301a9700 1 -- 172.21.15.45:0/687369116 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) v1 -- 0x7f4710005160 con 0x7f47280b1fe0 2023-10-08T12:45:08.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.264+0000 7fc4566eb700 1 -- 172.21.15.45:0/4018250930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc45015f240 msgr2=0x7fc45006cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.264+0000 7fc4566eb700 1 --2- 172.21.15.45:0/4018250930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc45015f240 0x7fc45006cf00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc4400098c0 tx=0x7fc440009bd0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.267 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-08T12:45:08.255+0000 7facc4800200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T12:45:08.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.263+0000 7f95e4b67700 1 -- 172.21.15.45:0/246492329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) v1 -- 0x7f95c4005160 con 0x7f95e0070920 2023-10-08T12:45:08.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.266+0000 7fc4566eb700 1 -- 172.21.15.45:0/4018250930 shutdown_connections 2023-10-08T12:45:08.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.266+0000 7fc4566eb700 1 --2- 172.21.15.45:0/4018250930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc45015f240 0x7fc45006cf00 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc4400098c0 tx=0x7fc440009bd0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.266+0000 7fc4566eb700 1 -- 172.21.15.45:0/4018250930 >> 172.21.15.45:0/4018250930 conn(0x7fc4500cd4b0 msgr2=0x7fc4500cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.271+0000 7f0752ffd700 1 -- 172.21.15.45:0/74721448 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0754017070 con 0x7f075c0ab720 2023-10-08T12:45:08.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.271+0000 7f0752ffd700 1 -- 172.21.15.45:0/74721448 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f075400f040 con 0x7f075c0ab720 2023-10-08T12:45:08.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.271+0000 7f0752ffd700 1 -- 172.21.15.45:0/74721448 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075400de30 con 0x7f075c0ab720 2023-10-08T12:45:08.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.276+0000 7f0764275700 1 -- 172.21.15.45:0/74721448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f075c0b2330 con 0x7f075c0ab720 2023-10-08T12:45:08.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.276+0000 7f0764275700 1 -- 172.21.15.45:0/74721448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075c148310 con 0x7f075c0ab720 2023-10-08T12:45:08.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.278+0000 7fc4566eb700 1 -- 172.21.15.45:0/4018250930 shutdown_connections 2023-10-08T12:45:08.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.278+0000 7fc4566eb700 1 -- 172.21.15.45:0/4018250930 wait complete. 2023-10-08T12:45:08.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.280+0000 7fc4566eb700 1 Processor -- start 2023-10-08T12:45:08.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.280+0000 7fc4566eb700 1 -- start start 2023-10-08T12:45:08.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.281+0000 7fc4566eb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc45006d440 0x7fc4501520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.281+0000 7fc4566eb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc450070dc0 0x7fc4501f74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.281+0000 7fc4566eb700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc4501546a0 0x7fc450158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.281+0000 7fc4566eb700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4501f79e0 con 0x7fc450070dc0 2023-10-08T12:45:08.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.281+0000 7fc4566eb700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc450152850 con 0x7fc45006d440 2023-10-08T12:45:08.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.281+0000 7fc4566eb700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc450156d80 con 0x7fc4501546a0 2023-10-08T12:45:08.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.282+0000 7fc44ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc45006d440 0x7fc4501520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.282+0000 7fc454c88700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc4501546a0 0x7fc450158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.282+0000 7fc454c88700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc4501546a0 0x7fc450158f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.45:36116/0 (socket says 172.21.15.45:36116) 2023-10-08T12:45:08.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.282+0000 7fc454c88700 1 -- 172.21.15.45:0/1461800647 learned_addr learned my addr 172.21.15.45:0/1461800647 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:08.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.282+0000 7fc44f7fe700 1 --2- 172.21.15.45:0/1461800647 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc450070dc0 0x7fc4501f74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.282+0000 7fc44f7fe700 1 -- 172.21.15.45:0/1461800647 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc4501546a0 msgr2=0x7fc450158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.282+0000 7fc44f7fe700 1 --2- 172.21.15.45:0/1461800647 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc4501546a0 0x7fc450158f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.282+0000 7fc44f7fe700 1 -- 172.21.15.45:0/1461800647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc45006d440 msgr2=0x7fc4501520b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.282+0000 7fc44f7fe700 1 --2- 172.21.15.45:0/1461800647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc45006d440 0x7fc4501520b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.283+0000 7fc44f7fe700 1 -- 172.21.15.45:0/1461800647 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc440009520 con 0x7fc450070dc0 2023-10-08T12:45:08.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.283+0000 7fc44f7fe700 1 --2- 172.21.15.45:0/1461800647 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc450070dc0 0x7fc4501f74a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc44400c3e0 tx=0x7fc44400c6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:08.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.284+0000 7fc44cff9700 1 -- 172.21.15.45:0/1461800647 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4440052d0 con 0x7fc450070dc0 2023-10-08T12:45:08.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.284+0000 7fc44cff9700 1 -- 172.21.15.45:0/1461800647 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc444005450 con 0x7fc450070dc0 2023-10-08T12:45:08.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.284+0000 7fc44cff9700 1 -- 172.21.15.45:0/1461800647 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4440038e0 con 0x7fc450070dc0 2023-10-08T12:45:08.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.278+0000 7f0752ffd700 1 -- 172.21.15.45:0/74721448 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0754005020 con 0x7f075c0ab720 2023-10-08T12:45:08.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.278+0000 7f0752ffd700 1 -- 172.21.15.45:0/74721448 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f075401c410 con 0x7f075c0ab720 2023-10-08T12:45:08.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.284+0000 7fc4566eb700 1 -- 172.21.15.45:0/1461800647 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc450157060 con 0x7fc450070dc0 2023-10-08T12:45:08.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.284+0000 7fc4566eb700 1 -- 172.21.15.45:0/1461800647 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc450157620 con 0x7fc450070dc0 2023-10-08T12:45:08.289 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi045') 2023-10-08T12:45:08.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.284+0000 7f0764275700 1 -- 172.21.15.45:0/74721448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f075c066850 con 0x7f075c0ab720 2023-10-08T12:45:08.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.286+0000 7f86baab5700 1 -- 172.21.15.45:0/31292318 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f86b4070920 msgr2=0x7f86b406cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.286+0000 7f86baab5700 1 --2- 172.21.15.45:0/31292318 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f86b4070920 0x7f86b406cf00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f86b406c3d0 tx=0x7f86a4009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:08.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.286+0000 7f0f7ea68700 1 -- 172.21.15.45:0/3040864770 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) v1 -- 0x7f0f58005910 con 0x7f0f78070d00 2023-10-08T12:45:08.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.287+0000 7f86baab5700 1 -- 172.21.15.45:0/31292318 shutdown_connections 2023-10-08T12:45:08.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.287+0000 7f86baab5700 1 --2- 172.21.15.45:0/31292318 >> v2:172.21.15.45:3300/0 conn(0x7f86b40b1fe0 0x7f86b40ab720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.287+0000 7f86baab5700 1 --2- 172.21.15.45:0/31292318 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f86b4070920 0x7f86b406cf00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.287+0000 7f86baab5700 1 --2- 172.21.15.45:0/31292318 >> v2:172.21.15.78:3300/0 conn(0x7f86b4070d00 0x7f86b40b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.287+0000 7f86baab5700 1 -- 172.21.15.45:0/31292318 >> 172.21.15.45:0/31292318 conn(0x7f86b40cd4b0 msgr2=0x7f86b40cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.287+0000 7f86baab5700 1 -- 172.21.15.45:0/31292318 shutdown_connections 2023-10-08T12:45:08.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.288+0000 7f86baab5700 1 -- 172.21.15.45:0/31292318 wait complete. 2023-10-08T12:45:08.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.289+0000 7f86baab5700 1 Processor -- start 2023-10-08T12:45:08.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.290+0000 7f86baab5700 1 -- start start 2023-10-08T12:45:08.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.291+0000 7f86baab5700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f86b4070920 0x7f86b40a7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.291+0000 7f86baab5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86b4070d00 0x7f86b4138960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.291+0000 7f86baab5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86b40b1fe0 0x7f86b40a6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.291+0000 7f86baab5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b4135f10 con 0x7f86b4070d00 2023-10-08T12:45:08.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.291+0000 7f86baab5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b4136160 con 0x7f86b40b1fe0 2023-10-08T12:45:08.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.291+0000 7f86baab5700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b4136440 con 0x7f86b4070920 2023-10-08T12:45:08.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.293+0000 7f86b3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86b4070d00 0x7f86b4138960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.293+0000 7f86b3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86b4070d00 0x7f86b4138960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34280/0 (socket says 172.21.15.45:34280) 2023-10-08T12:45:08.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.293+0000 7f86b3fff700 1 -- 172.21.15.45:0/3250020650 learned_addr learned my addr 172.21.15.45:0/3250020650 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:08.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.293+0000 7f86b8851700 1 --2- 172.21.15.45:0/3250020650 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f86b4070920 0x7f86b40a7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.292+0000 7f0752ffd700 1 -- 172.21.15.45:0/74721448 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f0754005560 con 0x7f075c0ab720 2023-10-08T12:45:08.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.293+0000 7f86b3fff700 1 -- 172.21.15.45:0/3250020650 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f86b4070920 msgr2=0x7f86b40a7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.293+0000 7f86b3fff700 1 --2- 172.21.15.45:0/3250020650 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f86b4070920 0x7f86b40a7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.293+0000 7f86b3fff700 1 -- 172.21.15.45:0/3250020650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86b40b1fe0 msgr2=0x7f86b40a6480 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T12:45:08.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.293+0000 7f86b3fff700 1 --2- 172.21.15.45:0/3250020650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86b40b1fe0 0x7f86b40a6480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.293+0000 7f86b3fff700 1 -- 172.21.15.45:0/3250020650 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a40095f0 con 0x7f86b4070d00 2023-10-08T12:45:08.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.287+0000 7fc44cff9700 1 -- 172.21.15.45:0/1461800647 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc444003d40 con 0x7fc450070dc0 2023-10-08T12:45:08.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.287+0000 7fc44cff9700 1 -- 172.21.15.45:0/1461800647 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc444012740 con 0x7fc450070dc0 2023-10-08T12:45:08.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.291+0000 7fc4566eb700 1 -- 172.21.15.45:0/1461800647 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4300052f0 con 0x7fc450070dc0 2023-10-08T12:45:08.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.294+0000 7f86b3fff700 1 --2- 172.21.15.45:0/3250020650 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86b4070d00 0x7f86b4138960 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f86a800e9a0 tx=0x7f86a800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:08.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.294+0000 7f471e7fc700 1 -- 172.21.15.45:0/687369116 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v11)=0 v11) v1 ==== 116+0+0 (secure 0 0 0) 0x7f4724011e40 con 0x7f47280b1fe0 2023-10-08T12:45:08.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.297+0000 7fc44cff9700 1 -- 172.21.15.45:0/1461800647 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fc444017070 con 0x7fc450070dc0 2023-10-08T12:45:08.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.298+0000 7f86b17fa700 1 -- 172.21.15.45:0/3250020650 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a8009790 con 0x7f86b4070d00 2023-10-08T12:45:08.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.298+0000 7f86b17fa700 1 -- 172.21.15.45:0/3250020650 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f86a800ccc0 con 0x7f86b4070d00 2023-10-08T12:45:08.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.298+0000 7f86b17fa700 1 -- 172.21.15.45:0/3250020650 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a8010690 con 0x7f86b4070d00 2023-10-08T12:45:08.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.298+0000 7f86baab5700 1 -- 172.21.15.45:0/3250020650 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b4136720 con 0x7f86b4070d00 2023-10-08T12:45:08.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.298+0000 7f86baab5700 1 -- 172.21.15.45:0/3250020650 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b4135570 con 0x7f86b4070d00 2023-10-08T12:45:08.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.299+0000 7f95ceffd700 1 -- 172.21.15.45:0/246492329 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v12)=0 v12) v1 ==== 118+0+0 (secure 0 0 0) 0x7f95d8028070 con 0x7f95e0070920 2023-10-08T12:45:08.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.300+0000 7f86baab5700 1 -- 172.21.15.45:0/3250020650 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86b4136c40 con 0x7f86b4070d00 2023-10-08T12:45:08.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.301+0000 7f95e4b67700 1 -- 172.21.15.45:0/246492329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95e0070920 msgr2=0x7f95e013eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.301+0000 7f95e4b67700 1 --2- 172.21.15.45:0/246492329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95e0070920 0x7f95e013eff0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f95d8025000 tx=0x7f95d8003cb0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.302+0000 7f95e4b67700 1 -- 172.21.15.45:0/246492329 shutdown_connections 2023-10-08T12:45:08.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.302+0000 7f95e4b67700 1 --2- 172.21.15.45:0/246492329 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f95e00b1fe0 0x7f95e00ae560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.302+0000 7f95e4b67700 1 --2- 172.21.15.45:0/246492329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95e0070920 0x7f95e013eff0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.302+0000 7f95e4b67700 1 --2- 172.21.15.45:0/246492329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95e0070d00 0x7f95e00a66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.302+0000 7f95e4b67700 1 -- 172.21.15.45:0/246492329 >> 172.21.15.45:0/246492329 conn(0x7f95e00cd4b0 msgr2=0x7f95e01590e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.302+0000 7f95e4b67700 1 -- 172.21.15.45:0/246492329 shutdown_connections 2023-10-08T12:45:08.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.302+0000 7f95e4b67700 1 -- 172.21.15.45:0/246492329 wait complete. 2023-10-08T12:45:08.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.305+0000 7fedbeafe700 1 -- 172.21.15.45:0/1314617996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedb80ab720 msgr2=0x7fedb80abbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.305+0000 7fedbeafe700 1 --2- 172.21.15.45:0/1314617996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedb80ab720 0x7fedb80abbd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fedb0009f60 tx=0x7fedb0009f90 comp rx=0 tx=0).stop 2023-10-08T12:45:08.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.305+0000 7f86b17fa700 1 -- 172.21.15.45:0/3250020650 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f86a80107f0 con 0x7f86b4070d00 2023-10-08T12:45:08.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.305+0000 7f86b17fa700 1 -- 172.21.15.45:0/3250020650 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f86a8014070 con 0x7f86b4070d00 2023-10-08T12:45:08.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.314+0000 7fedbeafe700 1 -- 172.21.15.45:0/1314617996 shutdown_connections 2023-10-08T12:45:08.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.314+0000 7fedbeafe700 1 --2- 172.21.15.45:0/1314617996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedb80ab720 0x7fedb80abbd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.314+0000 7fedbeafe700 1 -- 172.21.15.45:0/1314617996 >> 172.21.15.45:0/1314617996 conn(0x7fedb80cd4b0 msgr2=0x7fedb80cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.314+0000 7fedbeafe700 1 -- 172.21.15.45:0/1314617996 shutdown_connections 2023-10-08T12:45:08.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.314+0000 7fedbeafe700 1 -- 172.21.15.45:0/1314617996 wait complete. 2023-10-08T12:45:08.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.315+0000 7f0f757fa700 1 -- 172.21.15.45:0/3040864770 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v13)=0 v13) v1 ==== 119+0+0 (secure 0 0 0) 0x7f0f68028020 con 0x7f0f78070d00 2023-10-08T12:45:08.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.316+0000 7f47301a9700 1 -- 172.21.15.45:0/687369116 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f47280b1fe0 msgr2=0x7f4728159d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.316+0000 7f47301a9700 1 --2- 172.21.15.45:0/687369116 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f47280b1fe0 0x7f4728159d80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f472400c390 tx=0x7f472400c6a0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.318+0000 7f86b17fa700 1 -- 172.21.15.45:0/3250020650 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f86b4136c40 con 0x7f86b4070d00 2023-10-08T12:45:08.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.319+0000 7f0f7ea68700 1 -- 172.21.15.45:0/3040864770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f78070d00 msgr2=0x7f0f781335c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.319+0000 7f0f7ea68700 1 --2- 172.21.15.45:0/3040864770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f78070d00 0x7f0f781335c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0f7806c3a0 tx=0x7f0f6800b800 comp rx=0 tx=0).stop 2023-10-08T12:45:08.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.320+0000 7f0f7ea68700 1 -- 172.21.15.45:0/3040864770 shutdown_connections 2023-10-08T12:45:08.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.320+0000 7f0f7ea68700 1 --2- 172.21.15.45:0/3040864770 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0f780ab720 0x7f0f7813e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.320+0000 7f0f7ea68700 1 --2- 172.21.15.45:0/3040864770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f78070920 0x7f0f78132ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.320+0000 7f0f7ea68700 1 --2- 172.21.15.45:0/3040864770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f78070d00 0x7f0f781335c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.320+0000 7f0f7ea68700 1 -- 172.21.15.45:0/3040864770 >> 172.21.15.45:0/3040864770 conn(0x7f0f780cd4b0 msgr2=0x7f0f780ae530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.316+0000 7fedbeafe700 1 Processor -- start 2023-10-08T12:45:08.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.316+0000 7fedbeafe700 1 -- start start 2023-10-08T12:45:08.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.318+0000 7fedbeafe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedb8070920 0x7fedb81458e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.318+0000 7fedbeafe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedb8070d00 0x7fedb81f6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.318+0000 7fedbeafe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedb80ab720 0x7fedb815f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.318+0000 7fedbeafe700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb81555f0 con 0x7fedb8070d00 2023-10-08T12:45:08.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.318+0000 7fedbeafe700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb8145e20 con 0x7fedb80ab720 2023-10-08T12:45:08.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.318+0000 7fedbeafe700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb815fc20 con 0x7fedb8070920 2023-10-08T12:45:08.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.318+0000 7fedb7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedb8070d00 0x7fedb81f6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.318+0000 7fedb7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedb8070d00 0x7fedb81f6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34284/0 (socket says 172.21.15.45:34284) 2023-10-08T12:45:08.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.318+0000 7fedb7fff700 1 -- 172.21.15.45:0/256217044 learned_addr learned my addr 172.21.15.45:0/256217044 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:08.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.318+0000 7fedbc89a700 1 --2- 172.21.15.45:0/256217044 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedb8070920 0x7fedb81458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.318+0000 7fedbd09b700 1 --2- 172.21.15.45:0/256217044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedb80ab720 0x7fedb815f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.319+0000 7fedbd09b700 1 -- 172.21.15.45:0/256217044 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedb8070920 msgr2=0x7fedb81458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.319+0000 7fedbd09b700 1 --2- 172.21.15.45:0/256217044 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedb8070920 0x7fedb81458e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.319+0000 7fedbd09b700 1 -- 172.21.15.45:0/256217044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedb8070d00 msgr2=0x7fedb81f6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.319+0000 7fedbd09b700 1 --2- 172.21.15.45:0/256217044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedb8070d00 0x7fedb81f6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.319+0000 7fedbd09b700 1 -- 172.21.15.45:0/256217044 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb0009c40 con 0x7fedb80ab720 2023-10-08T12:45:08.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.319+0000 7fedbd09b700 1 --2- 172.21.15.45:0/256217044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedb80ab720 0x7fedb815f180 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fedb0015000 tx=0x7fedb0009470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:08.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.319+0000 7fedb57fa700 1 -- 172.21.15.45:0/256217044 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb000e040 con 0x7fedb80ab720 2023-10-08T12:45:08.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.319+0000 7fedb57fa700 1 -- 172.21.15.45:0/256217044 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fedb0003a00 con 0x7fedb80ab720 2023-10-08T12:45:08.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.319+0000 7fedb57fa700 1 -- 172.21.15.45:0/256217044 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb0003df0 con 0x7fedb80ab720 2023-10-08T12:45:08.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.320+0000 7f52b97ee700 1 -- 172.21.15.45:0/1072650700 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) v1 -- 0x7f52b4066850 con 0x7f52b40b1fe0 2023-10-08T12:45:08.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.321+0000 7f47301a9700 1 -- 172.21.15.45:0/687369116 shutdown_connections 2023-10-08T12:45:08.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.321+0000 7f47301a9700 1 --2- 172.21.15.45:0/687369116 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f47280b1fe0 0x7f4728159d80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.321+0000 7f47301a9700 1 --2- 172.21.15.45:0/687369116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4728070920 0x7f4728153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.321+0000 7f47301a9700 1 --2- 172.21.15.45:0/687369116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4728070d00 0x7f4728153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.321+0000 7f47301a9700 1 -- 172.21.15.45:0/687369116 >> 172.21.15.45:0/687369116 conn(0x7f47280cd4b0 msgr2=0x7f472815c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.328+0000 7f47301a9700 1 -- 172.21.15.45:0/687369116 shutdown_connections 2023-10-08T12:45:08.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.329+0000 7fedb7fff700 1 --2- 172.21.15.45:0/256217044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedb8070d00 0x7fedb81f6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:08.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.329+0000 7f47301a9700 1 -- 172.21.15.45:0/687369116 wait complete. 2023-10-08T12:45:08.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.323+0000 7f0f7ea68700 1 -- 172.21.15.45:0/3040864770 shutdown_connections 2023-10-08T12:45:08.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.330+0000 7f0f7ea68700 1 -- 172.21.15.45:0/3040864770 wait complete. 2023-10-08T12:45:08.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.330+0000 7fedbeafe700 1 -- 172.21.15.45:0/256217044 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb8154cc0 con 0x7fedb80ab720 2023-10-08T12:45:08.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.330+0000 7fedbeafe700 1 -- 172.21.15.45:0/256217044 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb8155280 con 0x7fedb80ab720 2023-10-08T12:45:08.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.331+0000 7fedb57fa700 1 -- 172.21.15.45:0/256217044 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fedb0004030 con 0x7fedb80ab720 2023-10-08T12:45:08.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.331+0000 7fedb57fa700 1 -- 172.21.15.45:0/256217044 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fedb0047870 con 0x7fedb80ab720 2023-10-08T12:45:08.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.340+0000 7fed9effd700 1 -- 172.21.15.45:0/256217044 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed900052f0 con 0x7fedb80ab720 2023-10-08T12:45:08.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.346+0000 7fedb57fa700 1 -- 172.21.15.45:0/256217044 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fedb0047a80 con 0x7fedb80ab720 2023-10-08T12:45:08.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.350+0000 7fb9a1b6c700 1 -- 172.21.15.45:0/1781010440 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) v1 -- 0x7fb99c1f3830 con 0x7fb99c070920 2023-10-08T12:45:08.360 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-10-08T12:45:08.360+0000 7fd6ecad2200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T12:45:08.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.353+0000 7f83e9526700 1 -- 172.21.15.45:0/561679304 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f83e40ccdf0 msgr2=0x7f83e40c9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.353+0000 7f83e9526700 1 --2- 172.21.15.45:0/561679304 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f83e40ccdf0 0x7f83e40c9e60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f83e40afe60 tx=0x7f83d8009ba0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.353+0000 7f83e9526700 1 -- 172.21.15.45:0/561679304 shutdown_connections 2023-10-08T12:45:08.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.353+0000 7f83e9526700 1 --2- 172.21.15.45:0/561679304 >> v2:172.21.15.78:3300/0 conn(0x7f83e40ca3a0 0x7f83e415b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.353+0000 7f83e9526700 1 --2- 172.21.15.45:0/561679304 >> v2:172.21.15.45:3300/0 conn(0x7f83e40c9a80 0x7f83e40c7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.353+0000 7f83e9526700 1 --2- 172.21.15.45:0/561679304 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f83e40ccdf0 0x7f83e40c9e60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.353+0000 7f83e9526700 1 -- 172.21.15.45:0/561679304 >> 172.21.15.45:0/561679304 conn(0x7f83e40cd2c0 msgr2=0x7f83e40cd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.353+0000 7f83e9526700 1 -- 172.21.15.45:0/561679304 shutdown_connections 2023-10-08T12:45:08.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.353+0000 7f83e9526700 1 -- 172.21.15.45:0/561679304 wait complete. 2023-10-08T12:45:08.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.355+0000 7f83e9526700 1 Processor -- start 2023-10-08T12:45:08.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.356+0000 7f83e9526700 1 -- start start 2023-10-08T12:45:08.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.357+0000 7f83e9526700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83e40c9a80 0x7f83e4096920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.357+0000 7f83e9526700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f83e40ca3a0 0x7f83e40c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.357+0000 7f83e9526700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83e40ccdf0 0x7f83e40b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.357+0000 7f83e9526700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e40c60c0 con 0x7f83e40ccdf0 2023-10-08T12:45:08.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.357+0000 7f83e9526700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e40c38b0 con 0x7f83e40c9a80 2023-10-08T12:45:08.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.357+0000 7f83e9526700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e40c5a70 con 0x7f83e40ca3a0 2023-10-08T12:45:08.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.357+0000 7f83e37fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f83e40ca3a0 0x7f83e40c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.357+0000 7f83e37fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f83e40ca3a0 0x7f83e40c6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.45:36150/0 (socket says 172.21.15.45:36150) 2023-10-08T12:45:08.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.357+0000 7f83e37fe700 1 -- 172.21.15.45:0/2529082659 learned_addr learned my addr 172.21.15.45:0/2529082659 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:08.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.357+0000 7f83e3fff700 1 --2- 172.21.15.45:0/2529082659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83e40c9a80 0x7f83e4096920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.358+0000 7f83e37fe700 1 -- 172.21.15.45:0/2529082659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83e40c9a80 msgr2=0x7f83e4096920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.358+0000 7f83e37fe700 1 --2- 172.21.15.45:0/2529082659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83e40c9a80 0x7f83e4096920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.358+0000 7f83e37fe700 1 -- 172.21.15.45:0/2529082659 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83e40ccdf0 msgr2=0x7f83e40b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.358+0000 7f83e37fe700 1 --2- 172.21.15.45:0/2529082659 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83e40ccdf0 0x7f83e40b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.358+0000 7f83e37fe700 1 -- 172.21.15.45:0/2529082659 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83dc01ad10 con 0x7f83e40ca3a0 2023-10-08T12:45:08.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.362+0000 7f83e37fe700 1 --2- 172.21.15.45:0/2529082659 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f83e40ca3a0 0x7f83e40c6550 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f83d8000c00 tx=0x7f83d800f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:08.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.362+0000 7f83e0ff9700 1 -- 172.21.15.45:0/2529082659 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d801b070 con 0x7f83e40ca3a0 2023-10-08T12:45:08.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.362+0000 7f529b7fe700 1 -- 172.21.15.45:0/1072650700 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v14)=0 v14) v1 ==== 116+0+0 (secure 0 0 0) 0x7f52a40270b0 con 0x7f52b40b1fe0 2023-10-08T12:45:08.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.362+0000 7f83e0ff9700 1 -- 172.21.15.45:0/2529082659 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f83d800f930 con 0x7f83e40ca3a0 2023-10-08T12:45:08.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.362+0000 7f83e0ff9700 1 -- 172.21.15.45:0/2529082659 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d800fd60 con 0x7f83e40ca3a0 2023-10-08T12:45:08.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.363+0000 7f83e9526700 1 -- 172.21.15.45:0/2529082659 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d8009520 con 0x7f83e40ca3a0 2023-10-08T12:45:08.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.363+0000 7f83e9526700 1 -- 172.21.15.45:0/2529082659 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e40c3b90 con 0x7f83e40ca3a0 2023-10-08T12:45:08.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.364+0000 7faafbc40700 1 -- 172.21.15.45:0/2267509456 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faaf4070920 msgr2=0x7faaf406dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.364+0000 7faafbc40700 1 --2- 172.21.15.45:0/2267509456 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faaf4070920 0x7faaf406dc40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7faaf0005fd0 tx=0x7faaf0009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:08.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.364+0000 7faafbc40700 1 -- 172.21.15.45:0/2267509456 shutdown_connections 2023-10-08T12:45:08.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.364+0000 7faafbc40700 1 --2- 172.21.15.45:0/2267509456 >> v2:172.21.15.78:3300/0 conn(0x7faaf4070d00 0x7faaf40ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.364+0000 7faafbc40700 1 --2- 172.21.15.45:0/2267509456 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faaf4070920 0x7faaf406dc40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.364+0000 7faafbc40700 1 -- 172.21.15.45:0/2267509456 >> 172.21.15.45:0/2267509456 conn(0x7faaf40cd4b0 msgr2=0x7faaf40cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.364+0000 7f83e0ff9700 1 -- 172.21.15.45:0/2529082659 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f83d8004830 con 0x7f83e40ca3a0 2023-10-08T12:45:08.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.364+0000 7f83e0ff9700 1 -- 172.21.15.45:0/2529082659 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f83d8005200 con 0x7f83e40ca3a0 2023-10-08T12:45:08.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.365+0000 7f52b97ee700 1 -- 172.21.15.45:0/1072650700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b40b1fe0 msgr2=0x7f52b40a7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.365+0000 7f52b97ee700 1 --2- 172.21.15.45:0/1072650700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b40b1fe0 0x7f52b40a7d70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f52a400c970 tx=0x7f52a400cc80 comp rx=0 tx=0).stop 2023-10-08T12:45:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.365+0000 7f52b97ee700 1 -- 172.21.15.45:0/1072650700 shutdown_connections 2023-10-08T12:45:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.365+0000 7f52b97ee700 1 --2- 172.21.15.45:0/1072650700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b40b1fe0 0x7f52b40a7d70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.365+0000 7f52b97ee700 1 --2- 172.21.15.45:0/1072650700 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f52b4070920 0x7f52b41f4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.365+0000 7f52b97ee700 1 --2- 172.21.15.45:0/1072650700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52b4070d00 0x7f52b4140f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.365+0000 7f52b97ee700 1 -- 172.21.15.45:0/1072650700 >> 172.21.15.45:0/1072650700 conn(0x7f52b40cd4b0 msgr2=0x7f52b40cc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.365+0000 7faafbc40700 1 -- 172.21.15.45:0/2267509456 shutdown_connections 2023-10-08T12:45:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.365+0000 7faafbc40700 1 -- 172.21.15.45:0/2267509456 wait complete. 2023-10-08T12:45:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.367+0000 7faafbc40700 1 Processor -- start 2023-10-08T12:45:08.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.369+0000 7fb98bfff700 1 -- 172.21.15.45:0/1781010440 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v15)=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb99c1f3830 con 0x7fb99c070920 2023-10-08T12:45:08.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.367+0000 7faafbc40700 1 -- start start 2023-10-08T12:45:08.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.369+0000 7faafbc40700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faaf4070920 0x7faaf4213710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.369+0000 7faafbc40700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaf4070d00 0x7faaf4165070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.369+0000 7faafbc40700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faaf40713b0 0x7faaf41655b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.369+0000 7faafbc40700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf4167890 con 0x7faaf4070d00 2023-10-08T12:45:08.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.369+0000 7faafbc40700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf4167b70 con 0x7faaf4070920 2023-10-08T12:45:08.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.369+0000 7faafbc40700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf4167e50 con 0x7faaf40713b0 2023-10-08T12:45:08.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.369+0000 7faafa1dd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faaf40713b0 0x7faaf41655b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.369+0000 7faaf91db700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaf4070d00 0x7faaf4165070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.369+0000 7faaf91db700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaf4070d00 0x7faaf4165070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34310/0 (socket says 172.21.15.45:34310) 2023-10-08T12:45:08.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.369+0000 7faaf91db700 1 -- 172.21.15.45:0/3905523431 learned_addr learned my addr 172.21.15.45:0/3905523431 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:08.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.369+0000 7faaf99dc700 1 --2- 172.21.15.45:0/3905523431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faaf4070920 0x7faaf4213710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.370+0000 7faaf91db700 1 -- 172.21.15.45:0/3905523431 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faaf40713b0 msgr2=0x7faaf41655b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.370+0000 7faaf91db700 1 --2- 172.21.15.45:0/3905523431 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faaf40713b0 0x7faaf41655b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.370+0000 7faaf91db700 1 -- 172.21.15.45:0/3905523431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faaf4070920 msgr2=0x7faaf4213710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.370+0000 7faaf91db700 1 --2- 172.21.15.45:0/3905523431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faaf4070920 0x7faaf4213710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.370+0000 7faaf91db700 1 -- 172.21.15.45:0/3905523431 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf00095f0 con 0x7faaf4070d00 2023-10-08T12:45:08.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.370+0000 7faaf91db700 1 --2- 172.21.15.45:0/3905523431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaf4070d00 0x7faaf4165070 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7faaec00cba0 tx=0x7faaec00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:08.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.371+0000 7f83e9526700 1 -- 172.21.15.45:0/2529082659 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e406b270 con 0x7f83e40ca3a0 2023-10-08T12:45:08.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.372+0000 7faaea7fc700 1 -- 172.21.15.45:0/3905523431 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec003c00 con 0x7faaf4070d00 2023-10-08T12:45:08.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.371+0000 7f52b97ee700 1 -- 172.21.15.45:0/1072650700 shutdown_connections 2023-10-08T12:45:08.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.372+0000 7faaea7fc700 1 -- 172.21.15.45:0/3905523431 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7faaec003d60 con 0x7faaf4070d00 2023-10-08T12:45:08.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.372+0000 7faaea7fc700 1 -- 172.21.15.45:0/3905523431 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec00ab00 con 0x7faaf4070d00 2023-10-08T12:45:08.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.372+0000 7faafbc40700 1 -- 172.21.15.45:0/3905523431 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf4168130 con 0x7faaf4070d00 2023-10-08T12:45:08.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.372+0000 7faafbc40700 1 -- 172.21.15.45:0/3905523431 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf4213c50 con 0x7faaf4070d00 2023-10-08T12:45:08.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.373+0000 7faaea7fc700 1 -- 172.21.15.45:0/3905523431 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7faaec0050d0 con 0x7faaf4070d00 2023-10-08T12:45:08.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.373+0000 7faaea7fc700 1 -- 172.21.15.45:0/3905523431 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7faaec012890 con 0x7faaf4070d00 2023-10-08T12:45:08.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.373+0000 7f83e0ff9700 1 -- 172.21.15.45:0/2529082659 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f83d8004cc0 con 0x7f83e40ca3a0 2023-10-08T12:45:08.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.376+0000 7fb9a1b6c700 1 -- 172.21.15.45:0/1781010440 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb99c070920 msgr2=0x7fb99c0a9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.376+0000 7fb9a1b6c700 1 --2- 172.21.15.45:0/1781010440 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb99c070920 0x7fb99c0a9e60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00e9f0 tx=0x7fb98c00ed00 comp rx=0 tx=0).stop 2023-10-08T12:45:08.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.376+0000 7fb9a1b6c700 1 -- 172.21.15.45:0/1781010440 shutdown_connections 2023-10-08T12:45:08.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.376+0000 7fb9a1b6c700 1 --2- 172.21.15.45:0/1781010440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb99c0ab720 0x7fb99c14f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.376+0000 7fb9a1b6c700 1 --2- 172.21.15.45:0/1781010440 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb99c070920 0x7fb99c0a9e60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.376+0000 7fb9a1b6c700 1 --2- 172.21.15.45:0/1781010440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb99c070d00 0x7fb99c1f44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.376+0000 7fb9a1b6c700 1 -- 172.21.15.45:0/1781010440 >> 172.21.15.45:0/1781010440 conn(0x7fb99c0cd4b0 msgr2=0x7fb99c152c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.375+0000 7faafbc40700 1 -- 172.21.15.45:0/3905523431 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad80052f0 con 0x7faaf4070d00 2023-10-08T12:45:08.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.382+0000 7f52b97ee700 1 -- 172.21.15.45:0/1072650700 wait complete. 2023-10-08T12:45:08.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.382+0000 7fb9a1b6c700 1 -- 172.21.15.45:0/1781010440 shutdown_connections 2023-10-08T12:45:08.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.382+0000 7fb9a1b6c700 1 -- 172.21.15.45:0/1781010440 wait complete. 2023-10-08T12:45:08.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.384+0000 7faaea7fc700 1 -- 172.21.15.45:0/3905523431 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7faaec005510 con 0x7faaf4070d00 2023-10-08T12:45:08.408 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi045') 2023-10-08T12:45:08.408 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi045') 2023-10-08T12:45:08.408 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi045') 2023-10-08T12:45:08.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.407+0000 7f4e77f38700 1 -- 172.21.15.45:0/2073615160 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) v1 -- 0x7f4e58005160 con 0x7f4e700b14d0 2023-10-08T12:45:08.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.424+0000 7f4e667fc700 1 -- 172.21.15.45:0/2073615160 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v16)=0 v16) v1 ==== 121+0+0 (secure 0 0 0) 0x7f4e6802c0c0 con 0x7f4e700b14d0 2023-10-08T12:45:08.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.429+0000 7f4e77f38700 1 -- 172.21.15.45:0/2073615160 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e700b14d0 msgr2=0x7f4e701f6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.429+0000 7f4e77f38700 1 --2- 172.21.15.45:0/2073615160 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e700b14d0 0x7f4e701f6680 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4e68007f10 tx=0x7f4e6800d3b0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.429+0000 7f4e77f38700 1 -- 172.21.15.45:0/2073615160 shutdown_connections 2023-10-08T12:45:08.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.429+0000 7f4e77f38700 1 --2- 172.21.15.45:0/2073615160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e70152690 0x7f4e701597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.429+0000 7f4e77f38700 1 --2- 172.21.15.45:0/2073615160 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e70071650 0x7f4e70168ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.429+0000 7f4e77f38700 1 --2- 172.21.15.45:0/2073615160 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e700b14d0 0x7f4e701f6680 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.429+0000 7f4e77f38700 1 -- 172.21.15.45:0/2073615160 >> 172.21.15.45:0/2073615160 conn(0x7f4e700cd4b0 msgr2=0x7f4e7015b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.429+0000 7f4e77f38700 1 -- 172.21.15.45:0/2073615160 shutdown_connections 2023-10-08T12:45:08.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.429+0000 7f4e77f38700 1 -- 172.21.15.45:0/2073615160 wait complete. 2023-10-08T12:45:08.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.438+0000 7f0764275700 1 -- 172.21.15.45:0/74721448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) v1 -- 0x7f075c0b2180 con 0x7f075c0ab720 2023-10-08T12:45:08.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.448+0000 7f0752ffd700 1 -- 172.21.15.45:0/74721448 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v17)=0 v17) v1 ==== 115+0+0 (secure 0 0 0) 0x7f0754005760 con 0x7f075c0ab720 2023-10-08T12:45:08.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.454+0000 7f0764275700 1 -- 172.21.15.45:0/74721448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f075c0ab720 msgr2=0x7f075c148830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.454+0000 7f0764275700 1 --2- 172.21.15.45:0/74721448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f075c0ab720 0x7f075c148830 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0754007c60 tx=0x7f075400d3b0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.455+0000 7f0764275700 1 -- 172.21.15.45:0/74721448 shutdown_connections 2023-10-08T12:45:08.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.455+0000 7f0764275700 1 --2- 172.21.15.45:0/74721448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f075c0ab720 0x7f075c148830 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.455+0000 7f0764275700 1 --2- 172.21.15.45:0/74721448 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f075c070920 0x7f075c1350e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.455+0000 7f0764275700 1 --2- 172.21.15.45:0/74721448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f075c070d00 0x7f075c14c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.455+0000 7f0764275700 1 -- 172.21.15.45:0/74721448 >> 172.21.15.45:0/74721448 conn(0x7f075c0cd4b0 msgr2=0x7f075c0ad380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.456+0000 7f0764275700 1 -- 172.21.15.45:0/74721448 shutdown_connections 2023-10-08T12:45:08.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.461+0000 7f0764275700 1 -- 172.21.15.45:0/74721448 wait complete. 2023-10-08T12:45:08.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.466+0000 7f86baab5700 1 -- 172.21.15.45:0/3250020650 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7f86b4066850 con 0x7f86b4070d00 2023-10-08T12:45:08.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.472+0000 7f86b17fa700 1 -- 172.21.15.45:0/3250020650 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v18)=0 v18) v1 ==== 121+0+0 (secure 0 0 0) 0x7f86a8026060 con 0x7f86b4070d00 2023-10-08T12:45:08.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.477+0000 7f86baab5700 1 -- 172.21.15.45:0/3250020650 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86b4070d00 msgr2=0x7f86b4138960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.477+0000 7f86baab5700 1 --2- 172.21.15.45:0/3250020650 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86b4070d00 0x7f86b4138960 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f86a800e9a0 tx=0x7f86a800ed60 comp rx=0 tx=0).stop 2023-10-08T12:45:08.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.478+0000 7f86baab5700 1 -- 172.21.15.45:0/3250020650 shutdown_connections 2023-10-08T12:45:08.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.478+0000 7f86baab5700 1 --2- 172.21.15.45:0/3250020650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86b40b1fe0 0x7f86b40a6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.478+0000 7f86baab5700 1 --2- 172.21.15.45:0/3250020650 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f86b4070920 0x7f86b40a7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.478+0000 7f86baab5700 1 --2- 172.21.15.45:0/3250020650 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86b4070d00 0x7f86b4138960 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.478+0000 7f86baab5700 1 -- 172.21.15.45:0/3250020650 >> 172.21.15.45:0/3250020650 conn(0x7f86b40cd4b0 msgr2=0x7f86b406db90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.480 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi045') 2023-10-08T12:45:08.481 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi045') 2023-10-08T12:45:08.481 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi045') 2023-10-08T12:45:08.481 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi045') 2023-10-08T12:45:08.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.479+0000 7f86baab5700 1 -- 172.21.15.45:0/3250020650 shutdown_connections 2023-10-08T12:45:08.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.479+0000 7f86baab5700 1 -- 172.21.15.45:0/3250020650 wait complete. 2023-10-08T12:45:08.482 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-10-08T12:45:08.481+0000 7fd6ecad2200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T12:45:08.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.493+0000 7f83e9526700 1 -- 172.21.15.45:0/2529082659 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) v1 -- 0x7f83e40c6270 con 0x7f83e40ca3a0 2023-10-08T12:45:08.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.494+0000 7fed9effd700 1 -- 172.21.15.45:0/256217044 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7fed90005160 con 0x7fedb80ab720 2023-10-08T12:45:08.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.495+0000 7fc4566eb700 1 -- 172.21.15.45:0/1461800647 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) v1 -- 0x7fc430005910 con 0x7fc450070dc0 2023-10-08T12:45:08.500 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi045') 2023-10-08T12:45:08.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.497+0000 7f83e0ff9700 1 -- 172.21.15.45:0/2529082659 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v19)=0 v19) v1 ==== 121+0+0 (secure 0 0 0) 0x7f83d8004e60 con 0x7f83e40ca3a0 2023-10-08T12:45:08.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.497+0000 7f83e9526700 1 -- 172.21.15.45:0/2529082659 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f83e40ca3a0 msgr2=0x7f83e40c6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.497+0000 7f83e9526700 1 --2- 172.21.15.45:0/2529082659 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f83e40ca3a0 0x7f83e40c6550 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f83d8000c00 tx=0x7f83d800f690 comp rx=0 tx=0).stop 2023-10-08T12:45:08.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.497+0000 7f83e9526700 1 -- 172.21.15.45:0/2529082659 shutdown_connections 2023-10-08T12:45:08.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.498+0000 7f83e9526700 1 --2- 172.21.15.45:0/2529082659 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83e40ccdf0 0x7f83e40b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.498+0000 7f83e9526700 1 --2- 172.21.15.45:0/2529082659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83e40c9a80 0x7f83e4096920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.498+0000 7f83e9526700 1 --2- 172.21.15.45:0/2529082659 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f83e40ca3a0 0x7f83e40c6550 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.498+0000 7f83e9526700 1 -- 172.21.15.45:0/2529082659 >> 172.21.15.45:0/2529082659 conn(0x7f83e40cd2c0 msgr2=0x7f83e415b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.498+0000 7f83e9526700 1 -- 172.21.15.45:0/2529082659 shutdown_connections 2023-10-08T12:45:08.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.498+0000 7f83e9526700 1 -- 172.21.15.45:0/2529082659 wait complete. 2023-10-08T12:45:08.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.502+0000 7fc44cff9700 1 -- 172.21.15.45:0/1461800647 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v20)=0 v20) v1 ==== 120+0+0 (secure 0 0 0) 0x7fc444012950 con 0x7fc450070dc0 2023-10-08T12:45:08.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.503+0000 7fc4566eb700 1 -- 172.21.15.45:0/1461800647 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc450070dc0 msgr2=0x7fc4501f74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.503+0000 7fc4566eb700 1 --2- 172.21.15.45:0/1461800647 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc450070dc0 0x7fc4501f74a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc44400c3e0 tx=0x7fc44400c6f0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.503+0000 7fc4566eb700 1 -- 172.21.15.45:0/1461800647 shutdown_connections 2023-10-08T12:45:08.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.503+0000 7fc4566eb700 1 --2- 172.21.15.45:0/1461800647 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc4501546a0 0x7fc450158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.503+0000 7fc4566eb700 1 --2- 172.21.15.45:0/1461800647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc45006d440 0x7fc4501520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.503+0000 7fc4566eb700 1 --2- 172.21.15.45:0/1461800647 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc450070dc0 0x7fc4501f74a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.503+0000 7fc4566eb700 1 -- 172.21.15.45:0/1461800647 >> 172.21.15.45:0/1461800647 conn(0x7fc4500cd4b0 msgr2=0x7fc45015af90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.503+0000 7fc4566eb700 1 -- 172.21.15.45:0/1461800647 shutdown_connections 2023-10-08T12:45:08.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.503+0000 7fc4566eb700 1 -- 172.21.15.45:0/1461800647 wait complete. 2023-10-08T12:45:08.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.506+0000 7faafbc40700 1 -- 172.21.15.45:0/3905523431 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) v1 -- 0x7faadc0051e0 con 0x7faaf4070d00 2023-10-08T12:45:08.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.510+0000 7fedb57fa700 1 -- 172.21.15.45:0/256217044 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v21)=0 v21) v1 ==== 121+0+0 (secure 0 0 0) 0x7fedb0047c20 con 0x7fedb80ab720 2023-10-08T12:45:08.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.512+0000 7fed9effd700 1 -- 172.21.15.45:0/256217044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedb80ab720 msgr2=0x7fedb815f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.512+0000 7fed9effd700 1 --2- 172.21.15.45:0/256217044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedb80ab720 0x7fedb815f180 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fedb0015000 tx=0x7fedb0009470 comp rx=0 tx=0).stop 2023-10-08T12:45:08.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.512+0000 7fed9effd700 1 -- 172.21.15.45:0/256217044 shutdown_connections 2023-10-08T12:45:08.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.512+0000 7fed9effd700 1 --2- 172.21.15.45:0/256217044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedb80ab720 0x7fedb815f180 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.512+0000 7fed9effd700 1 --2- 172.21.15.45:0/256217044 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedb8070920 0x7fedb81458e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.512+0000 7fed9effd700 1 --2- 172.21.15.45:0/256217044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedb8070d00 0x7fedb81f6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.512+0000 7fed9effd700 1 -- 172.21.15.45:0/256217044 >> 172.21.15.45:0/256217044 conn(0x7fedb80cd4b0 msgr2=0x7fedb806dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.512+0000 7faaea7fc700 1 -- 172.21.15.45:0/3905523431 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v22)=0 v22) v1 ==== 120+0+0 (secure 0 0 0) 0x7faaec0056b0 con 0x7faaf4070d00 2023-10-08T12:45:08.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.513+0000 7fed9effd700 1 -- 172.21.15.45:0/256217044 shutdown_connections 2023-10-08T12:45:08.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.514+0000 7fed9effd700 1 -- 172.21.15.45:0/256217044 wait complete. 2023-10-08T12:45:08.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.514+0000 7faafbc40700 1 -- 172.21.15.45:0/3905523431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaf4070d00 msgr2=0x7faaf4165070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.514+0000 7faafbc40700 1 --2- 172.21.15.45:0/3905523431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaf4070d00 0x7faaf4165070 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7faaec00cba0 tx=0x7faaec00ceb0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.514+0000 7faafbc40700 1 -- 172.21.15.45:0/3905523431 shutdown_connections 2023-10-08T12:45:08.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.514+0000 7faafbc40700 1 --2- 172.21.15.45:0/3905523431 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faaf40713b0 0x7faaf41655b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.514+0000 7faafbc40700 1 --2- 172.21.15.45:0/3905523431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faaf4070920 0x7faaf4213710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.514+0000 7faafbc40700 1 --2- 172.21.15.45:0/3905523431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaf4070d00 0x7faaf4165070 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.514+0000 7faafbc40700 1 -- 172.21.15.45:0/3905523431 >> 172.21.15.45:0/3905523431 conn(0x7faaf40cd4b0 msgr2=0x7faaf40acf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.514+0000 7faafbc40700 1 -- 172.21.15.45:0/3905523431 shutdown_connections 2023-10-08T12:45:08.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.514+0000 7faafbc40700 1 -- 172.21.15.45:0/3905523431 wait complete. 2023-10-08T12:45:08.520 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi045') 2023-10-08T12:45:08.524 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-08T12:45:08.523+0000 7facc4800200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T12:45:08.530 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi045') 2023-10-08T12:45:08.530 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi045') 2023-10-08T12:45:08.531 INFO:tasks.ceph:Setting crush tunables to default 2023-10-08T12:45:08.531 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd crush tunables default 2023-10-08T12:45:08.571 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-10-08T12:45:08.570+0000 7fd6ecad2200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T12:45:08.650 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-10-08T12:45:08.650+0000 7fd6ecad2200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T12:45:08.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.699+0000 7f9e76bf1700 1 -- 172.21.15.45:0/1333881122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e70162ad0 msgr2=0x7f9e70164ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.699+0000 7f9e76bf1700 1 --2- 172.21.15.45:0/1333881122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e70162ad0 0x7f9e70164ec0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9e68009fd0 tx=0x7f9e6800b380 comp rx=0 tx=0).stop 2023-10-08T12:45:08.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.700+0000 7f9e76bf1700 1 -- 172.21.15.45:0/1333881122 shutdown_connections 2023-10-08T12:45:08.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.700+0000 7f9e76bf1700 1 --2- 172.21.15.45:0/1333881122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e70162ad0 0x7f9e70164ec0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.700+0000 7f9e76bf1700 1 -- 172.21.15.45:0/1333881122 >> 172.21.15.45:0/1333881122 conn(0x7f9e700b1290 msgr2=0x7f9e700b16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.700+0000 7f9e76bf1700 1 -- 172.21.15.45:0/1333881122 shutdown_connections 2023-10-08T12:45:08.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.700+0000 7f9e76bf1700 1 -- 172.21.15.45:0/1333881122 wait complete. 2023-10-08T12:45:08.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.701+0000 7f9e76bf1700 1 Processor -- start 2023-10-08T12:45:08.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.701+0000 7f9e76bf1700 1 -- start start 2023-10-08T12:45:08.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.702+0000 7f9e76bf1700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9e700b06d0 0x7f9e70150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.702+0000 7f9e76bf1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e7015d0c0 0x7f9e701593f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.702+0000 7f9e76bf1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e70162ad0 0x7f9e70159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:08.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.702+0000 7f9e76bf1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e70155ec0 con 0x7f9e70162ad0 2023-10-08T12:45:08.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.702+0000 7f9e76bf1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e70150eb0 con 0x7f9e7015d0c0 2023-10-08T12:45:08.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.702+0000 7f9e76bf1700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e70154e20 con 0x7f9e700b06d0 2023-10-08T12:45:08.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.702+0000 7f9e7518e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e70162ad0 0x7f9e70159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.702+0000 7f9e7518e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e70162ad0 0x7f9e70159930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34322/0 (socket says 172.21.15.45:34322) 2023-10-08T12:45:08.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.702+0000 7f9e7518e700 1 -- 172.21.15.45:0/1721451933 learned_addr learned my addr 172.21.15.45:0/1721451933 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:08.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.702+0000 7f9e7498d700 1 --2- 172.21.15.45:0/1721451933 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9e700b06d0 0x7f9e70150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.702+0000 7f9e6ffff700 1 --2- 172.21.15.45:0/1721451933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e7015d0c0 0x7f9e701593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:08.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.702+0000 7f9e7518e700 1 -- 172.21.15.45:0/1721451933 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9e700b06d0 msgr2=0x7f9e70150970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.702+0000 7f9e7518e700 1 --2- 172.21.15.45:0/1721451933 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9e700b06d0 0x7f9e70150970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.702+0000 7f9e7518e700 1 -- 172.21.15.45:0/1721451933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e7015d0c0 msgr2=0x7f9e701593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.702+0000 7f9e7518e700 1 --2- 172.21.15.45:0/1721451933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e7015d0c0 0x7f9e701593f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.702+0000 7f9e7518e700 1 -- 172.21.15.45:0/1721451933 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e68009d00 con 0x7f9e70162ad0 2023-10-08T12:45:08.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.702+0000 7f9e7518e700 1 --2- 172.21.15.45:0/1721451933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e70162ad0 0x7f9e70159930 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9e6800b780 tx=0x7f9e68007b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:08.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.703+0000 7f9e6d7fa700 1 -- 172.21.15.45:0/1721451933 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6800e040 con 0x7f9e70162ad0 2023-10-08T12:45:08.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.703+0000 7f9e6d7fa700 1 -- 172.21.15.45:0/1721451933 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9e6801d6c0 con 0x7f9e70162ad0 2023-10-08T12:45:08.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.703+0000 7f9e76bf1700 1 -- 172.21.15.45:0/1721451933 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e70155100 con 0x7f9e70162ad0 2023-10-08T12:45:08.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.703+0000 7f9e6d7fa700 1 -- 172.21.15.45:0/1721451933 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6801dad0 con 0x7f9e70162ad0 2023-10-08T12:45:08.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.703+0000 7f9e76bf1700 1 -- 172.21.15.45:0/1721451933 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e701556c0 con 0x7f9e70162ad0 2023-10-08T12:45:08.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.703+0000 7f9e6d7fa700 1 -- 172.21.15.45:0/1721451933 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9e68026410 con 0x7f9e70162ad0 2023-10-08T12:45:08.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.703+0000 7f9e6d7fa700 1 -- 172.21.15.45:0/1721451933 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9e680123f0 con 0x7f9e70162ad0 2023-10-08T12:45:08.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.704+0000 7f9e76bf1700 1 -- 172.21.15.45:0/1721451933 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e70066850 con 0x7f9e70162ad0 2023-10-08T12:45:08.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.706+0000 7f9e6d7fa700 1 -- 172.21.15.45:0/1721451933 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f9e68012600 con 0x7f9e70162ad0 2023-10-08T12:45:08.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.782+0000 7f9e76bf1700 1 -- 172.21.15.45:0/1721451933 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f9e700b1fd0 con 0x7f9e70162ad0 2023-10-08T12:45:08.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.783+0000 7f9e6d7fa700 1 -- 172.21.15.45:0/1721451933 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f9e680268a0 con 0x7f9e70162ad0 2023-10-08T12:45:08.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.784+0000 7f9e76bf1700 1 -- 172.21.15.45:0/1721451933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e70162ad0 msgr2=0x7f9e70159930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:08.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.784+0000 7f9e76bf1700 1 --2- 172.21.15.45:0/1721451933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e70162ad0 0x7f9e70159930 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9e6800b780 tx=0x7f9e68007b60 comp rx=0 tx=0).stop 2023-10-08T12:45:08.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.784+0000 7f9e76bf1700 1 -- 172.21.15.45:0/1721451933 shutdown_connections 2023-10-08T12:45:08.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.784+0000 7f9e76bf1700 1 --2- 172.21.15.45:0/1721451933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e70162ad0 0x7f9e70159930 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.784+0000 7f9e76bf1700 1 --2- 172.21.15.45:0/1721451933 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9e700b06d0 0x7f9e70150970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.784+0000 7f9e76bf1700 1 --2- 172.21.15.45:0/1721451933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e7015d0c0 0x7f9e701593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:08.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.784+0000 7f9e76bf1700 1 -- 172.21.15.45:0/1721451933 >> 172.21.15.45:0/1721451933 conn(0x7f9e700b1290 msgr2=0x7f9e70154550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:08.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.784+0000 7f9e76bf1700 1 -- 172.21.15.45:0/1721451933 shutdown_connections 2023-10-08T12:45:08.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:08.784+0000 7f9e76bf1700 1 -- 172.21.15.45:0/1721451933 wait complete. 2023-10-08T12:45:08.788 INFO:teuthology.orchestra.run.smithi045.stderr:adjusted tunables profile to default 2023-10-08T12:45:08.800 INFO:tasks.ceph:check_enable_crimson: False 2023-10-08T12:45:08.801 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-08T12:45:08.801 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:45:08.801 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-08T12:45:08.830 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:45:08.830 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-08T12:45:08.898 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:45:08.898 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-08T12:45:08.963 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-08T12:45:08.963+0000 7facc4800200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T12:45:08.966 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:45:08.966 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-08T12:45:09.035 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T12:45:09.035 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-08T12:45:09.062 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T12:45:09.062 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-08T12:45:09.082 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-10-08T12:45:09.081+0000 7fd6ecad2200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T12:45:09.087 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-08T12:45:09.087+0000 7facc4800200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T12:45:09.107 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T12:45:09.108 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-08T12:45:09.175 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T12:45:09.175 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-08T12:45:09.178 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-08T12:45:09.177+0000 7facc4800200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T12:45:09.243 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new 5289f854-c23d-4d4f-b4b1-cccefadf2d4b 0 2023-10-08T12:45:09.263 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-08T12:45:09.263+0000 7facc4800200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T12:45:09.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.406+0000 7f01e0965700 1 -- 172.21.15.78:0/165448196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01dc0cbae0 msgr2=0x7f01dc0ca240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:09.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.406+0000 7f01e0965700 1 --2- 172.21.15.78:0/165448196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01dc0cbae0 0x7f01dc0ca240 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f01d0005fd0 tx=0x7f01d0009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:09.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.406+0000 7f01e0965700 1 -- 172.21.15.78:0/165448196 shutdown_connections 2023-10-08T12:45:09.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.406+0000 7f01e0965700 1 --2- 172.21.15.78:0/165448196 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01dc159af0 0x7f01dc159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.406+0000 7f01e0965700 1 --2- 172.21.15.78:0/165448196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01dc0cbae0 0x7f01dc0ca240 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.406+0000 7f01e0965700 1 -- 172.21.15.78:0/165448196 >> 172.21.15.78:0/165448196 conn(0x7f01dc097a20 msgr2=0x7f01dc0ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:09.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.406+0000 7f01e0965700 1 -- 172.21.15.78:0/165448196 shutdown_connections 2023-10-08T12:45:09.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.406+0000 7f01e0965700 1 -- 172.21.15.78:0/165448196 wait complete. 2023-10-08T12:45:09.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.408+0000 7f01e0965700 1 Processor -- start 2023-10-08T12:45:09.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.408+0000 7f01e0965700 1 -- start start 2023-10-08T12:45:09.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.408+0000 7f01e0965700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01dc06a210 0x7f01dc14aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.409+0000 7f01e0965700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01dc0cbae0 0x7f01dc0c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.409+0000 7f01e0965700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01dc159af0 0x7f01dc1e4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.409+0000 7f01e0965700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc0c5fe0 con 0x7f01dc06a210 2023-10-08T12:45:09.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.409+0000 7f01e0965700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc0c62c0 con 0x7f01dc0cbae0 2023-10-08T12:45:09.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.409+0000 7f01e0965700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc0c65a0 con 0x7f01dc159af0 2023-10-08T12:45:09.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.409+0000 7f01dad9d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01dc159af0 0x7f01dc1e4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.409+0000 7f01d9d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01dc0cbae0 0x7f01dc0c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.409+0000 7f01d9d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01dc0cbae0 0x7f01dc0c56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55230/0 (socket says 172.21.15.78:55230) 2023-10-08T12:45:09.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.409+0000 7f01dad9d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01dc159af0 0x7f01dc1e4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:46912/0 (socket says 172.21.15.78:46912) 2023-10-08T12:45:09.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.409+0000 7f01d9d9b700 1 -- 172.21.15.78:0/1480822448 learned_addr learned my addr 172.21.15.78:0/1480822448 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-08T12:45:09.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.409+0000 7f01da59c700 1 --2- 172.21.15.78:0/1480822448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01dc06a210 0x7f01dc14aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.409+0000 7f01d9d9b700 1 -- 172.21.15.78:0/1480822448 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01dc159af0 msgr2=0x7f01dc1e4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:09.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.409+0000 7f01d9d9b700 1 --2- 172.21.15.78:0/1480822448 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01dc159af0 0x7f01dc1e4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.409+0000 7f01d9d9b700 1 -- 172.21.15.78:0/1480822448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01dc06a210 msgr2=0x7f01dc14aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:09.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.409+0000 7f01d9d9b700 1 --2- 172.21.15.78:0/1480822448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01dc06a210 0x7f01dc14aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.409+0000 7f01d9d9b700 1 -- 172.21.15.78:0/1480822448 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc009520 con 0x7f01dc0cbae0 2023-10-08T12:45:09.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.409+0000 7f01d9d9b700 1 --2- 172.21.15.78:0/1480822448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01dc0cbae0 0x7f01dc0c56e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f01d00098e0 tx=0x7f01d0003d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:09.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.409+0000 7f01caffd700 1 -- 172.21.15.78:0/1480822448 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d001d070 con 0x7f01dc0cbae0 2023-10-08T12:45:09.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.409+0000 7f01caffd700 1 -- 172.21.15.78:0/1480822448 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f01d000b820 con 0x7f01dc0cbae0 2023-10-08T12:45:09.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.409+0000 7f01e0965700 1 -- 172.21.15.78:0/1480822448 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d00095f0 con 0x7f01dc0cbae0 2023-10-08T12:45:09.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.409+0000 7f01caffd700 1 -- 172.21.15.78:0/1480822448 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d00045f0 con 0x7f01dc0cbae0 2023-10-08T12:45:09.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.409+0000 7f01e0965700 1 -- 172.21.15.78:0/1480822448 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01dc0c6b60 con 0x7f01dc0cbae0 2023-10-08T12:45:09.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.410+0000 7f01caffd700 1 -- 172.21.15.78:0/1480822448 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f01d000bc10 con 0x7f01dc0cbae0 2023-10-08T12:45:09.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.410+0000 7f01caffd700 1 -- 172.21.15.78:0/1480822448 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f01d000fc30 con 0x7f01dc0cbae0 2023-10-08T12:45:09.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.410+0000 7f01e0965700 1 -- 172.21.15.78:0/1480822448 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01dc066850 con 0x7f01dc0cbae0 2023-10-08T12:45:09.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.412+0000 7f01caffd700 1 -- 172.21.15.78:0/1480822448 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f01d0026070 con 0x7f01dc0cbae0 2023-10-08T12:45:09.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.520+0000 7f01e0965700 1 -- 172.21.15.78:0/1480822448 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5289f854-c23d-4d4f-b4b1-cccefadf2d4b", "id": 0} v 0) v1 -- 0x7f01dc14af40 con 0x7f01dc0cbae0 2023-10-08T12:45:09.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.527+0000 7f01caffd700 1 -- 172.21.15.78:0/1480822448 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5289f854-c23d-4d4f-b4b1-cccefadf2d4b", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f01d000fe40 con 0x7f01dc0cbae0 2023-10-08T12:45:09.528 INFO:teuthology.orchestra.run.smithi078.stdout:0 2023-10-08T12:45:09.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.528+0000 7f01e0965700 1 -- 172.21.15.78:0/1480822448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01dc0cbae0 msgr2=0x7f01dc0c56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:09.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.528+0000 7f01e0965700 1 --2- 172.21.15.78:0/1480822448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01dc0cbae0 0x7f01dc0c56e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f01d00098e0 tx=0x7f01d0003d00 comp rx=0 tx=0).stop 2023-10-08T12:45:09.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.528+0000 7f01e0965700 1 -- 172.21.15.78:0/1480822448 shutdown_connections 2023-10-08T12:45:09.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.528+0000 7f01e0965700 1 --2- 172.21.15.78:0/1480822448 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01dc159af0 0x7f01dc1e4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.528+0000 7f01e0965700 1 --2- 172.21.15.78:0/1480822448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01dc06a210 0x7f01dc14aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.528+0000 7f01e0965700 1 --2- 172.21.15.78:0/1480822448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01dc0cbae0 0x7f01dc0c56e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.528+0000 7f01e0965700 1 -- 172.21.15.78:0/1480822448 >> 172.21.15.78:0/1480822448 conn(0x7f01dc097a20 msgr2=0x7f01dc0ce580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:09.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.538+0000 7f01e0965700 1 -- 172.21.15.78:0/1480822448 shutdown_connections 2023-10-08T12:45:09.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.538+0000 7f01e0965700 1 -- 172.21.15.78:0/1480822448 wait complete. 2023-10-08T12:45:09.554 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new 44e45b02-1124-4bbc-9cd8-d0d95a49f149 1 2023-10-08T12:45:09.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.678+0000 7fede7dcc700 1 -- 172.21.15.78:0/442392960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fede006a920 msgr2=0x7fede00afa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:09.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.678+0000 7fede7dcc700 1 --2- 172.21.15.78:0/442392960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fede006a920 0x7fede00afa20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fedd8009fd0 tx=0x7fedd800b380 comp rx=0 tx=0).stop 2023-10-08T12:45:09.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.678+0000 7fede7dcc700 1 -- 172.21.15.78:0/442392960 shutdown_connections 2023-10-08T12:45:09.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.678+0000 7fede7dcc700 1 --2- 172.21.15.78:0/442392960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fede006a920 0x7fede00afa20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.678+0000 7fede7dcc700 1 --2- 172.21.15.78:0/442392960 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fede00ca780 0x7fede00cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.678+0000 7fede7dcc700 1 -- 172.21.15.78:0/442392960 >> 172.21.15.78:0/442392960 conn(0x7fede0097a20 msgr2=0x7fede00ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:09.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.678+0000 7fede7dcc700 1 -- 172.21.15.78:0/442392960 shutdown_connections 2023-10-08T12:45:09.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.678+0000 7fede7dcc700 1 -- 172.21.15.78:0/442392960 wait complete. 2023-10-08T12:45:09.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.679+0000 7fede7dcc700 1 Processor -- start 2023-10-08T12:45:09.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.679+0000 7fede7dcc700 1 -- start start 2023-10-08T12:45:09.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.680+0000 7fede7dcc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fede006a920 0x7fede0158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.680+0000 7fede7dcc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fede00af5a0 0x7fede00c2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.680+0000 7fede7dcc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fede00ca780 0x7fede00c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.681+0000 7fede7dcc700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede00b4440 con 0x7fede00ca780 2023-10-08T12:45:09.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.681+0000 7fede7dcc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede00c21e0 con 0x7fede00af5a0 2023-10-08T12:45:09.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.681+0000 7fede7dcc700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede00b2770 con 0x7fede006a920 2023-10-08T12:45:09.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.681+0000 7fede5367700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fede00af5a0 0x7fede00c2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.681+0000 7fede5b68700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fede006a920 0x7fede0158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.681+0000 7fede5367700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fede00af5a0 0x7fede00c2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55242/0 (socket says 172.21.15.78:55242) 2023-10-08T12:45:09.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.681+0000 7fede5367700 1 -- 172.21.15.78:0/4194441133 learned_addr learned my addr 172.21.15.78:0/4194441133 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-08T12:45:09.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.681+0000 7fede6369700 1 --2- 172.21.15.78:0/4194441133 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fede00ca780 0x7fede00c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.681+0000 7fede5b68700 1 -- 172.21.15.78:0/4194441133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fede00af5a0 msgr2=0x7fede00c2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:09.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.681+0000 7fede5b68700 1 --2- 172.21.15.78:0/4194441133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fede00af5a0 0x7fede00c2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.681+0000 7fede5b68700 1 -- 172.21.15.78:0/4194441133 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fede00ca780 msgr2=0x7fede00c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:09.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.681+0000 7fede5b68700 1 --2- 172.21.15.78:0/4194441133 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fede00ca780 0x7fede00c76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.681+0000 7fede5b68700 1 -- 172.21.15.78:0/4194441133 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feddc009520 con 0x7fede006a920 2023-10-08T12:45:09.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.681+0000 7fede5367700 1 --2- 172.21.15.78:0/4194441133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fede00af5a0 0x7fede00c2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:09.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.681+0000 7fede6369700 1 --2- 172.21.15.78:0/4194441133 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fede00ca780 0x7fede00c76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:09.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.681+0000 7fede5b68700 1 --2- 172.21.15.78:0/4194441133 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fede006a920 0x7fede0158c30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7feddc00e9f0 tx=0x7feddc00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:09.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.681+0000 7fedd67fc700 1 -- 172.21.15.78:0/4194441133 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc004220 con 0x7fede006a920 2023-10-08T12:45:09.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.681+0000 7fedd67fc700 1 -- 172.21.15.78:0/4194441133 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7feddc004380 con 0x7fede006a920 2023-10-08T12:45:09.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.681+0000 7fedd67fc700 1 -- 172.21.15.78:0/4194441133 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc00ca20 con 0x7fede006a920 2023-10-08T12:45:09.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.681+0000 7fede7dcc700 1 -- 172.21.15.78:0/4194441133 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd8009d00 con 0x7fede006a920 2023-10-08T12:45:09.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.681+0000 7fede7dcc700 1 -- 172.21.15.78:0/4194441133 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede00c2760 con 0x7fede006a920 2023-10-08T12:45:09.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.682+0000 7fedd67fc700 1 -- 172.21.15.78:0/4194441133 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7feddc00cb80 con 0x7fede006a920 2023-10-08T12:45:09.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.682+0000 7fedd67fc700 1 -- 172.21.15.78:0/4194441133 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7feddc014070 con 0x7fede006a920 2023-10-08T12:45:09.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.682+0000 7fede7dcc700 1 -- 172.21.15.78:0/4194441133 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede00c2980 con 0x7fede006a920 2023-10-08T12:45:09.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.684+0000 7fedd67fc700 1 -- 172.21.15.78:0/4194441133 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7feddc004510 con 0x7fede006a920 2023-10-08T12:45:09.724 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-08T12:45:09.723+0000 7facc4800200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T12:45:09.740 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-10-08T12:45:09.739+0000 7fd6ecad2200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T12:45:09.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.768+0000 7fede7dcc700 1 -- 172.21.15.78:0/4194441133 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd new", "uuid": "44e45b02-1124-4bbc-9cd8-d0d95a49f149", "id": 1} v 0) v1 -- 0x7fede00732b0 con 0x7fede006a920 2023-10-08T12:45:09.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.775+0000 7fedd67fc700 1 -- 172.21.15.78:0/4194441133 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "44e45b02-1124-4bbc-9cd8-d0d95a49f149", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7feddc005530 con 0x7fede006a920 2023-10-08T12:45:09.776 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-10-08T12:45:09.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.776+0000 7fede7dcc700 1 -- 172.21.15.78:0/4194441133 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fede006a920 msgr2=0x7fede0158c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:09.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.776+0000 7fede7dcc700 1 --2- 172.21.15.78:0/4194441133 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fede006a920 0x7fede0158c30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7feddc00e9f0 tx=0x7feddc00ed00 comp rx=0 tx=0).stop 2023-10-08T12:45:09.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.776+0000 7fede7dcc700 1 -- 172.21.15.78:0/4194441133 shutdown_connections 2023-10-08T12:45:09.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.776+0000 7fede7dcc700 1 --2- 172.21.15.78:0/4194441133 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fede00ca780 0x7fede00c76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.776+0000 7fede7dcc700 1 --2- 172.21.15.78:0/4194441133 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fede006a920 0x7fede0158c30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.776+0000 7fede7dcc700 1 --2- 172.21.15.78:0/4194441133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fede00af5a0 0x7fede00c2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.776+0000 7fede7dcc700 1 -- 172.21.15.78:0/4194441133 >> 172.21.15.78:0/4194441133 conn(0x7fede0097a20 msgr2=0x7fede015aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:09.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.776+0000 7fede7dcc700 1 -- 172.21.15.78:0/4194441133 shutdown_connections 2023-10-08T12:45:09.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.777+0000 7fede7dcc700 1 -- 172.21.15.78:0/4194441133 wait complete. 2023-10-08T12:45:09.790 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new f4cac31c-3d7a-4373-b960-fa26a27918e3 2 2023-10-08T12:45:09.811 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-10-08T12:45:09.811+0000 7fd6ecad2200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T12:45:09.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.911+0000 7f5435572700 1 -- 172.21.15.78:0/3527312668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54300cfbe0 msgr2=0x7f5430164890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:09.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.911+0000 7f5435572700 1 --2- 172.21.15.78:0/3527312668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54300cfbe0 0x7f5430164890 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5428009fd0 tx=0x7f542800b380 comp rx=0 tx=0).stop 2023-10-08T12:45:09.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.912+0000 7f5435572700 1 -- 172.21.15.78:0/3527312668 shutdown_connections 2023-10-08T12:45:09.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.912+0000 7f5435572700 1 --2- 172.21.15.78:0/3527312668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54300cfbe0 0x7f5430164890 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.912+0000 7f5435572700 1 -- 172.21.15.78:0/3527312668 >> 172.21.15.78:0/3527312668 conn(0x7f5430088fb0 msgr2=0x7f54300893c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:09.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.912+0000 7f5435572700 1 -- 172.21.15.78:0/3527312668 shutdown_connections 2023-10-08T12:45:09.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.912+0000 7f5435572700 1 -- 172.21.15.78:0/3527312668 wait complete. 2023-10-08T12:45:09.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.913+0000 7f5435572700 1 Processor -- start 2023-10-08T12:45:09.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.913+0000 7f5435572700 1 -- start start 2023-10-08T12:45:09.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.914+0000 7f5435572700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f54300cfbe0 0x7f5430151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.914+0000 7f5435572700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5430159900 0x7f543006b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.914+0000 7f5435572700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f543015e090 0x7f54300ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:09.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.914+0000 7f5435572700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543015b820 con 0x7f5430159900 2023-10-08T12:45:09.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.914+0000 7f5435572700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543015aca0 con 0x7f543015e090 2023-10-08T12:45:09.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.914+0000 7f5435572700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f543015af80 con 0x7f54300cfbe0 2023-10-08T12:45:09.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.914+0000 7f542effd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f54300cfbe0 0x7f5430151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.914+0000 7f542f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f543015e090 0x7f54300ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.914+0000 7f542f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f543015e090 0x7f54300ade00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55254/0 (socket says 172.21.15.78:55254) 2023-10-08T12:45:09.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.914+0000 7f542effd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f54300cfbe0 0x7f5430151bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:46930/0 (socket says 172.21.15.78:46930) 2023-10-08T12:45:09.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.914+0000 7f542f7fe700 1 -- 172.21.15.78:0/1546072925 learned_addr learned my addr 172.21.15.78:0/1546072925 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-08T12:45:09.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.914+0000 7f542e7fc700 1 --2- 172.21.15.78:0/1546072925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5430159900 0x7f543006b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:09.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.914+0000 7f542f7fe700 1 -- 172.21.15.78:0/1546072925 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f54300cfbe0 msgr2=0x7f5430151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:09.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.914+0000 7f542f7fe700 1 --2- 172.21.15.78:0/1546072925 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f54300cfbe0 0x7f5430151bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.914+0000 7f542f7fe700 1 -- 172.21.15.78:0/1546072925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5430159900 msgr2=0x7f543006b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:09.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.914+0000 7f542f7fe700 1 --2- 172.21.15.78:0/1546072925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5430159900 0x7f543006b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:09.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.914+0000 7f542f7fe700 1 -- 172.21.15.78:0/1546072925 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5428009d00 con 0x7f543015e090 2023-10-08T12:45:09.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.914+0000 7f542effd700 1 --2- 172.21.15.78:0/1546072925 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f54300cfbe0 0x7f5430151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:09.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.914+0000 7f542f7fe700 1 --2- 172.21.15.78:0/1546072925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f543015e090 0x7f54300ade00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f542800b780 tx=0x7f5428007b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:09.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.914+0000 7f54177fe700 1 -- 172.21.15.78:0/1546072925 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542800e040 con 0x7f543015e090 2023-10-08T12:45:09.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.914+0000 7f54177fe700 1 -- 172.21.15.78:0/1546072925 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f542801d6c0 con 0x7f543015e090 2023-10-08T12:45:09.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.914+0000 7f54177fe700 1 -- 172.21.15.78:0/1546072925 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542801dad0 con 0x7f543015e090 2023-10-08T12:45:09.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.914+0000 7f5435572700 1 -- 172.21.15.78:0/1546072925 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f543015b260 con 0x7f543015e090 2023-10-08T12:45:09.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.915+0000 7f5435572700 1 -- 172.21.15.78:0/1546072925 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54301520f0 con 0x7f543015e090 2023-10-08T12:45:09.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.915+0000 7f54177fe700 1 -- 172.21.15.78:0/1546072925 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f542801b450 con 0x7f543015e090 2023-10-08T12:45:09.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.915+0000 7f54177fe700 1 -- 172.21.15.78:0/1546072925 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f5428026830 con 0x7f543015e090 2023-10-08T12:45:09.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.915+0000 7f5435572700 1 -- 172.21.15.78:0/1546072925 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5430066850 con 0x7f543015e090 2023-10-08T12:45:09.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:09.917+0000 7f54177fe700 1 -- 172.21.15.78:0/1546072925 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f5428021020 con 0x7f543015e090 2023-10-08T12:45:10.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.000+0000 7f5435572700 1 -- 172.21.15.78:0/1546072925 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f4cac31c-3d7a-4373-b960-fa26a27918e3", "id": 2} v 0) v1 -- 0x7f54300af240 con 0x7f543015e090 2023-10-08T12:45:10.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.005+0000 7f54177fe700 1 -- 172.21.15.78:0/1546072925 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f4cac31c-3d7a-4373-b960-fa26a27918e3", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f54280264e0 con 0x7f543015e090 2023-10-08T12:45:10.006 INFO:teuthology.orchestra.run.smithi078.stdout:2 2023-10-08T12:45:10.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.006+0000 7f5435572700 1 -- 172.21.15.78:0/1546072925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f543015e090 msgr2=0x7f54300ade00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:10.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.006+0000 7f5435572700 1 --2- 172.21.15.78:0/1546072925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f543015e090 0x7f54300ade00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f542800b780 tx=0x7f5428007b60 comp rx=0 tx=0).stop 2023-10-08T12:45:10.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.006+0000 7f5435572700 1 -- 172.21.15.78:0/1546072925 shutdown_connections 2023-10-08T12:45:10.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.006+0000 7f5435572700 1 --2- 172.21.15.78:0/1546072925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f543015e090 0x7f54300ade00 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:10.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.006+0000 7f5435572700 1 --2- 172.21.15.78:0/1546072925 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f54300cfbe0 0x7f5430151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:10.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.006+0000 7f5435572700 1 --2- 172.21.15.78:0/1546072925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5430159900 0x7f543006b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:10.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.006+0000 7f5435572700 1 -- 172.21.15.78:0/1546072925 >> 172.21.15.78:0/1546072925 conn(0x7f5430088fb0 msgr2=0x7f54300b5080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:10.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.006+0000 7f5435572700 1 -- 172.21.15.78:0/1546072925 shutdown_connections 2023-10-08T12:45:10.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.006+0000 7f5435572700 1 -- 172.21.15.78:0/1546072925 wait complete. 2023-10-08T12:45:10.019 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new dfb35345-e091-4243-99ac-68d724d637a5 3 2023-10-08T12:45:10.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.180+0000 7f0fe797b700 1 -- 172.21.15.78:0/1616653995 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fe015c8c0 msgr2=0x7f0fe015cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:10.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.180+0000 7f0fe797b700 1 --2- 172.21.15.78:0/1616653995 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fe015c8c0 0x7f0fe015cca0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc005fd0 tx=0x7f0fdc009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:10.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.180+0000 7f0fe797b700 1 -- 172.21.15.78:0/1616653995 shutdown_connections 2023-10-08T12:45:10.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.180+0000 7f0fe797b700 1 --2- 172.21.15.78:0/1616653995 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fe006ea50 0x7f0fe00ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:10.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.180+0000 7f0fe797b700 1 --2- 172.21.15.78:0/1616653995 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fe015c8c0 0x7f0fe015cca0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:10.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.180+0000 7f0fe797b700 1 -- 172.21.15.78:0/1616653995 >> 172.21.15.78:0/1616653995 conn(0x7f0fe0097a20 msgr2=0x7f0fe00ce850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:10.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.180+0000 7f0fe797b700 1 -- 172.21.15.78:0/1616653995 shutdown_connections 2023-10-08T12:45:10.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.180+0000 7f0fe797b700 1 -- 172.21.15.78:0/1616653995 wait complete. 2023-10-08T12:45:10.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.182+0000 7f0fe797b700 1 Processor -- start 2023-10-08T12:45:10.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.182+0000 7f0fe797b700 1 -- start start 2023-10-08T12:45:10.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.182+0000 7f0fe797b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fe006ea50 0x7f0fe0156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:10.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.182+0000 7f0fe797b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fe00cc420 0x7f0fe006a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:10.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.182+0000 7f0fe797b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fe015c8c0 0x7f0fe006a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:10.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.182+0000 7f0fe797b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe00ae640 con 0x7f0fe015c8c0 2023-10-08T12:45:10.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.182+0000 7f0fe797b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe00c5920 con 0x7f0fe00cc420 2023-10-08T12:45:10.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.182+0000 7f0fe797b700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe00c5c00 con 0x7f0fe006ea50 2023-10-08T12:45:10.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.182+0000 7f0fe5717700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fe006ea50 0x7f0fe0156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:10.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.182+0000 7f0fe4f16700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fe00cc420 0x7f0fe006a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:10.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.182+0000 7f0fe5717700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fe006ea50 0x7f0fe0156c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:46942/0 (socket says 172.21.15.78:46942) 2023-10-08T12:45:10.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.182+0000 7f0fe5717700 1 -- 172.21.15.78:0/2702934579 learned_addr learned my addr 172.21.15.78:0/2702934579 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-08T12:45:10.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.183+0000 7f0fe5f18700 1 --2- 172.21.15.78:0/2702934579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fe015c8c0 0x7f0fe006a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:10.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.183+0000 7f0fe4f16700 1 -- 172.21.15.78:0/2702934579 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fe006ea50 msgr2=0x7f0fe0156c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:10.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.183+0000 7f0fe4f16700 1 --2- 172.21.15.78:0/2702934579 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fe006ea50 0x7f0fe0156c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:10.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.183+0000 7f0fe4f16700 1 -- 172.21.15.78:0/2702934579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fe015c8c0 msgr2=0x7f0fe006a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:10.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.183+0000 7f0fe4f16700 1 --2- 172.21.15.78:0/2702934579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fe015c8c0 0x7f0fe006a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:10.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.183+0000 7f0fe4f16700 1 -- 172.21.15.78:0/2702934579 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fdc0095f0 con 0x7f0fe00cc420 2023-10-08T12:45:10.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.183+0000 7f0fe5717700 1 --2- 172.21.15.78:0/2702934579 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fe006ea50 0x7f0fe0156c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:10.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.183+0000 7f0fe5f18700 1 --2- 172.21.15.78:0/2702934579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fe015c8c0 0x7f0fe006a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:10.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.183+0000 7f0fe4f16700 1 --2- 172.21.15.78:0/2702934579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fe00cc420 0x7f0fe006a210 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0000f60 tx=0x7f0fd000c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:10.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.183+0000 7f0fd5ffb700 1 -- 172.21.15.78:0/2702934579 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd00052d0 con 0x7f0fe00cc420 2023-10-08T12:45:10.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.183+0000 7f0fd5ffb700 1 -- 172.21.15.78:0/2702934579 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0fd0005520 con 0x7f0fe00cc420 2023-10-08T12:45:10.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.183+0000 7f0fd5ffb700 1 -- 172.21.15.78:0/2702934579 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd00038e0 con 0x7f0fe00cc420 2023-10-08T12:45:10.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.183+0000 7f0fe797b700 1 -- 172.21.15.78:0/2702934579 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fe00c5ee0 con 0x7f0fe00cc420 2023-10-08T12:45:10.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.183+0000 7f0fd5ffb700 1 -- 172.21.15.78:0/2702934579 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0fd0003d40 con 0x7f0fe00cc420 2023-10-08T12:45:10.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.183+0000 7f0fe797b700 1 -- 172.21.15.78:0/2702934579 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fe01571b0 con 0x7f0fe00cc420 2023-10-08T12:45:10.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.184+0000 7f0fd5ffb700 1 -- 172.21.15.78:0/2702934579 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f0fd0011a20 con 0x7f0fe00cc420 2023-10-08T12:45:10.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.184+0000 7f0fe797b700 1 -- 172.21.15.78:0/2702934579 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fe00c6400 con 0x7f0fe00cc420 2023-10-08T12:45:10.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.186+0000 7f0fd5ffb700 1 -- 172.21.15.78:0/2702934579 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f0fe00c6400 con 0x7f0fe00cc420 2023-10-08T12:45:10.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.268+0000 7f0fe797b700 1 -- 172.21.15.78:0/2702934579 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dfb35345-e091-4243-99ac-68d724d637a5", "id": 3} v 0) v1 -- 0x7f0fe0066850 con 0x7f0fe00cc420 2023-10-08T12:45:10.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.276+0000 7f0fd5ffb700 1 -- 172.21.15.78:0/2702934579 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dfb35345-e091-4243-99ac-68d724d637a5", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0fd0017070 con 0x7f0fe00cc420 2023-10-08T12:45:10.276 INFO:teuthology.orchestra.run.smithi078.stdout:3 2023-10-08T12:45:10.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.277+0000 7f0fe797b700 1 -- 172.21.15.78:0/2702934579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fe00cc420 msgr2=0x7f0fe006a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:10.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.277+0000 7f0fe797b700 1 --2- 172.21.15.78:0/2702934579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fe00cc420 0x7f0fe006a210 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0000f60 tx=0x7f0fd000c730 comp rx=0 tx=0).stop 2023-10-08T12:45:10.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.277+0000 7f0fe797b700 1 -- 172.21.15.78:0/2702934579 shutdown_connections 2023-10-08T12:45:10.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.277+0000 7f0fe797b700 1 --2- 172.21.15.78:0/2702934579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fe015c8c0 0x7f0fe006a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:10.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.277+0000 7f0fe797b700 1 --2- 172.21.15.78:0/2702934579 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fe006ea50 0x7f0fe0156c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:10.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.277+0000 7f0fe797b700 1 --2- 172.21.15.78:0/2702934579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fe00cc420 0x7f0fe006a210 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:10.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.277+0000 7f0fe797b700 1 -- 172.21.15.78:0/2702934579 >> 172.21.15.78:0/2702934579 conn(0x7f0fe0097a20 msgr2=0x7f0fe00c9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:10.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.277+0000 7f0fe797b700 1 -- 172.21.15.78:0/2702934579 shutdown_connections 2023-10-08T12:45:10.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.277+0000 7f0fe797b700 1 -- 172.21.15.78:0/2702934579 wait complete. 2023-10-08T12:45:10.289 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new 93d5b66a-f53b-4d06-aebc-62971b279ae9 4 2023-10-08T12:45:10.395 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-08T12:45:10.394+0000 7facc4800200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T12:45:10.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.415+0000 7fac0a442700 1 -- 172.21.15.78:0/3242907056 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac040b06d0 msgr2=0x7fac04097f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:10.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.415+0000 7fac0a442700 1 --2- 172.21.15.78:0/3242907056 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac040b06d0 0x7fac04097f60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fabf8005fd0 tx=0x7fabf8009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:10.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.415+0000 7fac0a442700 1 -- 172.21.15.78:0/3242907056 shutdown_connections 2023-10-08T12:45:10.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.415+0000 7fac0a442700 1 --2- 172.21.15.78:0/3242907056 >> v2:172.21.15.78:3300/0 conn(0x7fac0415d0c0 0x7fac04097a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:10.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.415+0000 7fac0a442700 1 --2- 172.21.15.78:0/3242907056 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac040b06d0 0x7fac04097f60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:10.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.415+0000 7fac0a442700 1 -- 172.21.15.78:0/3242907056 >> 172.21.15.78:0/3242907056 conn(0x7fac040b1290 msgr2=0x7fac040b16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:10.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.415+0000 7fac0a442700 1 -- 172.21.15.78:0/3242907056 shutdown_connections 2023-10-08T12:45:10.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.415+0000 7fac0a442700 1 -- 172.21.15.78:0/3242907056 wait complete. 2023-10-08T12:45:10.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.416+0000 7fac0a442700 1 Processor -- start 2023-10-08T12:45:10.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.416+0000 7fac0a442700 1 -- start start 2023-10-08T12:45:10.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.417+0000 7fac0a442700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac040984a0 0x7fac040adfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:10.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.417+0000 7fac0a442700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac040b06d0 0x7fac040ae510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:10.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.417+0000 7fac0a442700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac0415d0c0 0x7fac040c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:10.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.417+0000 7fac0a442700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac040ac6b0 con 0x7fac040984a0 2023-10-08T12:45:10.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.417+0000 7fac0a442700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac040aed50 con 0x7fac0415d0c0 2023-10-08T12:45:10.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.417+0000 7fac0a442700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac040af030 con 0x7fac040b06d0 2023-10-08T12:45:10.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.417+0000 7fac037fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac040b06d0 0x7fac040ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:10.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.417+0000 7fac089df700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac0415d0c0 0x7fac040c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:10.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.417+0000 7fac037fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac040b06d0 0x7fac040ae510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:46954/0 (socket says 172.21.15.78:46954) 2023-10-08T12:45:10.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.417+0000 7fac037fe700 1 -- 172.21.15.78:0/1257927452 learned_addr learned my addr 172.21.15.78:0/1257927452 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-08T12:45:10.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.417+0000 7fac03fff700 1 --2- 172.21.15.78:0/1257927452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac040984a0 0x7fac040adfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:10.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.417+0000 7fac037fe700 1 -- 172.21.15.78:0/1257927452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac0415d0c0 msgr2=0x7fac040c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:10.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.417+0000 7fac037fe700 1 --2- 172.21.15.78:0/1257927452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac0415d0c0 0x7fac040c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:10.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.417+0000 7fac037fe700 1 -- 172.21.15.78:0/1257927452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac040984a0 msgr2=0x7fac040adfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:10.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.417+0000 7fac037fe700 1 --2- 172.21.15.78:0/1257927452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac040984a0 0x7fac040adfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:10.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.417+0000 7fac037fe700 1 -- 172.21.15.78:0/1257927452 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf80095f0 con 0x7fac040b06d0 2023-10-08T12:45:10.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.417+0000 7fac089df700 1 --2- 172.21.15.78:0/1257927452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac0415d0c0 0x7fac040c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:10.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.418+0000 7fac037fe700 1 --2- 172.21.15.78:0/1257927452 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac040b06d0 0x7fac040ae510 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fabf80098e0 tx=0x7fabf8003d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:10.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.418+0000 7fac00ff9700 1 -- 172.21.15.78:0/1257927452 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf801d070 con 0x7fac040b06d0 2023-10-08T12:45:10.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.418+0000 7fac00ff9700 1 -- 172.21.15.78:0/1257927452 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fabf800b820 con 0x7fac040b06d0 2023-10-08T12:45:10.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.418+0000 7fac0a442700 1 -- 172.21.15.78:0/1257927452 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac040af310 con 0x7fac040b06d0 2023-10-08T12:45:10.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.418+0000 7fac00ff9700 1 -- 172.21.15.78:0/1257927452 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf80045f0 con 0x7fac040b06d0 2023-10-08T12:45:10.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.418+0000 7fac0a442700 1 -- 172.21.15.78:0/1257927452 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac040af8d0 con 0x7fac040b06d0 2023-10-08T12:45:10.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.419+0000 7fac00ff9700 1 -- 172.21.15.78:0/1257927452 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fabf800bc10 con 0x7fac040b06d0 2023-10-08T12:45:10.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.419+0000 7fac00ff9700 1 -- 172.21.15.78:0/1257927452 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fabf800fbe0 con 0x7fac040b06d0 2023-10-08T12:45:10.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.419+0000 7fac0a442700 1 -- 172.21.15.78:0/1257927452 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac040aeb10 con 0x7fac040b06d0 2023-10-08T12:45:10.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.421+0000 7fac00ff9700 1 -- 172.21.15.78:0/1257927452 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fac040aeb10 con 0x7fac040b06d0 2023-10-08T12:45:10.467 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-08T12:45:10.467+0000 7facc4800200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T12:45:10.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.506+0000 7fac0a442700 1 -- 172.21.15.78:0/1257927452 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd new", "uuid": "93d5b66a-f53b-4d06-aebc-62971b279ae9", "id": 4} v 0) v1 -- 0x7fac04066850 con 0x7fac040b06d0 2023-10-08T12:45:10.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.509+0000 7fac00ff9700 1 -- 172.21.15.78:0/1257927452 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "93d5b66a-f53b-4d06-aebc-62971b279ae9", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fabf8026070 con 0x7fac040b06d0 2023-10-08T12:45:10.510 INFO:teuthology.orchestra.run.smithi078.stdout:4 2023-10-08T12:45:10.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.510+0000 7fac0a442700 1 -- 172.21.15.78:0/1257927452 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac040b06d0 msgr2=0x7fac040ae510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:10.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.510+0000 7fac0a442700 1 --2- 172.21.15.78:0/1257927452 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac040b06d0 0x7fac040ae510 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fabf80098e0 tx=0x7fabf8003d00 comp rx=0 tx=0).stop 2023-10-08T12:45:10.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.510+0000 7fac0a442700 1 -- 172.21.15.78:0/1257927452 shutdown_connections 2023-10-08T12:45:10.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.510+0000 7fac0a442700 1 --2- 172.21.15.78:0/1257927452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac0415d0c0 0x7fac040c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:10.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.510+0000 7fac0a442700 1 --2- 172.21.15.78:0/1257927452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac040984a0 0x7fac040adfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:10.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.510+0000 7fac0a442700 1 --2- 172.21.15.78:0/1257927452 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac040b06d0 0x7fac040ae510 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:10.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.510+0000 7fac0a442700 1 -- 172.21.15.78:0/1257927452 >> 172.21.15.78:0/1257927452 conn(0x7fac040b1290 msgr2=0x7fac040cd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:10.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.510+0000 7fac0a442700 1 -- 172.21.15.78:0/1257927452 shutdown_connections 2023-10-08T12:45:10.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.510+0000 7fac0a442700 1 -- 172.21.15.78:0/1257927452 wait complete. 2023-10-08T12:45:10.522 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new a8533314-3df2-48fa-878d-8b889893625b 5 2023-10-08T12:45:10.533 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-10-08T12:45:10.533+0000 7fd6ecad2200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:45:10.615 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-10-08T12:45:10.614+0000 7fd6ecad2200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T12:45:10.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.644+0000 7f432dd79700 1 -- 172.21.15.78:0/2091367229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f432815e090 msgr2=0x7f43280cf4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:10.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.644+0000 7f432dd79700 1 --2- 172.21.15.78:0/2091367229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f432815e090 0x7f43280cf4d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4310005fd0 tx=0x7f4310009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:10.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.644+0000 7f432dd79700 1 -- 172.21.15.78:0/2091367229 shutdown_connections 2023-10-08T12:45:10.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.644+0000 7f432dd79700 1 --2- 172.21.15.78:0/2091367229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f432815e090 0x7f43280cf4d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:10.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.644+0000 7f432dd79700 1 -- 172.21.15.78:0/2091367229 >> 172.21.15.78:0/2091367229 conn(0x7f4328088fb0 msgr2=0x7f43280893c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:10.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.644+0000 7f432dd79700 1 -- 172.21.15.78:0/2091367229 shutdown_connections 2023-10-08T12:45:10.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.644+0000 7f432dd79700 1 -- 172.21.15.78:0/2091367229 wait complete. 2023-10-08T12:45:10.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.645+0000 7f432dd79700 1 Processor -- start 2023-10-08T12:45:10.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.646+0000 7f432dd79700 1 -- start start 2023-10-08T12:45:10.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.646+0000 7f432dd79700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43280cfa10 0x7f4328152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:10.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.646+0000 7f432dd79700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4328159900 0x7f432814d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:10.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.646+0000 7f432dd79700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f432815e090 0x7f43280c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:10.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.646+0000 7f432dd79700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4328152d60 con 0x7f432815e090 2023-10-08T12:45:10.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.646+0000 7f432dd79700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43280c6850 con 0x7f4328159900 2023-10-08T12:45:10.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.646+0000 7f432dd79700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43280c6aa0 con 0x7f43280cfa10 2023-10-08T12:45:10.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.646+0000 7f43277fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43280cfa10 0x7f4328152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:10.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.647+0000 7f4326ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4328159900 0x7f432814d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:10.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.647+0000 7f43277fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43280cfa10 0x7f4328152820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:46966/0 (socket says 172.21.15.78:46966) 2023-10-08T12:45:10.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.647+0000 7f4326ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4328159900 0x7f432814d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55284/0 (socket says 172.21.15.78:55284) 2023-10-08T12:45:10.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.647+0000 7f43277fe700 1 -- 172.21.15.78:0/1256321516 learned_addr learned my addr 172.21.15.78:0/1256321516 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-08T12:45:10.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.647+0000 7f4327fff700 1 --2- 172.21.15.78:0/1256321516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f432815e090 0x7f43280c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:10.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.647+0000 7f4326ffd700 1 -- 172.21.15.78:0/1256321516 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43280cfa10 msgr2=0x7f4328152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:10.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.647+0000 7f4326ffd700 1 --2- 172.21.15.78:0/1256321516 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43280cfa10 0x7f4328152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:10.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.647+0000 7f4326ffd700 1 -- 172.21.15.78:0/1256321516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f432815e090 msgr2=0x7f43280c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:10.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.647+0000 7f4326ffd700 1 --2- 172.21.15.78:0/1256321516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f432815e090 0x7f43280c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:10.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.647+0000 7f4326ffd700 1 -- 172.21.15.78:0/1256321516 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43100095f0 con 0x7f4328159900 2023-10-08T12:45:10.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.647+0000 7f43277fe700 1 --2- 172.21.15.78:0/1256321516 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43280cfa10 0x7f4328152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:10.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.647+0000 7f4326ffd700 1 --2- 172.21.15.78:0/1256321516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4328159900 0x7f432814d960 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4310015000 tx=0x7f4310004260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:10.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.647+0000 7f431ffff700 1 -- 172.21.15.78:0/1256321516 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431001c070 con 0x7f4328159900 2023-10-08T12:45:10.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.647+0000 7f431ffff700 1 -- 172.21.15.78:0/1256321516 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4310003890 con 0x7f4328159900 2023-10-08T12:45:10.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.647+0000 7f431ffff700 1 -- 172.21.15.78:0/1256321516 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4310003c80 con 0x7f4328159900 2023-10-08T12:45:10.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.647+0000 7f432dd79700 1 -- 172.21.15.78:0/1256321516 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43280c6d80 con 0x7f4328159900 2023-10-08T12:45:10.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.647+0000 7f432dd79700 1 -- 172.21.15.78:0/1256321516 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43280c7340 con 0x7f4328159900 2023-10-08T12:45:10.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.647+0000 7f431ffff700 1 -- 172.21.15.78:0/1256321516 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f431000f460 con 0x7f4328159900 2023-10-08T12:45:10.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.647+0000 7f431ffff700 1 -- 172.21.15.78:0/1256321516 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f4310003de0 con 0x7f4328159900 2023-10-08T12:45:10.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.648+0000 7f432dd79700 1 -- 172.21.15.78:0/1256321516 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43280acbd0 con 0x7f4328159900 2023-10-08T12:45:10.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.650+0000 7f431ffff700 1 -- 172.21.15.78:0/1256321516 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f4310025070 con 0x7f4328159900 2023-10-08T12:45:10.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.747+0000 7f432dd79700 1 -- 172.21.15.78:0/1256321516 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a8533314-3df2-48fa-878d-8b889893625b", "id": 5} v 0) v1 -- 0x7f43280af240 con 0x7f4328159900 2023-10-08T12:45:10.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.750+0000 7f431ffff700 1 -- 172.21.15.78:0/1256321516 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a8533314-3df2-48fa-878d-8b889893625b", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f431000fa10 con 0x7f4328159900 2023-10-08T12:45:10.750 INFO:teuthology.orchestra.run.smithi078.stdout:5 2023-10-08T12:45:10.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.750+0000 7f432dd79700 1 -- 172.21.15.78:0/1256321516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4328159900 msgr2=0x7f432814d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:10.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.750+0000 7f432dd79700 1 --2- 172.21.15.78:0/1256321516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4328159900 0x7f432814d960 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4310015000 tx=0x7f4310004260 comp rx=0 tx=0).stop 2023-10-08T12:45:10.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.750+0000 7f432dd79700 1 -- 172.21.15.78:0/1256321516 shutdown_connections 2023-10-08T12:45:10.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.750+0000 7f432dd79700 1 --2- 172.21.15.78:0/1256321516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f432815e090 0x7f43280c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:10.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.750+0000 7f432dd79700 1 --2- 172.21.15.78:0/1256321516 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43280cfa10 0x7f4328152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:10.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.750+0000 7f432dd79700 1 --2- 172.21.15.78:0/1256321516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4328159900 0x7f432814d960 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:10.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.750+0000 7f432dd79700 1 -- 172.21.15.78:0/1256321516 >> 172.21.15.78:0/1256321516 conn(0x7f4328088fb0 msgr2=0x7f43280ac330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:10.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.751+0000 7f432dd79700 1 -- 172.21.15.78:0/1256321516 shutdown_connections 2023-10-08T12:45:10.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.751+0000 7f432dd79700 1 -- 172.21.15.78:0/1256321516 wait complete. 2023-10-08T12:45:10.763 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new d1f5a82f-4b2d-4102-99a7-cb66a0ea8286 6 2023-10-08T12:45:10.772 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-10-08T12:45:10.771+0000 7fd6ecad2200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:45:10.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.893+0000 7f31ace0a700 1 -- 172.21.15.78:0/3187186695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31a8072400 msgr2=0x7f31a80cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:10.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.893+0000 7f31ace0a700 1 --2- 172.21.15.78:0/3187186695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31a8072400 0x7f31a80cd910 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f319c005fd0 tx=0x7f319c009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:10.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.893+0000 7f31ace0a700 1 -- 172.21.15.78:0/3187186695 shutdown_connections 2023-10-08T12:45:10.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.893+0000 7f31ace0a700 1 --2- 172.21.15.78:0/3187186695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31a8072400 0x7f31a80cd910 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:10.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.893+0000 7f31ace0a700 1 -- 172.21.15.78:0/3187186695 >> 172.21.15.78:0/3187186695 conn(0x7f31a806b320 msgr2=0x7f31a806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:10.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.893+0000 7f31ace0a700 1 -- 172.21.15.78:0/3187186695 shutdown_connections 2023-10-08T12:45:10.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.894+0000 7f31ace0a700 1 -- 172.21.15.78:0/3187186695 wait complete. 2023-10-08T12:45:10.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.895+0000 7f31ace0a700 1 Processor -- start 2023-10-08T12:45:10.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.895+0000 7f31ace0a700 1 -- start start 2023-10-08T12:45:10.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.895+0000 7f31ace0a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31a8072400 0x7f31a814cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:10.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.895+0000 7f31ace0a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f31a80cde50 0x7f31a81efe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:10.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.896+0000 7f31ace0a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31a8159a30 0x7f31a80ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:10.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.896+0000 7f31ace0a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a81e2180 con 0x7f31a8072400 2023-10-08T12:45:10.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.896+0000 7f31ace0a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a81e3b90 con 0x7f31a8159a30 2023-10-08T12:45:10.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.896+0000 7f31ace0a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a81e3e70 con 0x7f31a80cde50 2023-10-08T12:45:10.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.896+0000 7f31a5d9b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f31a80cde50 0x7f31a81efe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:10.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.896+0000 7f31a5d9b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f31a80cde50 0x7f31a81efe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:46978/0 (socket says 172.21.15.78:46978) 2023-10-08T12:45:10.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.896+0000 7f31a6d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31a8159a30 0x7f31a80ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:10.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.896+0000 7f31a5d9b700 1 -- 172.21.15.78:0/1895371889 learned_addr learned my addr 172.21.15.78:0/1895371889 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-08T12:45:10.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.896+0000 7f31a659c700 1 --2- 172.21.15.78:0/1895371889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31a8072400 0x7f31a814cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:10.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.896+0000 7f31a5d9b700 1 -- 172.21.15.78:0/1895371889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31a8159a30 msgr2=0x7f31a80ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:10.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.896+0000 7f31a5d9b700 1 --2- 172.21.15.78:0/1895371889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31a8159a30 0x7f31a80ad8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:10.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.896+0000 7f31a5d9b700 1 -- 172.21.15.78:0/1895371889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31a8072400 msgr2=0x7f31a814cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:10.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.896+0000 7f31a5d9b700 1 --2- 172.21.15.78:0/1895371889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31a8072400 0x7f31a814cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:10.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.896+0000 7f31a5d9b700 1 -- 172.21.15.78:0/1895371889 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319c0095f0 con 0x7f31a80cde50 2023-10-08T12:45:10.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.896+0000 7f31a5d9b700 1 --2- 172.21.15.78:0/1895371889 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f31a80cde50 0x7f31a81efe70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f31a806b2f0 tx=0x7f319c004260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:10.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.896+0000 7f3196ffd700 1 -- 172.21.15.78:0/1895371889 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c01d070 con 0x7f31a80cde50 2023-10-08T12:45:10.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.896+0000 7f3196ffd700 1 -- 172.21.15.78:0/1895371889 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f319c003890 con 0x7f31a80cde50 2023-10-08T12:45:10.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.896+0000 7f3196ffd700 1 -- 172.21.15.78:0/1895371889 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c003ca0 con 0x7f31a80cde50 2023-10-08T12:45:10.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.896+0000 7f31ace0a700 1 -- 172.21.15.78:0/1895371889 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a81e4150 con 0x7f31a80cde50 2023-10-08T12:45:10.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.896+0000 7f31ace0a700 1 -- 172.21.15.78:0/1895371889 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a81f03b0 con 0x7f31a80cde50 2023-10-08T12:45:10.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.897+0000 7f3196ffd700 1 -- 172.21.15.78:0/1895371889 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f319c004830 con 0x7f31a80cde50 2023-10-08T12:45:10.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.897+0000 7f3196ffd700 1 -- 172.21.15.78:0/1895371889 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f319c022470 con 0x7f31a80cde50 2023-10-08T12:45:10.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.897+0000 7f31ace0a700 1 -- 172.21.15.78:0/1895371889 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a81e22f0 con 0x7f31a80cde50 2023-10-08T12:45:10.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.899+0000 7f3196ffd700 1 -- 172.21.15.78:0/1895371889 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f31a81e22f0 con 0x7f31a80cde50 2023-10-08T12:45:10.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.983+0000 7f31ace0a700 1 -- 172.21.15.78:0/1895371889 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d1f5a82f-4b2d-4102-99a7-cb66a0ea8286", "id": 6} v 0) v1 -- 0x7f31a806c2b0 con 0x7f31a80cde50 2023-10-08T12:45:10.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.986+0000 7f3196ffd700 1 -- 172.21.15.78:0/1895371889 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d1f5a82f-4b2d-4102-99a7-cb66a0ea8286", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f319c004d10 con 0x7f31a80cde50 2023-10-08T12:45:10.986 INFO:teuthology.orchestra.run.smithi078.stdout:6 2023-10-08T12:45:10.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.987+0000 7f31ace0a700 1 -- 172.21.15.78:0/1895371889 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f31a80cde50 msgr2=0x7f31a81efe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:10.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.987+0000 7f31ace0a700 1 --2- 172.21.15.78:0/1895371889 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f31a80cde50 0x7f31a81efe70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f31a806b2f0 tx=0x7f319c004260 comp rx=0 tx=0).stop 2023-10-08T12:45:10.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.987+0000 7f31ace0a700 1 -- 172.21.15.78:0/1895371889 shutdown_connections 2023-10-08T12:45:10.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.987+0000 7f31ace0a700 1 --2- 172.21.15.78:0/1895371889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31a8159a30 0x7f31a80ad8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:10.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.987+0000 7f31ace0a700 1 --2- 172.21.15.78:0/1895371889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31a8072400 0x7f31a814cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:10.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.987+0000 7f31ace0a700 1 --2- 172.21.15.78:0/1895371889 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f31a80cde50 0x7f31a81efe70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:10.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.987+0000 7f31ace0a700 1 -- 172.21.15.78:0/1895371889 >> 172.21.15.78:0/1895371889 conn(0x7f31a806b320 msgr2=0x7f31a81576f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:10.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.987+0000 7f31ace0a700 1 -- 172.21.15.78:0/1895371889 shutdown_connections 2023-10-08T12:45:10.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:10.987+0000 7f31ace0a700 1 -- 172.21.15.78:0/1895371889 wait complete. 2023-10-08T12:45:10.999 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new 1f5d41b2-6c06-44b0-992b-74e9911b49b2 7 2023-10-08T12:45:11.020 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-10-08T12:45:11.019+0000 7fd6ecad2200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T12:45:11.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.124+0000 7f2cc2131700 1 -- 172.21.15.78:0/857107834 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cbc0acf90 msgr2=0x7f2cbc159590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:11.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.124+0000 7f2cc2131700 1 --2- 172.21.15.78:0/857107834 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cbc0acf90 0x7f2cbc159590 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4005fd0 tx=0x7f2ca4009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:11.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.124+0000 7f2cc2131700 1 -- 172.21.15.78:0/857107834 shutdown_connections 2023-10-08T12:45:11.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.124+0000 7f2cc2131700 1 --2- 172.21.15.78:0/857107834 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2cbc1591b0 0x7f2cbc06b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.124+0000 7f2cc2131700 1 --2- 172.21.15.78:0/857107834 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cbc0acf90 0x7f2cbc159590 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.124+0000 7f2cc2131700 1 -- 172.21.15.78:0/857107834 >> 172.21.15.78:0/857107834 conn(0x7f2cbc0cddc0 msgr2=0x7f2cbc0ce1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:11.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.124+0000 7f2cc2131700 1 -- 172.21.15.78:0/857107834 shutdown_connections 2023-10-08T12:45:11.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.124+0000 7f2cc2131700 1 -- 172.21.15.78:0/857107834 wait complete. 2023-10-08T12:45:11.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.125+0000 7f2cc2131700 1 Processor -- start 2023-10-08T12:45:11.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.125+0000 7f2cc2131700 1 -- start start 2023-10-08T12:45:11.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.126+0000 7f2cc2131700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2cbc0acf90 0x7f2cbc150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:11.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.126+0000 7f2cc2131700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cbc1591b0 0x7f2cbc1f0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:11.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.126+0000 7f2cc2131700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cbc159ad0 0x7f2cbc15b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:11.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.126+0000 7f2cc2131700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cbc1f0870 con 0x7f2cbc159ad0 2023-10-08T12:45:11.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.126+0000 7f2cc2131700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cbc1f3920 con 0x7f2cbc1591b0 2023-10-08T12:45:11.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.126+0000 7f2cc2131700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cbc1f0ab0 con 0x7f2cbc0acf90 2023-10-08T12:45:11.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.126+0000 7f2cbb7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2cbc0acf90 0x7f2cbc150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:11.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.126+0000 7f2cbb7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2cbc0acf90 0x7f2cbc150300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:46988/0 (socket says 172.21.15.78:46988) 2023-10-08T12:45:11.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.126+0000 7f2cbaffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cbc1591b0 0x7f2cbc1f0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:11.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.126+0000 7f2cbb7fe700 1 -- 172.21.15.78:0/2764735835 learned_addr learned my addr 172.21.15.78:0/2764735835 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-08T12:45:11.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.126+0000 7f2cbbfff700 1 --2- 172.21.15.78:0/2764735835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cbc159ad0 0x7f2cbc15b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:11.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.126+0000 7f2cbb7fe700 1 -- 172.21.15.78:0/2764735835 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cbc1591b0 msgr2=0x7f2cbc1f0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:11.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.126+0000 7f2cbb7fe700 1 --2- 172.21.15.78:0/2764735835 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cbc1591b0 0x7f2cbc1f0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.126+0000 7f2cbb7fe700 1 -- 172.21.15.78:0/2764735835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cbc159ad0 msgr2=0x7f2cbc15b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:11.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.126+0000 7f2cbb7fe700 1 --2- 172.21.15.78:0/2764735835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cbc159ad0 0x7f2cbc15b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.126+0000 7f2cbb7fe700 1 -- 172.21.15.78:0/2764735835 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cac009520 con 0x7f2cbc0acf90 2023-10-08T12:45:11.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.126+0000 7f2cbaffd700 1 --2- 172.21.15.78:0/2764735835 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cbc1591b0 0x7f2cbc1f0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:11.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.127+0000 7f2cbb7fe700 1 --2- 172.21.15.78:0/2764735835 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2cbc0acf90 0x7f2cbc150300 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00eb30 tx=0x7f2cac00ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:11.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.127+0000 7f2cb3fff700 1 -- 172.21.15.78:0/2764735835 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac009880 con 0x7f2cbc0acf90 2023-10-08T12:45:11.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.127+0000 7f2cc2131700 1 -- 172.21.15.78:0/2764735835 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca40095f0 con 0x7f2cbc0acf90 2023-10-08T12:45:11.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.127+0000 7f2cb3fff700 1 -- 172.21.15.78:0/2764735835 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2cac00cbd0 con 0x7f2cbc0acf90 2023-10-08T12:45:11.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.127+0000 7f2cb3fff700 1 -- 172.21.15.78:0/2764735835 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac004020 con 0x7f2cbc0acf90 2023-10-08T12:45:11.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.127+0000 7f2cc2131700 1 -- 172.21.15.78:0/2764735835 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cbc1f1070 con 0x7f2cbc0acf90 2023-10-08T12:45:11.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.127+0000 7f2cb3fff700 1 -- 172.21.15.78:0/2764735835 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2cac004180 con 0x7f2cbc0acf90 2023-10-08T12:45:11.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.127+0000 7f2cb3fff700 1 -- 172.21.15.78:0/2764735835 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f2cac014070 con 0x7f2cbc0acf90 2023-10-08T12:45:11.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.128+0000 7f2cc2131700 1 -- 172.21.15.78:0/2764735835 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cbc0cdbc0 con 0x7f2cbc0acf90 2023-10-08T12:45:11.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.130+0000 7f2cb3fff700 1 -- 172.21.15.78:0/2764735835 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f2cac004900 con 0x7f2cbc0acf90 2023-10-08T12:45:11.199 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-08T12:45:11.198+0000 7facc4800200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:45:11.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.212+0000 7f2cc2131700 1 -- 172.21.15.78:0/2764735835 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1f5d41b2-6c06-44b0-992b-74e9911b49b2", "id": 7} v 0) v1 -- 0x7f2cbc067470 con 0x7f2cbc0acf90 2023-10-08T12:45:11.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.216+0000 7f2cb3fff700 1 -- 172.21.15.78:0/2764735835 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1f5d41b2-6c06-44b0-992b-74e9911b49b2", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2cac004aa0 con 0x7f2cbc0acf90 2023-10-08T12:45:11.216 INFO:teuthology.orchestra.run.smithi078.stdout:7 2023-10-08T12:45:11.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.217+0000 7f2cc2131700 1 -- 172.21.15.78:0/2764735835 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2cbc0acf90 msgr2=0x7f2cbc150300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:11.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.217+0000 7f2cc2131700 1 --2- 172.21.15.78:0/2764735835 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2cbc0acf90 0x7f2cbc150300 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00eb30 tx=0x7f2cac00ee40 comp rx=0 tx=0).stop 2023-10-08T12:45:11.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.217+0000 7f2cc2131700 1 -- 172.21.15.78:0/2764735835 shutdown_connections 2023-10-08T12:45:11.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.217+0000 7f2cc2131700 1 --2- 172.21.15.78:0/2764735835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cbc159ad0 0x7f2cbc15b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.217+0000 7f2cc2131700 1 --2- 172.21.15.78:0/2764735835 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2cbc0acf90 0x7f2cbc150300 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.217+0000 7f2cc2131700 1 --2- 172.21.15.78:0/2764735835 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cbc1591b0 0x7f2cbc1f0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.217+0000 7f2cc2131700 1 -- 172.21.15.78:0/2764735835 >> 172.21.15.78:0/2764735835 conn(0x7f2cbc0cddc0 msgr2=0x7f2cbc14c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:11.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.217+0000 7f2cc2131700 1 -- 172.21.15.78:0/2764735835 shutdown_connections 2023-10-08T12:45:11.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-08T12:45:11.217+0000 7f2cc2131700 1 -- 172.21.15.78:0/2764735835 wait complete. 2023-10-08T12:45:11.229 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-08T12:45:11.229 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-08T12:45:11.231 INFO:tasks.ceph.osd.0:Started 2023-10-08T12:45:11.232 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-08T12:45:11.232 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-08T12:45:11.234 INFO:tasks.ceph.osd.1:Started 2023-10-08T12:45:11.234 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-08T12:45:11.234 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-08T12:45:11.236 INFO:tasks.ceph.osd.2:Started 2023-10-08T12:45:11.236 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-08T12:45:11.236 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-08T12:45:11.239 INFO:tasks.ceph.osd.3:Started 2023-10-08T12:45:11.239 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-08T12:45:11.239 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-08T12:45:11.240 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-10-08T12:45:11.238+0000 7fd6ecad2200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T12:45:11.241 INFO:tasks.ceph.osd.4:Started 2023-10-08T12:45:11.241 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-08T12:45:11.241 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-08T12:45:11.243 INFO:tasks.ceph.osd.5:Started 2023-10-08T12:45:11.243 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-08T12:45:11.243 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-08T12:45:11.245 INFO:tasks.ceph.osd.6:Started 2023-10-08T12:45:11.245 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-08T12:45:11.246 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-08T12:45:11.248 INFO:tasks.ceph.osd.7:Started 2023-10-08T12:45:11.248 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:45:11.311 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-08T12:45:11.310+0000 7facc4800200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T12:45:11.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.407+0000 7fc633c3a700 1 -- 172.21.15.45:0/28769001 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc62c0b7340 msgr2=0x7fc62c0d0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:11.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.407+0000 7fc633c3a700 1 --2- 172.21.15.45:0/28769001 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc62c0b7340 0x7fc62c0d0770 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc624009f90 tx=0x7fc62400b330 comp rx=0 tx=0).stop 2023-10-08T12:45:11.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.407+0000 7fc633c3a700 1 -- 172.21.15.45:0/28769001 shutdown_connections 2023-10-08T12:45:11.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.407+0000 7fc633c3a700 1 --2- 172.21.15.45:0/28769001 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc62c0b7340 0x7fc62c0d0770 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.407+0000 7fc633c3a700 1 -- 172.21.15.45:0/28769001 >> 172.21.15.45:0/28769001 conn(0x7fc62c06ba10 msgr2=0x7fc62c06be20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:11.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.407+0000 7fc633c3a700 1 -- 172.21.15.45:0/28769001 shutdown_connections 2023-10-08T12:45:11.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.407+0000 7fc633c3a700 1 -- 172.21.15.45:0/28769001 wait complete. 2023-10-08T12:45:11.409 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-10-08T12:45:11.409+0000 7fd6ecad2200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T12:45:11.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.408+0000 7fc633c3a700 1 Processor -- start 2023-10-08T12:45:11.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.408+0000 7fc633c3a700 1 -- start start 2023-10-08T12:45:11.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.409+0000 7fc633c3a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc62c0b7340 0x7fc62c156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:11.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.409+0000 7fc633c3a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc62c0d2050 0x7fc62c1546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:11.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.409+0000 7fc633c3a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc62c15ba80 0x7fc62c15e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:11.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.409+0000 7fc633c3a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c0c8f90 con 0x7fc62c15ba80 2023-10-08T12:45:11.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.409+0000 7fc633c3a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c154bf0 con 0x7fc62c0d2050 2023-10-08T12:45:11.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.409+0000 7fc633c3a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c157440 con 0x7fc62c0b7340 2023-10-08T12:45:11.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.409+0000 7fc6321d7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc62c15ba80 0x7fc62c15e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:11.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.409+0000 7fc6321d7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc62c15ba80 0x7fc62c15e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34358/0 (socket says 172.21.15.45:34358) 2023-10-08T12:45:11.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.409+0000 7fc6321d7700 1 -- 172.21.15.45:0/3251781831 learned_addr learned my addr 172.21.15.45:0/3251781831 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:11.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.409+0000 7fc6319d6700 1 --2- 172.21.15.45:0/3251781831 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc62c0b7340 0x7fc62c156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:11.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.409+0000 7fc6311d5700 1 --2- 172.21.15.45:0/3251781831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc62c0d2050 0x7fc62c1546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:11.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.409+0000 7fc6319d6700 1 -- 172.21.15.45:0/3251781831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc62c0d2050 msgr2=0x7fc62c1546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:11.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.409+0000 7fc6319d6700 1 --2- 172.21.15.45:0/3251781831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc62c0d2050 0x7fc62c1546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.409+0000 7fc6319d6700 1 -- 172.21.15.45:0/3251781831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc62c15ba80 msgr2=0x7fc62c15e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:11.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.409+0000 7fc6319d6700 1 --2- 172.21.15.45:0/3251781831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc62c15ba80 0x7fc62c15e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.409+0000 7fc6319d6700 1 -- 172.21.15.45:0/3251781831 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc624009c40 con 0x7fc62c0b7340 2023-10-08T12:45:11.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.409+0000 7fc6319d6700 1 --2- 172.21.15.45:0/3251781831 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc62c0b7340 0x7fc62c156d80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc62800c3c0 tx=0x7fc62800c6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:11.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.410+0000 7fc6227fc700 1 -- 172.21.15.45:0/3251781831 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6280052d0 con 0x7fc62c0b7340 2023-10-08T12:45:11.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.410+0000 7fc6227fc700 1 -- 172.21.15.45:0/3251781831 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc628005520 con 0x7fc62c0b7340 2023-10-08T12:45:11.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.410+0000 7fc633c3a700 1 -- 172.21.15.45:0/3251781831 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc62c15f9a0 con 0x7fc62c0b7340 2023-10-08T12:45:11.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.410+0000 7fc6227fc700 1 -- 172.21.15.45:0/3251781831 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6280038e0 con 0x7fc62c0b7340 2023-10-08T12:45:11.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.410+0000 7fc633c3a700 1 -- 172.21.15.45:0/3251781831 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc62c0c8c20 con 0x7fc62c0b7340 2023-10-08T12:45:11.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.410+0000 7fc6227fc700 1 -- 172.21.15.45:0/3251781831 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc628003d40 con 0x7fc62c0b7340 2023-10-08T12:45:11.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.410+0000 7fc6227fc700 1 -- 172.21.15.45:0/3251781831 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fc62801cb10 con 0x7fc62c0b7340 2023-10-08T12:45:11.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.411+0000 7fc633c3a700 1 -- 172.21.15.45:0/3251781831 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc62c0c8a60 con 0x7fc62c0b7340 2023-10-08T12:45:11.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.413+0000 7fc6227fc700 1 -- 172.21.15.45:0/3251781831 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fc628017070 con 0x7fc62c0b7340 2023-10-08T12:45:11.479 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-08T12:45:11.478+0000 7facc4800200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:45:11.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.485+0000 7fc633c3a700 1 -- 172.21.15.45:0/3251781831 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc62c0d1530 con 0x7fc62c0b7340 2023-10-08T12:45:11.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.485+0000 7fc6227fc700 1 -- 172.21.15.45:0/3251781831 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fc62801c570 con 0x7fc62c0b7340 2023-10-08T12:45:11.486 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:11.486 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":10,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:45:11.214453+0000","last_up_change":"0.000000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:45:11.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.486+0000 7fc633c3a700 1 -- 172.21.15.45:0/3251781831 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc62c0b7340 msgr2=0x7fc62c156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:11.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.486+0000 7fc633c3a700 1 --2- 172.21.15.45:0/3251781831 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc62c0b7340 0x7fc62c156d80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc62800c3c0 tx=0x7fc62800c6d0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.486+0000 7fc633c3a700 1 -- 172.21.15.45:0/3251781831 shutdown_connections 2023-10-08T12:45:11.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.486+0000 7fc633c3a700 1 --2- 172.21.15.45:0/3251781831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc62c15ba80 0x7fc62c15e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.486+0000 7fc633c3a700 1 --2- 172.21.15.45:0/3251781831 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc62c0b7340 0x7fc62c156d80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.486+0000 7fc633c3a700 1 --2- 172.21.15.45:0/3251781831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc62c0d2050 0x7fc62c1546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.486+0000 7fc633c3a700 1 -- 172.21.15.45:0/3251781831 >> 172.21.15.45:0/3251781831 conn(0x7fc62c06ba10 msgr2=0x7fc62c0d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:11.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.486+0000 7fc633c3a700 1 -- 172.21.15.45:0/3251781831 shutdown_connections 2023-10-08T12:45:11.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:11.486+0000 7fc633c3a700 1 -- 172.21.15.45:0/3251781831 wait complete. 2023-10-08T12:45:11.499 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-08T12:45:11.499 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-08T12:45:11.631 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-10-08T12:45:11.631+0000 7fd6ecad2200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T12:45:11.729 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-08T12:45:11.728+0000 7facc4800200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T12:45:11.786 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-10-08T12:45:11.786+0000 7fd6ecad2200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T12:45:11.841 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-08T12:45:11.840+0000 7f8516881640 -1 Falling back to public interface 2023-10-08T12:45:11.846 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-10-08T12:45:11.845+0000 7f399ca9f640 -1 Falling back to public interface 2023-10-08T12:45:11.849 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-10-08T12:45:11.849+0000 7eff2544d640 -1 Falling back to public interface 2023-10-08T12:45:11.849 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-10-08T12:45:11.849+0000 7f0d2c31b640 -1 Falling back to public interface 2023-10-08T12:45:11.853 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T12:45:11.852+0000 7fae62672640 -1 Falling back to public interface 2023-10-08T12:45:11.862 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T12:45:11.861+0000 7f129da33640 -1 Falling back to public interface 2023-10-08T12:45:11.869 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T12:45:11.866+0000 7ff170cad640 -1 Falling back to public interface 2023-10-08T12:45:11.876 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T12:45:11.875+0000 7f485c6c3640 -1 Falling back to public interface 2023-10-08T12:45:11.906 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-10-08T12:45:11.905+0000 7fd6ecad2200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T12:45:11.950 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-08T12:45:11.949+0000 7facc4800200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T12:45:12.092 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-08T12:45:12.092+0000 7facc4800200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T12:45:12.225 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-10-08T12:45:12.224+0000 7fd6ecad2200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T12:45:12.303 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-08T12:45:12.323 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-10-08T12:45:12.322+0000 7fd6ecad2200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T12:45:12.326 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-08T12:45:12.325+0000 7facc4800200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T12:45:12.421 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.420+0000 7fe7615f2700 1 -- 172.21.15.45:0/185218211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe75c159a20 msgr2=0x7fe75c06a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:12.422 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.420+0000 7fe7615f2700 1 --2- 172.21.15.45:0/185218211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe75c159a20 0x7fe75c06a630 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe74c005fd0 tx=0x7fe74c009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:12.422 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.420+0000 7fe7615f2700 1 -- 172.21.15.45:0/185218211 shutdown_connections 2023-10-08T12:45:12.422 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.420+0000 7fe7615f2700 1 --2- 172.21.15.45:0/185218211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe75c159a20 0x7fe75c06a630 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:12.422 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.420+0000 7fe7615f2700 1 -- 172.21.15.45:0/185218211 >> 172.21.15.45:0/185218211 conn(0x7fe75c0b03c0 msgr2=0x7fe75c0b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:12.422 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.421+0000 7fe7615f2700 1 -- 172.21.15.45:0/185218211 shutdown_connections 2023-10-08T12:45:12.422 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.421+0000 7fe7615f2700 1 -- 172.21.15.45:0/185218211 wait complete. 2023-10-08T12:45:12.423 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.422+0000 7fe7615f2700 1 Processor -- start 2023-10-08T12:45:12.423 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.422+0000 7fe7615f2700 1 -- start start 2023-10-08T12:45:12.425 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.423+0000 7fe7615f2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe75c06ab70 0x7fe75c14d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:12.425 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.423+0000 7fe7615f2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe75c072420 0x7fe75c148330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:12.426 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.423+0000 7fe7615f2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe75c159a20 0x7fe75c14caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:12.426 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.423+0000 7fe7615f2700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c14dcf0 con 0x7fe75c159a20 2023-10-08T12:45:12.426 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.423+0000 7fe7615f2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c1f1ab0 con 0x7fe75c06ab70 2023-10-08T12:45:12.426 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.423+0000 7fe7615f2700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c14b450 con 0x7fe75c072420 2023-10-08T12:45:12.426 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.423+0000 7fe75b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe75c159a20 0x7fe75c14caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:12.426 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.423+0000 7fe75affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe75c06ab70 0x7fe75c14d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:12.426 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.423+0000 7fe75b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe75c159a20 0x7fe75c14caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34370/0 (socket says 172.21.15.45:34370) 2023-10-08T12:45:12.426 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.423+0000 7fe75b7fe700 1 -- 172.21.15.45:0/951312557 learned_addr learned my addr 172.21.15.45:0/951312557 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:12.426 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.423+0000 7fe75a7fc700 1 --2- 172.21.15.45:0/951312557 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe75c072420 0x7fe75c148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:12.426 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.423+0000 7fe75affd700 1 -- 172.21.15.45:0/951312557 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe75c072420 msgr2=0x7fe75c148330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:12.426 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.423+0000 7fe75affd700 1 --2- 172.21.15.45:0/951312557 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe75c072420 0x7fe75c148330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:12.427 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.423+0000 7fe75affd700 1 -- 172.21.15.45:0/951312557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe75c159a20 msgr2=0x7fe75c14caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:12.427 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.423+0000 7fe75affd700 1 --2- 172.21.15.45:0/951312557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe75c159a20 0x7fe75c14caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:12.427 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.423+0000 7fe75affd700 1 -- 172.21.15.45:0/951312557 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74c0095f0 con 0x7fe75c06ab70 2023-10-08T12:45:12.427 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.423+0000 7fe75b7fe700 1 --2- 172.21.15.45:0/951312557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe75c159a20 0x7fe75c14caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:12.427 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.423+0000 7fe75affd700 1 --2- 172.21.15.45:0/951312557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe75c06ab70 0x7fe75c14d7b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe74c014000 tx=0x7fe74c004260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:12.427 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.424+0000 7fe7437fe700 1 -- 172.21.15.45:0/951312557 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c01c070 con 0x7fe75c06ab70 2023-10-08T12:45:12.427 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.424+0000 7fe7437fe700 1 -- 172.21.15.45:0/951312557 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe74c00bea0 con 0x7fe75c06ab70 2023-10-08T12:45:12.427 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.424+0000 7fe7615f2700 1 -- 172.21.15.45:0/951312557 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe75c1f0dd0 con 0x7fe75c06ab70 2023-10-08T12:45:12.427 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.424+0000 7fe7437fe700 1 -- 172.21.15.45:0/951312557 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c003af0 con 0x7fe75c06ab70 2023-10-08T12:45:12.427 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.424+0000 7fe7615f2700 1 -- 172.21.15.45:0/951312557 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe75c1f1740 con 0x7fe75c06ab70 2023-10-08T12:45:12.427 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.424+0000 7fe7437fe700 1 -- 172.21.15.45:0/951312557 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe74c003c50 con 0x7fe75c06ab70 2023-10-08T12:45:12.428 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.424+0000 7fe7437fe700 1 -- 172.21.15.45:0/951312557 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fe74c004830 con 0x7fe75c06ab70 2023-10-08T12:45:12.428 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.425+0000 7fe7615f2700 1 -- 172.21.15.45:0/951312557 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe75c1f18d0 con 0x7fe75c06ab70 2023-10-08T12:45:12.428 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.427+0000 7fe7437fe700 1 -- 172.21.15.45:0/951312557 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fe74c004ad0 con 0x7fe75c06ab70 2023-10-08T12:45:12.497 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-08T12:45:12.496+0000 7facc4800200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T12:45:12.498 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.498+0000 7fe7615f2700 1 -- 172.21.15.45:0/951312557 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe75c1f12c0 con 0x7fe75c06ab70 2023-10-08T12:45:12.499 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.498+0000 7fe7437fe700 1 -- 172.21.15.45:0/951312557 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fe75c1f12c0 con 0x7fe75c06ab70 2023-10-08T12:45:12.499 INFO:teuthology.misc.health.smithi045.stdout: 2023-10-08T12:45:12.499 INFO:teuthology.misc.health.smithi045.stdout:{"epoch":10,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:45:11.214453+0000","last_up_change":"0.000000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:45:12.500 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.499+0000 7fe7615f2700 1 -- 172.21.15.45:0/951312557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe75c06ab70 msgr2=0x7fe75c14d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:12.500 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.499+0000 7fe7615f2700 1 --2- 172.21.15.45:0/951312557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe75c06ab70 0x7fe75c14d7b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe74c014000 tx=0x7fe74c004260 comp rx=0 tx=0).stop 2023-10-08T12:45:12.501 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.499+0000 7fe7615f2700 1 -- 172.21.15.45:0/951312557 shutdown_connections 2023-10-08T12:45:12.501 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.499+0000 7fe7615f2700 1 --2- 172.21.15.45:0/951312557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe75c159a20 0x7fe75c14caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:12.501 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.499+0000 7fe7615f2700 1 --2- 172.21.15.45:0/951312557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe75c06ab70 0x7fe75c14d7b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:12.501 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.499+0000 7fe7615f2700 1 --2- 172.21.15.45:0/951312557 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe75c072420 0x7fe75c148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:12.501 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.499+0000 7fe7615f2700 1 -- 172.21.15.45:0/951312557 >> 172.21.15.45:0/951312557 conn(0x7fe75c0b03c0 msgr2=0x7fe75c0c3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:12.501 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.499+0000 7fe7615f2700 1 -- 172.21.15.45:0/951312557 shutdown_connections 2023-10-08T12:45:12.501 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:12.499+0000 7fe7615f2700 1 -- 172.21.15.45:0/951312557 wait complete. 2023-10-08T12:45:12.511 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-08T12:45:12.512 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-10-08T12:45:12.511+0000 7fd6ecad2200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T12:45:12.619 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-08T12:45:12.618+0000 7facc4800200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T12:45:12.956 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-08T12:45:12.956+0000 7facc4800200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T12:45:13.062 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-08T12:45:13.061+0000 7facc4800200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T12:45:13.105 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-10-08T12:45:13.105+0000 7fd6ecad2200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T12:45:13.264 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-08T12:45:13.264+0000 7facc4800200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T12:45:13.897 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-08T12:45:13.897+0000 7facc4800200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T12:45:14.132 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-10-08T12:45:14.132+0000 7fd6a4a61700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-08T12:45:14.133 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-10-08T12:45:14.132+0000 7fd6a4a61700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-08T12:45:15.376 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-08T12:45:15.375+0000 7f8516881640 -1 osd.1 0 log_to_monitors true 2023-10-08T12:45:15.382 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T12:45:15.382+0000 7fae62672640 -1 osd.2 0 log_to_monitors true 2023-10-08T12:45:15.387 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T12:45:15.387+0000 7f129da33640 -1 osd.0 0 log_to_monitors true 2023-10-08T12:45:15.389 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-10-08T12:45:15.389+0000 7eff2544d640 -1 osd.6 0 log_to_monitors true 2023-10-08T12:45:15.412 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T12:45:15.412+0000 7f485c6c3640 -1 osd.3 0 log_to_monitors true 2023-10-08T12:45:15.420 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T12:45:15.420+0000 7ff170cad640 -1 osd.5 0 log_to_monitors true 2023-10-08T12:45:15.437 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-10-08T12:45:15.437+0000 7f399ca9f640 -1 osd.4 0 log_to_monitors true 2023-10-08T12:45:15.439 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-10-08T12:45:15.439+0000 7f0d2c31b640 -1 osd.7 0 log_to_monitors true 2023-10-08T12:45:17.812 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T12:45:17.811+0000 7f12915ea700 -1 osd.0 0 waiting for initial osdmap 2023-10-08T12:45:17.826 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T12:45:17.826+0000 7f12899c5700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:45:17.853 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-08T12:45:17.852+0000 7f850a438700 -1 osd.1 0 waiting for initial osdmap 2023-10-08T12:45:17.853 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T12:45:17.852+0000 7f485027a700 -1 osd.3 0 waiting for initial osdmap 2023-10-08T12:45:17.864 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T12:45:17.864+0000 7f4848655700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:45:17.926 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-08T12:45:17.926+0000 7f8502813700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:45:18.024 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T12:45:18.023+0000 7fae56229700 -1 osd.2 0 waiting for initial osdmap 2023-10-08T12:45:18.034 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T12:45:18.034+0000 7fae4e604700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:45:18.433 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T12:45:18.432+0000 7ff164864700 -1 osd.5 0 waiting for initial osdmap 2023-10-08T12:45:18.452 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T12:45:18.452+0000 7ff15cc3f700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:45:18.499 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-10-08T12:45:18.498+0000 7f3990656700 -1 osd.4 0 waiting for initial osdmap 2023-10-08T12:45:18.513 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-10-08T12:45:18.513+0000 7f3988a31700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:45:18.556 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-10-08T12:45:18.556+0000 7eff19004700 -1 osd.6 0 waiting for initial osdmap 2023-10-08T12:45:18.567 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-10-08T12:45:18.567+0000 7eff113df700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:45:18.599 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-10-08T12:45:18.599+0000 7f0d1fed2700 -1 osd.7 0 waiting for initial osdmap 2023-10-08T12:45:18.613 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-10-08T12:45:18.613+0000 7f0d182ad700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:45:19.318 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-08T12:45:19.449 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.448+0000 7fb43b7cf700 1 -- 172.21.15.45:0/2536756296 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb4341563f0 msgr2=0x7fb43406f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:19.450 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.448+0000 7fb43b7cf700 1 --2- 172.21.15.45:0/2536756296 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb4341563f0 0x7fb43406f620 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb4280098c0 tx=0x7fb428009bd0 comp rx=0 tx=0).stop 2023-10-08T12:45:19.450 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.448+0000 7fb43b7cf700 1 -- 172.21.15.45:0/2536756296 shutdown_connections 2023-10-08T12:45:19.450 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.448+0000 7fb43b7cf700 1 --2- 172.21.15.45:0/2536756296 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb4341563f0 0x7fb43406f620 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:19.450 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.448+0000 7fb43b7cf700 1 --2- 172.21.15.45:0/2536756296 >> v2:172.21.15.78:3300/0 conn(0x7fb434158f70 0x7fb43406fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:19.450 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.448+0000 7fb43b7cf700 1 -- 172.21.15.45:0/2536756296 >> 172.21.15.45:0/2536756296 conn(0x7fb4340b03c0 msgr2=0x7fb4340b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:19.450 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.448+0000 7fb43b7cf700 1 -- 172.21.15.45:0/2536756296 shutdown_connections 2023-10-08T12:45:19.450 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.448+0000 7fb43b7cf700 1 -- 172.21.15.45:0/2536756296 wait complete. 2023-10-08T12:45:19.452 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.449+0000 7fb43b7cf700 1 Processor -- start 2023-10-08T12:45:19.452 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.449+0000 7fb43b7cf700 1 -- start start 2023-10-08T12:45:19.452 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.450+0000 7fb43b7cf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4340cd740 0x7fb4340c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:19.452 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.450+0000 7fb43b7cf700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb4341563f0 0x7fb4341eec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:19.453 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.450+0000 7fb43b7cf700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb434158f70 0x7fb4340b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:19.453 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.450+0000 7fb43b7cf700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4340cabb0 con 0x7fb434158f70 2023-10-08T12:45:19.453 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.450+0000 7fb43b7cf700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4340b29f0 con 0x7fb4340cd740 2023-10-08T12:45:19.453 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.450+0000 7fb43b7cf700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4340b2c70 con 0x7fb4341563f0 2023-10-08T12:45:19.453 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.450+0000 7fb439d6c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb434158f70 0x7fb4340b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:19.453 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.450+0000 7fb439d6c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb434158f70 0x7fb4340b24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34574/0 (socket says 172.21.15.45:34574) 2023-10-08T12:45:19.453 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.450+0000 7fb439d6c700 1 -- 172.21.15.45:0/172060315 learned_addr learned my addr 172.21.15.45:0/172060315 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:19.453 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.450+0000 7fb43956b700 1 --2- 172.21.15.45:0/172060315 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4340cd740 0x7fb4340c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:19.453 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.451+0000 7fb438d6a700 1 --2- 172.21.15.45:0/172060315 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb4341563f0 0x7fb4341eec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:19.453 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.451+0000 7fb439d6c700 1 -- 172.21.15.45:0/172060315 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb4341563f0 msgr2=0x7fb4341eec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:19.453 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.451+0000 7fb439d6c700 1 --2- 172.21.15.45:0/172060315 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb4341563f0 0x7fb4341eec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:19.454 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.451+0000 7fb439d6c700 1 -- 172.21.15.45:0/172060315 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4340cd740 msgr2=0x7fb4340c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:19.454 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.451+0000 7fb439d6c700 1 --2- 172.21.15.45:0/172060315 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4340cd740 0x7fb4340c9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:19.454 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.451+0000 7fb439d6c700 1 -- 172.21.15.45:0/172060315 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb430009520 con 0x7fb434158f70 2023-10-08T12:45:19.454 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.451+0000 7fb439d6c700 1 --2- 172.21.15.45:0/172060315 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb434158f70 0x7fb4340b24b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb42c00ed60 tx=0x7fb42c00c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:19.454 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.451+0000 7fb425ffb700 1 -- 172.21.15.45:0/172060315 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c011470 con 0x7fb434158f70 2023-10-08T12:45:19.454 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.451+0000 7fb43b7cf700 1 -- 172.21.15.45:0/172060315 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb428009520 con 0x7fb434158f70 2023-10-08T12:45:19.454 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.451+0000 7fb425ffb700 1 -- 172.21.15.45:0/172060315 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb42c0116c0 con 0x7fb434158f70 2023-10-08T12:45:19.454 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.451+0000 7fb425ffb700 1 -- 172.21.15.45:0/172060315 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c011ad0 con 0x7fb434158f70 2023-10-08T12:45:19.454 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.451+0000 7fb43b7cf700 1 -- 172.21.15.45:0/172060315 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4340ca840 con 0x7fb434158f70 2023-10-08T12:45:19.455 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.452+0000 7fb43b7cf700 1 -- 172.21.15.45:0/172060315 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb434066900 con 0x7fb434158f70 2023-10-08T12:45:19.455 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.453+0000 7fb425ffb700 1 -- 172.21.15.45:0/172060315 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7fb42c011c30 con 0x7fb434158f70 2023-10-08T12:45:19.455 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.453+0000 7fb425ffb700 1 --2- 172.21.15.45:0/172060315 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb41806ae40 0x7fb41806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:19.455 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.453+0000 7fb425ffb700 1 -- 172.21.15.45:0/172060315 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fb42c08bda0 con 0x7fb434158f70 2023-10-08T12:45:19.455 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.453+0000 7fb43956b700 1 --2- 172.21.15.45:0/172060315 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb41806ae40 0x7fb41806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:19.456 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.454+0000 7fb43956b700 1 --2- 172.21.15.45:0/172060315 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb41806ae40 0x7fb41806d300 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb428009230 tx=0x7fb4280047c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:19.458 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.458+0000 7fb425ffb700 1 -- 172.21.15.45:0/172060315 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb42c057380 con 0x7fb434158f70 2023-10-08T12:45:19.662 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.661+0000 7fb43b7cf700 1 -- 172.21.15.45:0/172060315 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4340cacf0 con 0x7fb434158f70 2023-10-08T12:45:19.662 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.662+0000 7fb425ffb700 1 -- 172.21.15.45:0/172060315 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10860 (secure 0 0 0) 0x7fb42c01f090 con 0x7fb434158f70 2023-10-08T12:45:19.663 INFO:teuthology.misc.health.smithi045.stdout: 2023-10-08T12:45:19.663 INFO:teuthology.misc.health.smithi045.stdout:{"epoch":13,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:45:18.622542+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:45:19.665 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.664+0000 7fb43b7cf700 1 -- 172.21.15.45:0/172060315 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb41806ae40 msgr2=0x7fb41806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:19.665 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.664+0000 7fb43b7cf700 1 --2- 172.21.15.45:0/172060315 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb41806ae40 0x7fb41806d300 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb428009230 tx=0x7fb4280047c0 comp rx=0 tx=0).stop 2023-10-08T12:45:19.665 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.664+0000 7fb43b7cf700 1 -- 172.21.15.45:0/172060315 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb434158f70 msgr2=0x7fb4340b24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:19.665 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.664+0000 7fb43b7cf700 1 --2- 172.21.15.45:0/172060315 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb434158f70 0x7fb4340b24b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb42c00ed60 tx=0x7fb42c00c550 comp rx=0 tx=0).stop 2023-10-08T12:45:19.665 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.664+0000 7fb43b7cf700 1 -- 172.21.15.45:0/172060315 shutdown_connections 2023-10-08T12:45:19.666 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.664+0000 7fb43b7cf700 1 --2- 172.21.15.45:0/172060315 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb41806ae40 0x7fb41806d300 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:19.666 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.664+0000 7fb43b7cf700 1 --2- 172.21.15.45:0/172060315 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb434158f70 0x7fb4340b24b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:19.666 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.664+0000 7fb43b7cf700 1 --2- 172.21.15.45:0/172060315 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4340cd740 0x7fb4340c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:19.666 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.664+0000 7fb43b7cf700 1 --2- 172.21.15.45:0/172060315 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb4341563f0 0x7fb4341eec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:19.666 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.664+0000 7fb43b7cf700 1 -- 172.21.15.45:0/172060315 >> 172.21.15.45:0/172060315 conn(0x7fb4340b03c0 msgr2=0x7fb4340ae870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:19.666 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.664+0000 7fb43b7cf700 1 -- 172.21.15.45:0/172060315 shutdown_connections 2023-10-08T12:45:19.666 INFO:teuthology.misc.health.smithi045.stderr:2023-10-08T12:45:19.664+0000 7fb43b7cf700 1 -- 172.21.15.45:0/172060315 wait complete. 2023-10-08T12:45:19.676 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-08T12:45:19.677 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-08T12:45:19.677 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T12:45:19.677 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T12:45:19.680 INFO:tasks.ceph.mds.a:Started 2023-10-08T12:45:19.680 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T12:45:19.680 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T12:45:19.682 INFO:tasks.ceph.mds.c:Started 2023-10-08T12:45:19.682 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T12:45:19.682 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T12:45:19.685 INFO:tasks.ceph.mds.b:Started 2023-10-08T12:45:19.685 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T12:45:19.685 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T12:45:19.687 INFO:tasks.ceph.mds.d:Started 2023-10-08T12:45:19.687 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-08T12:45:19.688 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:45:19.760 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-10-08T12:45:19.761 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-10-08T12:45:19.773 INFO:tasks.ceph.mds.d.smithi078.stdout:starting mds.d at 2023-10-08T12:45:19.773 INFO:tasks.ceph.mds.b.smithi078.stdout:starting mds.b at 2023-10-08T12:45:19.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.821+0000 7f8470582700 1 -- 172.21.15.45:0/1847410954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8454004850 msgr2=0x7f8454004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:19.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.821+0000 7f8470582700 1 --2- 172.21.15.45:0/1847410954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8454004850 0x7f8454004cd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f845c009be0 tx=0x7f8454005880 comp rx=0 tx=0).stop 2023-10-08T12:45:19.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.821+0000 7f8470582700 1 -- 172.21.15.45:0/1847410954 shutdown_connections 2023-10-08T12:45:19.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.821+0000 7f8470582700 1 --2- 172.21.15.45:0/1847410954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8454004850 0x7f8454004cd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:19.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.821+0000 7f8470582700 1 -- 172.21.15.45:0/1847410954 >> 172.21.15.45:0/1847410954 conn(0x7f84680cf750 msgr2=0x7f84680cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:19.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.821+0000 7f8470582700 1 -- 172.21.15.45:0/1847410954 shutdown_connections 2023-10-08T12:45:19.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.821+0000 7f8470582700 1 -- 172.21.15.45:0/1847410954 wait complete. 2023-10-08T12:45:19.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.823+0000 7f8470582700 1 Processor -- start 2023-10-08T12:45:19.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.823+0000 7f8470582700 1 -- start start 2023-10-08T12:45:19.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.823+0000 7f8470582700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8454004850 0x7f846806c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:19.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.823+0000 7f8470582700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84681517c0 0x7f846806c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:19.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.823+0000 7f8470582700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f846806cd00 0x7f84681f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:19.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.823+0000 7f8470582700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84680c9710 con 0x7f846806cd00 2023-10-08T12:45:19.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.823+0000 7f8470582700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84680c8950 con 0x7f84681517c0 2023-10-08T12:45:19.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.823+0000 7f8470582700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84680c8c30 con 0x7f8454004850 2023-10-08T12:45:19.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.823+0000 7f846eb1f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f846806cd00 0x7f84681f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:19.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.823+0000 7f846e31e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8454004850 0x7f846806c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:19.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.824+0000 7f846db1d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84681517c0 0x7f846806c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:19.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.824+0000 7f846eb1f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f846806cd00 0x7f84681f1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34628/0 (socket says 172.21.15.45:34628) 2023-10-08T12:45:19.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.824+0000 7f846eb1f700 1 -- 172.21.15.45:0/1695919114 learned_addr learned my addr 172.21.15.45:0/1695919114 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:19.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.824+0000 7f846eb1f700 1 -- 172.21.15.45:0/1695919114 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8454004850 msgr2=0x7f846806c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:19.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.824+0000 7f846eb1f700 1 --2- 172.21.15.45:0/1695919114 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8454004850 0x7f846806c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:19.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.824+0000 7f846eb1f700 1 -- 172.21.15.45:0/1695919114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84681517c0 msgr2=0x7f846806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:19.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.824+0000 7f846eb1f700 1 --2- 172.21.15.45:0/1695919114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84681517c0 0x7f846806c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:19.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.824+0000 7f846eb1f700 1 -- 172.21.15.45:0/1695919114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84680c8f10 con 0x7f846806cd00 2023-10-08T12:45:19.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.824+0000 7f846db1d700 1 --2- 172.21.15.45:0/1695919114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84681517c0 0x7f846806c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:19.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.824+0000 7f846eb1f700 1 --2- 172.21.15.45:0/1695919114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f846806cd00 0x7f84681f1fa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f84680cba40 tx=0x7f8460006340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:19.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.824+0000 7f845affd700 1 -- 172.21.15.45:0/1695919114 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460011630 con 0x7f846806cd00 2023-10-08T12:45:19.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.824+0000 7f845affd700 1 -- 172.21.15.45:0/1695919114 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f84600117b0 con 0x7f846806cd00 2023-10-08T12:45:19.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.824+0000 7f8470582700 1 -- 172.21.15.45:0/1695919114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84680c91f0 con 0x7f846806cd00 2023-10-08T12:45:19.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.824+0000 7f845affd700 1 -- 172.21.15.45:0/1695919114 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460011c00 con 0x7f846806cd00 2023-10-08T12:45:19.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.824+0000 7f8470582700 1 -- 172.21.15.45:0/1695919114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f846806d1b0 con 0x7f846806cd00 2023-10-08T12:45:19.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.825+0000 7f8470582700 1 -- 172.21.15.45:0/1695919114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f846804e4c0 con 0x7f846806cd00 2023-10-08T12:45:19.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.826+0000 7f845affd700 1 -- 172.21.15.45:0/1695919114 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f84600103c0 con 0x7f846806cd00 2023-10-08T12:45:19.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.826+0000 7f845affd700 1 --2- 172.21.15.45:0/1695919114 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f844c06ae40 0x7f844c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:19.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.826+0000 7f845affd700 1 -- 172.21.15.45:0/1695919114 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f8460089b90 con 0x7f846806cd00 2023-10-08T12:45:19.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.826+0000 7f846e31e700 1 --2- 172.21.15.45:0/1695919114 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f844c06ae40 0x7f844c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:19.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.827+0000 7f846e31e700 1 --2- 172.21.15.45:0/1695919114 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f844c06ae40 0x7f844c06d300 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8464001050 tx=0x7f8464000fa0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:19.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:19.831+0000 7f845affd700 1 -- 172.21.15.45:0/1695919114 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8460055280 con 0x7f846806cd00 2023-10-08T12:45:20.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.032+0000 7f8470582700 1 -- 172.21.15.45:0/1695919114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84680ca590 con 0x7f846806cd00 2023-10-08T12:45:20.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.032+0000 7f845affd700 1 -- 172.21.15.45:0/1695919114 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+12806 (secure 0 0 0) 0x7f8460015020 con 0x7f846806cd00 2023-10-08T12:45:20.034 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:20.034 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":14,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:45:19.842786+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:45:19.183651+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.412453+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.351925+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.428025+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.437246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.441119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.388608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.415524+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.401835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:45:20.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.034+0000 7f8470582700 1 -- 172.21.15.45:0/1695919114 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f844c06ae40 msgr2=0x7f844c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:20.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.034+0000 7f8470582700 1 --2- 172.21.15.45:0/1695919114 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f844c06ae40 0x7f844c06d300 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8464001050 tx=0x7f8464000fa0 comp rx=0 tx=0).stop 2023-10-08T12:45:20.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.034+0000 7f8470582700 1 -- 172.21.15.45:0/1695919114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f846806cd00 msgr2=0x7f84681f1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:20.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.034+0000 7f8470582700 1 --2- 172.21.15.45:0/1695919114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f846806cd00 0x7f84681f1fa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f84680cba40 tx=0x7f8460006340 comp rx=0 tx=0).stop 2023-10-08T12:45:20.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.034+0000 7f8470582700 1 -- 172.21.15.45:0/1695919114 shutdown_connections 2023-10-08T12:45:20.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.034+0000 7f8470582700 1 --2- 172.21.15.45:0/1695919114 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f844c06ae40 0x7f844c06d300 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:20.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.034+0000 7f8470582700 1 --2- 172.21.15.45:0/1695919114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f846806cd00 0x7f84681f1fa0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:20.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.034+0000 7f8470582700 1 --2- 172.21.15.45:0/1695919114 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8454004850 0x7f846806c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:20.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.034+0000 7f8470582700 1 --2- 172.21.15.45:0/1695919114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84681517c0 0x7f846806c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:20.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.034+0000 7f8470582700 1 -- 172.21.15.45:0/1695919114 >> 172.21.15.45:0/1695919114 conn(0x7f84680cf750 msgr2=0x7f846815ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:20.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.034+0000 7f8470582700 1 -- 172.21.15.45:0/1695919114 shutdown_connections 2023-10-08T12:45:20.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.034+0000 7f8470582700 1 -- 172.21.15.45:0/1695919114 wait complete. 2023-10-08T12:45:20.048 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:45:19.183651+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:45:20.048 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:45:20.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.179+0000 7f4f4260a700 1 -- 172.21.15.45:0/1726558903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f28003a00 msgr2=0x7f4f28003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:20.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.180+0000 7f4f4260a700 1 --2- 172.21.15.45:0/1726558903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f28003a00 0x7f4f28003e20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c001720 tx=0x7f4f28005880 comp rx=0 tx=0).stop 2023-10-08T12:45:20.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.180+0000 7f4f4260a700 1 -- 172.21.15.45:0/1726558903 shutdown_connections 2023-10-08T12:45:20.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.180+0000 7f4f4260a700 1 --2- 172.21.15.45:0/1726558903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f28003a00 0x7f4f28003e20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:20.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.180+0000 7f4f4260a700 1 -- 172.21.15.45:0/1726558903 >> 172.21.15.45:0/1726558903 conn(0x7f4f3c0b1290 msgr2=0x7f4f3c0b16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:20.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.180+0000 7f4f4260a700 1 -- 172.21.15.45:0/1726558903 shutdown_connections 2023-10-08T12:45:20.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.180+0000 7f4f4260a700 1 -- 172.21.15.45:0/1726558903 wait complete. 2023-10-08T12:45:20.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.181+0000 7f4f4260a700 1 Processor -- start 2023-10-08T12:45:20.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.181+0000 7f4f4260a700 1 -- start start 2023-10-08T12:45:20.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.182+0000 7f4f4260a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f28003a00 0x7f4f3c0c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:20.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.182+0000 7f4f4260a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f3c150d50 0x7f4f3c155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:20.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.182+0000 7f4f4260a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4f3c0c6b10 0x7f4f3c0c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:20.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.182+0000 7f4f4260a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c0c74e0 con 0x7f4f3c150d50 2023-10-08T12:45:20.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.182+0000 7f4f4260a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c1511b0 con 0x7f4f28003a00 2023-10-08T12:45:20.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.182+0000 7f4f4260a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c06b320 con 0x7f4f3c0c6b10 2023-10-08T12:45:20.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.182+0000 7f4f3b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f3c150d50 0x7f4f3c155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:20.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.182+0000 7f4f3b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f3c150d50 0x7f4f3c155dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34670/0 (socket says 172.21.15.45:34670) 2023-10-08T12:45:20.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.182+0000 7f4f3b7fe700 1 -- 172.21.15.45:0/3460763560 learned_addr learned my addr 172.21.15.45:0/3460763560 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:20.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.182+0000 7f4f3bfff700 1 --2- 172.21.15.45:0/3460763560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f28003a00 0x7f4f3c0c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:20.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.182+0000 7f4f40ba7700 1 --2- 172.21.15.45:0/3460763560 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4f3c0c6b10 0x7f4f3c0c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:20.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.182+0000 7f4f3b7fe700 1 -- 172.21.15.45:0/3460763560 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4f3c0c6b10 msgr2=0x7f4f3c0c6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:20.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.182+0000 7f4f3b7fe700 1 --2- 172.21.15.45:0/3460763560 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4f3c0c6b10 0x7f4f3c0c6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:20.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.182+0000 7f4f3b7fe700 1 -- 172.21.15.45:0/3460763560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f28003a00 msgr2=0x7f4f3c0c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:20.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.182+0000 7f4f3b7fe700 1 --2- 172.21.15.45:0/3460763560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f28003a00 0x7f4f3c0c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:20.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.182+0000 7f4f3b7fe700 1 -- 172.21.15.45:0/3460763560 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c06b600 con 0x7f4f3c150d50 2023-10-08T12:45:20.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.182+0000 7f4f3bfff700 1 --2- 172.21.15.45:0/3460763560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f28003a00 0x7f4f3c0c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:45:20.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.182+0000 7f4f40ba7700 1 --2- 172.21.15.45:0/3460763560 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4f3c0c6b10 0x7f4f3c0c6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:45:20.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.182+0000 7f4f3b7fe700 1 --2- 172.21.15.45:0/3460763560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f3c150d50 0x7f4f3c155dd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4f24006630 tx=0x7f4f24003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:20.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.182+0000 7f4f38ff9700 1 -- 172.21.15.45:0/3460763560 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f24011840 con 0x7f4f3c150d50 2023-10-08T12:45:20.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.182+0000 7f4f38ff9700 1 -- 172.21.15.45:0/3460763560 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4f240119c0 con 0x7f4f3c150d50 2023-10-08T12:45:20.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.182+0000 7f4f4260a700 1 -- 172.21.15.45:0/3460763560 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f3c156310 con 0x7f4f3c150d50 2023-10-08T12:45:20.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.182+0000 7f4f38ff9700 1 -- 172.21.15.45:0/3460763560 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f24011dd0 con 0x7f4f3c150d50 2023-10-08T12:45:20.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.182+0000 7f4f4260a700 1 -- 172.21.15.45:0/3460763560 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3c156890 con 0x7f4f3c150d50 2023-10-08T12:45:20.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.183+0000 7f4f4260a700 1 -- 172.21.15.45:0/3460763560 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f3c0c9780 con 0x7f4f3c150d50 2023-10-08T12:45:20.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.184+0000 7f4f38ff9700 1 -- 172.21.15.45:0/3460763560 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f4f240103c0 con 0x7f4f3c150d50 2023-10-08T12:45:20.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.184+0000 7f4f38ff9700 1 --2- 172.21.15.45:0/3460763560 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4f1c06ae40 0x7f4f1c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:20.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.184+0000 7f4f38ff9700 1 -- 172.21.15.45:0/3460763560 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4846+0+0 (secure 0 0 0) 0x7f4f2408a030 con 0x7f4f3c150d50 2023-10-08T12:45:20.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.184+0000 7f4f3bfff700 1 --2- 172.21.15.45:0/3460763560 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4f1c06ae40 0x7f4f1c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:20.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.185+0000 7f4f3bfff700 1 --2- 172.21.15.45:0/3460763560 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4f1c06ae40 0x7f4f1c06d300 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c001720 tx=0x7f4f2c001190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:20.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.189+0000 7f4f38ff9700 1 -- 172.21.15.45:0/3460763560 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4f240555b0 con 0x7f4f3c150d50 2023-10-08T12:45:20.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.390+0000 7f4f4260a700 1 -- 172.21.15.45:0/3460763560 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4f3c06b790 con 0x7f4f3c150d50 2023-10-08T12:45:20.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.390+0000 7f4f38ff9700 1 -- 172.21.15.45:0/3460763560 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v14) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4f24015020 con 0x7f4f3c150d50 2023-10-08T12:45:20.391 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-08T12:45:20.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.392+0000 7f4f4260a700 1 -- 172.21.15.45:0/3460763560 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4f1c06ae40 msgr2=0x7f4f1c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:20.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.392+0000 7f4f4260a700 1 --2- 172.21.15.45:0/3460763560 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4f1c06ae40 0x7f4f1c06d300 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c001720 tx=0x7f4f2c001190 comp rx=0 tx=0).stop 2023-10-08T12:45:20.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.392+0000 7f4f4260a700 1 -- 172.21.15.45:0/3460763560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f3c150d50 msgr2=0x7f4f3c155dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:20.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.392+0000 7f4f4260a700 1 --2- 172.21.15.45:0/3460763560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f3c150d50 0x7f4f3c155dd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4f24006630 tx=0x7f4f24003960 comp rx=0 tx=0).stop 2023-10-08T12:45:20.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.392+0000 7f4f4260a700 1 -- 172.21.15.45:0/3460763560 shutdown_connections 2023-10-08T12:45:20.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.392+0000 7f4f4260a700 1 --2- 172.21.15.45:0/3460763560 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4f1c06ae40 0x7f4f1c06d300 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:20.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.392+0000 7f4f4260a700 1 --2- 172.21.15.45:0/3460763560 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4f3c0c6b10 0x7f4f3c0c6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:20.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.392+0000 7f4f4260a700 1 --2- 172.21.15.45:0/3460763560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f28003a00 0x7f4f3c0c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:20.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.392+0000 7f4f4260a700 1 --2- 172.21.15.45:0/3460763560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f3c150d50 0x7f4f3c155dd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:20.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.392+0000 7f4f4260a700 1 -- 172.21.15.45:0/3460763560 >> 172.21.15.45:0/3460763560 conn(0x7f4f3c0b1290 msgr2=0x7f4f3c157800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:20.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.392+0000 7f4f4260a700 1 -- 172.21.15.45:0/3460763560 shutdown_connections 2023-10-08T12:45:20.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.392+0000 7f4f4260a700 1 -- 172.21.15.45:0/3460763560 wait complete. 2023-10-08T12:45:20.405 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:45:20.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.532+0000 7f13558b7700 1 -- 172.21.15.45:0/4244071202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1338004850 msgr2=0x7f1338004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:20.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.532+0000 7f13558b7700 1 --2- 172.21.15.45:0/4244071202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1338004850 0x7f1338004cd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f134000c2e0 tx=0x7f1338005880 comp rx=0 tx=0).stop 2023-10-08T12:45:20.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.532+0000 7f13558b7700 1 -- 172.21.15.45:0/4244071202 shutdown_connections 2023-10-08T12:45:20.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.532+0000 7f13558b7700 1 --2- 172.21.15.45:0/4244071202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1338004850 0x7f1338004cd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:20.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.532+0000 7f13558b7700 1 -- 172.21.15.45:0/4244071202 >> 172.21.15.45:0/4244071202 conn(0x7f13500afae0 msgr2=0x7f13500afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:20.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.532+0000 7f13558b7700 1 -- 172.21.15.45:0/4244071202 shutdown_connections 2023-10-08T12:45:20.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.532+0000 7f13558b7700 1 -- 172.21.15.45:0/4244071202 wait complete. 2023-10-08T12:45:20.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.534+0000 7f13558b7700 1 Processor -- start 2023-10-08T12:45:20.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.534+0000 7f13558b7700 1 -- start start 2023-10-08T12:45:20.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.535+0000 7f13558b7700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1338004850 0x7f1350155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:20.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.535+0000 7f13558b7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1350159680 0x7f13500c2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:20.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.535+0000 7f13558b7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1350159b00 0x7f13500c2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:20.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.535+0000 7f13558b7700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13501e53e0 con 0x7f1350159680 2023-10-08T12:45:20.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.535+0000 7f13558b7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13501e4580 con 0x7f1350159b00 2023-10-08T12:45:20.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.535+0000 7f13558b7700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1350156110 con 0x7f1338004850 2023-10-08T12:45:20.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.535+0000 7f134e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1350159680 0x7f13500c2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:20.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.535+0000 7f134e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1350159680 0x7f13500c2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34690/0 (socket says 172.21.15.45:34690) 2023-10-08T12:45:20.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.535+0000 7f134e7fc700 1 -- 172.21.15.45:0/3734594295 learned_addr learned my addr 172.21.15.45:0/3734594295 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:20.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.535+0000 7f134f7fe700 1 --2- 172.21.15.45:0/3734594295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1350159b00 0x7f13500c2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:20.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.535+0000 7f134effd700 1 --2- 172.21.15.45:0/3734594295 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1338004850 0x7f1350155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:20.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.535+0000 7f134e7fc700 1 -- 172.21.15.45:0/3734594295 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1338004850 msgr2=0x7f1350155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:20.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.535+0000 7f134e7fc700 1 --2- 172.21.15.45:0/3734594295 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1338004850 0x7f1350155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:20.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.535+0000 7f134e7fc700 1 -- 172.21.15.45:0/3734594295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1350159b00 msgr2=0x7f13500c2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:20.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.535+0000 7f134e7fc700 1 --2- 172.21.15.45:0/3734594295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1350159b00 0x7f13500c2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:20.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.535+0000 7f134e7fc700 1 -- 172.21.15.45:0/3734594295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13501e47d0 con 0x7f1350159680 2023-10-08T12:45:20.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.535+0000 7f134e7fc700 1 --2- 172.21.15.45:0/3734594295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1350159680 0x7f13500c2300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1340012040 tx=0x7f1340001470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:20.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.535+0000 7f1337fff700 1 -- 172.21.15.45:0/3734594295 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1340006650 con 0x7f1350159680 2023-10-08T12:45:20.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.536+0000 7f1337fff700 1 -- 172.21.15.45:0/3734594295 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1340003770 con 0x7f1350159680 2023-10-08T12:45:20.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.536+0000 7f13558b7700 1 -- 172.21.15.45:0/3734594295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13501e4ab0 con 0x7f1350159680 2023-10-08T12:45:20.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.536+0000 7f1337fff700 1 -- 172.21.15.45:0/3734594295 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1340003b60 con 0x7f1350159680 2023-10-08T12:45:20.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.536+0000 7f13558b7700 1 -- 172.21.15.45:0/3734594295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13501e5070 con 0x7f1350159680 2023-10-08T12:45:20.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.536+0000 7f13558b7700 1 -- 172.21.15.45:0/3734594295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13500674a0 con 0x7f1350159680 2023-10-08T12:45:20.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.537+0000 7f1337fff700 1 -- 172.21.15.45:0/3734594295 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f1340021020 con 0x7f1350159680 2023-10-08T12:45:20.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.537+0000 7f1337fff700 1 --2- 172.21.15.45:0/3734594295 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f133c06ae40 0x7f133c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:20.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.537+0000 7f1337fff700 1 -- 172.21.15.45:0/3734594295 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4846+0+0 (secure 0 0 0) 0x7f134008aa60 con 0x7f1350159680 2023-10-08T12:45:20.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.537+0000 7f134effd700 1 --2- 172.21.15.45:0/3734594295 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f133c06ae40 0x7f133c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:20.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.538+0000 7f134effd700 1 --2- 172.21.15.45:0/3734594295 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f133c06ae40 0x7f133c06d300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1344005950 tx=0x7f13440058e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:20.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.542+0000 7f1337fff700 1 -- 172.21.15.45:0/3734594295 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1340055fe0 con 0x7f1350159680 2023-10-08T12:45:20.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.790+0000 7f13558b7700 1 -- 172.21.15.45:0/3734594295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f135004e4c0 con 0x7f1350159680 2023-10-08T12:45:20.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.791+0000 7f1337fff700 1 -- 172.21.15.45:0/3734594295 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3691 (secure 0 0 0) 0x7f1340029020 con 0x7f1350159680 2023-10-08T12:45:20.792 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:20.792 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4332,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3352988594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3352988594},{"type":"v1","addr":"172.21.15.45:6834","nonce":3352988594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4335,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/448033669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":448033669},{"type":"v1","addr":"172.21.15.45:6835","nonce":448033669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4347,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2935302656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":2935302656},{"type":"v1","addr":"172.21.15.78:6837","nonce":2935302656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4372,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/2145831865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2145831865},{"type":"v1","addr":"172.21.15.78:6836","nonce":2145831865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-08T12:45:20.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.793+0000 7f13558b7700 1 -- 172.21.15.45:0/3734594295 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f133c06ae40 msgr2=0x7f133c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:20.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.793+0000 7f13558b7700 1 --2- 172.21.15.45:0/3734594295 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f133c06ae40 0x7f133c06d300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1344005950 tx=0x7f13440058e0 comp rx=0 tx=0).stop 2023-10-08T12:45:20.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.793+0000 7f13558b7700 1 -- 172.21.15.45:0/3734594295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1350159680 msgr2=0x7f13500c2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:20.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.793+0000 7f13558b7700 1 --2- 172.21.15.45:0/3734594295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1350159680 0x7f13500c2300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1340012040 tx=0x7f1340001470 comp rx=0 tx=0).stop 2023-10-08T12:45:20.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.793+0000 7f13558b7700 1 -- 172.21.15.45:0/3734594295 shutdown_connections 2023-10-08T12:45:20.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.793+0000 7f13558b7700 1 --2- 172.21.15.45:0/3734594295 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f133c06ae40 0x7f133c06d300 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:20.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.793+0000 7f13558b7700 1 --2- 172.21.15.45:0/3734594295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1350159b00 0x7f13500c2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:20.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.793+0000 7f13558b7700 1 --2- 172.21.15.45:0/3734594295 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1338004850 0x7f1350155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:20.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.793+0000 7f13558b7700 1 --2- 172.21.15.45:0/3734594295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1350159680 0x7f13500c2300 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:20.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.793+0000 7f13558b7700 1 -- 172.21.15.45:0/3734594295 >> 172.21.15.45:0/3734594295 conn(0x7f13500afae0 msgr2=0x7f13500cbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:20.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.793+0000 7f13558b7700 1 -- 172.21.15.45:0/3734594295 shutdown_connections 2023-10-08T12:45:20.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.793+0000 7f13558b7700 1 -- 172.21.15.45:0/3734594295 wait complete. 2023-10-08T12:45:20.795 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 3 2023-10-08T12:45:20.806 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:45:20.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.934+0000 7fa3e0038700 1 -- 172.21.15.45:0/1922272766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3d80c9ff0 msgr2=0x7fa3d80ca480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:20.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.934+0000 7fa3e0038700 1 --2- 172.21.15.45:0/1922272766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3d80c9ff0 0x7fa3d80ca480 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0009fd0 tx=0x7fa3d000b380 comp rx=0 tx=0).stop 2023-10-08T12:45:20.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.934+0000 7fa3e0038700 1 -- 172.21.15.45:0/1922272766 shutdown_connections 2023-10-08T12:45:20.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.934+0000 7fa3e0038700 1 --2- 172.21.15.45:0/1922272766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3d80c9ff0 0x7fa3d80ca480 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:20.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.934+0000 7fa3e0038700 1 --2- 172.21.15.45:0/1922272766 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3d8158950 0x7fa3d80cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:20.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.934+0000 7fa3e0038700 1 -- 172.21.15.45:0/1922272766 >> 172.21.15.45:0/1922272766 conn(0x7fa3d80b0430 msgr2=0x7fa3d80b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:20.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.934+0000 7fa3e0038700 1 -- 172.21.15.45:0/1922272766 shutdown_connections 2023-10-08T12:45:20.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.935+0000 7fa3e0038700 1 -- 172.21.15.45:0/1922272766 wait complete. 2023-10-08T12:45:20.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.936+0000 7fa3e0038700 1 Processor -- start 2023-10-08T12:45:20.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.936+0000 7fa3e0038700 1 -- start start 2023-10-08T12:45:20.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.936+0000 7fa3e0038700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d80c9ff0 0x7fa3d80c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:20.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.936+0000 7fa3e0038700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3d8158950 0x7fa3d815a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:20.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.936+0000 7fa3e0038700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3d815c320 0x7fa3d80c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:20.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.936+0000 7fa3e0038700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d81efd60 con 0x7fa3d815c320 2023-10-08T12:45:20.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.936+0000 7fa3e0038700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d81f37e0 con 0x7fa3d80c9ff0 2023-10-08T12:45:20.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.936+0000 7fa3e0038700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d81f3ac0 con 0x7fa3d8158950 2023-10-08T12:45:20.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.937+0000 7fa3de5d5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3d815c320 0x7fa3d80c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:20.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.937+0000 7fa3de5d5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3d815c320 0x7fa3d80c8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34710/0 (socket says 172.21.15.45:34710) 2023-10-08T12:45:20.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.937+0000 7fa3de5d5700 1 -- 172.21.15.45:0/2505116518 learned_addr learned my addr 172.21.15.45:0/2505116518 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:20.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.937+0000 7fa3dd5d3700 1 --2- 172.21.15.45:0/2505116518 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3d8158950 0x7fa3d815a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:20.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.937+0000 7fa3dddd4700 1 --2- 172.21.15.45:0/2505116518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d80c9ff0 0x7fa3d80c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:20.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.937+0000 7fa3de5d5700 1 -- 172.21.15.45:0/2505116518 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3d8158950 msgr2=0x7fa3d815a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:20.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.937+0000 7fa3de5d5700 1 --2- 172.21.15.45:0/2505116518 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3d8158950 0x7fa3d815a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:20.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.937+0000 7fa3de5d5700 1 -- 172.21.15.45:0/2505116518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d80c9ff0 msgr2=0x7fa3d80c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:20.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.937+0000 7fa3de5d5700 1 --2- 172.21.15.45:0/2505116518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d80c9ff0 0x7fa3d80c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:20.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.937+0000 7fa3de5d5700 1 -- 172.21.15.45:0/2505116518 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d0009d00 con 0x7fa3d815c320 2023-10-08T12:45:20.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.937+0000 7fa3dd5d3700 1 --2- 172.21.15.45:0/2505116518 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3d8158950 0x7fa3d815a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:45:20.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.937+0000 7fa3de5d5700 1 --2- 172.21.15.45:0/2505116518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3d815c320 0x7fa3d80c8410 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa3d000b780 tx=0x7fa3d0009450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:20.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.937+0000 7fa3ce7fc700 1 -- 172.21.15.45:0/2505116518 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d000e040 con 0x7fa3d815c320 2023-10-08T12:45:20.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.937+0000 7fa3ce7fc700 1 -- 172.21.15.45:0/2505116518 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa3d0007bc0 con 0x7fa3d815c320 2023-10-08T12:45:20.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.937+0000 7fa3e0038700 1 -- 172.21.15.45:0/2505116518 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d81f3da0 con 0x7fa3d815c320 2023-10-08T12:45:20.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.937+0000 7fa3ce7fc700 1 -- 172.21.15.45:0/2505116518 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0004030 con 0x7fa3d815c320 2023-10-08T12:45:20.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.937+0000 7fa3e0038700 1 -- 172.21.15.45:0/2505116518 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d81f3390 con 0x7fa3d815c320 2023-10-08T12:45:20.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.938+0000 7fa3e0038700 1 -- 172.21.15.45:0/2505116518 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d804e4c0 con 0x7fa3d815c320 2023-10-08T12:45:20.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.939+0000 7fa3ce7fc700 1 -- 172.21.15.45:0/2505116518 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7fa3d0004190 con 0x7fa3d815c320 2023-10-08T12:45:20.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.939+0000 7fa3ce7fc700 1 --2- 172.21.15.45:0/2505116518 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa3bc06ae40 0x7fa3bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:20.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.939+0000 7fa3ce7fc700 1 -- 172.21.15.45:0/2505116518 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa3d008aa10 con 0x7fa3d815c320 2023-10-08T12:45:20.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.939+0000 7fa3dddd4700 1 --2- 172.21.15.45:0/2505116518 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa3bc06ae40 0x7fa3bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:20.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.940+0000 7fa3dddd4700 1 --2- 172.21.15.45:0/2505116518 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa3bc06ae40 0x7fa3bc06d300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8005fd0 tx=0x7fa3c8005db0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:20.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:20.944+0000 7fa3ce7fc700 1 -- 172.21.15.45:0/2505116518 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa3d0056040 con 0x7fa3d815c320 2023-10-08T12:45:21.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.154+0000 7fa3e0038700 1 -- 172.21.15.45:0/2505116518 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3d81f3520 con 0x7fa3d815c320 2023-10-08T12:45:21.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.155+0000 7fa3ce7fc700 1 -- 172.21.15.45:0/2505116518 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12815 (secure 0 0 0) 0x7fa3d0017090 con 0x7fa3d815c320 2023-10-08T12:45:21.156 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:21.156 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":15,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:45:20.846910+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:45:19.183651+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.412453+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.351925+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.428025+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.437246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.441119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.388608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.415524+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.401835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:45:21.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.157+0000 7fa3e0038700 1 -- 172.21.15.45:0/2505116518 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa3bc06ae40 msgr2=0x7fa3bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:21.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.157+0000 7fa3e0038700 1 --2- 172.21.15.45:0/2505116518 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa3bc06ae40 0x7fa3bc06d300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8005fd0 tx=0x7fa3c8005db0 comp rx=0 tx=0).stop 2023-10-08T12:45:21.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.157+0000 7fa3e0038700 1 -- 172.21.15.45:0/2505116518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3d815c320 msgr2=0x7fa3d80c8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:21.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.157+0000 7fa3e0038700 1 --2- 172.21.15.45:0/2505116518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3d815c320 0x7fa3d80c8410 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa3d000b780 tx=0x7fa3d0009450 comp rx=0 tx=0).stop 2023-10-08T12:45:21.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.157+0000 7fa3e0038700 1 -- 172.21.15.45:0/2505116518 shutdown_connections 2023-10-08T12:45:21.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.157+0000 7fa3e0038700 1 --2- 172.21.15.45:0/2505116518 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa3bc06ae40 0x7fa3bc06d300 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:21.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.157+0000 7fa3e0038700 1 --2- 172.21.15.45:0/2505116518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3d815c320 0x7fa3d80c8410 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:21.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.157+0000 7fa3e0038700 1 --2- 172.21.15.45:0/2505116518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d80c9ff0 0x7fa3d80c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:21.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.157+0000 7fa3e0038700 1 --2- 172.21.15.45:0/2505116518 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3d8158950 0x7fa3d815a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:21.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.157+0000 7fa3e0038700 1 -- 172.21.15.45:0/2505116518 >> 172.21.15.45:0/2505116518 conn(0x7fa3d80b0430 msgr2=0x7fa3d80b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:21.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.157+0000 7fa3e0038700 1 -- 172.21.15.45:0/2505116518 shutdown_connections 2023-10-08T12:45:21.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.157+0000 7fa3e0038700 1 -- 172.21.15.45:0/2505116518 wait complete. 2023-10-08T12:45:21.172 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:45:19.183651+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:45:21.173 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:45:21.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.305+0000 7fa80df71700 1 -- 172.21.15.45:0/938921455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa80815c0d0 msgr2=0x7fa8080c9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:21.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.305+0000 7fa80df71700 1 --2- 172.21.15.45:0/938921455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa80815c0d0 0x7fa8080c9c00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa808071bb0 tx=0x7fa7f8009ba0 comp rx=0 tx=0).stop 2023-10-08T12:45:21.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.305+0000 7fa80df71700 1 -- 172.21.15.45:0/938921455 shutdown_connections 2023-10-08T12:45:21.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.305+0000 7fa80df71700 1 --2- 172.21.15.45:0/938921455 >> v2:172.21.15.78:3300/0 conn(0x7fa8080cb730 0x7fa8080b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:21.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.305+0000 7fa80df71700 1 --2- 172.21.15.45:0/938921455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa80815c0d0 0x7fa8080c9c00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:21.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.305+0000 7fa80df71700 1 -- 172.21.15.45:0/938921455 >> 172.21.15.45:0/938921455 conn(0x7fa808097a20 msgr2=0x7fa8080ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:21.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.305+0000 7fa80df71700 1 -- 172.21.15.45:0/938921455 shutdown_connections 2023-10-08T12:45:21.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.305+0000 7fa80df71700 1 -- 172.21.15.45:0/938921455 wait complete. 2023-10-08T12:45:21.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.306+0000 7fa80df71700 1 Processor -- start 2023-10-08T12:45:21.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.307+0000 7fa80df71700 1 -- start start 2023-10-08T12:45:21.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.307+0000 7fa80df71700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8080cb730 0x7fa8080c7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:21.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.308+0000 7fa80df71700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8080cf000 0x7fa80806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:21.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.308+0000 7fa80df71700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa80815c0d0 0x7fa8081f1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:21.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.308+0000 7fa80df71700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8080c7040 con 0x7fa8080cf000 2023-10-08T12:45:21.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.308+0000 7fa80df71700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8080c6730 con 0x7fa8080cb730 2023-10-08T12:45:21.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.308+0000 7fa80df71700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8081f6600 con 0x7fa80815c0d0 2023-10-08T12:45:21.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.308+0000 7fa806ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8080cf000 0x7fa80806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:21.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.308+0000 7fa8077fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8080cb730 0x7fa8080c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:21.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.308+0000 7fa806ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8080cf000 0x7fa80806a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34722/0 (socket says 172.21.15.45:34722) 2023-10-08T12:45:21.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.308+0000 7fa806ffd700 1 -- 172.21.15.45:0/449781538 learned_addr learned my addr 172.21.15.45:0/449781538 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:21.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.308+0000 7fa807fff700 1 --2- 172.21.15.45:0/449781538 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa80815c0d0 0x7fa8081f1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:21.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.308+0000 7fa8077fe700 1 -- 172.21.15.45:0/449781538 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa80815c0d0 msgr2=0x7fa8081f1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:21.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.308+0000 7fa8077fe700 1 --2- 172.21.15.45:0/449781538 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa80815c0d0 0x7fa8081f1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:21.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.308+0000 7fa8077fe700 1 -- 172.21.15.45:0/449781538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8080cf000 msgr2=0x7fa80806a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:21.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.308+0000 7fa8077fe700 1 --2- 172.21.15.45:0/449781538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8080cf000 0x7fa80806a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:21.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.308+0000 7fa8077fe700 1 -- 172.21.15.45:0/449781538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f8009520 con 0x7fa8080cb730 2023-10-08T12:45:21.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.308+0000 7fa806ffd700 1 --2- 172.21.15.45:0/449781538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8080cf000 0x7fa80806a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:21.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.308+0000 7fa8077fe700 1 --2- 172.21.15.45:0/449781538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8080cb730 0x7fa8080c7460 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8016000 tx=0x7fa7f800f710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:21.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.308+0000 7fa7effff700 1 -- 172.21.15.45:0/449781538 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f800fd90 con 0x7fa8080cb730 2023-10-08T12:45:21.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.309+0000 7fa7effff700 1 -- 172.21.15.45:0/449781538 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa7f8004030 con 0x7fa8080cb730 2023-10-08T12:45:21.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.309+0000 7fa80df71700 1 -- 172.21.15.45:0/449781538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8080c6980 con 0x7fa8080cb730 2023-10-08T12:45:21.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.309+0000 7fa7effff700 1 -- 172.21.15.45:0/449781538 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8004440 con 0x7fa8080cb730 2023-10-08T12:45:21.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.309+0000 7fa80df71700 1 -- 172.21.15.45:0/449781538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa80806a9c0 con 0x7fa8080cb730 2023-10-08T12:45:21.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.310+0000 7fa80df71700 1 -- 172.21.15.45:0/449781538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8080c7180 con 0x7fa8080cb730 2023-10-08T12:45:21.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.310+0000 7fa7effff700 1 -- 172.21.15.45:0/449781538 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7fa7f8003680 con 0x7fa8080cb730 2023-10-08T12:45:21.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.311+0000 7fa7effff700 1 --2- 172.21.15.45:0/449781538 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa7f406ae40 0x7fa7f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:21.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.311+0000 7fa7effff700 1 -- 172.21.15.45:0/449781538 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa7f808a9d0 con 0x7fa8080cb730 2023-10-08T12:45:21.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.311+0000 7fa806ffd700 1 --2- 172.21.15.45:0/449781538 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa7f406ae40 0x7fa7f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:21.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.311+0000 7fa806ffd700 1 --2- 172.21.15.45:0/449781538 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa7f406ae40 0x7fa7f406d300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa8080c5690 tx=0x7fa7fc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:21.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.316+0000 7fa7effff700 1 -- 172.21.15.45:0/449781538 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa8080c7180 con 0x7fa8080cb730 2023-10-08T12:45:21.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.522+0000 7fa80df71700 1 -- 172.21.15.45:0/449781538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa8080c7180 con 0x7fa8080cb730 2023-10-08T12:45:21.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.522+0000 7fa7effff700 1 -- 172.21.15.45:0/449781538 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v15) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa7f8055e20 con 0x7fa8080cb730 2023-10-08T12:45:21.523 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-08T12:45:21.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.525+0000 7fa80df71700 1 -- 172.21.15.45:0/449781538 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa7f406ae40 msgr2=0x7fa7f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:21.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.525+0000 7fa80df71700 1 --2- 172.21.15.45:0/449781538 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa7f406ae40 0x7fa7f406d300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa8080c5690 tx=0x7fa7fc009040 comp rx=0 tx=0).stop 2023-10-08T12:45:21.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.525+0000 7fa80df71700 1 -- 172.21.15.45:0/449781538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8080cb730 msgr2=0x7fa8080c7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:21.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.525+0000 7fa80df71700 1 --2- 172.21.15.45:0/449781538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8080cb730 0x7fa8080c7460 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8016000 tx=0x7fa7f800f710 comp rx=0 tx=0).stop 2023-10-08T12:45:21.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.525+0000 7fa80df71700 1 -- 172.21.15.45:0/449781538 shutdown_connections 2023-10-08T12:45:21.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.525+0000 7fa80df71700 1 --2- 172.21.15.45:0/449781538 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa7f406ae40 0x7fa7f406d300 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:21.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.525+0000 7fa80df71700 1 --2- 172.21.15.45:0/449781538 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa80815c0d0 0x7fa8081f1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:21.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.525+0000 7fa80df71700 1 --2- 172.21.15.45:0/449781538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8080cb730 0x7fa8080c7460 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:21.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.525+0000 7fa80df71700 1 --2- 172.21.15.45:0/449781538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8080cf000 0x7fa80806a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:21.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.525+0000 7fa80df71700 1 -- 172.21.15.45:0/449781538 >> 172.21.15.45:0/449781538 conn(0x7fa808097a20 msgr2=0x7fa808157e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:21.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.525+0000 7fa80df71700 1 -- 172.21.15.45:0/449781538 shutdown_connections 2023-10-08T12:45:21.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.525+0000 7fa80df71700 1 -- 172.21.15.45:0/449781538 wait complete. 2023-10-08T12:45:21.538 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T12:45:21.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.665+0000 7f567bcd5700 1 -- 172.21.15.45:0/469133265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56740b1730 msgr2=0x7f567406a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:21.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.665+0000 7f567bcd5700 1 --2- 172.21.15.45:0/469133265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56740b1730 0x7f567406a210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f567406b240 tx=0x7f5664009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:21.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.665+0000 7f567bcd5700 1 -- 172.21.15.45:0/469133265 shutdown_connections 2023-10-08T12:45:21.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.665+0000 7f567bcd5700 1 --2- 172.21.15.45:0/469133265 >> v2:172.21.15.78:3300/0 conn(0x7f567406a750 0x7f56740ce920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:21.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.665+0000 7f567bcd5700 1 --2- 172.21.15.45:0/469133265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56740b1730 0x7f567406a210 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:21.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.665+0000 7f567bcd5700 1 -- 172.21.15.45:0/469133265 >> 172.21.15.45:0/469133265 conn(0x7f56740b0430 msgr2=0x7f56740b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:21.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.665+0000 7f567bcd5700 1 -- 172.21.15.45:0/469133265 shutdown_connections 2023-10-08T12:45:21.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.665+0000 7f567bcd5700 1 -- 172.21.15.45:0/469133265 wait complete. 2023-10-08T12:45:21.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.666+0000 7f567bcd5700 1 Processor -- start 2023-10-08T12:45:21.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.666+0000 7f567bcd5700 1 -- start start 2023-10-08T12:45:21.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.667+0000 7f567bcd5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f567406a750 0x7f56740ad6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:21.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.667+0000 7f567bcd5700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f56740b1730 0x7f56740a7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:21.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.667+0000 7f567bcd5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5674159960 0x7f56740a7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:21.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.667+0000 7f567bcd5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56740b2bf0 con 0x7f567406a750 2023-10-08T12:45:21.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.667+0000 7f567bcd5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56740a84e0 con 0x7f5674159960 2023-10-08T12:45:21.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.667+0000 7f567bcd5700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56740a87c0 con 0x7f56740b1730 2023-10-08T12:45:21.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.667+0000 7f5679a71700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f567406a750 0x7f56740ad6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:21.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.667+0000 7f5679a71700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f567406a750 0x7f56740ad6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34738/0 (socket says 172.21.15.45:34738) 2023-10-08T12:45:21.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.667+0000 7f5679a71700 1 -- 172.21.15.45:0/2391136658 learned_addr learned my addr 172.21.15.45:0/2391136658 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:21.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.667+0000 7f567a272700 1 --2- 172.21.15.45:0/2391136658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5674159960 0x7f56740a7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:21.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.667+0000 7f5679270700 1 --2- 172.21.15.45:0/2391136658 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f56740b1730 0x7f56740a7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:21.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.667+0000 7f5679a71700 1 -- 172.21.15.45:0/2391136658 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f56740b1730 msgr2=0x7f56740a7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:21.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.667+0000 7f5679a71700 1 --2- 172.21.15.45:0/2391136658 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f56740b1730 0x7f56740a7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:21.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.667+0000 7f5679a71700 1 -- 172.21.15.45:0/2391136658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5674159960 msgr2=0x7f56740a7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:21.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.667+0000 7f5679a71700 1 --2- 172.21.15.45:0/2391136658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5674159960 0x7f56740a7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:21.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.667+0000 7f5679a71700 1 -- 172.21.15.45:0/2391136658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56640095f0 con 0x7f567406a750 2023-10-08T12:45:21.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.668+0000 7f5679a71700 1 --2- 172.21.15.45:0/2391136658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f567406a750 0x7f56740ad6b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f567000c550 tx=0x7f567000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:21.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.668+0000 7f566a7fc700 1 -- 172.21.15.45:0/2391136658 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56700054e0 con 0x7f567406a750 2023-10-08T12:45:21.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.668+0000 7f566a7fc700 1 -- 172.21.15.45:0/2391136658 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5670003680 con 0x7f567406a750 2023-10-08T12:45:21.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.668+0000 7f567bcd5700 1 -- 172.21.15.45:0/2391136658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56740a8aa0 con 0x7f567406a750 2023-10-08T12:45:21.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.668+0000 7f566a7fc700 1 -- 172.21.15.45:0/2391136658 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5670003a90 con 0x7f567406a750 2023-10-08T12:45:21.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.668+0000 7f567bcd5700 1 -- 172.21.15.45:0/2391136658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56740ab500 con 0x7f567406a750 2023-10-08T12:45:21.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.669+0000 7f567bcd5700 1 -- 172.21.15.45:0/2391136658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56740cf600 con 0x7f567406a750 2023-10-08T12:45:21.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.669+0000 7f566a7fc700 1 -- 172.21.15.45:0/2391136658 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f5670003bf0 con 0x7f567406a750 2023-10-08T12:45:21.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.669+0000 7f566a7fc700 1 --2- 172.21.15.45:0/2391136658 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f565806ae40 0x7f565806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:21.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.670+0000 7f566a7fc700 1 -- 172.21.15.45:0/2391136658 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5670088660 con 0x7f567406a750 2023-10-08T12:45:21.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.670+0000 7f5679270700 1 --2- 172.21.15.45:0/2391136658 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f565806ae40 0x7f565806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:21.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.670+0000 7f5679270700 1 --2- 172.21.15.45:0/2391136658 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f565806ae40 0x7f565806d300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5664000c00 tx=0x7f56640047c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:21.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.674+0000 7f566a7fc700 1 -- 172.21.15.45:0/2391136658 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5670053b40 con 0x7f567406a750 2023-10-08T12:45:21.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.884+0000 7f567bcd5700 1 -- 172.21.15.45:0/2391136658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f56740ab750 con 0x7f567406a750 2023-10-08T12:45:21.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.885+0000 7f566a7fc700 1 -- 172.21.15.45:0/2391136658 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f5670017090 con 0x7f567406a750 2023-10-08T12:45:21.886 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:21.886 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-10-08T12:45:21.886 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-08T12:45:21.886 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-10-08T12:45:21.887 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-10-08T12:45:21.887 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-08T12:45:21.887 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-10-08T12:45:21.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.887+0000 7f567bcd5700 1 -- 172.21.15.45:0/2391136658 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f565806ae40 msgr2=0x7f565806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:21.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.887+0000 7f567bcd5700 1 --2- 172.21.15.45:0/2391136658 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f565806ae40 0x7f565806d300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5664000c00 tx=0x7f56640047c0 comp rx=0 tx=0).stop 2023-10-08T12:45:21.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.887+0000 7f567bcd5700 1 -- 172.21.15.45:0/2391136658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f567406a750 msgr2=0x7f56740ad6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:21.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.887+0000 7f567bcd5700 1 --2- 172.21.15.45:0/2391136658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f567406a750 0x7f56740ad6b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f567000c550 tx=0x7f567000c860 comp rx=0 tx=0).stop 2023-10-08T12:45:21.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.887+0000 7f567bcd5700 1 -- 172.21.15.45:0/2391136658 shutdown_connections 2023-10-08T12:45:21.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.887+0000 7f567bcd5700 1 --2- 172.21.15.45:0/2391136658 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f565806ae40 0x7f565806d300 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:21.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.887+0000 7f567bcd5700 1 --2- 172.21.15.45:0/2391136658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5674159960 0x7f56740a7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:21.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.887+0000 7f567bcd5700 1 --2- 172.21.15.45:0/2391136658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f567406a750 0x7f56740ad6b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:21.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.887+0000 7f567bcd5700 1 --2- 172.21.15.45:0/2391136658 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f56740b1730 0x7f56740a7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:21.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.887+0000 7f567bcd5700 1 -- 172.21.15.45:0/2391136658 >> 172.21.15.45:0/2391136658 conn(0x7f56740b0430 msgr2=0x7f56740ceef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:21.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.887+0000 7f567bcd5700 1 -- 172.21.15.45:0/2391136658 shutdown_connections 2023-10-08T12:45:21.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:21.887+0000 7f567bcd5700 1 -- 172.21.15.45:0/2391136658 wait complete. 2023-10-08T12:45:21.900 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T12:45:21.900 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T12:45:22.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.032+0000 7fc7ecb54700 1 -- 172.21.15.45:0/1445771101 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7e806f270 msgr2=0x7fc7e80d00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:22.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.032+0000 7fc7ecb54700 1 --2- 172.21.15.45:0/1445771101 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7e806f270 0x7fc7e80d00e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8005fd0 tx=0x7fc7d8009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:22.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.032+0000 7fc7ecb54700 1 -- 172.21.15.45:0/1445771101 shutdown_connections 2023-10-08T12:45:22.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.032+0000 7fc7ecb54700 1 --2- 172.21.15.45:0/1445771101 >> v2:172.21.15.45:3300/0 conn(0x7fc7e80cb3d0 0x7fc7e80cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:22.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.032+0000 7fc7ecb54700 1 --2- 172.21.15.45:0/1445771101 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7e806f270 0x7fc7e80d00e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:22.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.032+0000 7fc7ecb54700 1 -- 172.21.15.45:0/1445771101 >> 172.21.15.45:0/1445771101 conn(0x7fc7e8098b60 msgr2=0x7fc7e80cf7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:22.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.032+0000 7fc7ecb54700 1 -- 172.21.15.45:0/1445771101 shutdown_connections 2023-10-08T12:45:22.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.032+0000 7fc7ecb54700 1 -- 172.21.15.45:0/1445771101 wait complete. 2023-10-08T12:45:22.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.033+0000 7fc7ecb54700 1 Processor -- start 2023-10-08T12:45:22.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.033+0000 7fc7ecb54700 1 -- start start 2023-10-08T12:45:22.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.034+0000 7fc7ecb54700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7e806ea70 0x7fc7e80c5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:22.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.034+0000 7fc7ecb54700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7e806f270 0x7fc7e809b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:22.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.034+0000 7fc7ecb54700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7e80cb3d0 0x7fc7e809c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:22.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.034+0000 7fc7ecb54700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e81453c0 con 0x7fc7e806f270 2023-10-08T12:45:22.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.034+0000 7fc7ecb54700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e809ba80 con 0x7fc7e806ea70 2023-10-08T12:45:22.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.034+0000 7fc7ecb54700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e809bd60 con 0x7fc7e80cb3d0 2023-10-08T12:45:22.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.034+0000 7fc7e5d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7e806f270 0x7fc7e809b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:22.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.034+0000 7fc7e5d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7e806f270 0x7fc7e809b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34754/0 (socket says 172.21.15.45:34754) 2023-10-08T12:45:22.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.034+0000 7fc7e5d9b700 1 -- 172.21.15.45:0/1698498562 learned_addr learned my addr 172.21.15.45:0/1698498562 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:22.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.034+0000 7fc7e6d9d700 1 --2- 172.21.15.45:0/1698498562 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7e80cb3d0 0x7fc7e809c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:22.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.034+0000 7fc7e659c700 1 --2- 172.21.15.45:0/1698498562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7e806ea70 0x7fc7e80c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:22.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.035+0000 7fc7e6d9d700 1 -- 172.21.15.45:0/1698498562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7e806ea70 msgr2=0x7fc7e80c5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:22.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.035+0000 7fc7e6d9d700 1 --2- 172.21.15.45:0/1698498562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7e806ea70 0x7fc7e80c5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:22.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.035+0000 7fc7e6d9d700 1 -- 172.21.15.45:0/1698498562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7e806f270 msgr2=0x7fc7e809b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:22.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.035+0000 7fc7e6d9d700 1 --2- 172.21.15.45:0/1698498562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7e806f270 0x7fc7e809b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:22.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.035+0000 7fc7e6d9d700 1 -- 172.21.15.45:0/1698498562 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d80095f0 con 0x7fc7e80cb3d0 2023-10-08T12:45:22.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.035+0000 7fc7e5d9b700 1 --2- 172.21.15.45:0/1698498562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7e806f270 0x7fc7e809b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:22.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.035+0000 7fc7e6d9d700 1 --2- 172.21.15.45:0/1698498562 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7e80cb3d0 0x7fc7e809c830 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc7e000efc0 tx=0x7fc7e000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:22.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.035+0000 7fc7d6ffd700 1 -- 172.21.15.45:0/1698498562 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0018070 con 0x7fc7e80cb3d0 2023-10-08T12:45:22.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.035+0000 7fc7d6ffd700 1 -- 172.21.15.45:0/1698498562 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc7e000f040 con 0x7fc7e80cb3d0 2023-10-08T12:45:22.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.035+0000 7fc7d6ffd700 1 -- 172.21.15.45:0/1698498562 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0004bb0 con 0x7fc7e80cb3d0 2023-10-08T12:45:22.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.035+0000 7fc7ecb54700 1 -- 172.21.15.45:0/1698498562 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e809c040 con 0x7fc7e80cb3d0 2023-10-08T12:45:22.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.035+0000 7fc7ecb54700 1 -- 172.21.15.45:0/1698498562 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e80c5870 con 0x7fc7e80cb3d0 2023-10-08T12:45:22.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.036+0000 7fc7ecb54700 1 -- 172.21.15.45:0/1698498562 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e8145850 con 0x7fc7e80cb3d0 2023-10-08T12:45:22.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.037+0000 7fc7d6ffd700 1 -- 172.21.15.45:0/1698498562 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7fc7e000c880 con 0x7fc7e80cb3d0 2023-10-08T12:45:22.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.037+0000 7fc7d6ffd700 1 --2- 172.21.15.45:0/1698498562 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc7c806ae40 0x7fc7c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:22.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.037+0000 7fc7d6ffd700 1 -- 172.21.15.45:0/1698498562 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc7e0088f00 con 0x7fc7e80cb3d0 2023-10-08T12:45:22.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.037+0000 7fc7e659c700 1 --2- 172.21.15.45:0/1698498562 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc7c806ae40 0x7fc7c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:22.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.038+0000 7fc7e659c700 1 --2- 172.21.15.45:0/1698498562 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc7c806ae40 0x7fc7c806d300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8000c00 tx=0x7fc7d80047c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:22.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.042+0000 7fc7d6ffd700 1 -- 172.21.15.45:0/1698498562 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc7e0054470 con 0x7fc7e80cb3d0 2023-10-08T12:45:22.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:22.246+0000 7fc7ecb54700 1 -- 172.21.15.45:0/1698498562 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc7e809bea0 con 0x7fc7e80cb3d0 2023-10-08T12:45:23.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.202+0000 7fc7d6ffd700 1 -- 172.21.15.45:0/1698498562 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc7e809bea0 con 0x7fc7e80cb3d0 2023-10-08T12:45:23.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.208+0000 7fc7ecb54700 1 -- 172.21.15.45:0/1698498562 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc7c806ae40 msgr2=0x7fc7c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:23.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.208+0000 7fc7ecb54700 1 --2- 172.21.15.45:0/1698498562 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc7c806ae40 0x7fc7c806d300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8000c00 tx=0x7fc7d80047c0 comp rx=0 tx=0).stop 2023-10-08T12:45:23.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.208+0000 7fc7ecb54700 1 -- 172.21.15.45:0/1698498562 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7e80cb3d0 msgr2=0x7fc7e809c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:23.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.208+0000 7fc7ecb54700 1 --2- 172.21.15.45:0/1698498562 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7e80cb3d0 0x7fc7e809c830 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc7e000efc0 tx=0x7fc7e000c3a0 comp rx=0 tx=0).stop 2023-10-08T12:45:23.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.208+0000 7fc7ecb54700 1 -- 172.21.15.45:0/1698498562 shutdown_connections 2023-10-08T12:45:23.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.208+0000 7fc7ecb54700 1 --2- 172.21.15.45:0/1698498562 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc7c806ae40 0x7fc7c806d300 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:23.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.208+0000 7fc7ecb54700 1 --2- 172.21.15.45:0/1698498562 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7e80cb3d0 0x7fc7e809c830 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:23.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.208+0000 7fc7ecb54700 1 --2- 172.21.15.45:0/1698498562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7e806ea70 0x7fc7e80c5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:23.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.208+0000 7fc7ecb54700 1 --2- 172.21.15.45:0/1698498562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7e806f270 0x7fc7e809b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:23.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.208+0000 7fc7ecb54700 1 -- 172.21.15.45:0/1698498562 >> 172.21.15.45:0/1698498562 conn(0x7fc7e8098b60 msgr2=0x7fc7e815caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:23.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.209+0000 7fc7ecb54700 1 -- 172.21.15.45:0/1698498562 shutdown_connections 2023-10-08T12:45:23.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.209+0000 7fc7ecb54700 1 -- 172.21.15.45:0/1698498562 wait complete. 2023-10-08T12:45:23.210 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-10-08T12:45:23.225 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T12:45:23.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.365+0000 7fa709a6a700 1 -- 172.21.15.45:0/2873719941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6f0003f70 msgr2=0x7fa6f0004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:23.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.365+0000 7fa709a6a700 1 --2- 172.21.15.45:0/2873719941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6f0003f70 0x7fa6f0004850 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec001830 tx=0x7fa6f0005880 comp rx=0 tx=0).stop 2023-10-08T12:45:23.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.365+0000 7fa703fff700 1 -- 172.21.15.45:0/2873719941 reap_dead start 2023-10-08T12:45:23.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.365+0000 7fa709a6a700 1 -- 172.21.15.45:0/2873719941 shutdown_connections 2023-10-08T12:45:23.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.365+0000 7fa709a6a700 1 -- 172.21.15.45:0/2873719941 >> 172.21.15.45:0/2873719941 conn(0x7fa704097a20 msgr2=0x7fa7040ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:23.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.365+0000 7fa709a6a700 1 -- 172.21.15.45:0/2873719941 shutdown_connections 2023-10-08T12:45:23.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.365+0000 7fa709a6a700 1 -- 172.21.15.45:0/2873719941 wait complete. 2023-10-08T12:45:23.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.366+0000 7fa709a6a700 1 Processor -- start 2023-10-08T12:45:23.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.366+0000 7fa709a6a700 1 -- start start 2023-10-08T12:45:23.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.367+0000 7fa709a6a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6f0003f70 0x7fa7040c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:23.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.367+0000 7fa709a6a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa704154b80 0x7fa704155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:23.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.367+0000 7fa709a6a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa704156f90 0x7fa7041e3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:23.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.367+0000 7fa709a6a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa704155000 con 0x7fa704154b80 2023-10-08T12:45:23.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.367+0000 7fa709a6a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa704155c50 con 0x7fa6f0003f70 2023-10-08T12:45:23.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.367+0000 7fa709a6a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa704155ef0 con 0x7fa704156f90 2023-10-08T12:45:23.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.367+0000 7fa702ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa704154b80 0x7fa704155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:23.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.367+0000 7fa702ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa704154b80 0x7fa704155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34774/0 (socket says 172.21.15.45:34774) 2023-10-08T12:45:23.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.367+0000 7fa702ffd700 1 -- 172.21.15.45:0/2972042090 learned_addr learned my addr 172.21.15.45:0/2972042090 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:23.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.367+0000 7fa7037fe700 1 --2- 172.21.15.45:0/2972042090 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6f0003f70 0x7fa7040c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:23.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.367+0000 7fa703fff700 1 --2- 172.21.15.45:0/2972042090 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa704156f90 0x7fa7041e3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:23.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.367+0000 7fa702ffd700 1 -- 172.21.15.45:0/2972042090 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa704156f90 msgr2=0x7fa7041e3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:23.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.367+0000 7fa702ffd700 1 --2- 172.21.15.45:0/2972042090 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa704156f90 0x7fa7041e3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:23.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.367+0000 7fa702ffd700 1 -- 172.21.15.45:0/2972042090 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6f0003f70 msgr2=0x7fa7040c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:23.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.368+0000 7fa702ffd700 1 --2- 172.21.15.45:0/2972042090 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6f0003f70 0x7fa7040c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:23.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.368+0000 7fa702ffd700 1 -- 172.21.15.45:0/2972042090 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7041561d0 con 0x7fa704154b80 2023-10-08T12:45:23.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.368+0000 7fa703fff700 1 --2- 172.21.15.45:0/2972042090 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa704156f90 0x7fa7041e3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:23.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.368+0000 7fa702ffd700 1 --2- 172.21.15.45:0/2972042090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa704154b80 0x7fa704155710 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec006040 tx=0x7fa6ec004f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:23.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.368+0000 7fa6fbfff700 1 -- 172.21.15.45:0/2972042090 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec00c760 con 0x7fa704154b80 2023-10-08T12:45:23.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.368+0000 7fa6fbfff700 1 -- 172.21.15.45:0/2972042090 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa6ec00c8c0 con 0x7fa704154b80 2023-10-08T12:45:23.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.368+0000 7fa6fbfff700 1 -- 172.21.15.45:0/2972042090 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec00ccd0 con 0x7fa704154b80 2023-10-08T12:45:23.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.368+0000 7fa709a6a700 1 -- 172.21.15.45:0/2972042090 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7041564b0 con 0x7fa704154b80 2023-10-08T12:45:23.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.368+0000 7fa709a6a700 1 -- 172.21.15.45:0/2972042090 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa704156a70 con 0x7fa704154b80 2023-10-08T12:45:23.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.369+0000 7fa709a6a700 1 -- 172.21.15.45:0/2972042090 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa704156de0 con 0x7fa704154b80 2023-10-08T12:45:23.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.369+0000 7fa6fbfff700 1 -- 172.21.15.45:0/2972042090 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7fa6ec010480 con 0x7fa704154b80 2023-10-08T12:45:23.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.370+0000 7fa6fbfff700 1 --2- 172.21.15.45:0/2972042090 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa6e406ae40 0x7fa6e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:23.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.370+0000 7fa6fbfff700 1 -- 172.21.15.45:0/2972042090 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fa6ec08af50 con 0x7fa704154b80 2023-10-08T12:45:23.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.370+0000 7fa7037fe700 1 --2- 172.21.15.45:0/2972042090 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa6e406ae40 0x7fa6e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:23.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.370+0000 7fa7037fe700 1 --2- 172.21.15.45:0/2972042090 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa6e406ae40 0x7fa6e406d300 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4009d40 tx=0x7fa6f4009260 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:23.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.375+0000 7fa6fbfff700 1 -- 172.21.15.45:0/2972042090 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa6ec056470 con 0x7fa704154b80 2023-10-08T12:45:23.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.575+0000 7fa709a6a700 1 -- 172.21.15.45:0/2972042090 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa70415c300 con 0x7fa704154b80 2023-10-08T12:45:23.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:23.872+0000 7fa6fbfff700 1 -- 172.21.15.45:0/2972042090 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa6ec0013d0 con 0x7fa704154b80 2023-10-08T12:45:24.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.203+0000 7fa6fbfff700 1 -- 172.21.15.45:0/2972042090 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa6ec06e5b0 con 0x7fa704154b80 2023-10-08T12:45:24.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.206+0000 7fa709a6a700 1 -- 172.21.15.45:0/2972042090 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa6e406ae40 msgr2=0x7fa6e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:24.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.206+0000 7fa709a6a700 1 --2- 172.21.15.45:0/2972042090 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa6e406ae40 0x7fa6e406d300 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4009d40 tx=0x7fa6f4009260 comp rx=0 tx=0).stop 2023-10-08T12:45:24.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.206+0000 7fa709a6a700 1 -- 172.21.15.45:0/2972042090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa704154b80 msgr2=0x7fa704155710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:24.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.206+0000 7fa709a6a700 1 --2- 172.21.15.45:0/2972042090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa704154b80 0x7fa704155710 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec006040 tx=0x7fa6ec004f00 comp rx=0 tx=0).stop 2023-10-08T12:45:24.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.207+0000 7fa709a6a700 1 -- 172.21.15.45:0/2972042090 shutdown_connections 2023-10-08T12:45:24.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.207+0000 7fa709a6a700 1 --2- 172.21.15.45:0/2972042090 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa6e406ae40 0x7fa6e406d300 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:24.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.207+0000 7fa709a6a700 1 --2- 172.21.15.45:0/2972042090 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa704156f90 0x7fa7041e3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:24.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.207+0000 7fa709a6a700 1 --2- 172.21.15.45:0/2972042090 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6f0003f70 0x7fa7040c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:24.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.207+0000 7fa709a6a700 1 --2- 172.21.15.45:0/2972042090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa704154b80 0x7fa704155710 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:24.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.207+0000 7fa709a6a700 1 -- 172.21.15.45:0/2972042090 >> 172.21.15.45:0/2972042090 conn(0x7fa704097a20 msgr2=0x7fa7040ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:24.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.209+0000 7fa709a6a700 1 -- 172.21.15.45:0/2972042090 shutdown_connections 2023-10-08T12:45:24.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.211+0000 7fa709a6a700 1 -- 172.21.15.45:0/2972042090 wait complete. 2023-10-08T12:45:24.214 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-10-08T12:45:24.234 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T12:45:24.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.365+0000 7f4643c3a700 1 -- 172.21.15.45:0/3355837330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f463c0b06d0 msgr2=0x7f463c098130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:24.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.365+0000 7f4643c3a700 1 --2- 172.21.15.45:0/3355837330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f463c0b06d0 0x7f463c098130 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f462c0098c0 tx=0x7f462c009bd0 comp rx=0 tx=0).stop 2023-10-08T12:45:24.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.365+0000 7f4643c3a700 1 -- 172.21.15.45:0/3355837330 shutdown_connections 2023-10-08T12:45:24.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.365+0000 7f4643c3a700 1 --2- 172.21.15.45:0/3355837330 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f463c0cafc0 0x7f463c0cb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:24.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.365+0000 7f4643c3a700 1 --2- 172.21.15.45:0/3355837330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f463c0b06d0 0x7f463c098130 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:24.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.365+0000 7f4643c3a700 1 -- 172.21.15.45:0/3355837330 >> 172.21.15.45:0/3355837330 conn(0x7f463c0b1290 msgr2=0x7f463c0b16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:24.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.366+0000 7f4643c3a700 1 -- 172.21.15.45:0/3355837330 shutdown_connections 2023-10-08T12:45:24.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.366+0000 7f4643c3a700 1 -- 172.21.15.45:0/3355837330 wait complete. 2023-10-08T12:45:24.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.367+0000 7f4643c3a700 1 Processor -- start 2023-10-08T12:45:24.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.367+0000 7f4643c3a700 1 -- start start 2023-10-08T12:45:24.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.367+0000 7f4643c3a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f463c0b06d0 0x7f463c0c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:24.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.367+0000 7f4643c3a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f463c0cafc0 0x7f463c1546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:24.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.367+0000 7f4643c3a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f463c15d0c0 0x7f463c0b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:24.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.367+0000 7f4643c3a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463c06d3f0 con 0x7f463c15d0c0 2023-10-08T12:45:24.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.367+0000 7f4643c3a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463c155420 con 0x7f463c0b06d0 2023-10-08T12:45:24.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.367+0000 7f4643c3a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463c0c6db0 con 0x7f463c0cafc0 2023-10-08T12:45:24.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.368+0000 7f46421d7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f463c15d0c0 0x7f463c0b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:24.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.368+0000 7f46421d7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f463c15d0c0 0x7f463c0b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34790/0 (socket says 172.21.15.45:34790) 2023-10-08T12:45:24.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.368+0000 7f46421d7700 1 -- 172.21.15.45:0/2985636938 learned_addr learned my addr 172.21.15.45:0/2985636938 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:24.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.368+0000 7f46419d6700 1 --2- 172.21.15.45:0/2985636938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f463c0b06d0 0x7f463c0c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:24.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.368+0000 7f46411d5700 1 --2- 172.21.15.45:0/2985636938 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f463c0cafc0 0x7f463c1546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:24.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.368+0000 7f46421d7700 1 -- 172.21.15.45:0/2985636938 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f463c0cafc0 msgr2=0x7f463c1546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:24.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.368+0000 7f46421d7700 1 --2- 172.21.15.45:0/2985636938 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f463c0cafc0 0x7f463c1546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:24.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.368+0000 7f46421d7700 1 -- 172.21.15.45:0/2985636938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f463c0b06d0 msgr2=0x7f463c0c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:24.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.368+0000 7f46421d7700 1 --2- 172.21.15.45:0/2985636938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f463c0b06d0 0x7f463c0c6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:24.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.368+0000 7f46421d7700 1 -- 172.21.15.45:0/2985636938 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462c009520 con 0x7f463c15d0c0 2023-10-08T12:45:24.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.368+0000 7f46419d6700 1 --2- 172.21.15.45:0/2985636938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f463c0b06d0 0x7f463c0c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:24.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.368+0000 7f46421d7700 1 --2- 172.21.15.45:0/2985636938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f463c15d0c0 0x7f463c0b43c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f463400ef30 tx=0x7f463400c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:24.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.368+0000 7f46327fc700 1 -- 172.21.15.45:0/2985636938 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4634018070 con 0x7f463c15d0c0 2023-10-08T12:45:24.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.368+0000 7f46327fc700 1 -- 172.21.15.45:0/2985636938 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f463400f040 con 0x7f463c15d0c0 2023-10-08T12:45:24.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.368+0000 7f4643c3a700 1 -- 172.21.15.45:0/2985636938 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f463c155220 con 0x7f463c15d0c0 2023-10-08T12:45:24.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.368+0000 7f46327fc700 1 -- 172.21.15.45:0/2985636938 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4634004bb0 con 0x7f463c15d0c0 2023-10-08T12:45:24.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.368+0000 7f4643c3a700 1 -- 172.21.15.45:0/2985636938 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f463c0c7560 con 0x7f463c15d0c0 2023-10-08T12:45:24.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.369+0000 7f4643c3a700 1 -- 172.21.15.45:0/2985636938 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f463c066850 con 0x7f463c15d0c0 2023-10-08T12:45:24.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.370+0000 7f46327fc700 1 -- 172.21.15.45:0/2985636938 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4634004d10 con 0x7f463c15d0c0 2023-10-08T12:45:24.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.370+0000 7f46327fc700 1 --2- 172.21.15.45:0/2985636938 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f462006aed0 0x7f462006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:24.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.370+0000 7f46327fc700 1 -- 172.21.15.45:0/2985636938 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f46340895a0 con 0x7f463c15d0c0 2023-10-08T12:45:24.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.370+0000 7f46419d6700 1 --2- 172.21.15.45:0/2985636938 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f462006aed0 0x7f462006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:24.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.371+0000 7f46419d6700 1 --2- 172.21.15.45:0/2985636938 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f462006aed0 0x7f462006d390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4638004740 tx=0x7f4638009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:24.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.375+0000 7f46327fc700 1 -- 172.21.15.45:0/2985636938 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4634054740 con 0x7f463c15d0c0 2023-10-08T12:45:24.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:24.622+0000 7f4643c3a700 1 -- 172.21.15.45:0/2985636938 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f463c0b5220 con 0x7f463c15d0c0 2023-10-08T12:45:25.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.205+0000 7f46327fc700 1 -- 172.21.15.45:0/2985636938 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4634057d60 con 0x7f463c15d0c0 2023-10-08T12:45:25.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.209+0000 7f4643c3a700 1 -- 172.21.15.45:0/2985636938 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f462006aed0 msgr2=0x7f462006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:25.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.209+0000 7f4643c3a700 1 --2- 172.21.15.45:0/2985636938 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f462006aed0 0x7f462006d390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4638004740 tx=0x7f4638009040 comp rx=0 tx=0).stop 2023-10-08T12:45:25.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.209+0000 7f4643c3a700 1 -- 172.21.15.45:0/2985636938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f463c15d0c0 msgr2=0x7f463c0b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:25.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.209+0000 7f4643c3a700 1 --2- 172.21.15.45:0/2985636938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f463c15d0c0 0x7f463c0b43c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f463400ef30 tx=0x7f463400c450 comp rx=0 tx=0).stop 2023-10-08T12:45:25.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.211+0000 7f4643c3a700 1 -- 172.21.15.45:0/2985636938 shutdown_connections 2023-10-08T12:45:25.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.211+0000 7f4643c3a700 1 --2- 172.21.15.45:0/2985636938 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f462006aed0 0x7f462006d390 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:25.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.211+0000 7f4643c3a700 1 --2- 172.21.15.45:0/2985636938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f463c15d0c0 0x7f463c0b43c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:25.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.211+0000 7f4643c3a700 1 --2- 172.21.15.45:0/2985636938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f463c0b06d0 0x7f463c0c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:25.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.211+0000 7f4643c3a700 1 --2- 172.21.15.45:0/2985636938 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f463c0cafc0 0x7f463c1546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:25.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.211+0000 7f4643c3a700 1 -- 172.21.15.45:0/2985636938 >> 172.21.15.45:0/2985636938 conn(0x7f463c0b1290 msgr2=0x7f463c158b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:25.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.212+0000 7f4643c3a700 1 -- 172.21.15.45:0/2985636938 shutdown_connections 2023-10-08T12:45:25.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.212+0000 7f4643c3a700 1 -- 172.21.15.45:0/2985636938 wait complete. 2023-10-08T12:45:25.216 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 2 and data pool 3 2023-10-08T12:45:25.242 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:45:25.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.373+0000 7f45f0c3a700 1 -- 172.21.15.45:0/3386393764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45d4004850 msgr2=0x7f45d4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:25.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.373+0000 7f45f0c3a700 1 --2- 172.21.15.45:0/3386393764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45d4004850 0x7f45d4004cd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009be0 tx=0x7f45d4005880 comp rx=0 tx=0).stop 2023-10-08T12:45:25.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.373+0000 7f45ead9d700 1 -- 172.21.15.45:0/3386393764 reap_dead start 2023-10-08T12:45:25.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.373+0000 7f45f0c3a700 1 -- 172.21.15.45:0/3386393764 shutdown_connections 2023-10-08T12:45:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.373+0000 7f45f0c3a700 1 -- 172.21.15.45:0/3386393764 >> 172.21.15.45:0/3386393764 conn(0x7f45ec0b0430 msgr2=0x7f45ec0b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.373+0000 7f45f0c3a700 1 -- 172.21.15.45:0/3386393764 shutdown_connections 2023-10-08T12:45:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.373+0000 7f45f0c3a700 1 -- 172.21.15.45:0/3386393764 wait complete. 2023-10-08T12:45:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.375+0000 7f45f0c3a700 1 Processor -- start 2023-10-08T12:45:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.375+0000 7f45f0c3a700 1 -- start start 2023-10-08T12:45:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.376+0000 7f45f0c3a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45d4004850 0x7f45ec14b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.376+0000 7f45f0c3a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45ec0aa8a0 0x7f45ec0ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.376+0000 7f45f0c3a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45ec0ceb00 0x7f45ec06a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.376+0000 7f45f0c3a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec1f64b0 con 0x7f45ec0aa8a0 2023-10-08T12:45:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.376+0000 7f45f0c3a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec0cef60 con 0x7f45d4004850 2023-10-08T12:45:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.376+0000 7f45f0c3a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec1f55e0 con 0x7f45ec0ceb00 2023-10-08T12:45:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.376+0000 7f45e9d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45ec0aa8a0 0x7f45ec0ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.376+0000 7f45e9d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45ec0aa8a0 0x7f45ec0ce5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34808/0 (socket says 172.21.15.45:34808) 2023-10-08T12:45:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.376+0000 7f45e9d9b700 1 -- 172.21.15.45:0/1797946453 learned_addr learned my addr 172.21.15.45:0/1797946453 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.376+0000 7f45ea59c700 1 --2- 172.21.15.45:0/1797946453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45d4004850 0x7f45ec14b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.376+0000 7f45ead9d700 1 --2- 172.21.15.45:0/1797946453 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45ec0ceb00 0x7f45ec06a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.376+0000 7f45e9d9b700 1 -- 172.21.15.45:0/1797946453 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45ec0ceb00 msgr2=0x7f45ec06a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.376+0000 7f45e9d9b700 1 --2- 172.21.15.45:0/1797946453 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45ec0ceb00 0x7f45ec06a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.376+0000 7f45e9d9b700 1 -- 172.21.15.45:0/1797946453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45d4004850 msgr2=0x7f45ec14b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.376+0000 7f45e9d9b700 1 --2- 172.21.15.45:0/1797946453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45d4004850 0x7f45ec14b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.376+0000 7f45e9d9b700 1 -- 172.21.15.45:0/1797946453 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ec1f1ea0 con 0x7f45ec0aa8a0 2023-10-08T12:45:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.376+0000 7f45ea59c700 1 --2- 172.21.15.45:0/1797946453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45d4004850 0x7f45ec14b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.376+0000 7f45ead9d700 1 --2- 172.21.15.45:0/1797946453 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45ec0ceb00 0x7f45ec06a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.376+0000 7f45e9d9b700 1 --2- 172.21.15.45:0/1797946453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45ec0aa8a0 0x7f45ec0ce5c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009b00 tx=0x7f45dc0058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.377+0000 7f45daffd700 1 -- 172.21.15.45:0/1797946453 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc003680 con 0x7f45ec0aa8a0 2023-10-08T12:45:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.377+0000 7f45daffd700 1 -- 172.21.15.45:0/1797946453 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f45dc0037e0 con 0x7f45ec0aa8a0 2023-10-08T12:45:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.377+0000 7f45f0c3a700 1 -- 172.21.15.45:0/1797946453 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45ec1f5830 con 0x7f45ec0aa8a0 2023-10-08T12:45:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.377+0000 7f45daffd700 1 -- 172.21.15.45:0/1797946453 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc003bf0 con 0x7f45ec0aa8a0 2023-10-08T12:45:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.377+0000 7f45f0c3a700 1 -- 172.21.15.45:0/1797946453 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45ec1f5df0 con 0x7f45ec0aa8a0 2023-10-08T12:45:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.377+0000 7f45f0c3a700 1 -- 172.21.15.45:0/1797946453 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45ec04e4c0 con 0x7f45ec0aa8a0 2023-10-08T12:45:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.378+0000 7f45daffd700 1 -- 172.21.15.45:0/1797946453 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f45dc003d50 con 0x7f45ec0aa8a0 2023-10-08T12:45:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.378+0000 7f45daffd700 1 --2- 172.21.15.45:0/1797946453 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f45cc06aed0 0x7f45cc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.378+0000 7f45daffd700 1 -- 172.21.15.45:0/1797946453 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f45dc014070 con 0x7f45ec0aa8a0 2023-10-08T12:45:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.379+0000 7f45ea59c700 1 --2- 172.21.15.45:0/1797946453 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f45cc06aed0 0x7f45cc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.379+0000 7f45ea59c700 1 --2- 172.21.15.45:0/1797946453 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f45cc06aed0 0x7f45cc06d390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f45e0000fb0 tx=0x7f45e0006830 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:25.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.383+0000 7f45daffd700 1 -- 172.21.15.45:0/1797946453 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f45dc056300 con 0x7f45ec0aa8a0 2023-10-08T12:45:25.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.583+0000 7f45f0c3a700 1 -- 172.21.15.45:0/1797946453 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45ec155520 con 0x7f45ec0aa8a0 2023-10-08T12:45:25.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.585+0000 7f45daffd700 1 -- 172.21.15.45:0/1797946453 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f45dc059920 con 0x7f45ec0aa8a0 2023-10-08T12:45:25.586 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:25.586 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":19,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:45:24.623506+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:45:19.183651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:45:22.277383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:45:23.606639+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.412453+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.351925+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.428025+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.437246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.441119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.388608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.415524+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.401835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:45:25.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.587+0000 7f45f0c3a700 1 -- 172.21.15.45:0/1797946453 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f45cc06aed0 msgr2=0x7f45cc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:25.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.587+0000 7f45f0c3a700 1 --2- 172.21.15.45:0/1797946453 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f45cc06aed0 0x7f45cc06d390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f45e0000fb0 tx=0x7f45e0006830 comp rx=0 tx=0).stop 2023-10-08T12:45:25.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.587+0000 7f45f0c3a700 1 -- 172.21.15.45:0/1797946453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45ec0aa8a0 msgr2=0x7f45ec0ce5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:25.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.587+0000 7f45f0c3a700 1 --2- 172.21.15.45:0/1797946453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45ec0aa8a0 0x7f45ec0ce5c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009b00 tx=0x7f45dc0058e0 comp rx=0 tx=0).stop 2023-10-08T12:45:25.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.587+0000 7f45f0c3a700 1 -- 172.21.15.45:0/1797946453 shutdown_connections 2023-10-08T12:45:25.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.587+0000 7f45f0c3a700 1 --2- 172.21.15.45:0/1797946453 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f45cc06aed0 0x7f45cc06d390 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:25.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.587+0000 7f45f0c3a700 1 --2- 172.21.15.45:0/1797946453 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45ec0ceb00 0x7f45ec06a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:25.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.587+0000 7f45f0c3a700 1 --2- 172.21.15.45:0/1797946453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45d4004850 0x7f45ec14b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:25.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.587+0000 7f45f0c3a700 1 --2- 172.21.15.45:0/1797946453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45ec0aa8a0 0x7f45ec0ce5c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:25.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.587+0000 7f45f0c3a700 1 -- 172.21.15.45:0/1797946453 >> 172.21.15.45:0/1797946453 conn(0x7f45ec0b0430 msgr2=0x7f45ec0cc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:25.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.587+0000 7f45f0c3a700 1 -- 172.21.15.45:0/1797946453 shutdown_connections 2023-10-08T12:45:25.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.587+0000 7f45f0c3a700 1 -- 172.21.15.45:0/1797946453 wait complete. 2023-10-08T12:45:25.600 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:45:25.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.726+0000 7f1137b54700 1 -- 172.21.15.45:0/3814461894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11300cc160 msgr2=0x7f11300cc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:25.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.726+0000 7f1137b54700 1 --2- 172.21.15.45:0/3814461894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11300cc160 0x7f11300cc5e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1120005fd0 tx=0x7f1120009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:25.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.726+0000 7f1137b54700 1 -- 172.21.15.45:0/3814461894 shutdown_connections 2023-10-08T12:45:25.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.726+0000 7f1137b54700 1 --2- 172.21.15.45:0/3814461894 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f11300ae380 0x7f11300ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:25.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.726+0000 7f1137b54700 1 --2- 172.21.15.45:0/3814461894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11300cc160 0x7f11300cc5e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:25.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.726+0000 7f1137b54700 1 -- 172.21.15.45:0/3814461894 >> 172.21.15.45:0/3814461894 conn(0x7f11300cf750 msgr2=0x7f11300cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:25.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.726+0000 7f1137b54700 1 -- 172.21.15.45:0/3814461894 shutdown_connections 2023-10-08T12:45:25.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.726+0000 7f1137b54700 1 -- 172.21.15.45:0/3814461894 wait complete. 2023-10-08T12:45:25.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.728+0000 7f1137b54700 1 Processor -- start 2023-10-08T12:45:25.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.728+0000 7f1137b54700 1 -- start start 2023-10-08T12:45:25.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.729+0000 7f1137b54700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f11300ae380 0x7f11300b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:25.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.729+0000 7f1137b54700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11300cc160 0x7f11301f0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:25.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.729+0000 7f1137b54700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11301599f0 0x7f113014faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:25.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.729+0000 7f1137b54700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11301f10b0 con 0x7f11300cc160 2023-10-08T12:45:25.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.729+0000 7f1137b54700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11300b3b50 con 0x7f11301599f0 2023-10-08T12:45:25.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.729+0000 7f1137b54700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11300b3e30 con 0x7f11300ae380 2023-10-08T12:45:25.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.729+0000 7f11350ef700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11300cc160 0x7f11301f0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:25.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.729+0000 7f11350ef700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11300cc160 0x7f11301f0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34822/0 (socket says 172.21.15.45:34822) 2023-10-08T12:45:25.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.729+0000 7f11350ef700 1 -- 172.21.15.45:0/798228494 learned_addr learned my addr 172.21.15.45:0/798228494 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:25.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.729+0000 7f11358f0700 1 --2- 172.21.15.45:0/798228494 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f11300ae380 0x7f11300b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:25.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.729+0000 7f11360f1700 1 --2- 172.21.15.45:0/798228494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11301599f0 0x7f113014faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:25.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.729+0000 7f11350ef700 1 -- 172.21.15.45:0/798228494 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f11300ae380 msgr2=0x7f11300b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:25.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.729+0000 7f11350ef700 1 --2- 172.21.15.45:0/798228494 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f11300ae380 0x7f11300b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:25.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.729+0000 7f11350ef700 1 -- 172.21.15.45:0/798228494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11301599f0 msgr2=0x7f113014faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:25.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.729+0000 7f11350ef700 1 --2- 172.21.15.45:0/798228494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11301599f0 0x7f113014faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:25.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.729+0000 7f11350ef700 1 -- 172.21.15.45:0/798228494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11200095f0 con 0x7f11300cc160 2023-10-08T12:45:25.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.729+0000 7f11360f1700 1 --2- 172.21.15.45:0/798228494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11301599f0 0x7f113014faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:25.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.729+0000 7f11350ef700 1 --2- 172.21.15.45:0/798228494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11300cc160 0x7f11301f0b70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f11300717b0 tx=0x7f1120004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:25.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.729+0000 7f11267fc700 1 -- 172.21.15.45:0/798228494 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112001d070 con 0x7f11300cc160 2023-10-08T12:45:25.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.729+0000 7f11267fc700 1 -- 172.21.15.45:0/798228494 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f112000b820 con 0x7f11300cc160 2023-10-08T12:45:25.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.729+0000 7f1137b54700 1 -- 172.21.15.45:0/798228494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11300b4110 con 0x7f11300cc160 2023-10-08T12:45:25.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.729+0000 7f11267fc700 1 -- 172.21.15.45:0/798228494 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11200045f0 con 0x7f11300cc160 2023-10-08T12:45:25.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.729+0000 7f1137b54700 1 -- 172.21.15.45:0/798228494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11300b46d0 con 0x7f11300cc160 2023-10-08T12:45:25.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.730+0000 7f1137b54700 1 -- 172.21.15.45:0/798228494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f113004e4c0 con 0x7f11300cc160 2023-10-08T12:45:25.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.731+0000 7f11267fc700 1 -- 172.21.15.45:0/798228494 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f112000bc30 con 0x7f11300cc160 2023-10-08T12:45:25.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.731+0000 7f11267fc700 1 --2- 172.21.15.45:0/798228494 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f111406aed0 0x7f111406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:25.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.731+0000 7f11267fc700 1 -- 172.21.15.45:0/798228494 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f112008ac80 con 0x7f11300cc160 2023-10-08T12:45:25.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.731+0000 7f11358f0700 1 --2- 172.21.15.45:0/798228494 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f111406aed0 0x7f111406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:25.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.732+0000 7f11358f0700 1 --2- 172.21.15.45:0/798228494 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f111406aed0 0x7f111406d390 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1130150490 tx=0x7f112c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:25.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.736+0000 7f11267fc700 1 -- 172.21.15.45:0/798228494 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1120055d20 con 0x7f11300cc160 2023-10-08T12:45:25.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.937+0000 7f1137b54700 1 -- 172.21.15.45:0/798228494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11300ca590 con 0x7f11300cc160 2023-10-08T12:45:26.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.938+0000 7f11267fc700 1 -- 172.21.15.45:0/798228494 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f1120026020 con 0x7f11300cc160 2023-10-08T12:45:26.392 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:26.392 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":19,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:45:24.623506+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:45:19.183651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:45:22.277383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:45:23.606639+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.412453+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.351925+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.428025+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.437246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.441119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.388608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.415524+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.401835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:45:26.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.940+0000 7f1137b54700 1 -- 172.21.15.45:0/798228494 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f111406aed0 msgr2=0x7f111406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:26.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.940+0000 7f1137b54700 1 --2- 172.21.15.45:0/798228494 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f111406aed0 0x7f111406d390 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1130150490 tx=0x7f112c009040 comp rx=0 tx=0).stop 2023-10-08T12:45:26.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.940+0000 7f1137b54700 1 -- 172.21.15.45:0/798228494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11300cc160 msgr2=0x7f11301f0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:26.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.940+0000 7f1137b54700 1 --2- 172.21.15.45:0/798228494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11300cc160 0x7f11301f0b70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f11300717b0 tx=0x7f1120004260 comp rx=0 tx=0).stop 2023-10-08T12:45:26.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.940+0000 7f1137b54700 1 -- 172.21.15.45:0/798228494 shutdown_connections 2023-10-08T12:45:26.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.940+0000 7f1137b54700 1 --2- 172.21.15.45:0/798228494 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f111406aed0 0x7f111406d390 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:26.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.940+0000 7f1137b54700 1 --2- 172.21.15.45:0/798228494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11301599f0 0x7f113014faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:26.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.940+0000 7f1137b54700 1 --2- 172.21.15.45:0/798228494 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f11300ae380 0x7f11300b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:26.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.940+0000 7f1137b54700 1 --2- 172.21.15.45:0/798228494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11300cc160 0x7f11301f0b70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:26.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.940+0000 7f1137b54700 1 -- 172.21.15.45:0/798228494 >> 172.21.15.45:0/798228494 conn(0x7f11300cf750 msgr2=0x7f11300cfb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:26.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.940+0000 7f1137b54700 1 -- 172.21.15.45:0/798228494 shutdown_connections 2023-10-08T12:45:26.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:25.940+0000 7f1137b54700 1 -- 172.21.15.45:0/798228494 wait complete. 2023-10-08T12:45:26.395 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T12:45:26.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.539+0000 7f2109ccb700 1 -- 172.21.15.45:0/4181109463 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21040cf000 msgr2=0x7f21040cb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:26.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.539+0000 7f2109ccb700 1 --2- 172.21.15.45:0/4181109463 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21040cf000 0x7f21040cb020 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f21040cc0f0 tx=0x7f20ec009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:26.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.539+0000 7f2109ccb700 1 -- 172.21.15.45:0/4181109463 shutdown_connections 2023-10-08T12:45:26.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.539+0000 7f2109ccb700 1 --2- 172.21.15.45:0/4181109463 >> v2:172.21.15.78:3300/0 conn(0x7f21040cb560 0x7f21040cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:26.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.539+0000 7f2109ccb700 1 --2- 172.21.15.45:0/4181109463 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f210415c0d0 0x7f21040c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:26.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.539+0000 7f2109ccb700 1 --2- 172.21.15.45:0/4181109463 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21040cf000 0x7f21040cb020 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:26.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.539+0000 7f2109ccb700 1 -- 172.21.15.45:0/4181109463 >> 172.21.15.45:0/4181109463 conn(0x7f2104097a20 msgr2=0x7f21040ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:26.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.539+0000 7f2109ccb700 1 -- 172.21.15.45:0/4181109463 shutdown_connections 2023-10-08T12:45:26.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.539+0000 7f2109ccb700 1 -- 172.21.15.45:0/4181109463 wait complete. 2023-10-08T12:45:26.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.541+0000 7f2109ccb700 1 Processor -- start 2023-10-08T12:45:26.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.541+0000 7f2109ccb700 1 -- start start 2023-10-08T12:45:26.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.542+0000 7f2109ccb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21040cb560 0x7f2104156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:26.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.542+0000 7f2109ccb700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f21040cf000 0x7f21041efd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:26.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.542+0000 7f2109ccb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f210415c0d0 0x7f210414ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:26.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.542+0000 7f2109ccb700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21041f3500 con 0x7f21040cb560 2023-10-08T12:45:26.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.542+0000 7f2109ccb700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21041f0d30 con 0x7f210415c0d0 2023-10-08T12:45:26.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.542+0000 7f2109ccb700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21041504c0 con 0x7f21040cf000 2023-10-08T12:45:26.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.542+0000 7f21037fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21040cb560 0x7f2104156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:26.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.542+0000 7f21037fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21040cb560 0x7f2104156c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34834/0 (socket says 172.21.15.45:34834) 2023-10-08T12:45:26.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.542+0000 7f21037fe700 1 -- 172.21.15.45:0/3936621434 learned_addr learned my addr 172.21.15.45:0/3936621434 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:26.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.542+0000 7f2103fff700 1 --2- 172.21.15.45:0/3936621434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f210415c0d0 0x7f210414ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:26.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.542+0000 7f2102ffd700 1 --2- 172.21.15.45:0/3936621434 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f21040cf000 0x7f21041efd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:26.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.542+0000 7f21037fe700 1 -- 172.21.15.45:0/3936621434 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f21040cf000 msgr2=0x7f21041efd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:26.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.542+0000 7f21037fe700 1 --2- 172.21.15.45:0/3936621434 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f21040cf000 0x7f21041efd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:26.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.542+0000 7f21037fe700 1 -- 172.21.15.45:0/3936621434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f210415c0d0 msgr2=0x7f210414ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:26.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.542+0000 7f21037fe700 1 --2- 172.21.15.45:0/3936621434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f210415c0d0 0x7f210414ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:26.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.542+0000 7f21037fe700 1 -- 172.21.15.45:0/3936621434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec0095f0 con 0x7f21040cb560 2023-10-08T12:45:26.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.542+0000 7f21037fe700 1 --2- 172.21.15.45:0/3936621434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21040cb560 0x7f2104156c20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f20fc00efc0 tx=0x7f20fc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:26.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.543+0000 7f20fbfff700 1 -- 172.21.15.45:0/3936621434 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20fc00ca70 con 0x7f21040cb560 2023-10-08T12:45:26.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.543+0000 7f20fbfff700 1 -- 172.21.15.45:0/3936621434 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f20fc00f040 con 0x7f21040cb560 2023-10-08T12:45:26.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.543+0000 7f2109ccb700 1 -- 172.21.15.45:0/3936621434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21041f0490 con 0x7f21040cb560 2023-10-08T12:45:26.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.543+0000 7f20fbfff700 1 -- 172.21.15.45:0/3936621434 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20fc00ce70 con 0x7f21040cb560 2023-10-08T12:45:26.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.543+0000 7f2109ccb700 1 -- 172.21.15.45:0/3936621434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21041f0a50 con 0x7f21040cb560 2023-10-08T12:45:26.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.544+0000 7f2109ccb700 1 -- 172.21.15.45:0/3936621434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21041f37e0 con 0x7f21040cb560 2023-10-08T12:45:26.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.544+0000 7f20fbfff700 1 -- 172.21.15.45:0/3936621434 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f20fc007500 con 0x7f21040cb560 2023-10-08T12:45:26.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.544+0000 7f20fbfff700 1 --2- 172.21.15.45:0/3936621434 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f20e406aed0 0x7f20e406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:26.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.545+0000 7f20fbfff700 1 -- 172.21.15.45:0/3936621434 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20fc089f20 con 0x7f21040cb560 2023-10-08T12:45:26.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.545+0000 7f2102ffd700 1 --2- 172.21.15.45:0/3936621434 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f20e406aed0 0x7f20e406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:26.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.545+0000 7f2102ffd700 1 --2- 172.21.15.45:0/3936621434 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f20e406aed0 0x7f20e406d390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2104154140 tx=0x7f20ec0047c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:26.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.549+0000 7f20fbfff700 1 -- 172.21.15.45:0/3936621434 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f20fc058af0 con 0x7f21040cb560 2023-10-08T12:45:26.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:26.794+0000 7f2109ccb700 1 -- 172.21.15.45:0/3936621434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2104066850 con 0x7f21040cb560 2023-10-08T12:45:27.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.236+0000 7f20fbfff700 1 -- 172.21.15.45:0/3936621434 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f20fc058680 con 0x7f21040cb560 2023-10-08T12:45:27.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.238+0000 7f2109ccb700 1 -- 172.21.15.45:0/3936621434 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f20e406aed0 msgr2=0x7f20e406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:27.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.238+0000 7f2109ccb700 1 --2- 172.21.15.45:0/3936621434 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f20e406aed0 0x7f20e406d390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2104154140 tx=0x7f20ec0047c0 comp rx=0 tx=0).stop 2023-10-08T12:45:27.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.238+0000 7f2109ccb700 1 -- 172.21.15.45:0/3936621434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21040cb560 msgr2=0x7f2104156c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:27.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.238+0000 7f2109ccb700 1 --2- 172.21.15.45:0/3936621434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21040cb560 0x7f2104156c20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f20fc00efc0 tx=0x7f20fc00c3a0 comp rx=0 tx=0).stop 2023-10-08T12:45:27.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.238+0000 7f2109ccb700 1 -- 172.21.15.45:0/3936621434 shutdown_connections 2023-10-08T12:45:27.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.238+0000 7f2109ccb700 1 --2- 172.21.15.45:0/3936621434 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f20e406aed0 0x7f20e406d390 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:27.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.238+0000 7f2109ccb700 1 --2- 172.21.15.45:0/3936621434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f210415c0d0 0x7f210414ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:27.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.238+0000 7f2109ccb700 1 --2- 172.21.15.45:0/3936621434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21040cb560 0x7f2104156c20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:27.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.238+0000 7f2109ccb700 1 --2- 172.21.15.45:0/3936621434 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f21040cf000 0x7f21041efd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:27.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.238+0000 7f2109ccb700 1 -- 172.21.15.45:0/3936621434 >> 172.21.15.45:0/3936621434 conn(0x7f2104097a20 msgr2=0x7f21040affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:27.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.238+0000 7f2109ccb700 1 -- 172.21.15.45:0/3936621434 shutdown_connections 2023-10-08T12:45:27.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.238+0000 7f2109ccb700 1 -- 172.21.15.45:0/3936621434 wait complete. 2023-10-08T12:45:27.253 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-08T12:45:27.253 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T12:45:27.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.387+0000 7f044ae6c700 1 -- 172.21.15.45:0/560153615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0434003a00 msgr2=0x7f0434003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:27.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.387+0000 7f044ae6c700 1 --2- 172.21.15.45:0/560153615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0434003a00 0x7f0434003e20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0438009be0 tx=0x7f0434005880 comp rx=0 tx=0).stop 2023-10-08T12:45:27.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.387+0000 7f044ae6c700 1 -- 172.21.15.45:0/560153615 shutdown_connections 2023-10-08T12:45:27.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.387+0000 7f044ae6c700 1 --2- 172.21.15.45:0/560153615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0434003a00 0x7f0434003e20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:27.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.387+0000 7f044ae6c700 1 -- 172.21.15.45:0/560153615 >> 172.21.15.45:0/560153615 conn(0x7f04440cddc0 msgr2=0x7f04440ce1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:27.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.387+0000 7f044ae6c700 1 -- 172.21.15.45:0/560153615 shutdown_connections 2023-10-08T12:45:27.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.387+0000 7f044ae6c700 1 -- 172.21.15.45:0/560153615 wait complete. 2023-10-08T12:45:27.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.388+0000 7f044ae6c700 1 Processor -- start 2023-10-08T12:45:27.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.388+0000 7f044ae6c700 1 -- start start 2023-10-08T12:45:27.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.389+0000 7f044ae6c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0434003a00 0x7f044415a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:27.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.389+0000 7f044ae6c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f04441e3fb0 0x7f0444154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:27.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.389+0000 7f044ae6c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f044414a030 0x7f044414a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:27.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.389+0000 7f044ae6c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04441e2690 con 0x7f044414a030 2023-10-08T12:45:27.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.389+0000 7f044ae6c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044414a9f0 con 0x7f0434003a00 2023-10-08T12:45:27.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.389+0000 7f044ae6c700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04441e1a10 con 0x7f04441e3fb0 2023-10-08T12:45:27.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.389+0000 7f0449409700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f044414a030 0x7f044414a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:27.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.389+0000 7f0449409700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f044414a030 0x7f044414a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34858/0 (socket says 172.21.15.45:34858) 2023-10-08T12:45:27.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.389+0000 7f0449409700 1 -- 172.21.15.45:0/493012758 learned_addr learned my addr 172.21.15.45:0/493012758 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:27.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.389+0000 7f0448c08700 1 --2- 172.21.15.45:0/493012758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0434003a00 0x7f044415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:27.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.389+0000 7f0443fff700 1 --2- 172.21.15.45:0/493012758 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f04441e3fb0 0x7f0444154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:27.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.390+0000 7f0449409700 1 -- 172.21.15.45:0/493012758 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f04441e3fb0 msgr2=0x7f0444154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:27.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.390+0000 7f0449409700 1 --2- 172.21.15.45:0/493012758 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f04441e3fb0 0x7f0444154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:27.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.390+0000 7f0449409700 1 -- 172.21.15.45:0/493012758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0434003a00 msgr2=0x7f044415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:27.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.390+0000 7f0449409700 1 --2- 172.21.15.45:0/493012758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0434003a00 0x7f044415a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:27.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.390+0000 7f0449409700 1 -- 172.21.15.45:0/493012758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04441e1cf0 con 0x7f044414a030 2023-10-08T12:45:27.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.390+0000 7f0448c08700 1 --2- 172.21.15.45:0/493012758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0434003a00 0x7f044415a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:27.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.390+0000 7f0449409700 1 --2- 172.21.15.45:0/493012758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f044414a030 0x7f044414a4b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0444072130 tx=0x7f043c006570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:27.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.390+0000 7f04417fa700 1 -- 172.21.15.45:0/493012758 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c011840 con 0x7f044414a030 2023-10-08T12:45:27.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.390+0000 7f04417fa700 1 -- 172.21.15.45:0/493012758 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f043c0119a0 con 0x7f044414a030 2023-10-08T12:45:27.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.390+0000 7f044ae6c700 1 -- 172.21.15.45:0/493012758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04441e1fd0 con 0x7f044414a030 2023-10-08T12:45:27.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.390+0000 7f04417fa700 1 -- 172.21.15.45:0/493012758 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c011d90 con 0x7f044414a030 2023-10-08T12:45:27.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.390+0000 7f044ae6c700 1 -- 172.21.15.45:0/493012758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f044415a940 con 0x7f044414a030 2023-10-08T12:45:27.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.391+0000 7f044ae6c700 1 -- 172.21.15.45:0/493012758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0444067470 con 0x7f044414a030 2023-10-08T12:45:27.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.392+0000 7f04417fa700 1 -- 172.21.15.45:0/493012758 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f043c0103c0 con 0x7f044414a030 2023-10-08T12:45:27.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.392+0000 7f04417fa700 1 --2- 172.21.15.45:0/493012758 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f042806aed0 0x7f042806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:27.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.392+0000 7f04417fa700 1 -- 172.21.15.45:0/493012758 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f043c089f40 con 0x7f044414a030 2023-10-08T12:45:27.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.392+0000 7f0448c08700 1 --2- 172.21.15.45:0/493012758 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f042806aed0 0x7f042806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:27.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.393+0000 7f0448c08700 1 --2- 172.21.15.45:0/493012758 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f042806aed0 0x7f042806d390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0438009be0 tx=0x7f0438004750 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:27.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.397+0000 7f04417fa700 1 -- 172.21.15.45:0/493012758 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f043c054ff0 con 0x7f044414a030 2023-10-08T12:45:27.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:27.648+0000 7f044ae6c700 1 -- 172.21.15.45:0/493012758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f04440ad6a0 con 0x7f044414a030 2023-10-08T12:45:28.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.237+0000 7f04417fa700 1 -- 172.21.15.45:0/493012758 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f04440ad6a0 con 0x7f044414a030 2023-10-08T12:45:28.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.240+0000 7f044ae6c700 1 -- 172.21.15.45:0/493012758 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f042806aed0 msgr2=0x7f042806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:28.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.240+0000 7f044ae6c700 1 --2- 172.21.15.45:0/493012758 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f042806aed0 0x7f042806d390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0438009be0 tx=0x7f0438004750 comp rx=0 tx=0).stop 2023-10-08T12:45:28.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.240+0000 7f044ae6c700 1 -- 172.21.15.45:0/493012758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f044414a030 msgr2=0x7f044414a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:28.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.240+0000 7f044ae6c700 1 --2- 172.21.15.45:0/493012758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f044414a030 0x7f044414a4b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0444072130 tx=0x7f043c006570 comp rx=0 tx=0).stop 2023-10-08T12:45:28.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.240+0000 7f044ae6c700 1 -- 172.21.15.45:0/493012758 shutdown_connections 2023-10-08T12:45:28.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.240+0000 7f044ae6c700 1 --2- 172.21.15.45:0/493012758 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f042806aed0 0x7f042806d390 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:28.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.240+0000 7f044ae6c700 1 --2- 172.21.15.45:0/493012758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f044414a030 0x7f044414a4b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:28.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.240+0000 7f044ae6c700 1 --2- 172.21.15.45:0/493012758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0434003a00 0x7f044415a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:28.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.240+0000 7f044ae6c700 1 --2- 172.21.15.45:0/493012758 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f04441e3fb0 0x7f0444154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:28.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.240+0000 7f044ae6c700 1 -- 172.21.15.45:0/493012758 >> 172.21.15.45:0/493012758 conn(0x7f04440cddc0 msgr2=0x7f044414c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:28.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.240+0000 7f044ae6c700 1 -- 172.21.15.45:0/493012758 shutdown_connections 2023-10-08T12:45:28.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.240+0000 7f044ae6c700 1 -- 172.21.15.45:0/493012758 wait complete. 2023-10-08T12:45:28.255 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-08T12:45:28.256 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:45:28.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.389+0000 7faf413b7700 1 -- 172.21.15.45:0/312481041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf3c072e00 msgr2=0x7faf3c0c9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:28.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.389+0000 7faf413b7700 1 --2- 172.21.15.45:0/312481041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf3c072e00 0x7faf3c0c9a10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faf2c0098c0 tx=0x7faf2c009bd0 comp rx=0 tx=0).stop 2023-10-08T12:45:28.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.389+0000 7faf413b7700 1 -- 172.21.15.45:0/312481041 shutdown_connections 2023-10-08T12:45:28.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.389+0000 7faf413b7700 1 --2- 172.21.15.45:0/312481041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf3c072e00 0x7faf3c0c9a10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:28.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.389+0000 7faf413b7700 1 -- 172.21.15.45:0/312481041 >> 172.21.15.45:0/312481041 conn(0x7faf3c0afae0 msgr2=0x7faf3c0afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:28.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.389+0000 7faf413b7700 1 -- 172.21.15.45:0/312481041 shutdown_connections 2023-10-08T12:45:28.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.389+0000 7faf413b7700 1 -- 172.21.15.45:0/312481041 wait complete. 2023-10-08T12:45:28.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.390+0000 7faf413b7700 1 Processor -- start 2023-10-08T12:45:28.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.390+0000 7faf413b7700 1 -- start start 2023-10-08T12:45:28.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.391+0000 7faf413b7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf3c072e00 0x7faf3c09eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:28.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.391+0000 7faf413b7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf3c0c8640 0x7faf3c157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:28.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.391+0000 7faf413b7700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faf3c159a80 0x7faf3c158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:28.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.391+0000 7faf413b7700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c0c2b30 con 0x7faf3c072e00 2023-10-08T12:45:28.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.391+0000 7faf413b7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c0c1b20 con 0x7faf3c0c8640 2023-10-08T12:45:28.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.391+0000 7faf413b7700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c0c1d70 con 0x7faf3c159a80 2023-10-08T12:45:28.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.391+0000 7faf3affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf3c072e00 0x7faf3c09eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:28.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.391+0000 7faf3affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf3c072e00 0x7faf3c09eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34868/0 (socket says 172.21.15.45:34868) 2023-10-08T12:45:28.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.391+0000 7faf3affd700 1 -- 172.21.15.45:0/67161903 learned_addr learned my addr 172.21.15.45:0/67161903 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:28.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.391+0000 7faf3a7fc700 1 --2- 172.21.15.45:0/67161903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf3c0c8640 0x7faf3c157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:28.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.391+0000 7faf3affd700 1 -- 172.21.15.45:0/67161903 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faf3c159a80 msgr2=0x7faf3c158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:28.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.391+0000 7faf3affd700 1 --2- 172.21.15.45:0/67161903 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faf3c159a80 0x7faf3c158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:28.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.391+0000 7faf3affd700 1 -- 172.21.15.45:0/67161903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf3c0c8640 msgr2=0x7faf3c157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:28.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.391+0000 7faf3affd700 1 --2- 172.21.15.45:0/67161903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf3c0c8640 0x7faf3c157f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:28.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.391+0000 7faf3affd700 1 -- 172.21.15.45:0/67161903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c009520 con 0x7faf3c072e00 2023-10-08T12:45:28.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.391+0000 7faf3affd700 1 --2- 172.21.15.45:0/67161903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf3c072e00 0x7faf3c09eaf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faf3000c4c0 tx=0x7faf3000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:28.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.391+0000 7faf237fe700 1 -- 172.21.15.45:0/67161903 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30004230 con 0x7faf3c072e00 2023-10-08T12:45:28.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.391+0000 7faf237fe700 1 -- 172.21.15.45:0/67161903 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7faf30004480 con 0x7faf3c072e00 2023-10-08T12:45:28.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.391+0000 7faf413b7700 1 -- 172.21.15.45:0/67161903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf3c06cff0 con 0x7faf3c072e00 2023-10-08T12:45:28.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.391+0000 7faf237fe700 1 -- 172.21.15.45:0/67161903 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf300038e0 con 0x7faf3c072e00 2023-10-08T12:45:28.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.392+0000 7faf413b7700 1 -- 172.21.15.45:0/67161903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf3c0c2330 con 0x7faf3c072e00 2023-10-08T12:45:28.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.392+0000 7faf413b7700 1 -- 172.21.15.45:0/67161903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf3c0674a0 con 0x7faf3c072e00 2023-10-08T12:45:28.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.393+0000 7faf237fe700 1 -- 172.21.15.45:0/67161903 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7faf30003a40 con 0x7faf3c072e00 2023-10-08T12:45:28.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.393+0000 7faf237fe700 1 --2- 172.21.15.45:0/67161903 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7faf2806af00 0x7faf2806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:28.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.393+0000 7faf237fe700 1 -- 172.21.15.45:0/67161903 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf30088df0 con 0x7faf3c072e00 2023-10-08T12:45:28.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.393+0000 7faf3a7fc700 1 --2- 172.21.15.45:0/67161903 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7faf2806af00 0x7faf2806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:28.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.394+0000 7faf3a7fc700 1 --2- 172.21.15.45:0/67161903 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7faf2806af00 0x7faf2806d3c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faf2c009230 tx=0x7faf2c011040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:28.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.398+0000 7faf237fe700 1 -- 172.21.15.45:0/67161903 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faf30053e10 con 0x7faf3c072e00 2023-10-08T12:45:28.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.644+0000 7faf413b7700 1 -- 172.21.15.45:0/67161903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf3c066e90 con 0x7faf3c072e00 2023-10-08T12:45:28.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.644+0000 7faf237fe700 1 -- 172.21.15.45:0/67161903 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7faf30017030 con 0x7faf3c072e00 2023-10-08T12:45:28.645 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:28.646 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4332,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3352988594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3352988594},{"type":"v1","addr":"172.21.15.45:6834","nonce":3352988594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4335,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/448033669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":448033669},{"type":"v1","addr":"172.21.15.45:6835","nonce":448033669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4347,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2935302656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":2935302656},{"type":"v1","addr":"172.21.15.78:6837","nonce":2935302656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T12:45:24.623822+0000","modified":"2023-10-08T12:45:27.649794+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4372},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4372":{"gid":4372,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6836/2145831865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2145831865},{"type":"v1","addr":"172.21.15.78:6836","nonce":2145831865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:45:28.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.647+0000 7faf413b7700 1 -- 172.21.15.45:0/67161903 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7faf2806af00 msgr2=0x7faf2806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:28.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.647+0000 7faf413b7700 1 --2- 172.21.15.45:0/67161903 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7faf2806af00 0x7faf2806d3c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faf2c009230 tx=0x7faf2c011040 comp rx=0 tx=0).stop 2023-10-08T12:45:28.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.647+0000 7faf413b7700 1 -- 172.21.15.45:0/67161903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf3c072e00 msgr2=0x7faf3c09eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:28.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.647+0000 7faf413b7700 1 --2- 172.21.15.45:0/67161903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf3c072e00 0x7faf3c09eaf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faf3000c4c0 tx=0x7faf3000c880 comp rx=0 tx=0).stop 2023-10-08T12:45:28.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.647+0000 7faf413b7700 1 -- 172.21.15.45:0/67161903 shutdown_connections 2023-10-08T12:45:28.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.647+0000 7faf413b7700 1 --2- 172.21.15.45:0/67161903 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7faf2806af00 0x7faf2806d3c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:28.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.647+0000 7faf413b7700 1 --2- 172.21.15.45:0/67161903 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faf3c159a80 0x7faf3c158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:28.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.647+0000 7faf413b7700 1 --2- 172.21.15.45:0/67161903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf3c072e00 0x7faf3c09eaf0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:28.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.647+0000 7faf413b7700 1 --2- 172.21.15.45:0/67161903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf3c0c8640 0x7faf3c157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:28.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.647+0000 7faf413b7700 1 -- 172.21.15.45:0/67161903 >> 172.21.15.45:0/67161903 conn(0x7faf3c0afae0 msgr2=0x7faf3c0aec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:28.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.647+0000 7faf413b7700 1 -- 172.21.15.45:0/67161903 shutdown_connections 2023-10-08T12:45:28.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.647+0000 7faf413b7700 1 -- 172.21.15.45:0/67161903 wait complete. 2023-10-08T12:45:28.649 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-10-08T12:45:28.660 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:45:28.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.786+0000 7fdf3d580700 1 -- 172.21.15.45:0/2536099452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf380b7340 msgr2=0x7fdf380d1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:28.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.786+0000 7fdf3d580700 1 --2- 172.21.15.45:0/2536099452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf380b7340 0x7fdf380d1e80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdf380cf340 tx=0x7fdf20009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:28.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.786+0000 7fdf3d580700 1 -- 172.21.15.45:0/2536099452 shutdown_connections 2023-10-08T12:45:28.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.786+0000 7fdf3d580700 1 --2- 172.21.15.45:0/2536099452 >> v2:172.21.15.78:3300/0 conn(0x7fdf3815f610 0x7fdf380b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:28.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.786+0000 7fdf3d580700 1 --2- 172.21.15.45:0/2536099452 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdf3815ba80 0x7fdf380d1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:28.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.786+0000 7fdf3d580700 1 --2- 172.21.15.45:0/2536099452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf380b7340 0x7fdf380d1e80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:28.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.786+0000 7fdf3d580700 1 -- 172.21.15.45:0/2536099452 >> 172.21.15.45:0/2536099452 conn(0x7fdf3806ba10 msgr2=0x7fdf3806be20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:28.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.786+0000 7fdf3d580700 1 -- 172.21.15.45:0/2536099452 shutdown_connections 2023-10-08T12:45:28.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.786+0000 7fdf3d580700 1 -- 172.21.15.45:0/2536099452 wait complete. 2023-10-08T12:45:28.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.787+0000 7fdf3d580700 1 Processor -- start 2023-10-08T12:45:28.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.787+0000 7fdf3d580700 1 -- start start 2023-10-08T12:45:28.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.788+0000 7fdf3d580700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdf380b7340 0x7fdf38159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:28.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.788+0000 7fdf3d580700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf3815ba80 0x7fdf3815de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:28.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.788+0000 7fdf3d580700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf3815f610 0x7fdf380d0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:28.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.788+0000 7fdf3d580700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf381f6290 con 0x7fdf3815ba80 2023-10-08T12:45:28.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.788+0000 7fdf3d580700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3815e390 con 0x7fdf3815f610 2023-10-08T12:45:28.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.788+0000 7fdf3d580700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf381f5680 con 0x7fdf380b7340 2023-10-08T12:45:28.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.788+0000 7fdf367fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf3815ba80 0x7fdf3815de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:28.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.788+0000 7fdf367fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf3815ba80 0x7fdf3815de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34884/0 (socket says 172.21.15.45:34884) 2023-10-08T12:45:28.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.788+0000 7fdf367fc700 1 -- 172.21.15.45:0/2128272228 learned_addr learned my addr 172.21.15.45:0/2128272228 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:28.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.788+0000 7fdf377fe700 1 --2- 172.21.15.45:0/2128272228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf3815f610 0x7fdf380d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:28.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.788+0000 7fdf36ffd700 1 --2- 172.21.15.45:0/2128272228 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdf380b7340 0x7fdf38159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:28.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.788+0000 7fdf367fc700 1 -- 172.21.15.45:0/2128272228 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdf380b7340 msgr2=0x7fdf38159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:28.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.788+0000 7fdf367fc700 1 --2- 172.21.15.45:0/2128272228 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdf380b7340 0x7fdf38159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:28.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.788+0000 7fdf367fc700 1 -- 172.21.15.45:0/2128272228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf3815f610 msgr2=0x7fdf380d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:28.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.788+0000 7fdf367fc700 1 --2- 172.21.15.45:0/2128272228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf3815f610 0x7fdf380d0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:28.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.788+0000 7fdf367fc700 1 -- 172.21.15.45:0/2128272228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf200095f0 con 0x7fdf3815ba80 2023-10-08T12:45:28.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.788+0000 7fdf367fc700 1 --2- 172.21.15.45:0/2128272228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf3815ba80 0x7fdf3815de50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdf380d2710 tx=0x7fdf20004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:28.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.789+0000 7fdf2f7fe700 1 -- 172.21.15.45:0/2128272228 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2001d070 con 0x7fdf3815ba80 2023-10-08T12:45:28.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.789+0000 7fdf2f7fe700 1 -- 172.21.15.45:0/2128272228 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdf2000b7b0 con 0x7fdf3815ba80 2023-10-08T12:45:28.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.789+0000 7fdf3d580700 1 -- 172.21.15.45:0/2128272228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf381f5960 con 0x7fdf3815ba80 2023-10-08T12:45:28.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.789+0000 7fdf2f7fe700 1 -- 172.21.15.45:0/2128272228 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf200045f0 con 0x7fdf3815ba80 2023-10-08T12:45:28.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.789+0000 7fdf3d580700 1 -- 172.21.15.45:0/2128272228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf381f5f20 con 0x7fdf3815ba80 2023-10-08T12:45:28.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.790+0000 7fdf3d580700 1 -- 172.21.15.45:0/2128272228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf3804e4c0 con 0x7fdf3815ba80 2023-10-08T12:45:28.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.790+0000 7fdf2f7fe700 1 -- 172.21.15.45:0/2128272228 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdf2000bbc0 con 0x7fdf3815ba80 2023-10-08T12:45:28.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.790+0000 7fdf2f7fe700 1 --2- 172.21.15.45:0/2128272228 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fdf1806aed0 0x7fdf1806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:28.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.791+0000 7fdf2f7fe700 1 -- 172.21.15.45:0/2128272228 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf2008ac60 con 0x7fdf3815ba80 2023-10-08T12:45:28.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.791+0000 7fdf36ffd700 1 --2- 172.21.15.45:0/2128272228 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fdf1806aed0 0x7fdf1806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:28.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.791+0000 7fdf36ffd700 1 --2- 172.21.15.45:0/2128272228 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fdf1806aed0 0x7fdf1806d390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdf28005fd0 tx=0x7fdf2800b410 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:28.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.795+0000 7fdf2f7fe700 1 -- 172.21.15.45:0/2128272228 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdf20055da0 con 0x7fdf3815ba80 2023-10-08T12:45:28.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.996+0000 7fdf3d580700 1 -- 172.21.15.45:0/2128272228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf380d1550 con 0x7fdf3815ba80 2023-10-08T12:45:28.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.997+0000 7fdf2f7fe700 1 -- 172.21.15.45:0/2128272228 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7fdf200593c0 con 0x7fdf3815ba80 2023-10-08T12:45:28.998 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:28.999 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:45:26.206424+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:45:19.183651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:45:22.277383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:45:23.606639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.412453+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.351925+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.428025+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.437246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.441119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.388608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.415524+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.401835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:45:29.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.999+0000 7fdf3d580700 1 -- 172.21.15.45:0/2128272228 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fdf1806aed0 msgr2=0x7fdf1806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:29.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.999+0000 7fdf3d580700 1 --2- 172.21.15.45:0/2128272228 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fdf1806aed0 0x7fdf1806d390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdf28005fd0 tx=0x7fdf2800b410 comp rx=0 tx=0).stop 2023-10-08T12:45:29.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.999+0000 7fdf3d580700 1 -- 172.21.15.45:0/2128272228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf3815ba80 msgr2=0x7fdf3815de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:29.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.999+0000 7fdf3d580700 1 --2- 172.21.15.45:0/2128272228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf3815ba80 0x7fdf3815de50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdf380d2710 tx=0x7fdf20004260 comp rx=0 tx=0).stop 2023-10-08T12:45:29.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.999+0000 7fdf3d580700 1 -- 172.21.15.45:0/2128272228 shutdown_connections 2023-10-08T12:45:29.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.999+0000 7fdf3d580700 1 --2- 172.21.15.45:0/2128272228 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fdf1806aed0 0x7fdf1806d390 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:29.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.999+0000 7fdf3d580700 1 --2- 172.21.15.45:0/2128272228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf3815f610 0x7fdf380d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:29.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.999+0000 7fdf3d580700 1 --2- 172.21.15.45:0/2128272228 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdf380b7340 0x7fdf38159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:29.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.999+0000 7fdf3d580700 1 --2- 172.21.15.45:0/2128272228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf3815ba80 0x7fdf3815de50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:29.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.999+0000 7fdf3d580700 1 -- 172.21.15.45:0/2128272228 >> 172.21.15.45:0/2128272228 conn(0x7fdf3806ba10 msgr2=0x7fdf3806bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:29.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.999+0000 7fdf3d580700 1 -- 172.21.15.45:0/2128272228 shutdown_connections 2023-10-08T12:45:29.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:28.999+0000 7fdf3d580700 1 -- 172.21.15.45:0/2128272228 wait complete. 2023-10-08T12:45:29.013 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T12:45:29.013 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T12:45:29.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.139+0000 7fb048332700 1 -- 172.21.15.45:0/1828121149 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb04006f3d0 msgr2=0x7fb0400cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:29.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.139+0000 7fb048332700 1 --2- 172.21.15.45:0/1828121149 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb04006f3d0 0x7fb0400cc160 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb0340098f0 tx=0x7fb034009c00 comp rx=0 tx=0).stop 2023-10-08T12:45:29.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.139+0000 7fb048332700 1 -- 172.21.15.45:0/1828121149 shutdown_connections 2023-10-08T12:45:29.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.139+0000 7fb048332700 1 --2- 172.21.15.45:0/1828121149 >> v2:172.21.15.78:3300/0 conn(0x7fb0401599f0 0x7fb04006ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:29.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.139+0000 7fb048332700 1 --2- 172.21.15.45:0/1828121149 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb04006f3d0 0x7fb0400cc160 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:29.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.139+0000 7fb048332700 1 -- 172.21.15.45:0/1828121149 >> 172.21.15.45:0/1828121149 conn(0x7fb0400cf750 msgr2=0x7fb0400cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:29.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.139+0000 7fb048332700 1 -- 172.21.15.45:0/1828121149 shutdown_connections 2023-10-08T12:45:29.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.139+0000 7fb048332700 1 -- 172.21.15.45:0/1828121149 wait complete. 2023-10-08T12:45:29.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.140+0000 7fb048332700 1 Processor -- start 2023-10-08T12:45:29.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.140+0000 7fb048332700 1 -- start start 2023-10-08T12:45:29.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.141+0000 7fb048332700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb04006f3d0 0x7fb0401e2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:29.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.141+0000 7fb048332700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0400cc6a0 0x7fb040156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:29.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.141+0000 7fb048332700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb0401599f0 0x7fb0400c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:29.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.141+0000 7fb048332700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb040157eb0 con 0x7fb04006f3d0 2023-10-08T12:45:29.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.141+0000 7fb048332700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0400c7080 con 0x7fb0400cc6a0 2023-10-08T12:45:29.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.141+0000 7fb048332700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb040157bd0 con 0x7fb0401599f0 2023-10-08T12:45:29.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.141+0000 7fb0460ce700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb04006f3d0 0x7fb0401e2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:29.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.141+0000 7fb0460ce700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb04006f3d0 0x7fb0401e2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34896/0 (socket says 172.21.15.45:34896) 2023-10-08T12:45:29.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.141+0000 7fb0460ce700 1 -- 172.21.15.45:0/1052354621 learned_addr learned my addr 172.21.15.45:0/1052354621 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:29.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.141+0000 7fb0458cd700 1 --2- 172.21.15.45:0/1052354621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0400cc6a0 0x7fb040156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:29.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.141+0000 7fb0468cf700 1 --2- 172.21.15.45:0/1052354621 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb0401599f0 0x7fb0400c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:29.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.141+0000 7fb0460ce700 1 -- 172.21.15.45:0/1052354621 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb0401599f0 msgr2=0x7fb0400c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:29.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.141+0000 7fb0460ce700 1 --2- 172.21.15.45:0/1052354621 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb0401599f0 0x7fb0400c8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:29.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.141+0000 7fb0460ce700 1 -- 172.21.15.45:0/1052354621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0400cc6a0 msgr2=0x7fb040156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:29.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.141+0000 7fb0460ce700 1 --2- 172.21.15.45:0/1052354621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0400cc6a0 0x7fb040156330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:29.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.141+0000 7fb0460ce700 1 -- 172.21.15.45:0/1052354621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03c009520 con 0x7fb04006f3d0 2023-10-08T12:45:29.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.141+0000 7fb0458cd700 1 --2- 172.21.15.45:0/1052354621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0400cc6a0 0x7fb040156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:45:29.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.142+0000 7fb0460ce700 1 --2- 172.21.15.45:0/1052354621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb04006f3d0 0x7fb0401e2160 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00e9f0 tx=0x7fb03c00edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:29.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.142+0000 7fb032ffd700 1 -- 172.21.15.45:0/1052354621 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c00cc90 con 0x7fb04006f3d0 2023-10-08T12:45:29.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.142+0000 7fb032ffd700 1 -- 172.21.15.45:0/1052354621 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb03c00cdf0 con 0x7fb04006f3d0 2023-10-08T12:45:29.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.142+0000 7fb032ffd700 1 -- 172.21.15.45:0/1052354621 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c004280 con 0x7fb04006f3d0 2023-10-08T12:45:29.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.142+0000 7fb048332700 1 -- 172.21.15.45:0/1052354621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb034009520 con 0x7fb04006f3d0 2023-10-08T12:45:29.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.142+0000 7fb048332700 1 -- 172.21.15.45:0/1052354621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0400c6ca0 con 0x7fb04006f3d0 2023-10-08T12:45:29.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.143+0000 7fb048332700 1 -- 172.21.15.45:0/1052354621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0400c6800 con 0x7fb04006f3d0 2023-10-08T12:45:29.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.143+0000 7fb032ffd700 1 -- 172.21.15.45:0/1052354621 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb03c0043e0 con 0x7fb04006f3d0 2023-10-08T12:45:29.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.144+0000 7fb032ffd700 1 --2- 172.21.15.45:0/1052354621 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb02406aed0 0x7fb02406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:29.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.144+0000 7fb032ffd700 1 -- 172.21.15.45:0/1052354621 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb03c014070 con 0x7fb04006f3d0 2023-10-08T12:45:29.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.144+0000 7fb0458cd700 1 --2- 172.21.15.45:0/1052354621 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb02406aed0 0x7fb02406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:29.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.145+0000 7fb0458cd700 1 --2- 172.21.15.45:0/1052354621 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb02406aed0 0x7fb02406d390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb034000c00 tx=0x7fb0340047c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:29.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.148+0000 7fb032ffd700 1 -- 172.21.15.45:0/1052354621 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb03c0551f0 con 0x7fb04006f3d0 2023-10-08T12:45:29.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.350+0000 7fb048332700 1 -- 172.21.15.45:0/1052354621 --> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb040159fe0 con 0x7fb02406aed0 2023-10-08T12:45:29.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.357+0000 7fb032ffd700 1 -- 172.21.15.45:0/1052354621 <== mgr.4105 v2:172.21.15.78:6832/3438117854 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+259283 (secure 0 0 0) 0x7fb03400bb20 con 0x7fb02406aed0 2023-10-08T12:45:29.362 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:29.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.360+0000 7fb048332700 1 -- 172.21.15.45:0/1052354621 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb02406aed0 msgr2=0x7fb02406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:29.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.360+0000 7fb048332700 1 --2- 172.21.15.45:0/1052354621 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb02406aed0 0x7fb02406d390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb034000c00 tx=0x7fb0340047c0 comp rx=0 tx=0).stop 2023-10-08T12:45:29.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.360+0000 7fb048332700 1 -- 172.21.15.45:0/1052354621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb04006f3d0 msgr2=0x7fb0401e2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:29.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.360+0000 7fb048332700 1 --2- 172.21.15.45:0/1052354621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb04006f3d0 0x7fb0401e2160 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00e9f0 tx=0x7fb03c00edb0 comp rx=0 tx=0).stop 2023-10-08T12:45:29.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.361+0000 7fb048332700 1 -- 172.21.15.45:0/1052354621 shutdown_connections 2023-10-08T12:45:29.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.361+0000 7fb048332700 1 --2- 172.21.15.45:0/1052354621 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb02406aed0 0x7fb02406d390 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:29.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.361+0000 7fb048332700 1 --2- 172.21.15.45:0/1052354621 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb0401599f0 0x7fb0400c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:29.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.361+0000 7fb048332700 1 --2- 172.21.15.45:0/1052354621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb04006f3d0 0x7fb0401e2160 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:29.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.361+0000 7fb048332700 1 --2- 172.21.15.45:0/1052354621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0400cc6a0 0x7fb040156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:29.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.361+0000 7fb048332700 1 -- 172.21.15.45:0/1052354621 >> 172.21.15.45:0/1052354621 conn(0x7fb0400cf750 msgr2=0x7fb0401588e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:29.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.361+0000 7fb048332700 1 -- 172.21.15.45:0/1052354621 shutdown_connections 2023-10-08T12:45:29.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.361+0000 7fb048332700 1 -- 172.21.15.45:0/1052354621 wait complete. 2023-10-08T12:45:29.365 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-08T12:45:29.373 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-08T12:45:29.128025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218744,"kb_used_data":2568,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755976,"statfs":{"total":773094113280,"available":772870119424,"internally_reserved":0,"allocated":2629632,"data_stored":1643320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001269"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.217479+0000","last_change":"2023-10-08T12:45:24.217479+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.217479+0000","last_undegraded":"2023-10-08T12:45:24.217479+0000","last_fullsized":"2023-10-08T12:45:24.217479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.217377+0000","last_change":"2023-10-08T12:45:24.217377+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.217377+0000","last_undegraded":"2023-10-08T12:45:24.217377+0000","last_fullsized":"2023-10-08T12:45:24.217377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210475+0000","last_change":"2023-10-08T12:45:24.210475+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210475+0000","last_undegraded":"2023-10-08T12:45:24.210475+0000","last_fullsized":"2023-10-08T12:45:24.210475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.211204+0000","last_change":"2023-10-08T12:45:24.211204+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.211204+0000","last_undegraded":"2023-10-08T12:45:24.211204+0000","last_fullsized":"2023-10-08T12:45:24.211204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.218087+0000","last_change":"2023-10-08T12:45:24.218087+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.218087+0000","last_undegraded":"2023-10-08T12:45:24.218087+0000","last_fullsized":"2023-10-08T12:45:24.218087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213469+0000","last_change":"2023-10-08T12:45:24.213469+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213469+0000","last_undegraded":"2023-10-08T12:45:24.213469+0000","last_fullsized":"2023-10-08T12:45:24.213469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.216581+0000","last_change":"2023-10-08T12:45:24.216581+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.216581+0000","last_undegraded":"2023-10-08T12:45:24.216581+0000","last_fullsized":"2023-10-08T12:45:24.216581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213458+0000","last_change":"2023-10-08T12:45:24.213458+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213458+0000","last_undegraded":"2023-10-08T12:45:24.213458+0000","last_fullsized":"2023-10-08T12:45:24.213458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.216999+0000","last_change":"2023-10-08T12:45:24.216999+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.216999+0000","last_undegraded":"2023-10-08T12:45:24.216999+0000","last_fullsized":"2023-10-08T12:45:24.216999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.214181+0000","last_change":"2023-10-08T12:45:24.214181+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.214181+0000","last_undegraded":"2023-10-08T12:45:24.214181+0000","last_fullsized":"2023-10-08T12:45:24.214181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.215422+0000","last_change":"2023-10-08T12:45:24.215422+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.215422+0000","last_undegraded":"2023-10-08T12:45:24.215422+0000","last_fullsized":"2023-10-08T12:45:24.215422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210890+0000","last_change":"2023-10-08T12:45:24.210890+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210890+0000","last_undegraded":"2023-10-08T12:45:24.210890+0000","last_fullsized":"2023-10-08T12:45:24.210890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213162+0000","last_change":"2023-10-08T12:45:24.213162+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213162+0000","last_undegraded":"2023-10-08T12:45:24.213162+0000","last_fullsized":"2023-10-08T12:45:24.213162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.211135+0000","last_change":"2023-10-08T12:45:24.211135+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.211135+0000","last_undegraded":"2023-10-08T12:45:24.211135+0000","last_fullsized":"2023-10-08T12:45:24.211135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.217815+0000","last_change":"2023-10-08T12:45:24.217815+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.217815+0000","last_undegraded":"2023-10-08T12:45:24.217815+0000","last_fullsized":"2023-10-08T12:45:24.217815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.211517+0000","last_change":"2023-10-08T12:45:24.211517+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.211517+0000","last_undegraded":"2023-10-08T12:45:24.211517+0000","last_fullsized":"2023-10-08T12:45:24.211517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213043+0000","last_change":"2023-10-08T12:45:24.213043+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213043+0000","last_undegraded":"2023-10-08T12:45:24.213043+0000","last_fullsized":"2023-10-08T12:45:24.213043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.208356+0000","last_change":"2023-10-08T12:45:24.208356+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.208356+0000","last_undegraded":"2023-10-08T12:45:24.208356+0000","last_fullsized":"2023-10-08T12:45:24.208356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.220371+0000","last_change":"2023-10-08T12:45:24.220371+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.220371+0000","last_undegraded":"2023-10-08T12:45:24.220371+0000","last_fullsized":"2023-10-08T12:45:24.220371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.228806+0000","last_change":"2023-10-08T12:45:24.228061+0000","last_active":"2023-10-08T12:45:24.228806+0000","last_peered":"2023-10-08T12:45:24.228806+0000","last_clean":"2023-10-08T12:45:24.228806+0000","last_became_active":"2023-10-08T12:45:24.227725+0000","last_became_peered":"2023-10-08T12:45:24.227725+0000","last_unstale":"2023-10-08T12:45:24.228806+0000","last_undegraded":"2023-10-08T12:45:24.228806+0000","last_fullsized":"2023-10-08T12:45:24.228806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.212448+0000","last_change":"2023-10-08T12:45:24.212448+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.212448+0000","last_undegraded":"2023-10-08T12:45:24.212448+0000","last_fullsized":"2023-10-08T12:45:24.212448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.227019+0000","last_change":"2023-10-08T12:45:24.224322+0000","last_active":"2023-10-08T12:45:24.227019+0000","last_peered":"2023-10-08T12:45:24.227019+0000","last_clean":"2023-10-08T12:45:24.227019+0000","last_became_active":"2023-10-08T12:45:24.223973+0000","last_became_peered":"2023-10-08T12:45:24.223973+0000","last_unstale":"2023-10-08T12:45:24.227019+0000","last_undegraded":"2023-10-08T12:45:24.227019+0000","last_fullsized":"2023-10-08T12:45:24.227019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.211581+0000","last_change":"2023-10-08T12:45:24.211581+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.211581+0000","last_undegraded":"2023-10-08T12:45:24.211581+0000","last_fullsized":"2023-10-08T12:45:24.211581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.234444+0000","last_change":"2023-10-08T12:45:24.228768+0000","last_active":"2023-10-08T12:45:24.234444+0000","last_peered":"2023-10-08T12:45:24.234444+0000","last_clean":"2023-10-08T12:45:24.234444+0000","last_became_active":"2023-10-08T12:45:24.228469+0000","last_became_peered":"2023-10-08T12:45:24.228469+0000","last_unstale":"2023-10-08T12:45:24.234444+0000","last_undegraded":"2023-10-08T12:45:24.234444+0000","last_fullsized":"2023-10-08T12:45:24.234444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:03:57.184403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.214518+0000","last_change":"2023-10-08T12:45:24.214518+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.214518+0000","last_undegraded":"2023-10-08T12:45:24.214518+0000","last_fullsized":"2023-10-08T12:45:24.214518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.231491+0000","last_change":"2023-10-08T12:45:24.227667+0000","last_active":"2023-10-08T12:45:24.231491+0000","last_peered":"2023-10-08T12:45:24.231491+0000","last_clean":"2023-10-08T12:45:24.231491+0000","last_became_active":"2023-10-08T12:45:24.227346+0000","last_became_peered":"2023-10-08T12:45:24.227346+0000","last_unstale":"2023-10-08T12:45:24.231491+0000","last_undegraded":"2023-10-08T12:45:24.231491+0000","last_fullsized":"2023-10-08T12:45:24.231491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:08.251593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213937+0000","last_change":"2023-10-08T12:45:24.213937+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213937+0000","last_undegraded":"2023-10-08T12:45:24.213937+0000","last_fullsized":"2023-10-08T12:45:24.213937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.228079+0000","last_change":"2023-10-08T12:45:24.225874+0000","last_active":"2023-10-08T12:45:24.228079+0000","last_peered":"2023-10-08T12:45:24.228079+0000","last_clean":"2023-10-08T12:45:24.228079+0000","last_became_active":"2023-10-08T12:45:24.225568+0000","last_became_peered":"2023-10-08T12:45:24.225568+0000","last_unstale":"2023-10-08T12:45:24.228079+0000","last_undegraded":"2023-10-08T12:45:24.228079+0000","last_fullsized":"2023-10-08T12:45:24.228079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:08.251593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210834+0000","last_change":"2023-10-08T12:45:24.210834+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210834+0000","last_undegraded":"2023-10-08T12:45:24.210834+0000","last_fullsized":"2023-10-08T12:45:24.210834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.224588+0000","last_change":"2023-10-08T12:45:24.221289+0000","last_active":"2023-10-08T12:45:24.224588+0000","last_peered":"2023-10-08T12:45:24.224588+0000","last_clean":"2023-10-08T12:45:24.224588+0000","last_became_active":"2023-10-08T12:45:24.220980+0000","last_became_peered":"2023-10-08T12:45:24.220980+0000","last_unstale":"2023-10-08T12:45:24.224588+0000","last_undegraded":"2023-10-08T12:45:24.224588+0000","last_fullsized":"2023-10-08T12:45:24.224588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.211066+0000","last_change":"2023-10-08T12:45:24.211066+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.211066+0000","last_undegraded":"2023-10-08T12:45:24.211066+0000","last_fullsized":"2023-10-08T12:45:24.211066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.227046+0000","last_change":"2023-10-08T12:45:24.223766+0000","last_active":"2023-10-08T12:45:24.227046+0000","last_peered":"2023-10-08T12:45:24.227046+0000","last_clean":"2023-10-08T12:45:24.227046+0000","last_became_active":"2023-10-08T12:45:24.223463+0000","last_became_peered":"2023-10-08T12:45:24.223463+0000","last_unstale":"2023-10-08T12:45:24.227046+0000","last_undegraded":"2023-10-08T12:45:24.227046+0000","last_fullsized":"2023-10-08T12:45:24.227046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:28.393554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.212628+0000","last_change":"2023-10-08T12:45:24.212628+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.212628+0000","last_undegraded":"2023-10-08T12:45:24.212628+0000","last_fullsized":"2023-10-08T12:45:24.212628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.221506+0000","last_change":"2023-10-08T12:45:24.219555+0000","last_active":"2023-10-08T12:45:24.221506+0000","last_peered":"2023-10-08T12:45:24.221506+0000","last_clean":"2023-10-08T12:45:24.221506+0000","last_became_active":"2023-10-08T12:45:24.219262+0000","last_became_peered":"2023-10-08T12:45:24.219262+0000","last_unstale":"2023-10-08T12:45:24.221506+0000","last_undegraded":"2023-10-08T12:45:24.221506+0000","last_fullsized":"2023-10-08T12:45:24.221506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:28.393554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.216049+0000","last_change":"2023-10-08T12:45:24.216049+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.216049+0000","last_undegraded":"2023-10-08T12:45:24.216049+0000","last_fullsized":"2023-10-08T12:45:24.216049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.225678+0000","last_change":"2023-10-08T12:45:24.224004+0000","last_active":"2023-10-08T12:45:24.225678+0000","last_peered":"2023-10-08T12:45:24.225678+0000","last_clean":"2023-10-08T12:45:24.225678+0000","last_became_active":"2023-10-08T12:45:24.223726+0000","last_became_peered":"2023-10-08T12:45:24.223726+0000","last_unstale":"2023-10-08T12:45:24.225678+0000","last_undegraded":"2023-10-08T12:45:24.225678+0000","last_fullsized":"2023-10-08T12:45:24.225678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:15.170657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213312+0000","last_change":"2023-10-08T12:45:24.213312+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213312+0000","last_undegraded":"2023-10-08T12:45:24.213312+0000","last_fullsized":"2023-10-08T12:45:24.213312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.228866+0000","last_change":"2023-10-08T12:45:24.226086+0000","last_active":"2023-10-08T12:45:24.228866+0000","last_peered":"2023-10-08T12:45:24.228866+0000","last_clean":"2023-10-08T12:45:24.228866+0000","last_became_active":"2023-10-08T12:45:24.225807+0000","last_became_peered":"2023-10-08T12:45:24.225807+0000","last_unstale":"2023-10-08T12:45:24.228866+0000","last_undegraded":"2023-10-08T12:45:24.228866+0000","last_fullsized":"2023-10-08T12:45:24.228866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:23.245919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210977+0000","last_change":"2023-10-08T12:45:24.210977+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210977+0000","last_undegraded":"2023-10-08T12:45:24.210977+0000","last_fullsized":"2023-10-08T12:45:24.210977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.228684+0000","last_change":"2023-10-08T12:45:24.226329+0000","last_active":"2023-10-08T12:45:24.228684+0000","last_peered":"2023-10-08T12:45:24.228684+0000","last_clean":"2023-10-08T12:45:24.228684+0000","last_became_active":"2023-10-08T12:45:24.226056+0000","last_became_peered":"2023-10-08T12:45:24.226056+0000","last_unstale":"2023-10-08T12:45:24.228684+0000","last_undegraded":"2023-10-08T12:45:24.228684+0000","last_fullsized":"2023-10-08T12:45:24.228684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210367+0000","last_change":"2023-10-08T12:45:24.210367+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210367+0000","last_undegraded":"2023-10-08T12:45:24.210367+0000","last_fullsized":"2023-10-08T12:45:24.210367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.225639+0000","last_change":"2023-10-08T12:45:24.222786+0000","last_active":"2023-10-08T12:45:24.225639+0000","last_peered":"2023-10-08T12:45:24.225639+0000","last_clean":"2023-10-08T12:45:24.225639+0000","last_became_active":"2023-10-08T12:45:24.222465+0000","last_became_peered":"2023-10-08T12:45:24.222465+0000","last_unstale":"2023-10-08T12:45:24.225639+0000","last_undegraded":"2023-10-08T12:45:24.225639+0000","last_fullsized":"2023-10-08T12:45:24.225639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:08.251593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.219875+0000","last_change":"2023-10-08T12:45:24.219875+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.219875+0000","last_undegraded":"2023-10-08T12:45:24.219875+0000","last_fullsized":"2023-10-08T12:45:24.219875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.223131+0000","last_change":"2023-10-08T12:45:24.221225+0000","last_active":"2023-10-08T12:45:24.223131+0000","last_peered":"2023-10-08T12:45:24.223131+0000","last_clean":"2023-10-08T12:45:24.223131+0000","last_became_active":"2023-10-08T12:45:24.220465+0000","last_became_peered":"2023-10-08T12:45:24.220465+0000","last_unstale":"2023-10-08T12:45:24.223131+0000","last_undegraded":"2023-10-08T12:45:24.223131+0000","last_fullsized":"2023-10-08T12:45:24.223131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:08.251593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210495+0000","last_change":"2023-10-08T12:45:24.210495+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210495+0000","last_undegraded":"2023-10-08T12:45:24.210495+0000","last_fullsized":"2023-10-08T12:45:24.210495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.224486+0000","last_change":"2023-10-08T12:45:24.223071+0000","last_active":"2023-10-08T12:45:24.224486+0000","last_peered":"2023-10-08T12:45:24.224486+0000","last_clean":"2023-10-08T12:45:24.224486+0000","last_became_active":"2023-10-08T12:45:24.222681+0000","last_became_peered":"2023-10-08T12:45:24.222681+0000","last_unstale":"2023-10-08T12:45:24.224486+0000","last_undegraded":"2023-10-08T12:45:24.224486+0000","last_fullsized":"2023-10-08T12:45:24.224486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213378+0000","last_change":"2023-10-08T12:45:24.213378+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213378+0000","last_undegraded":"2023-10-08T12:45:24.213378+0000","last_fullsized":"2023-10-08T12:45:24.213378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.224558+0000","last_change":"2023-10-08T12:45:24.220892+0000","last_active":"2023-10-08T12:45:24.224558+0000","last_peered":"2023-10-08T12:45:24.224558+0000","last_clean":"2023-10-08T12:45:24.224558+0000","last_became_active":"2023-10-08T12:45:24.220573+0000","last_became_peered":"2023-10-08T12:45:24.220573+0000","last_unstale":"2023-10-08T12:45:24.224558+0000","last_undegraded":"2023-10-08T12:45:24.224558+0000","last_fullsized":"2023-10-08T12:45:24.224558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:28.393554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213240+0000","last_change":"2023-10-08T12:45:24.213240+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213240+0000","last_undegraded":"2023-10-08T12:45:24.213240+0000","last_fullsized":"2023-10-08T12:45:24.213240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.226948+0000","last_change":"2023-10-08T12:45:24.225777+0000","last_active":"2023-10-08T12:45:24.226948+0000","last_peered":"2023-10-08T12:45:24.226948+0000","last_clean":"2023-10-08T12:45:24.226948+0000","last_became_active":"2023-10-08T12:45:24.225472+0000","last_became_peered":"2023-10-08T12:45:24.225472+0000","last_unstale":"2023-10-08T12:45:24.226948+0000","last_undegraded":"2023-10-08T12:45:24.226948+0000","last_fullsized":"2023-10-08T12:45:24.226948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:15.170657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213636+0000","last_change":"2023-10-08T12:45:24.213636+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213636+0000","last_undegraded":"2023-10-08T12:45:24.213636+0000","last_fullsized":"2023-10-08T12:45:24.213636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.225971+0000","last_change":"2023-10-08T12:45:24.222110+0000","last_active":"2023-10-08T12:45:24.225971+0000","last_peered":"2023-10-08T12:45:24.225971+0000","last_clean":"2023-10-08T12:45:24.225971+0000","last_became_active":"2023-10-08T12:45:24.221768+0000","last_became_peered":"2023-10-08T12:45:24.221768+0000","last_unstale":"2023-10-08T12:45:24.225971+0000","last_undegraded":"2023-10-08T12:45:24.225971+0000","last_fullsized":"2023-10-08T12:45:24.225971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.216619+0000","last_change":"2023-10-08T12:45:24.216619+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.216619+0000","last_undegraded":"2023-10-08T12:45:24.216619+0000","last_fullsized":"2023-10-08T12:45:24.216619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.228635+0000","last_change":"2023-10-08T12:45:24.225910+0000","last_active":"2023-10-08T12:45:24.228635+0000","last_peered":"2023-10-08T12:45:24.228635+0000","last_clean":"2023-10-08T12:45:24.228635+0000","last_became_active":"2023-10-08T12:45:24.225590+0000","last_became_peered":"2023-10-08T12:45:24.225590+0000","last_unstale":"2023-10-08T12:45:24.228635+0000","last_undegraded":"2023-10-08T12:45:24.228635+0000","last_fullsized":"2023-10-08T12:45:24.228635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:15.170657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213456+0000","last_change":"2023-10-08T12:45:24.213456+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213456+0000","last_undegraded":"2023-10-08T12:45:24.213456+0000","last_fullsized":"2023-10-08T12:45:24.213456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.228742+0000","last_change":"2023-10-08T12:45:24.226194+0000","last_active":"2023-10-08T12:45:24.228742+0000","last_peered":"2023-10-08T12:45:24.228742+0000","last_clean":"2023-10-08T12:45:24.228742+0000","last_became_active":"2023-10-08T12:45:24.225901+0000","last_became_peered":"2023-10-08T12:45:24.225901+0000","last_unstale":"2023-10-08T12:45:24.228742+0000","last_undegraded":"2023-10-08T12:45:24.228742+0000","last_fullsized":"2023-10-08T12:45:24.228742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:15.170657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210301+0000","last_change":"2023-10-08T12:45:24.210301+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210301+0000","last_undegraded":"2023-10-08T12:45:24.210301+0000","last_fullsized":"2023-10-08T12:45:24.210301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.217923+0000","last_change":"2023-10-08T12:45:24.217923+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.217923+0000","last_undegraded":"2023-10-08T12:45:24.217923+0000","last_fullsized":"2023-10-08T12:45:24.217923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.218628+0000","last_change":"2023-10-08T12:45:24.216886+0000","last_active":"2023-10-08T12:45:24.218628+0000","last_peered":"2023-10-08T12:45:24.218628+0000","last_clean":"2023-10-08T12:45:24.218628+0000","last_became_active":"2023-10-08T12:45:24.216435+0000","last_became_peered":"2023-10-08T12:45:24.216435+0000","last_unstale":"2023-10-08T12:45:24.218628+0000","last_undegraded":"2023-10-08T12:45:24.218628+0000","last_fullsized":"2023-10-08T12:45:24.218628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:08.251593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.209282+0000","last_change":"2023-10-08T12:45:24.209282+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.209282+0000","last_undegraded":"2023-10-08T12:45:24.209282+0000","last_fullsized":"2023-10-08T12:45:24.209282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.221461+0000","last_change":"2023-10-08T12:45:24.218750+0000","last_active":"2023-10-08T12:45:24.221461+0000","last_peered":"2023-10-08T12:45:24.221461+0000","last_clean":"2023-10-08T12:45:24.221461+0000","last_became_active":"2023-10-08T12:45:24.218402+0000","last_became_peered":"2023-10-08T12:45:24.218402+0000","last_unstale":"2023-10-08T12:45:24.221461+0000","last_undegraded":"2023-10-08T12:45:24.221461+0000","last_fullsized":"2023-10-08T12:45:24.221461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:08.251593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":163,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.221448+0000","last_change":"2023-10-08T12:45:21.094571+0000","last_active":"2023-10-08T12:45:24.221448+0000","last_peered":"2023-10-08T12:45:24.221448+0000","last_clean":"2023-10-08T12:45:24.221448+0000","last_became_active":"2023-10-08T12:45:21.093551+0000","last_became_peered":"2023-10-08T12:45:21.093551+0000","last_unstale":"2023-10-08T12:45:24.221448+0000","last_undegraded":"2023-10-08T12:45:24.221448+0000","last_fullsized":"2023-10-08T12:45:24.221448+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:19.842786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:19.842786+0000","last_clean_scrub_stamp":"2023-10-08T12:45:19.842786+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:25.041743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.209841+0000","last_change":"2023-10-08T12:45:24.209841+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.209841+0000","last_undegraded":"2023-10-08T12:45:24.209841+0000","last_fullsized":"2023-10-08T12:45:24.209841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.234531+0000","last_change":"2023-10-08T12:45:24.229708+0000","last_active":"2023-10-08T12:45:24.234531+0000","last_peered":"2023-10-08T12:45:24.234531+0000","last_clean":"2023-10-08T12:45:24.234531+0000","last_became_active":"2023-10-08T12:45:24.229494+0000","last_became_peered":"2023-10-08T12:45:24.229494+0000","last_unstale":"2023-10-08T12:45:24.234531+0000","last_undegraded":"2023-10-08T12:45:24.234531+0000","last_fullsized":"2023-10-08T12:45:24.234531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:15.170657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.234464+0000","last_change":"2023-10-08T12:45:24.229122+0000","last_active":"2023-10-08T12:45:24.234464+0000","last_peered":"2023-10-08T12:45:24.234464+0000","last_clean":"2023-10-08T12:45:24.234464+0000","last_became_active":"2023-10-08T12:45:24.228838+0000","last_became_peered":"2023-10-08T12:45:24.228838+0000","last_unstale":"2023-10-08T12:45:24.234464+0000","last_undegraded":"2023-10-08T12:45:24.234464+0000","last_fullsized":"2023-10-08T12:45:24.234464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:19:36.620765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.219902+0000","last_change":"2023-10-08T12:45:24.219902+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.219902+0000","last_undegraded":"2023-10-08T12:45:24.219902+0000","last_fullsized":"2023-10-08T12:45:24.219902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.229064+0000","last_change":"2023-10-08T12:45:24.226993+0000","last_active":"2023-10-08T12:45:24.229064+0000","last_peered":"2023-10-08T12:45:24.229064+0000","last_clean":"2023-10-08T12:45:24.229064+0000","last_became_active":"2023-10-08T12:45:24.226721+0000","last_became_peered":"2023-10-08T12:45:24.226721+0000","last_unstale":"2023-10-08T12:45:24.229064+0000","last_undegraded":"2023-10-08T12:45:24.229064+0000","last_fullsized":"2023-10-08T12:45:24.229064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:03:57.184403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.209710+0000","last_change":"2023-10-08T12:45:24.209710+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.209710+0000","last_undegraded":"2023-10-08T12:45:24.209710+0000","last_fullsized":"2023-10-08T12:45:24.209710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.234227+0000","last_change":"2023-10-08T12:45:24.229198+0000","last_active":"2023-10-08T12:45:24.234227+0000","last_peered":"2023-10-08T12:45:24.234227+0000","last_clean":"2023-10-08T12:45:24.234227+0000","last_became_active":"2023-10-08T12:45:24.228922+0000","last_became_peered":"2023-10-08T12:45:24.228922+0000","last_unstale":"2023-10-08T12:45:24.234227+0000","last_undegraded":"2023-10-08T12:45:24.234227+0000","last_fullsized":"2023-10-08T12:45:24.234227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:23.245919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.209913+0000","last_change":"2023-10-08T12:45:24.209913+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.209913+0000","last_undegraded":"2023-10-08T12:45:24.209913+0000","last_fullsized":"2023-10-08T12:45:24.209913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.231553+0000","last_change":"2023-10-08T12:45:24.228202+0000","last_active":"2023-10-08T12:45:24.231553+0000","last_peered":"2023-10-08T12:45:24.231553+0000","last_clean":"2023-10-08T12:45:24.231553+0000","last_became_active":"2023-10-08T12:45:24.227988+0000","last_became_peered":"2023-10-08T12:45:24.227988+0000","last_unstale":"2023-10-08T12:45:24.231553+0000","last_undegraded":"2023-10-08T12:45:24.231553+0000","last_fullsized":"2023-10-08T12:45:24.231553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210282+0000","last_change":"2023-10-08T12:45:24.210282+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210282+0000","last_undegraded":"2023-10-08T12:45:24.210282+0000","last_fullsized":"2023-10-08T12:45:24.210282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.229119+0000","last_change":"2023-10-08T12:45:24.228028+0000","last_active":"2023-10-08T12:45:24.229119+0000","last_peered":"2023-10-08T12:45:24.229119+0000","last_clean":"2023-10-08T12:45:24.229119+0000","last_became_active":"2023-10-08T12:45:24.227739+0000","last_became_peered":"2023-10-08T12:45:24.227739+0000","last_unstale":"2023-10-08T12:45:24.229119+0000","last_undegraded":"2023-10-08T12:45:24.229119+0000","last_fullsized":"2023-10-08T12:45:24.229119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:23.245919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.209625+0000","last_change":"2023-10-08T12:45:24.209625+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.209625+0000","last_undegraded":"2023-10-08T12:45:24.209625+0000","last_fullsized":"2023-10-08T12:45:24.209625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.227316+0000","last_change":"2023-10-08T12:45:24.222491+0000","last_active":"2023-10-08T12:45:24.227316+0000","last_peered":"2023-10-08T12:45:24.227316+0000","last_clean":"2023-10-08T12:45:24.227316+0000","last_became_active":"2023-10-08T12:45:24.222266+0000","last_became_peered":"2023-10-08T12:45:24.222266+0000","last_unstale":"2023-10-08T12:45:24.227316+0000","last_undegraded":"2023-10-08T12:45:24.227316+0000","last_fullsized":"2023-10-08T12:45:24.227316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:28.393554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210719+0000","last_change":"2023-10-08T12:45:24.210719+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210719+0000","last_undegraded":"2023-10-08T12:45:24.210719+0000","last_fullsized":"2023-10-08T12:45:24.210719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.231530+0000","last_change":"2023-10-08T12:45:24.227674+0000","last_active":"2023-10-08T12:45:24.231530+0000","last_peered":"2023-10-08T12:45:24.231530+0000","last_clean":"2023-10-08T12:45:24.231530+0000","last_became_active":"2023-10-08T12:45:24.227376+0000","last_became_peered":"2023-10-08T12:45:24.227376+0000","last_unstale":"2023-10-08T12:45:24.231530+0000","last_undegraded":"2023-10-08T12:45:24.231530+0000","last_fullsized":"2023-10-08T12:45:24.231530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:23.245919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.215552+0000","last_change":"2023-10-08T12:45:24.215552+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.215552+0000","last_undegraded":"2023-10-08T12:45:24.215552+0000","last_fullsized":"2023-10-08T12:45:24.215552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.218592+0000","last_change":"2023-10-08T12:45:24.215676+0000","last_active":"2023-10-08T12:45:24.218592+0000","last_peered":"2023-10-08T12:45:24.218592+0000","last_clean":"2023-10-08T12:45:24.218592+0000","last_became_active":"2023-10-08T12:45:24.215332+0000","last_became_peered":"2023-10-08T12:45:24.215332+0000","last_unstale":"2023-10-08T12:45:24.218592+0000","last_undegraded":"2023-10-08T12:45:24.218592+0000","last_fullsized":"2023-10-08T12:45:24.218592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213956+0000","last_change":"2023-10-08T12:45:24.213956+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213956+0000","last_undegraded":"2023-10-08T12:45:24.213956+0000","last_fullsized":"2023-10-08T12:45:24.213956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.226783+0000","last_change":"2023-10-08T12:45:24.220654+0000","last_active":"2023-10-08T12:45:24.226783+0000","last_peered":"2023-10-08T12:45:24.226783+0000","last_clean":"2023-10-08T12:45:24.226783+0000","last_became_active":"2023-10-08T12:45:24.220367+0000","last_became_peered":"2023-10-08T12:45:24.220367+0000","last_unstale":"2023-10-08T12:45:24.226783+0000","last_undegraded":"2023-10-08T12:45:24.226783+0000","last_fullsized":"2023-10-08T12:45:24.226783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:08.251593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.211647+0000","last_change":"2023-10-08T12:45:24.211647+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.211647+0000","last_undegraded":"2023-10-08T12:45:24.211647+0000","last_fullsized":"2023-10-08T12:45:24.211647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.218617+0000","last_change":"2023-10-08T12:45:24.216389+0000","last_active":"2023-10-08T12:45:24.218617+0000","last_peered":"2023-10-08T12:45:24.218617+0000","last_clean":"2023-10-08T12:45:24.218617+0000","last_became_active":"2023-10-08T12:45:24.216111+0000","last_became_peered":"2023-10-08T12:45:24.216111+0000","last_unstale":"2023-10-08T12:45:24.218617+0000","last_undegraded":"2023-10-08T12:45:24.218617+0000","last_fullsized":"2023-10-08T12:45:24.218617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:28.393554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.214398+0000","last_change":"2023-10-08T12:45:24.214398+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.214398+0000","last_undegraded":"2023-10-08T12:45:24.214398+0000","last_fullsized":"2023-10-08T12:45:24.214398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213834+0000","last_change":"2023-10-08T12:45:24.213834+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213834+0000","last_undegraded":"2023-10-08T12:45:24.213834+0000","last_fullsized":"2023-10-08T12:45:24.213834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.208467+0000","last_change":"2023-10-08T12:45:24.208467+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.208467+0000","last_undegraded":"2023-10-08T12:45:24.208467+0000","last_fullsized":"2023-10-08T12:45:24.208467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.212366+0000","last_change":"2023-10-08T12:45:24.212366+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.212366+0000","last_undegraded":"2023-10-08T12:45:24.212366+0000","last_fullsized":"2023-10-08T12:45:24.212366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.211571+0000","last_change":"2023-10-08T12:45:24.211571+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.211571+0000","last_undegraded":"2023-10-08T12:45:24.211571+0000","last_fullsized":"2023-10-08T12:45:24.211571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213860+0000","last_change":"2023-10-08T12:45:24.213860+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213860+0000","last_undegraded":"2023-10-08T12:45:24.213860+0000","last_fullsized":"2023-10-08T12:45:24.213860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.218858+0000","last_change":"2023-10-08T12:45:24.218858+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.218858+0000","last_undegraded":"2023-10-08T12:45:24.218858+0000","last_fullsized":"2023-10-08T12:45:24.218858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.216612+0000","last_change":"2023-10-08T12:45:24.216612+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.216612+0000","last_undegraded":"2023-10-08T12:45:24.216612+0000","last_fullsized":"2023-10-08T12:45:24.216612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.212770+0000","last_change":"2023-10-08T12:45:24.212770+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.212770+0000","last_undegraded":"2023-10-08T12:45:24.212770+0000","last_fullsized":"2023-10-08T12:45:24.212770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210381+0000","last_change":"2023-10-08T12:45:24.210381+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210381+0000","last_undegraded":"2023-10-08T12:45:24.210381+0000","last_fullsized":"2023-10-08T12:45:24.210381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213760+0000","last_change":"2023-10-08T12:45:24.213760+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213760+0000","last_undegraded":"2023-10-08T12:45:24.213760+0000","last_fullsized":"2023-10-08T12:45:24.213760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.212940+0000","last_change":"2023-10-08T12:45:24.212940+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.212940+0000","last_undegraded":"2023-10-08T12:45:24.212940+0000","last_fullsized":"2023-10-08T12:45:24.212940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.212268+0000","last_change":"2023-10-08T12:45:24.212268+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.212268+0000","last_undegraded":"2023-10-08T12:45:24.212268+0000","last_fullsized":"2023-10-08T12:45:24.212268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.215024+0000","last_change":"2023-10-08T12:45:24.215024+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.215024+0000","last_undegraded":"2023-10-08T12:45:24.215024+0000","last_fullsized":"2023-10-08T12:45:24.215024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":774144,"data_stored":648191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":774144,"data_stored":648191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:45:29.380 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T12:45:29.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.540+0000 7fe552335700 1 -- 172.21.15.45:0/646285723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe538004d90 msgr2=0x7fe538005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:29.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.540+0000 7fe552335700 1 --2- 172.21.15.45:0/646285723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe538004d90 0x7fe538005210 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe54400e350 tx=0x7fe538005880 comp rx=0 tx=0).stop 2023-10-08T12:45:29.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.540+0000 7fe5508d2700 1 -- 172.21.15.45:0/646285723 reap_dead start 2023-10-08T12:45:29.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.540+0000 7fe552335700 1 -- 172.21.15.45:0/646285723 shutdown_connections 2023-10-08T12:45:29.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.540+0000 7fe552335700 1 -- 172.21.15.45:0/646285723 >> 172.21.15.45:0/646285723 conn(0x7fe54c0b0430 msgr2=0x7fe54c0b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:29.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.540+0000 7fe552335700 1 -- 172.21.15.45:0/646285723 shutdown_connections 2023-10-08T12:45:29.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.540+0000 7fe552335700 1 -- 172.21.15.45:0/646285723 wait complete. 2023-10-08T12:45:29.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.541+0000 7fe552335700 1 Processor -- start 2023-10-08T12:45:29.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.541+0000 7fe552335700 1 -- start start 2023-10-08T12:45:29.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.542+0000 7fe552335700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe538004d90 0x7fe54c14cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:29.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.542+0000 7fe552335700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe54c0b2ff0 0x7fe54c0b3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:29.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.542+0000 7fe552335700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe54c15b030 0x7fe54c15b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:29.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.542+0000 7fe552335700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54c15ba00 con 0x7fe54c15b030 2023-10-08T12:45:29.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.542+0000 7fe552335700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54c1f0d90 con 0x7fe54c0b2ff0 2023-10-08T12:45:29.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.542+0000 7fe552335700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54c0c6890 con 0x7fe538004d90 2023-10-08T12:45:29.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.542+0000 7fe5508d2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe54c15b030 0x7fe54c15b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:29.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.542+0000 7fe5508d2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe54c15b030 0x7fe54c15b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34920/0 (socket says 172.21.15.45:34920) 2023-10-08T12:45:29.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.542+0000 7fe5508d2700 1 -- 172.21.15.45:0/1483157499 learned_addr learned my addr 172.21.15.45:0/1483157499 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:29.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.542+0000 7fe54b7fe700 1 --2- 172.21.15.45:0/1483157499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe54c0b2ff0 0x7fe54c0b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:29.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.542+0000 7fe54bfff700 1 --2- 172.21.15.45:0/1483157499 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe538004d90 0x7fe54c14cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:29.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.543+0000 7fe5508d2700 1 -- 172.21.15.45:0/1483157499 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe538004d90 msgr2=0x7fe54c14cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:29.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.543+0000 7fe5508d2700 1 --2- 172.21.15.45:0/1483157499 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe538004d90 0x7fe54c14cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:29.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.543+0000 7fe5508d2700 1 -- 172.21.15.45:0/1483157499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe54c0b2ff0 msgr2=0x7fe54c0b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:29.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.543+0000 7fe5508d2700 1 --2- 172.21.15.45:0/1483157499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe54c0b2ff0 0x7fe54c0b3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:29.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.543+0000 7fe5508d2700 1 -- 172.21.15.45:0/1483157499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54c1efd70 con 0x7fe54c15b030 2023-10-08T12:45:29.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.543+0000 7fe5508d2700 1 --2- 172.21.15.45:0/1483157499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe54c15b030 0x7fe54c15b4c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe544009040 tx=0x7fe54400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:29.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.543+0000 7fe548ff9700 1 -- 172.21.15.45:0/1483157499 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe544018070 con 0x7fe54c15b030 2023-10-08T12:45:29.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.543+0000 7fe548ff9700 1 -- 172.21.15.45:0/1483157499 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe544019040 con 0x7fe54c15b030 2023-10-08T12:45:29.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.543+0000 7fe552335700 1 -- 172.21.15.45:0/1483157499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe54c1f0010 con 0x7fe54c15b030 2023-10-08T12:45:29.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.543+0000 7fe548ff9700 1 -- 172.21.15.45:0/1483157499 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe544007760 con 0x7fe54c15b030 2023-10-08T12:45:29.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.543+0000 7fe552335700 1 -- 172.21.15.45:0/1483157499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe54c1f05d0 con 0x7fe54c15b030 2023-10-08T12:45:29.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.544+0000 7fe552335700 1 -- 172.21.15.45:0/1483157499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe54c04e4c0 con 0x7fe54c15b030 2023-10-08T12:45:29.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.544+0000 7fe548ff9700 1 -- 172.21.15.45:0/1483157499 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe5440078c0 con 0x7fe54c15b030 2023-10-08T12:45:29.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.545+0000 7fe548ff9700 1 --2- 172.21.15.45:0/1483157499 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe52c06aed0 0x7fe52c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:29.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.545+0000 7fe548ff9700 1 -- 172.21.15.45:0/1483157499 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe54408a510 con 0x7fe54c15b030 2023-10-08T12:45:29.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.545+0000 7fe54bfff700 1 --2- 172.21.15.45:0/1483157499 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe52c06aed0 0x7fe52c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:29.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.545+0000 7fe54bfff700 1 --2- 172.21.15.45:0/1483157499 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe52c06aed0 0x7fe52c06d390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe534009d40 tx=0x7fe534009260 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:29.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.549+0000 7fe548ff9700 1 -- 172.21.15.45:0/1483157499 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe544055650 con 0x7fe54c15b030 2023-10-08T12:45:29.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.743+0000 7fe552335700 1 -- 172.21.15.45:0/1483157499 --> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe54c0cdf60 con 0x7fe52c06aed0 2023-10-08T12:45:29.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.750+0000 7fe548ff9700 1 -- 172.21.15.45:0/1483157499 <== mgr.4105 v2:172.21.15.78:6832/3438117854 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+259283 (secure 0 0 0) 0x7fe534009990 con 0x7fe52c06aed0 2023-10-08T12:45:29.757 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:29.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.753+0000 7fe552335700 1 -- 172.21.15.45:0/1483157499 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe52c06aed0 msgr2=0x7fe52c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:29.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.753+0000 7fe552335700 1 --2- 172.21.15.45:0/1483157499 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe52c06aed0 0x7fe52c06d390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe534009d40 tx=0x7fe534009260 comp rx=0 tx=0).stop 2023-10-08T12:45:29.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.753+0000 7fe552335700 1 -- 172.21.15.45:0/1483157499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe54c15b030 msgr2=0x7fe54c15b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:29.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.753+0000 7fe552335700 1 --2- 172.21.15.45:0/1483157499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe54c15b030 0x7fe54c15b4c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe544009040 tx=0x7fe54400edc0 comp rx=0 tx=0).stop 2023-10-08T12:45:29.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.753+0000 7fe552335700 1 -- 172.21.15.45:0/1483157499 shutdown_connections 2023-10-08T12:45:29.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.753+0000 7fe552335700 1 --2- 172.21.15.45:0/1483157499 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe52c06aed0 0x7fe52c06d390 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:29.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.753+0000 7fe552335700 1 --2- 172.21.15.45:0/1483157499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe54c15b030 0x7fe54c15b4c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:29.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.753+0000 7fe552335700 1 --2- 172.21.15.45:0/1483157499 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe538004d90 0x7fe54c14cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:29.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.753+0000 7fe552335700 1 --2- 172.21.15.45:0/1483157499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe54c0b2ff0 0x7fe54c0b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:29.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.753+0000 7fe552335700 1 -- 172.21.15.45:0/1483157499 >> 172.21.15.45:0/1483157499 conn(0x7fe54c0b0430 msgr2=0x7fe54c1e2420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:29.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.753+0000 7fe552335700 1 -- 172.21.15.45:0/1483157499 shutdown_connections 2023-10-08T12:45:29.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.753+0000 7fe552335700 1 -- 172.21.15.45:0/1483157499 wait complete. 2023-10-08T12:45:29.762 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-08T12:45:29.767 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-08T12:45:29.128025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218744,"kb_used_data":2568,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755976,"statfs":{"total":773094113280,"available":772870119424,"internally_reserved":0,"allocated":2629632,"data_stored":1643320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001269"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.217479+0000","last_change":"2023-10-08T12:45:24.217479+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.217479+0000","last_undegraded":"2023-10-08T12:45:24.217479+0000","last_fullsized":"2023-10-08T12:45:24.217479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.217377+0000","last_change":"2023-10-08T12:45:24.217377+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.217377+0000","last_undegraded":"2023-10-08T12:45:24.217377+0000","last_fullsized":"2023-10-08T12:45:24.217377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210475+0000","last_change":"2023-10-08T12:45:24.210475+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210475+0000","last_undegraded":"2023-10-08T12:45:24.210475+0000","last_fullsized":"2023-10-08T12:45:24.210475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.211204+0000","last_change":"2023-10-08T12:45:24.211204+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.211204+0000","last_undegraded":"2023-10-08T12:45:24.211204+0000","last_fullsized":"2023-10-08T12:45:24.211204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.218087+0000","last_change":"2023-10-08T12:45:24.218087+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.218087+0000","last_undegraded":"2023-10-08T12:45:24.218087+0000","last_fullsized":"2023-10-08T12:45:24.218087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213469+0000","last_change":"2023-10-08T12:45:24.213469+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213469+0000","last_undegraded":"2023-10-08T12:45:24.213469+0000","last_fullsized":"2023-10-08T12:45:24.213469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.216581+0000","last_change":"2023-10-08T12:45:24.216581+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.216581+0000","last_undegraded":"2023-10-08T12:45:24.216581+0000","last_fullsized":"2023-10-08T12:45:24.216581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213458+0000","last_change":"2023-10-08T12:45:24.213458+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213458+0000","last_undegraded":"2023-10-08T12:45:24.213458+0000","last_fullsized":"2023-10-08T12:45:24.213458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.216999+0000","last_change":"2023-10-08T12:45:24.216999+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.216999+0000","last_undegraded":"2023-10-08T12:45:24.216999+0000","last_fullsized":"2023-10-08T12:45:24.216999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.214181+0000","last_change":"2023-10-08T12:45:24.214181+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.214181+0000","last_undegraded":"2023-10-08T12:45:24.214181+0000","last_fullsized":"2023-10-08T12:45:24.214181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.215422+0000","last_change":"2023-10-08T12:45:24.215422+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.215422+0000","last_undegraded":"2023-10-08T12:45:24.215422+0000","last_fullsized":"2023-10-08T12:45:24.215422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210890+0000","last_change":"2023-10-08T12:45:24.210890+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210890+0000","last_undegraded":"2023-10-08T12:45:24.210890+0000","last_fullsized":"2023-10-08T12:45:24.210890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213162+0000","last_change":"2023-10-08T12:45:24.213162+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213162+0000","last_undegraded":"2023-10-08T12:45:24.213162+0000","last_fullsized":"2023-10-08T12:45:24.213162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.211135+0000","last_change":"2023-10-08T12:45:24.211135+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.211135+0000","last_undegraded":"2023-10-08T12:45:24.211135+0000","last_fullsized":"2023-10-08T12:45:24.211135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.217815+0000","last_change":"2023-10-08T12:45:24.217815+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.217815+0000","last_undegraded":"2023-10-08T12:45:24.217815+0000","last_fullsized":"2023-10-08T12:45:24.217815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.211517+0000","last_change":"2023-10-08T12:45:24.211517+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.211517+0000","last_undegraded":"2023-10-08T12:45:24.211517+0000","last_fullsized":"2023-10-08T12:45:24.211517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213043+0000","last_change":"2023-10-08T12:45:24.213043+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213043+0000","last_undegraded":"2023-10-08T12:45:24.213043+0000","last_fullsized":"2023-10-08T12:45:24.213043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.208356+0000","last_change":"2023-10-08T12:45:24.208356+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.208356+0000","last_undegraded":"2023-10-08T12:45:24.208356+0000","last_fullsized":"2023-10-08T12:45:24.208356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.220371+0000","last_change":"2023-10-08T12:45:24.220371+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.220371+0000","last_undegraded":"2023-10-08T12:45:24.220371+0000","last_fullsized":"2023-10-08T12:45:24.220371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.228806+0000","last_change":"2023-10-08T12:45:24.228061+0000","last_active":"2023-10-08T12:45:24.228806+0000","last_peered":"2023-10-08T12:45:24.228806+0000","last_clean":"2023-10-08T12:45:24.228806+0000","last_became_active":"2023-10-08T12:45:24.227725+0000","last_became_peered":"2023-10-08T12:45:24.227725+0000","last_unstale":"2023-10-08T12:45:24.228806+0000","last_undegraded":"2023-10-08T12:45:24.228806+0000","last_fullsized":"2023-10-08T12:45:24.228806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.212448+0000","last_change":"2023-10-08T12:45:24.212448+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.212448+0000","last_undegraded":"2023-10-08T12:45:24.212448+0000","last_fullsized":"2023-10-08T12:45:24.212448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.227019+0000","last_change":"2023-10-08T12:45:24.224322+0000","last_active":"2023-10-08T12:45:24.227019+0000","last_peered":"2023-10-08T12:45:24.227019+0000","last_clean":"2023-10-08T12:45:24.227019+0000","last_became_active":"2023-10-08T12:45:24.223973+0000","last_became_peered":"2023-10-08T12:45:24.223973+0000","last_unstale":"2023-10-08T12:45:24.227019+0000","last_undegraded":"2023-10-08T12:45:24.227019+0000","last_fullsized":"2023-10-08T12:45:24.227019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.211581+0000","last_change":"2023-10-08T12:45:24.211581+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.211581+0000","last_undegraded":"2023-10-08T12:45:24.211581+0000","last_fullsized":"2023-10-08T12:45:24.211581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.234444+0000","last_change":"2023-10-08T12:45:24.228768+0000","last_active":"2023-10-08T12:45:24.234444+0000","last_peered":"2023-10-08T12:45:24.234444+0000","last_clean":"2023-10-08T12:45:24.234444+0000","last_became_active":"2023-10-08T12:45:24.228469+0000","last_became_peered":"2023-10-08T12:45:24.228469+0000","last_unstale":"2023-10-08T12:45:24.234444+0000","last_undegraded":"2023-10-08T12:45:24.234444+0000","last_fullsized":"2023-10-08T12:45:24.234444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:03:57.184403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.214518+0000","last_change":"2023-10-08T12:45:24.214518+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.214518+0000","last_undegraded":"2023-10-08T12:45:24.214518+0000","last_fullsized":"2023-10-08T12:45:24.214518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.231491+0000","last_change":"2023-10-08T12:45:24.227667+0000","last_active":"2023-10-08T12:45:24.231491+0000","last_peered":"2023-10-08T12:45:24.231491+0000","last_clean":"2023-10-08T12:45:24.231491+0000","last_became_active":"2023-10-08T12:45:24.227346+0000","last_became_peered":"2023-10-08T12:45:24.227346+0000","last_unstale":"2023-10-08T12:45:24.231491+0000","last_undegraded":"2023-10-08T12:45:24.231491+0000","last_fullsized":"2023-10-08T12:45:24.231491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:08.251593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213937+0000","last_change":"2023-10-08T12:45:24.213937+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213937+0000","last_undegraded":"2023-10-08T12:45:24.213937+0000","last_fullsized":"2023-10-08T12:45:24.213937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.228079+0000","last_change":"2023-10-08T12:45:24.225874+0000","last_active":"2023-10-08T12:45:24.228079+0000","last_peered":"2023-10-08T12:45:24.228079+0000","last_clean":"2023-10-08T12:45:24.228079+0000","last_became_active":"2023-10-08T12:45:24.225568+0000","last_became_peered":"2023-10-08T12:45:24.225568+0000","last_unstale":"2023-10-08T12:45:24.228079+0000","last_undegraded":"2023-10-08T12:45:24.228079+0000","last_fullsized":"2023-10-08T12:45:24.228079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:08.251593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210834+0000","last_change":"2023-10-08T12:45:24.210834+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210834+0000","last_undegraded":"2023-10-08T12:45:24.210834+0000","last_fullsized":"2023-10-08T12:45:24.210834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.224588+0000","last_change":"2023-10-08T12:45:24.221289+0000","last_active":"2023-10-08T12:45:24.224588+0000","last_peered":"2023-10-08T12:45:24.224588+0000","last_clean":"2023-10-08T12:45:24.224588+0000","last_became_active":"2023-10-08T12:45:24.220980+0000","last_became_peered":"2023-10-08T12:45:24.220980+0000","last_unstale":"2023-10-08T12:45:24.224588+0000","last_undegraded":"2023-10-08T12:45:24.224588+0000","last_fullsized":"2023-10-08T12:45:24.224588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.211066+0000","last_change":"2023-10-08T12:45:24.211066+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.211066+0000","last_undegraded":"2023-10-08T12:45:24.211066+0000","last_fullsized":"2023-10-08T12:45:24.211066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.227046+0000","last_change":"2023-10-08T12:45:24.223766+0000","last_active":"2023-10-08T12:45:24.227046+0000","last_peered":"2023-10-08T12:45:24.227046+0000","last_clean":"2023-10-08T12:45:24.227046+0000","last_became_active":"2023-10-08T12:45:24.223463+0000","last_became_peered":"2023-10-08T12:45:24.223463+0000","last_unstale":"2023-10-08T12:45:24.227046+0000","last_undegraded":"2023-10-08T12:45:24.227046+0000","last_fullsized":"2023-10-08T12:45:24.227046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:28.393554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.212628+0000","last_change":"2023-10-08T12:45:24.212628+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.212628+0000","last_undegraded":"2023-10-08T12:45:24.212628+0000","last_fullsized":"2023-10-08T12:45:24.212628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.221506+0000","last_change":"2023-10-08T12:45:24.219555+0000","last_active":"2023-10-08T12:45:24.221506+0000","last_peered":"2023-10-08T12:45:24.221506+0000","last_clean":"2023-10-08T12:45:24.221506+0000","last_became_active":"2023-10-08T12:45:24.219262+0000","last_became_peered":"2023-10-08T12:45:24.219262+0000","last_unstale":"2023-10-08T12:45:24.221506+0000","last_undegraded":"2023-10-08T12:45:24.221506+0000","last_fullsized":"2023-10-08T12:45:24.221506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:28.393554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.216049+0000","last_change":"2023-10-08T12:45:24.216049+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.216049+0000","last_undegraded":"2023-10-08T12:45:24.216049+0000","last_fullsized":"2023-10-08T12:45:24.216049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.225678+0000","last_change":"2023-10-08T12:45:24.224004+0000","last_active":"2023-10-08T12:45:24.225678+0000","last_peered":"2023-10-08T12:45:24.225678+0000","last_clean":"2023-10-08T12:45:24.225678+0000","last_became_active":"2023-10-08T12:45:24.223726+0000","last_became_peered":"2023-10-08T12:45:24.223726+0000","last_unstale":"2023-10-08T12:45:24.225678+0000","last_undegraded":"2023-10-08T12:45:24.225678+0000","last_fullsized":"2023-10-08T12:45:24.225678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:15.170657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213312+0000","last_change":"2023-10-08T12:45:24.213312+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213312+0000","last_undegraded":"2023-10-08T12:45:24.213312+0000","last_fullsized":"2023-10-08T12:45:24.213312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.228866+0000","last_change":"2023-10-08T12:45:24.226086+0000","last_active":"2023-10-08T12:45:24.228866+0000","last_peered":"2023-10-08T12:45:24.228866+0000","last_clean":"2023-10-08T12:45:24.228866+0000","last_became_active":"2023-10-08T12:45:24.225807+0000","last_became_peered":"2023-10-08T12:45:24.225807+0000","last_unstale":"2023-10-08T12:45:24.228866+0000","last_undegraded":"2023-10-08T12:45:24.228866+0000","last_fullsized":"2023-10-08T12:45:24.228866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:23.245919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210977+0000","last_change":"2023-10-08T12:45:24.210977+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210977+0000","last_undegraded":"2023-10-08T12:45:24.210977+0000","last_fullsized":"2023-10-08T12:45:24.210977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.228684+0000","last_change":"2023-10-08T12:45:24.226329+0000","last_active":"2023-10-08T12:45:24.228684+0000","last_peered":"2023-10-08T12:45:24.228684+0000","last_clean":"2023-10-08T12:45:24.228684+0000","last_became_active":"2023-10-08T12:45:24.226056+0000","last_became_peered":"2023-10-08T12:45:24.226056+0000","last_unstale":"2023-10-08T12:45:24.228684+0000","last_undegraded":"2023-10-08T12:45:24.228684+0000","last_fullsized":"2023-10-08T12:45:24.228684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210367+0000","last_change":"2023-10-08T12:45:24.210367+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210367+0000","last_undegraded":"2023-10-08T12:45:24.210367+0000","last_fullsized":"2023-10-08T12:45:24.210367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.225639+0000","last_change":"2023-10-08T12:45:24.222786+0000","last_active":"2023-10-08T12:45:24.225639+0000","last_peered":"2023-10-08T12:45:24.225639+0000","last_clean":"2023-10-08T12:45:24.225639+0000","last_became_active":"2023-10-08T12:45:24.222465+0000","last_became_peered":"2023-10-08T12:45:24.222465+0000","last_unstale":"2023-10-08T12:45:24.225639+0000","last_undegraded":"2023-10-08T12:45:24.225639+0000","last_fullsized":"2023-10-08T12:45:24.225639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:08.251593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.219875+0000","last_change":"2023-10-08T12:45:24.219875+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.219875+0000","last_undegraded":"2023-10-08T12:45:24.219875+0000","last_fullsized":"2023-10-08T12:45:24.219875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.223131+0000","last_change":"2023-10-08T12:45:24.221225+0000","last_active":"2023-10-08T12:45:24.223131+0000","last_peered":"2023-10-08T12:45:24.223131+0000","last_clean":"2023-10-08T12:45:24.223131+0000","last_became_active":"2023-10-08T12:45:24.220465+0000","last_became_peered":"2023-10-08T12:45:24.220465+0000","last_unstale":"2023-10-08T12:45:24.223131+0000","last_undegraded":"2023-10-08T12:45:24.223131+0000","last_fullsized":"2023-10-08T12:45:24.223131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:08.251593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210495+0000","last_change":"2023-10-08T12:45:24.210495+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210495+0000","last_undegraded":"2023-10-08T12:45:24.210495+0000","last_fullsized":"2023-10-08T12:45:24.210495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.224486+0000","last_change":"2023-10-08T12:45:24.223071+0000","last_active":"2023-10-08T12:45:24.224486+0000","last_peered":"2023-10-08T12:45:24.224486+0000","last_clean":"2023-10-08T12:45:24.224486+0000","last_became_active":"2023-10-08T12:45:24.222681+0000","last_became_peered":"2023-10-08T12:45:24.222681+0000","last_unstale":"2023-10-08T12:45:24.224486+0000","last_undegraded":"2023-10-08T12:45:24.224486+0000","last_fullsized":"2023-10-08T12:45:24.224486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213378+0000","last_change":"2023-10-08T12:45:24.213378+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213378+0000","last_undegraded":"2023-10-08T12:45:24.213378+0000","last_fullsized":"2023-10-08T12:45:24.213378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.224558+0000","last_change":"2023-10-08T12:45:24.220892+0000","last_active":"2023-10-08T12:45:24.224558+0000","last_peered":"2023-10-08T12:45:24.224558+0000","last_clean":"2023-10-08T12:45:24.224558+0000","last_became_active":"2023-10-08T12:45:24.220573+0000","last_became_peered":"2023-10-08T12:45:24.220573+0000","last_unstale":"2023-10-08T12:45:24.224558+0000","last_undegraded":"2023-10-08T12:45:24.224558+0000","last_fullsized":"2023-10-08T12:45:24.224558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:28.393554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213240+0000","last_change":"2023-10-08T12:45:24.213240+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213240+0000","last_undegraded":"2023-10-08T12:45:24.213240+0000","last_fullsized":"2023-10-08T12:45:24.213240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.226948+0000","last_change":"2023-10-08T12:45:24.225777+0000","last_active":"2023-10-08T12:45:24.226948+0000","last_peered":"2023-10-08T12:45:24.226948+0000","last_clean":"2023-10-08T12:45:24.226948+0000","last_became_active":"2023-10-08T12:45:24.225472+0000","last_became_peered":"2023-10-08T12:45:24.225472+0000","last_unstale":"2023-10-08T12:45:24.226948+0000","last_undegraded":"2023-10-08T12:45:24.226948+0000","last_fullsized":"2023-10-08T12:45:24.226948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:15.170657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213636+0000","last_change":"2023-10-08T12:45:24.213636+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213636+0000","last_undegraded":"2023-10-08T12:45:24.213636+0000","last_fullsized":"2023-10-08T12:45:24.213636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.225971+0000","last_change":"2023-10-08T12:45:24.222110+0000","last_active":"2023-10-08T12:45:24.225971+0000","last_peered":"2023-10-08T12:45:24.225971+0000","last_clean":"2023-10-08T12:45:24.225971+0000","last_became_active":"2023-10-08T12:45:24.221768+0000","last_became_peered":"2023-10-08T12:45:24.221768+0000","last_unstale":"2023-10-08T12:45:24.225971+0000","last_undegraded":"2023-10-08T12:45:24.225971+0000","last_fullsized":"2023-10-08T12:45:24.225971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.216619+0000","last_change":"2023-10-08T12:45:24.216619+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.216619+0000","last_undegraded":"2023-10-08T12:45:24.216619+0000","last_fullsized":"2023-10-08T12:45:24.216619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.228635+0000","last_change":"2023-10-08T12:45:24.225910+0000","last_active":"2023-10-08T12:45:24.228635+0000","last_peered":"2023-10-08T12:45:24.228635+0000","last_clean":"2023-10-08T12:45:24.228635+0000","last_became_active":"2023-10-08T12:45:24.225590+0000","last_became_peered":"2023-10-08T12:45:24.225590+0000","last_unstale":"2023-10-08T12:45:24.228635+0000","last_undegraded":"2023-10-08T12:45:24.228635+0000","last_fullsized":"2023-10-08T12:45:24.228635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:15.170657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213456+0000","last_change":"2023-10-08T12:45:24.213456+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213456+0000","last_undegraded":"2023-10-08T12:45:24.213456+0000","last_fullsized":"2023-10-08T12:45:24.213456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.228742+0000","last_change":"2023-10-08T12:45:24.226194+0000","last_active":"2023-10-08T12:45:24.228742+0000","last_peered":"2023-10-08T12:45:24.228742+0000","last_clean":"2023-10-08T12:45:24.228742+0000","last_became_active":"2023-10-08T12:45:24.225901+0000","last_became_peered":"2023-10-08T12:45:24.225901+0000","last_unstale":"2023-10-08T12:45:24.228742+0000","last_undegraded":"2023-10-08T12:45:24.228742+0000","last_fullsized":"2023-10-08T12:45:24.228742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:15.170657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210301+0000","last_change":"2023-10-08T12:45:24.210301+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210301+0000","last_undegraded":"2023-10-08T12:45:24.210301+0000","last_fullsized":"2023-10-08T12:45:24.210301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.217923+0000","last_change":"2023-10-08T12:45:24.217923+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.217923+0000","last_undegraded":"2023-10-08T12:45:24.217923+0000","last_fullsized":"2023-10-08T12:45:24.217923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.218628+0000","last_change":"2023-10-08T12:45:24.216886+0000","last_active":"2023-10-08T12:45:24.218628+0000","last_peered":"2023-10-08T12:45:24.218628+0000","last_clean":"2023-10-08T12:45:24.218628+0000","last_became_active":"2023-10-08T12:45:24.216435+0000","last_became_peered":"2023-10-08T12:45:24.216435+0000","last_unstale":"2023-10-08T12:45:24.218628+0000","last_undegraded":"2023-10-08T12:45:24.218628+0000","last_fullsized":"2023-10-08T12:45:24.218628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:08.251593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.209282+0000","last_change":"2023-10-08T12:45:24.209282+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.209282+0000","last_undegraded":"2023-10-08T12:45:24.209282+0000","last_fullsized":"2023-10-08T12:45:24.209282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.221461+0000","last_change":"2023-10-08T12:45:24.218750+0000","last_active":"2023-10-08T12:45:24.221461+0000","last_peered":"2023-10-08T12:45:24.221461+0000","last_clean":"2023-10-08T12:45:24.221461+0000","last_became_active":"2023-10-08T12:45:24.218402+0000","last_became_peered":"2023-10-08T12:45:24.218402+0000","last_unstale":"2023-10-08T12:45:24.221461+0000","last_undegraded":"2023-10-08T12:45:24.221461+0000","last_fullsized":"2023-10-08T12:45:24.221461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:08.251593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":163,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.221448+0000","last_change":"2023-10-08T12:45:21.094571+0000","last_active":"2023-10-08T12:45:24.221448+0000","last_peered":"2023-10-08T12:45:24.221448+0000","last_clean":"2023-10-08T12:45:24.221448+0000","last_became_active":"2023-10-08T12:45:21.093551+0000","last_became_peered":"2023-10-08T12:45:21.093551+0000","last_unstale":"2023-10-08T12:45:24.221448+0000","last_undegraded":"2023-10-08T12:45:24.221448+0000","last_fullsized":"2023-10-08T12:45:24.221448+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:19.842786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:19.842786+0000","last_clean_scrub_stamp":"2023-10-08T12:45:19.842786+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:25.041743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.209841+0000","last_change":"2023-10-08T12:45:24.209841+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.209841+0000","last_undegraded":"2023-10-08T12:45:24.209841+0000","last_fullsized":"2023-10-08T12:45:24.209841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.234531+0000","last_change":"2023-10-08T12:45:24.229708+0000","last_active":"2023-10-08T12:45:24.234531+0000","last_peered":"2023-10-08T12:45:24.234531+0000","last_clean":"2023-10-08T12:45:24.234531+0000","last_became_active":"2023-10-08T12:45:24.229494+0000","last_became_peered":"2023-10-08T12:45:24.229494+0000","last_unstale":"2023-10-08T12:45:24.234531+0000","last_undegraded":"2023-10-08T12:45:24.234531+0000","last_fullsized":"2023-10-08T12:45:24.234531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:15.170657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.234464+0000","last_change":"2023-10-08T12:45:24.229122+0000","last_active":"2023-10-08T12:45:24.234464+0000","last_peered":"2023-10-08T12:45:24.234464+0000","last_clean":"2023-10-08T12:45:24.234464+0000","last_became_active":"2023-10-08T12:45:24.228838+0000","last_became_peered":"2023-10-08T12:45:24.228838+0000","last_unstale":"2023-10-08T12:45:24.234464+0000","last_undegraded":"2023-10-08T12:45:24.234464+0000","last_fullsized":"2023-10-08T12:45:24.234464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:19:36.620765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.219902+0000","last_change":"2023-10-08T12:45:24.219902+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.219902+0000","last_undegraded":"2023-10-08T12:45:24.219902+0000","last_fullsized":"2023-10-08T12:45:24.219902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.229064+0000","last_change":"2023-10-08T12:45:24.226993+0000","last_active":"2023-10-08T12:45:24.229064+0000","last_peered":"2023-10-08T12:45:24.229064+0000","last_clean":"2023-10-08T12:45:24.229064+0000","last_became_active":"2023-10-08T12:45:24.226721+0000","last_became_peered":"2023-10-08T12:45:24.226721+0000","last_unstale":"2023-10-08T12:45:24.229064+0000","last_undegraded":"2023-10-08T12:45:24.229064+0000","last_fullsized":"2023-10-08T12:45:24.229064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:03:57.184403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.209710+0000","last_change":"2023-10-08T12:45:24.209710+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.209710+0000","last_undegraded":"2023-10-08T12:45:24.209710+0000","last_fullsized":"2023-10-08T12:45:24.209710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.234227+0000","last_change":"2023-10-08T12:45:24.229198+0000","last_active":"2023-10-08T12:45:24.234227+0000","last_peered":"2023-10-08T12:45:24.234227+0000","last_clean":"2023-10-08T12:45:24.234227+0000","last_became_active":"2023-10-08T12:45:24.228922+0000","last_became_peered":"2023-10-08T12:45:24.228922+0000","last_unstale":"2023-10-08T12:45:24.234227+0000","last_undegraded":"2023-10-08T12:45:24.234227+0000","last_fullsized":"2023-10-08T12:45:24.234227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:23.245919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.209913+0000","last_change":"2023-10-08T12:45:24.209913+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.209913+0000","last_undegraded":"2023-10-08T12:45:24.209913+0000","last_fullsized":"2023-10-08T12:45:24.209913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.231553+0000","last_change":"2023-10-08T12:45:24.228202+0000","last_active":"2023-10-08T12:45:24.231553+0000","last_peered":"2023-10-08T12:45:24.231553+0000","last_clean":"2023-10-08T12:45:24.231553+0000","last_became_active":"2023-10-08T12:45:24.227988+0000","last_became_peered":"2023-10-08T12:45:24.227988+0000","last_unstale":"2023-10-08T12:45:24.231553+0000","last_undegraded":"2023-10-08T12:45:24.231553+0000","last_fullsized":"2023-10-08T12:45:24.231553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210282+0000","last_change":"2023-10-08T12:45:24.210282+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210282+0000","last_undegraded":"2023-10-08T12:45:24.210282+0000","last_fullsized":"2023-10-08T12:45:24.210282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.229119+0000","last_change":"2023-10-08T12:45:24.228028+0000","last_active":"2023-10-08T12:45:24.229119+0000","last_peered":"2023-10-08T12:45:24.229119+0000","last_clean":"2023-10-08T12:45:24.229119+0000","last_became_active":"2023-10-08T12:45:24.227739+0000","last_became_peered":"2023-10-08T12:45:24.227739+0000","last_unstale":"2023-10-08T12:45:24.229119+0000","last_undegraded":"2023-10-08T12:45:24.229119+0000","last_fullsized":"2023-10-08T12:45:24.229119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:23.245919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.209625+0000","last_change":"2023-10-08T12:45:24.209625+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.209625+0000","last_undegraded":"2023-10-08T12:45:24.209625+0000","last_fullsized":"2023-10-08T12:45:24.209625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.227316+0000","last_change":"2023-10-08T12:45:24.222491+0000","last_active":"2023-10-08T12:45:24.227316+0000","last_peered":"2023-10-08T12:45:24.227316+0000","last_clean":"2023-10-08T12:45:24.227316+0000","last_became_active":"2023-10-08T12:45:24.222266+0000","last_became_peered":"2023-10-08T12:45:24.222266+0000","last_unstale":"2023-10-08T12:45:24.227316+0000","last_undegraded":"2023-10-08T12:45:24.227316+0000","last_fullsized":"2023-10-08T12:45:24.227316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:28.393554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210719+0000","last_change":"2023-10-08T12:45:24.210719+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210719+0000","last_undegraded":"2023-10-08T12:45:24.210719+0000","last_fullsized":"2023-10-08T12:45:24.210719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.231530+0000","last_change":"2023-10-08T12:45:24.227674+0000","last_active":"2023-10-08T12:45:24.231530+0000","last_peered":"2023-10-08T12:45:24.231530+0000","last_clean":"2023-10-08T12:45:24.231530+0000","last_became_active":"2023-10-08T12:45:24.227376+0000","last_became_peered":"2023-10-08T12:45:24.227376+0000","last_unstale":"2023-10-08T12:45:24.231530+0000","last_undegraded":"2023-10-08T12:45:24.231530+0000","last_fullsized":"2023-10-08T12:45:24.231530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:23.245919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.215552+0000","last_change":"2023-10-08T12:45:24.215552+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.215552+0000","last_undegraded":"2023-10-08T12:45:24.215552+0000","last_fullsized":"2023-10-08T12:45:24.215552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.218592+0000","last_change":"2023-10-08T12:45:24.215676+0000","last_active":"2023-10-08T12:45:24.218592+0000","last_peered":"2023-10-08T12:45:24.218592+0000","last_clean":"2023-10-08T12:45:24.218592+0000","last_became_active":"2023-10-08T12:45:24.215332+0000","last_became_peered":"2023-10-08T12:45:24.215332+0000","last_unstale":"2023-10-08T12:45:24.218592+0000","last_undegraded":"2023-10-08T12:45:24.218592+0000","last_fullsized":"2023-10-08T12:45:24.218592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213956+0000","last_change":"2023-10-08T12:45:24.213956+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213956+0000","last_undegraded":"2023-10-08T12:45:24.213956+0000","last_fullsized":"2023-10-08T12:45:24.213956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.226783+0000","last_change":"2023-10-08T12:45:24.220654+0000","last_active":"2023-10-08T12:45:24.226783+0000","last_peered":"2023-10-08T12:45:24.226783+0000","last_clean":"2023-10-08T12:45:24.226783+0000","last_became_active":"2023-10-08T12:45:24.220367+0000","last_became_peered":"2023-10-08T12:45:24.220367+0000","last_unstale":"2023-10-08T12:45:24.226783+0000","last_undegraded":"2023-10-08T12:45:24.226783+0000","last_fullsized":"2023-10-08T12:45:24.226783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:08.251593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.211647+0000","last_change":"2023-10-08T12:45:24.211647+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.211647+0000","last_undegraded":"2023-10-08T12:45:24.211647+0000","last_fullsized":"2023-10-08T12:45:24.211647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.218617+0000","last_change":"2023-10-08T12:45:24.216389+0000","last_active":"2023-10-08T12:45:24.218617+0000","last_peered":"2023-10-08T12:45:24.218617+0000","last_clean":"2023-10-08T12:45:24.218617+0000","last_became_active":"2023-10-08T12:45:24.216111+0000","last_became_peered":"2023-10-08T12:45:24.216111+0000","last_unstale":"2023-10-08T12:45:24.218617+0000","last_undegraded":"2023-10-08T12:45:24.218617+0000","last_fullsized":"2023-10-08T12:45:24.218617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:28.393554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.214398+0000","last_change":"2023-10-08T12:45:24.214398+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.214398+0000","last_undegraded":"2023-10-08T12:45:24.214398+0000","last_fullsized":"2023-10-08T12:45:24.214398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213834+0000","last_change":"2023-10-08T12:45:24.213834+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213834+0000","last_undegraded":"2023-10-08T12:45:24.213834+0000","last_fullsized":"2023-10-08T12:45:24.213834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.208467+0000","last_change":"2023-10-08T12:45:24.208467+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.208467+0000","last_undegraded":"2023-10-08T12:45:24.208467+0000","last_fullsized":"2023-10-08T12:45:24.208467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.212366+0000","last_change":"2023-10-08T12:45:24.212366+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.212366+0000","last_undegraded":"2023-10-08T12:45:24.212366+0000","last_fullsized":"2023-10-08T12:45:24.212366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.211571+0000","last_change":"2023-10-08T12:45:24.211571+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.211571+0000","last_undegraded":"2023-10-08T12:45:24.211571+0000","last_fullsized":"2023-10-08T12:45:24.211571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213860+0000","last_change":"2023-10-08T12:45:24.213860+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213860+0000","last_undegraded":"2023-10-08T12:45:24.213860+0000","last_fullsized":"2023-10-08T12:45:24.213860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.218858+0000","last_change":"2023-10-08T12:45:24.218858+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.218858+0000","last_undegraded":"2023-10-08T12:45:24.218858+0000","last_fullsized":"2023-10-08T12:45:24.218858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.216612+0000","last_change":"2023-10-08T12:45:24.216612+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.216612+0000","last_undegraded":"2023-10-08T12:45:24.216612+0000","last_fullsized":"2023-10-08T12:45:24.216612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.212770+0000","last_change":"2023-10-08T12:45:24.212770+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.212770+0000","last_undegraded":"2023-10-08T12:45:24.212770+0000","last_fullsized":"2023-10-08T12:45:24.212770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210381+0000","last_change":"2023-10-08T12:45:24.210381+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210381+0000","last_undegraded":"2023-10-08T12:45:24.210381+0000","last_fullsized":"2023-10-08T12:45:24.210381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213760+0000","last_change":"2023-10-08T12:45:24.213760+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213760+0000","last_undegraded":"2023-10-08T12:45:24.213760+0000","last_fullsized":"2023-10-08T12:45:24.213760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.212940+0000","last_change":"2023-10-08T12:45:24.212940+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.212940+0000","last_undegraded":"2023-10-08T12:45:24.212940+0000","last_fullsized":"2023-10-08T12:45:24.212940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.212268+0000","last_change":"2023-10-08T12:45:24.212268+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.212268+0000","last_undegraded":"2023-10-08T12:45:24.212268+0000","last_fullsized":"2023-10-08T12:45:24.212268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.215024+0000","last_change":"2023-10-08T12:45:24.215024+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.215024+0000","last_undegraded":"2023-10-08T12:45:24.215024+0000","last_fullsized":"2023-10-08T12:45:24.215024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":774144,"data_stored":648191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":774144,"data_stored":648191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:45:29.774 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T12:45:29.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.933+0000 7f4c2fdda700 1 -- 172.21.15.45:0/2248702531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c281420a0 msgr2=0x7f4c280b3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:29.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.933+0000 7f4c2fdda700 1 --2- 172.21.15.45:0/2248702531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c281420a0 0x7f4c280b3400 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4c24005fd0 tx=0x7f4c24009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:29.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.933+0000 7f4c2fdda700 1 -- 172.21.15.45:0/2248702531 shutdown_connections 2023-10-08T12:45:29.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.933+0000 7f4c2fdda700 1 --2- 172.21.15.45:0/2248702531 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4c2806c820 0x7f4c2806cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:29.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.933+0000 7f4c2fdda700 1 --2- 172.21.15.45:0/2248702531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c281420a0 0x7f4c280b3400 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:29.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.933+0000 7f4c2fdda700 1 -- 172.21.15.45:0/2248702531 >> 172.21.15.45:0/2248702531 conn(0x7f4c2806a210 msgr2=0x7f4c2806a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:29.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.933+0000 7f4c2fdda700 1 -- 172.21.15.45:0/2248702531 shutdown_connections 2023-10-08T12:45:29.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.933+0000 7f4c2fdda700 1 -- 172.21.15.45:0/2248702531 wait complete. 2023-10-08T12:45:29.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.935+0000 7f4c2fdda700 1 Processor -- start 2023-10-08T12:45:29.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.935+0000 7f4c2fdda700 1 -- start start 2023-10-08T12:45:29.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.936+0000 7f4c2fdda700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c2806c820 0x7f4c2813f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:29.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.936+0000 7f4c2fdda700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4c280cc880 0x7f4c280a94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:29.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.936+0000 7f4c2fdda700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c281420a0 0x7f4c2815b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:29.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.936+0000 7f4c2fdda700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c281eefa0 con 0x7f4c281420a0 2023-10-08T12:45:29.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.936+0000 7f4c2fdda700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c280aa7e0 con 0x7f4c2806c820 2023-10-08T12:45:29.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.936+0000 7f4c2fdda700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c280a9f60 con 0x7f4c280cc880 2023-10-08T12:45:29.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.936+0000 7f4c2e377700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c281420a0 0x7f4c2815b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:29.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.936+0000 7f4c2e377700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c281420a0 0x7f4c2815b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34934/0 (socket says 172.21.15.45:34934) 2023-10-08T12:45:29.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.936+0000 7f4c2e377700 1 -- 172.21.15.45:0/1934858020 learned_addr learned my addr 172.21.15.45:0/1934858020 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:29.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.936+0000 7f4c2db76700 1 --2- 172.21.15.45:0/1934858020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c2806c820 0x7f4c2813f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:29.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.936+0000 7f4c2d375700 1 --2- 172.21.15.45:0/1934858020 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4c280cc880 0x7f4c280a94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:29.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.936+0000 7f4c2e377700 1 -- 172.21.15.45:0/1934858020 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4c280cc880 msgr2=0x7f4c280a94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:29.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.936+0000 7f4c2e377700 1 --2- 172.21.15.45:0/1934858020 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4c280cc880 0x7f4c280a94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:29.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.936+0000 7f4c2e377700 1 -- 172.21.15.45:0/1934858020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c2806c820 msgr2=0x7f4c2813f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:29.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.936+0000 7f4c2e377700 1 --2- 172.21.15.45:0/1934858020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c2806c820 0x7f4c2813f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:29.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.936+0000 7f4c2e377700 1 -- 172.21.15.45:0/1934858020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c240095f0 con 0x7f4c281420a0 2023-10-08T12:45:29.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.936+0000 7f4c2db76700 1 --2- 172.21.15.45:0/1934858020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c2806c820 0x7f4c2813f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:45:29.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.936+0000 7f4c2e377700 1 --2- 172.21.15.45:0/1934858020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c281420a0 0x7f4c2815b170 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000efb0 tx=0x7f4c2000c600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:29.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.936+0000 7f4c1e7fc700 1 -- 172.21.15.45:0/1934858020 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c20011670 con 0x7f4c281420a0 2023-10-08T12:45:29.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.936+0000 7f4c1e7fc700 1 -- 172.21.15.45:0/1934858020 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4c200118c0 con 0x7f4c281420a0 2023-10-08T12:45:29.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.936+0000 7f4c1e7fc700 1 -- 172.21.15.45:0/1934858020 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c20011cd0 con 0x7f4c281420a0 2023-10-08T12:45:29.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.936+0000 7f4c2fdda700 1 -- 172.21.15.45:0/1934858020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c280aa240 con 0x7f4c281420a0 2023-10-08T12:45:29.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.937+0000 7f4c2fdda700 1 -- 172.21.15.45:0/1934858020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c280af630 con 0x7f4c281420a0 2023-10-08T12:45:29.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.938+0000 7f4c2fdda700 1 -- 172.21.15.45:0/1934858020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c28140e20 con 0x7f4c281420a0 2023-10-08T12:45:29.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.938+0000 7f4c1e7fc700 1 -- 172.21.15.45:0/1934858020 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4c200103d0 con 0x7f4c281420a0 2023-10-08T12:45:29.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.939+0000 7f4c1e7fc700 1 --2- 172.21.15.45:0/1934858020 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4c0c06aed0 0x7f4c0c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:29.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.939+0000 7f4c1e7fc700 1 -- 172.21.15.45:0/1934858020 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c2008c470 con 0x7f4c281420a0 2023-10-08T12:45:29.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.939+0000 7f4c2db76700 1 --2- 172.21.15.45:0/1934858020 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4c0c06aed0 0x7f4c0c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:29.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.939+0000 7f4c2db76700 1 --2- 172.21.15.45:0/1934858020 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4c0c06aed0 0x7f4c0c06d390 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4c240098e0 tx=0x7f4c24011040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:29.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:29.943+0000 7f4c1e7fc700 1 -- 172.21.15.45:0/1934858020 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4c200575b0 con 0x7f4c281420a0 2023-10-08T12:45:30.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.138+0000 7f4c2fdda700 1 -- 172.21.15.45:0/1934858020 --> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4c280aa660 con 0x7f4c0c06aed0 2023-10-08T12:45:30.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.146+0000 7f4c1e7fc700 1 -- 172.21.15.45:0/1934858020 <== mgr.4105 v2:172.21.15.78:6832/3438117854 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+259283 (secure 0 0 0) 0x7f4c24004a10 con 0x7f4c0c06aed0 2023-10-08T12:45:30.149 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:30.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.148+0000 7f4c2fdda700 1 -- 172.21.15.45:0/1934858020 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4c0c06aed0 msgr2=0x7f4c0c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:30.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.148+0000 7f4c2fdda700 1 --2- 172.21.15.45:0/1934858020 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4c0c06aed0 0x7f4c0c06d390 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4c240098e0 tx=0x7f4c24011040 comp rx=0 tx=0).stop 2023-10-08T12:45:30.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.148+0000 7f4c2fdda700 1 -- 172.21.15.45:0/1934858020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c281420a0 msgr2=0x7f4c2815b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:30.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.148+0000 7f4c2fdda700 1 --2- 172.21.15.45:0/1934858020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c281420a0 0x7f4c2815b170 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000efb0 tx=0x7f4c2000c600 comp rx=0 tx=0).stop 2023-10-08T12:45:30.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.149+0000 7f4c2fdda700 1 -- 172.21.15.45:0/1934858020 shutdown_connections 2023-10-08T12:45:30.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.149+0000 7f4c2fdda700 1 --2- 172.21.15.45:0/1934858020 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4c0c06aed0 0x7f4c0c06d390 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:30.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.149+0000 7f4c2fdda700 1 --2- 172.21.15.45:0/1934858020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c281420a0 0x7f4c2815b170 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:30.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.149+0000 7f4c2fdda700 1 --2- 172.21.15.45:0/1934858020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c2806c820 0x7f4c2813f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:30.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.149+0000 7f4c2fdda700 1 --2- 172.21.15.45:0/1934858020 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4c280cc880 0x7f4c280a94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:30.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.149+0000 7f4c2fdda700 1 -- 172.21.15.45:0/1934858020 >> 172.21.15.45:0/1934858020 conn(0x7f4c2806a210 msgr2=0x7f4c28140230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:30.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.149+0000 7f4c2fdda700 1 -- 172.21.15.45:0/1934858020 shutdown_connections 2023-10-08T12:45:30.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.149+0000 7f4c2fdda700 1 -- 172.21.15.45:0/1934858020 wait complete. 2023-10-08T12:45:30.154 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-08T12:45:30.162 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-08T12:45:29.128025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218744,"kb_used_data":2568,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755976,"statfs":{"total":773094113280,"available":772870119424,"internally_reserved":0,"allocated":2629632,"data_stored":1643320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001269"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.217479+0000","last_change":"2023-10-08T12:45:24.217479+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.217479+0000","last_undegraded":"2023-10-08T12:45:24.217479+0000","last_fullsized":"2023-10-08T12:45:24.217479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.217377+0000","last_change":"2023-10-08T12:45:24.217377+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.217377+0000","last_undegraded":"2023-10-08T12:45:24.217377+0000","last_fullsized":"2023-10-08T12:45:24.217377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210475+0000","last_change":"2023-10-08T12:45:24.210475+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210475+0000","last_undegraded":"2023-10-08T12:45:24.210475+0000","last_fullsized":"2023-10-08T12:45:24.210475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.211204+0000","last_change":"2023-10-08T12:45:24.211204+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.211204+0000","last_undegraded":"2023-10-08T12:45:24.211204+0000","last_fullsized":"2023-10-08T12:45:24.211204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.218087+0000","last_change":"2023-10-08T12:45:24.218087+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.218087+0000","last_undegraded":"2023-10-08T12:45:24.218087+0000","last_fullsized":"2023-10-08T12:45:24.218087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213469+0000","last_change":"2023-10-08T12:45:24.213469+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213469+0000","last_undegraded":"2023-10-08T12:45:24.213469+0000","last_fullsized":"2023-10-08T12:45:24.213469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.216581+0000","last_change":"2023-10-08T12:45:24.216581+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.216581+0000","last_undegraded":"2023-10-08T12:45:24.216581+0000","last_fullsized":"2023-10-08T12:45:24.216581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213458+0000","last_change":"2023-10-08T12:45:24.213458+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213458+0000","last_undegraded":"2023-10-08T12:45:24.213458+0000","last_fullsized":"2023-10-08T12:45:24.213458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.216999+0000","last_change":"2023-10-08T12:45:24.216999+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.216999+0000","last_undegraded":"2023-10-08T12:45:24.216999+0000","last_fullsized":"2023-10-08T12:45:24.216999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.214181+0000","last_change":"2023-10-08T12:45:24.214181+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.214181+0000","last_undegraded":"2023-10-08T12:45:24.214181+0000","last_fullsized":"2023-10-08T12:45:24.214181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.215422+0000","last_change":"2023-10-08T12:45:24.215422+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.215422+0000","last_undegraded":"2023-10-08T12:45:24.215422+0000","last_fullsized":"2023-10-08T12:45:24.215422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210890+0000","last_change":"2023-10-08T12:45:24.210890+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210890+0000","last_undegraded":"2023-10-08T12:45:24.210890+0000","last_fullsized":"2023-10-08T12:45:24.210890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213162+0000","last_change":"2023-10-08T12:45:24.213162+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213162+0000","last_undegraded":"2023-10-08T12:45:24.213162+0000","last_fullsized":"2023-10-08T12:45:24.213162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.211135+0000","last_change":"2023-10-08T12:45:24.211135+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.211135+0000","last_undegraded":"2023-10-08T12:45:24.211135+0000","last_fullsized":"2023-10-08T12:45:24.211135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.217815+0000","last_change":"2023-10-08T12:45:24.217815+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.217815+0000","last_undegraded":"2023-10-08T12:45:24.217815+0000","last_fullsized":"2023-10-08T12:45:24.217815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.211517+0000","last_change":"2023-10-08T12:45:24.211517+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.211517+0000","last_undegraded":"2023-10-08T12:45:24.211517+0000","last_fullsized":"2023-10-08T12:45:24.211517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213043+0000","last_change":"2023-10-08T12:45:24.213043+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213043+0000","last_undegraded":"2023-10-08T12:45:24.213043+0000","last_fullsized":"2023-10-08T12:45:24.213043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.208356+0000","last_change":"2023-10-08T12:45:24.208356+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.208356+0000","last_undegraded":"2023-10-08T12:45:24.208356+0000","last_fullsized":"2023-10-08T12:45:24.208356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.220371+0000","last_change":"2023-10-08T12:45:24.220371+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.220371+0000","last_undegraded":"2023-10-08T12:45:24.220371+0000","last_fullsized":"2023-10-08T12:45:24.220371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.228806+0000","last_change":"2023-10-08T12:45:24.228061+0000","last_active":"2023-10-08T12:45:24.228806+0000","last_peered":"2023-10-08T12:45:24.228806+0000","last_clean":"2023-10-08T12:45:24.228806+0000","last_became_active":"2023-10-08T12:45:24.227725+0000","last_became_peered":"2023-10-08T12:45:24.227725+0000","last_unstale":"2023-10-08T12:45:24.228806+0000","last_undegraded":"2023-10-08T12:45:24.228806+0000","last_fullsized":"2023-10-08T12:45:24.228806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.212448+0000","last_change":"2023-10-08T12:45:24.212448+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.212448+0000","last_undegraded":"2023-10-08T12:45:24.212448+0000","last_fullsized":"2023-10-08T12:45:24.212448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.227019+0000","last_change":"2023-10-08T12:45:24.224322+0000","last_active":"2023-10-08T12:45:24.227019+0000","last_peered":"2023-10-08T12:45:24.227019+0000","last_clean":"2023-10-08T12:45:24.227019+0000","last_became_active":"2023-10-08T12:45:24.223973+0000","last_became_peered":"2023-10-08T12:45:24.223973+0000","last_unstale":"2023-10-08T12:45:24.227019+0000","last_undegraded":"2023-10-08T12:45:24.227019+0000","last_fullsized":"2023-10-08T12:45:24.227019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.211581+0000","last_change":"2023-10-08T12:45:24.211581+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.211581+0000","last_undegraded":"2023-10-08T12:45:24.211581+0000","last_fullsized":"2023-10-08T12:45:24.211581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.234444+0000","last_change":"2023-10-08T12:45:24.228768+0000","last_active":"2023-10-08T12:45:24.234444+0000","last_peered":"2023-10-08T12:45:24.234444+0000","last_clean":"2023-10-08T12:45:24.234444+0000","last_became_active":"2023-10-08T12:45:24.228469+0000","last_became_peered":"2023-10-08T12:45:24.228469+0000","last_unstale":"2023-10-08T12:45:24.234444+0000","last_undegraded":"2023-10-08T12:45:24.234444+0000","last_fullsized":"2023-10-08T12:45:24.234444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:03:57.184403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.214518+0000","last_change":"2023-10-08T12:45:24.214518+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.214518+0000","last_undegraded":"2023-10-08T12:45:24.214518+0000","last_fullsized":"2023-10-08T12:45:24.214518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.231491+0000","last_change":"2023-10-08T12:45:24.227667+0000","last_active":"2023-10-08T12:45:24.231491+0000","last_peered":"2023-10-08T12:45:24.231491+0000","last_clean":"2023-10-08T12:45:24.231491+0000","last_became_active":"2023-10-08T12:45:24.227346+0000","last_became_peered":"2023-10-08T12:45:24.227346+0000","last_unstale":"2023-10-08T12:45:24.231491+0000","last_undegraded":"2023-10-08T12:45:24.231491+0000","last_fullsized":"2023-10-08T12:45:24.231491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:08.251593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213937+0000","last_change":"2023-10-08T12:45:24.213937+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213937+0000","last_undegraded":"2023-10-08T12:45:24.213937+0000","last_fullsized":"2023-10-08T12:45:24.213937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.228079+0000","last_change":"2023-10-08T12:45:24.225874+0000","last_active":"2023-10-08T12:45:24.228079+0000","last_peered":"2023-10-08T12:45:24.228079+0000","last_clean":"2023-10-08T12:45:24.228079+0000","last_became_active":"2023-10-08T12:45:24.225568+0000","last_became_peered":"2023-10-08T12:45:24.225568+0000","last_unstale":"2023-10-08T12:45:24.228079+0000","last_undegraded":"2023-10-08T12:45:24.228079+0000","last_fullsized":"2023-10-08T12:45:24.228079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:08.251593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210834+0000","last_change":"2023-10-08T12:45:24.210834+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210834+0000","last_undegraded":"2023-10-08T12:45:24.210834+0000","last_fullsized":"2023-10-08T12:45:24.210834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.224588+0000","last_change":"2023-10-08T12:45:24.221289+0000","last_active":"2023-10-08T12:45:24.224588+0000","last_peered":"2023-10-08T12:45:24.224588+0000","last_clean":"2023-10-08T12:45:24.224588+0000","last_became_active":"2023-10-08T12:45:24.220980+0000","last_became_peered":"2023-10-08T12:45:24.220980+0000","last_unstale":"2023-10-08T12:45:24.224588+0000","last_undegraded":"2023-10-08T12:45:24.224588+0000","last_fullsized":"2023-10-08T12:45:24.224588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.211066+0000","last_change":"2023-10-08T12:45:24.211066+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.211066+0000","last_undegraded":"2023-10-08T12:45:24.211066+0000","last_fullsized":"2023-10-08T12:45:24.211066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.227046+0000","last_change":"2023-10-08T12:45:24.223766+0000","last_active":"2023-10-08T12:45:24.227046+0000","last_peered":"2023-10-08T12:45:24.227046+0000","last_clean":"2023-10-08T12:45:24.227046+0000","last_became_active":"2023-10-08T12:45:24.223463+0000","last_became_peered":"2023-10-08T12:45:24.223463+0000","last_unstale":"2023-10-08T12:45:24.227046+0000","last_undegraded":"2023-10-08T12:45:24.227046+0000","last_fullsized":"2023-10-08T12:45:24.227046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:28.393554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.212628+0000","last_change":"2023-10-08T12:45:24.212628+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.212628+0000","last_undegraded":"2023-10-08T12:45:24.212628+0000","last_fullsized":"2023-10-08T12:45:24.212628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.221506+0000","last_change":"2023-10-08T12:45:24.219555+0000","last_active":"2023-10-08T12:45:24.221506+0000","last_peered":"2023-10-08T12:45:24.221506+0000","last_clean":"2023-10-08T12:45:24.221506+0000","last_became_active":"2023-10-08T12:45:24.219262+0000","last_became_peered":"2023-10-08T12:45:24.219262+0000","last_unstale":"2023-10-08T12:45:24.221506+0000","last_undegraded":"2023-10-08T12:45:24.221506+0000","last_fullsized":"2023-10-08T12:45:24.221506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:28.393554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.216049+0000","last_change":"2023-10-08T12:45:24.216049+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.216049+0000","last_undegraded":"2023-10-08T12:45:24.216049+0000","last_fullsized":"2023-10-08T12:45:24.216049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.225678+0000","last_change":"2023-10-08T12:45:24.224004+0000","last_active":"2023-10-08T12:45:24.225678+0000","last_peered":"2023-10-08T12:45:24.225678+0000","last_clean":"2023-10-08T12:45:24.225678+0000","last_became_active":"2023-10-08T12:45:24.223726+0000","last_became_peered":"2023-10-08T12:45:24.223726+0000","last_unstale":"2023-10-08T12:45:24.225678+0000","last_undegraded":"2023-10-08T12:45:24.225678+0000","last_fullsized":"2023-10-08T12:45:24.225678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:15.170657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213312+0000","last_change":"2023-10-08T12:45:24.213312+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213312+0000","last_undegraded":"2023-10-08T12:45:24.213312+0000","last_fullsized":"2023-10-08T12:45:24.213312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.228866+0000","last_change":"2023-10-08T12:45:24.226086+0000","last_active":"2023-10-08T12:45:24.228866+0000","last_peered":"2023-10-08T12:45:24.228866+0000","last_clean":"2023-10-08T12:45:24.228866+0000","last_became_active":"2023-10-08T12:45:24.225807+0000","last_became_peered":"2023-10-08T12:45:24.225807+0000","last_unstale":"2023-10-08T12:45:24.228866+0000","last_undegraded":"2023-10-08T12:45:24.228866+0000","last_fullsized":"2023-10-08T12:45:24.228866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:23.245919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210977+0000","last_change":"2023-10-08T12:45:24.210977+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210977+0000","last_undegraded":"2023-10-08T12:45:24.210977+0000","last_fullsized":"2023-10-08T12:45:24.210977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.228684+0000","last_change":"2023-10-08T12:45:24.226329+0000","last_active":"2023-10-08T12:45:24.228684+0000","last_peered":"2023-10-08T12:45:24.228684+0000","last_clean":"2023-10-08T12:45:24.228684+0000","last_became_active":"2023-10-08T12:45:24.226056+0000","last_became_peered":"2023-10-08T12:45:24.226056+0000","last_unstale":"2023-10-08T12:45:24.228684+0000","last_undegraded":"2023-10-08T12:45:24.228684+0000","last_fullsized":"2023-10-08T12:45:24.228684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210367+0000","last_change":"2023-10-08T12:45:24.210367+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210367+0000","last_undegraded":"2023-10-08T12:45:24.210367+0000","last_fullsized":"2023-10-08T12:45:24.210367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.225639+0000","last_change":"2023-10-08T12:45:24.222786+0000","last_active":"2023-10-08T12:45:24.225639+0000","last_peered":"2023-10-08T12:45:24.225639+0000","last_clean":"2023-10-08T12:45:24.225639+0000","last_became_active":"2023-10-08T12:45:24.222465+0000","last_became_peered":"2023-10-08T12:45:24.222465+0000","last_unstale":"2023-10-08T12:45:24.225639+0000","last_undegraded":"2023-10-08T12:45:24.225639+0000","last_fullsized":"2023-10-08T12:45:24.225639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:08.251593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.219875+0000","last_change":"2023-10-08T12:45:24.219875+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.219875+0000","last_undegraded":"2023-10-08T12:45:24.219875+0000","last_fullsized":"2023-10-08T12:45:24.219875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.223131+0000","last_change":"2023-10-08T12:45:24.221225+0000","last_active":"2023-10-08T12:45:24.223131+0000","last_peered":"2023-10-08T12:45:24.223131+0000","last_clean":"2023-10-08T12:45:24.223131+0000","last_became_active":"2023-10-08T12:45:24.220465+0000","last_became_peered":"2023-10-08T12:45:24.220465+0000","last_unstale":"2023-10-08T12:45:24.223131+0000","last_undegraded":"2023-10-08T12:45:24.223131+0000","last_fullsized":"2023-10-08T12:45:24.223131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:08.251593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210495+0000","last_change":"2023-10-08T12:45:24.210495+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210495+0000","last_undegraded":"2023-10-08T12:45:24.210495+0000","last_fullsized":"2023-10-08T12:45:24.210495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.224486+0000","last_change":"2023-10-08T12:45:24.223071+0000","last_active":"2023-10-08T12:45:24.224486+0000","last_peered":"2023-10-08T12:45:24.224486+0000","last_clean":"2023-10-08T12:45:24.224486+0000","last_became_active":"2023-10-08T12:45:24.222681+0000","last_became_peered":"2023-10-08T12:45:24.222681+0000","last_unstale":"2023-10-08T12:45:24.224486+0000","last_undegraded":"2023-10-08T12:45:24.224486+0000","last_fullsized":"2023-10-08T12:45:24.224486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213378+0000","last_change":"2023-10-08T12:45:24.213378+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213378+0000","last_undegraded":"2023-10-08T12:45:24.213378+0000","last_fullsized":"2023-10-08T12:45:24.213378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.224558+0000","last_change":"2023-10-08T12:45:24.220892+0000","last_active":"2023-10-08T12:45:24.224558+0000","last_peered":"2023-10-08T12:45:24.224558+0000","last_clean":"2023-10-08T12:45:24.224558+0000","last_became_active":"2023-10-08T12:45:24.220573+0000","last_became_peered":"2023-10-08T12:45:24.220573+0000","last_unstale":"2023-10-08T12:45:24.224558+0000","last_undegraded":"2023-10-08T12:45:24.224558+0000","last_fullsized":"2023-10-08T12:45:24.224558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:28.393554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213240+0000","last_change":"2023-10-08T12:45:24.213240+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213240+0000","last_undegraded":"2023-10-08T12:45:24.213240+0000","last_fullsized":"2023-10-08T12:45:24.213240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.226948+0000","last_change":"2023-10-08T12:45:24.225777+0000","last_active":"2023-10-08T12:45:24.226948+0000","last_peered":"2023-10-08T12:45:24.226948+0000","last_clean":"2023-10-08T12:45:24.226948+0000","last_became_active":"2023-10-08T12:45:24.225472+0000","last_became_peered":"2023-10-08T12:45:24.225472+0000","last_unstale":"2023-10-08T12:45:24.226948+0000","last_undegraded":"2023-10-08T12:45:24.226948+0000","last_fullsized":"2023-10-08T12:45:24.226948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:15.170657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213636+0000","last_change":"2023-10-08T12:45:24.213636+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213636+0000","last_undegraded":"2023-10-08T12:45:24.213636+0000","last_fullsized":"2023-10-08T12:45:24.213636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.225971+0000","last_change":"2023-10-08T12:45:24.222110+0000","last_active":"2023-10-08T12:45:24.225971+0000","last_peered":"2023-10-08T12:45:24.225971+0000","last_clean":"2023-10-08T12:45:24.225971+0000","last_became_active":"2023-10-08T12:45:24.221768+0000","last_became_peered":"2023-10-08T12:45:24.221768+0000","last_unstale":"2023-10-08T12:45:24.225971+0000","last_undegraded":"2023-10-08T12:45:24.225971+0000","last_fullsized":"2023-10-08T12:45:24.225971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.216619+0000","last_change":"2023-10-08T12:45:24.216619+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.216619+0000","last_undegraded":"2023-10-08T12:45:24.216619+0000","last_fullsized":"2023-10-08T12:45:24.216619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.228635+0000","last_change":"2023-10-08T12:45:24.225910+0000","last_active":"2023-10-08T12:45:24.228635+0000","last_peered":"2023-10-08T12:45:24.228635+0000","last_clean":"2023-10-08T12:45:24.228635+0000","last_became_active":"2023-10-08T12:45:24.225590+0000","last_became_peered":"2023-10-08T12:45:24.225590+0000","last_unstale":"2023-10-08T12:45:24.228635+0000","last_undegraded":"2023-10-08T12:45:24.228635+0000","last_fullsized":"2023-10-08T12:45:24.228635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:15.170657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213456+0000","last_change":"2023-10-08T12:45:24.213456+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213456+0000","last_undegraded":"2023-10-08T12:45:24.213456+0000","last_fullsized":"2023-10-08T12:45:24.213456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.228742+0000","last_change":"2023-10-08T12:45:24.226194+0000","last_active":"2023-10-08T12:45:24.228742+0000","last_peered":"2023-10-08T12:45:24.228742+0000","last_clean":"2023-10-08T12:45:24.228742+0000","last_became_active":"2023-10-08T12:45:24.225901+0000","last_became_peered":"2023-10-08T12:45:24.225901+0000","last_unstale":"2023-10-08T12:45:24.228742+0000","last_undegraded":"2023-10-08T12:45:24.228742+0000","last_fullsized":"2023-10-08T12:45:24.228742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:15.170657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210301+0000","last_change":"2023-10-08T12:45:24.210301+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210301+0000","last_undegraded":"2023-10-08T12:45:24.210301+0000","last_fullsized":"2023-10-08T12:45:24.210301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.217923+0000","last_change":"2023-10-08T12:45:24.217923+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.217923+0000","last_undegraded":"2023-10-08T12:45:24.217923+0000","last_fullsized":"2023-10-08T12:45:24.217923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.218628+0000","last_change":"2023-10-08T12:45:24.216886+0000","last_active":"2023-10-08T12:45:24.218628+0000","last_peered":"2023-10-08T12:45:24.218628+0000","last_clean":"2023-10-08T12:45:24.218628+0000","last_became_active":"2023-10-08T12:45:24.216435+0000","last_became_peered":"2023-10-08T12:45:24.216435+0000","last_unstale":"2023-10-08T12:45:24.218628+0000","last_undegraded":"2023-10-08T12:45:24.218628+0000","last_fullsized":"2023-10-08T12:45:24.218628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:08.251593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.209282+0000","last_change":"2023-10-08T12:45:24.209282+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.209282+0000","last_undegraded":"2023-10-08T12:45:24.209282+0000","last_fullsized":"2023-10-08T12:45:24.209282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.221461+0000","last_change":"2023-10-08T12:45:24.218750+0000","last_active":"2023-10-08T12:45:24.221461+0000","last_peered":"2023-10-08T12:45:24.221461+0000","last_clean":"2023-10-08T12:45:24.221461+0000","last_became_active":"2023-10-08T12:45:24.218402+0000","last_became_peered":"2023-10-08T12:45:24.218402+0000","last_unstale":"2023-10-08T12:45:24.221461+0000","last_undegraded":"2023-10-08T12:45:24.221461+0000","last_fullsized":"2023-10-08T12:45:24.221461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:08.251593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":163,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.221448+0000","last_change":"2023-10-08T12:45:21.094571+0000","last_active":"2023-10-08T12:45:24.221448+0000","last_peered":"2023-10-08T12:45:24.221448+0000","last_clean":"2023-10-08T12:45:24.221448+0000","last_became_active":"2023-10-08T12:45:21.093551+0000","last_became_peered":"2023-10-08T12:45:21.093551+0000","last_unstale":"2023-10-08T12:45:24.221448+0000","last_undegraded":"2023-10-08T12:45:24.221448+0000","last_fullsized":"2023-10-08T12:45:24.221448+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:19.842786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:19.842786+0000","last_clean_scrub_stamp":"2023-10-08T12:45:19.842786+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:25.041743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.209841+0000","last_change":"2023-10-08T12:45:24.209841+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.209841+0000","last_undegraded":"2023-10-08T12:45:24.209841+0000","last_fullsized":"2023-10-08T12:45:24.209841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.234531+0000","last_change":"2023-10-08T12:45:24.229708+0000","last_active":"2023-10-08T12:45:24.234531+0000","last_peered":"2023-10-08T12:45:24.234531+0000","last_clean":"2023-10-08T12:45:24.234531+0000","last_became_active":"2023-10-08T12:45:24.229494+0000","last_became_peered":"2023-10-08T12:45:24.229494+0000","last_unstale":"2023-10-08T12:45:24.234531+0000","last_undegraded":"2023-10-08T12:45:24.234531+0000","last_fullsized":"2023-10-08T12:45:24.234531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:15.170657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.234464+0000","last_change":"2023-10-08T12:45:24.229122+0000","last_active":"2023-10-08T12:45:24.234464+0000","last_peered":"2023-10-08T12:45:24.234464+0000","last_clean":"2023-10-08T12:45:24.234464+0000","last_became_active":"2023-10-08T12:45:24.228838+0000","last_became_peered":"2023-10-08T12:45:24.228838+0000","last_unstale":"2023-10-08T12:45:24.234464+0000","last_undegraded":"2023-10-08T12:45:24.234464+0000","last_fullsized":"2023-10-08T12:45:24.234464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:19:36.620765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.219902+0000","last_change":"2023-10-08T12:45:24.219902+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.219902+0000","last_undegraded":"2023-10-08T12:45:24.219902+0000","last_fullsized":"2023-10-08T12:45:24.219902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.229064+0000","last_change":"2023-10-08T12:45:24.226993+0000","last_active":"2023-10-08T12:45:24.229064+0000","last_peered":"2023-10-08T12:45:24.229064+0000","last_clean":"2023-10-08T12:45:24.229064+0000","last_became_active":"2023-10-08T12:45:24.226721+0000","last_became_peered":"2023-10-08T12:45:24.226721+0000","last_unstale":"2023-10-08T12:45:24.229064+0000","last_undegraded":"2023-10-08T12:45:24.229064+0000","last_fullsized":"2023-10-08T12:45:24.229064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:03:57.184403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.209710+0000","last_change":"2023-10-08T12:45:24.209710+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.209710+0000","last_undegraded":"2023-10-08T12:45:24.209710+0000","last_fullsized":"2023-10-08T12:45:24.209710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.234227+0000","last_change":"2023-10-08T12:45:24.229198+0000","last_active":"2023-10-08T12:45:24.234227+0000","last_peered":"2023-10-08T12:45:24.234227+0000","last_clean":"2023-10-08T12:45:24.234227+0000","last_became_active":"2023-10-08T12:45:24.228922+0000","last_became_peered":"2023-10-08T12:45:24.228922+0000","last_unstale":"2023-10-08T12:45:24.234227+0000","last_undegraded":"2023-10-08T12:45:24.234227+0000","last_fullsized":"2023-10-08T12:45:24.234227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:23.245919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.209913+0000","last_change":"2023-10-08T12:45:24.209913+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.209913+0000","last_undegraded":"2023-10-08T12:45:24.209913+0000","last_fullsized":"2023-10-08T12:45:24.209913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.231553+0000","last_change":"2023-10-08T12:45:24.228202+0000","last_active":"2023-10-08T12:45:24.231553+0000","last_peered":"2023-10-08T12:45:24.231553+0000","last_clean":"2023-10-08T12:45:24.231553+0000","last_became_active":"2023-10-08T12:45:24.227988+0000","last_became_peered":"2023-10-08T12:45:24.227988+0000","last_unstale":"2023-10-08T12:45:24.231553+0000","last_undegraded":"2023-10-08T12:45:24.231553+0000","last_fullsized":"2023-10-08T12:45:24.231553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210282+0000","last_change":"2023-10-08T12:45:24.210282+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210282+0000","last_undegraded":"2023-10-08T12:45:24.210282+0000","last_fullsized":"2023-10-08T12:45:24.210282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.229119+0000","last_change":"2023-10-08T12:45:24.228028+0000","last_active":"2023-10-08T12:45:24.229119+0000","last_peered":"2023-10-08T12:45:24.229119+0000","last_clean":"2023-10-08T12:45:24.229119+0000","last_became_active":"2023-10-08T12:45:24.227739+0000","last_became_peered":"2023-10-08T12:45:24.227739+0000","last_unstale":"2023-10-08T12:45:24.229119+0000","last_undegraded":"2023-10-08T12:45:24.229119+0000","last_fullsized":"2023-10-08T12:45:24.229119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:23.245919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.209625+0000","last_change":"2023-10-08T12:45:24.209625+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.209625+0000","last_undegraded":"2023-10-08T12:45:24.209625+0000","last_fullsized":"2023-10-08T12:45:24.209625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.227316+0000","last_change":"2023-10-08T12:45:24.222491+0000","last_active":"2023-10-08T12:45:24.227316+0000","last_peered":"2023-10-08T12:45:24.227316+0000","last_clean":"2023-10-08T12:45:24.227316+0000","last_became_active":"2023-10-08T12:45:24.222266+0000","last_became_peered":"2023-10-08T12:45:24.222266+0000","last_unstale":"2023-10-08T12:45:24.227316+0000","last_undegraded":"2023-10-08T12:45:24.227316+0000","last_fullsized":"2023-10-08T12:45:24.227316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:28.393554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210719+0000","last_change":"2023-10-08T12:45:24.210719+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210719+0000","last_undegraded":"2023-10-08T12:45:24.210719+0000","last_fullsized":"2023-10-08T12:45:24.210719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.231530+0000","last_change":"2023-10-08T12:45:24.227674+0000","last_active":"2023-10-08T12:45:24.231530+0000","last_peered":"2023-10-08T12:45:24.231530+0000","last_clean":"2023-10-08T12:45:24.231530+0000","last_became_active":"2023-10-08T12:45:24.227376+0000","last_became_peered":"2023-10-08T12:45:24.227376+0000","last_unstale":"2023-10-08T12:45:24.231530+0000","last_undegraded":"2023-10-08T12:45:24.231530+0000","last_fullsized":"2023-10-08T12:45:24.231530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:23.245919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.215552+0000","last_change":"2023-10-08T12:45:24.215552+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.215552+0000","last_undegraded":"2023-10-08T12:45:24.215552+0000","last_fullsized":"2023-10-08T12:45:24.215552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.218592+0000","last_change":"2023-10-08T12:45:24.215676+0000","last_active":"2023-10-08T12:45:24.218592+0000","last_peered":"2023-10-08T12:45:24.218592+0000","last_clean":"2023-10-08T12:45:24.218592+0000","last_became_active":"2023-10-08T12:45:24.215332+0000","last_became_peered":"2023-10-08T12:45:24.215332+0000","last_unstale":"2023-10-08T12:45:24.218592+0000","last_undegraded":"2023-10-08T12:45:24.218592+0000","last_fullsized":"2023-10-08T12:45:24.218592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213956+0000","last_change":"2023-10-08T12:45:24.213956+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213956+0000","last_undegraded":"2023-10-08T12:45:24.213956+0000","last_fullsized":"2023-10-08T12:45:24.213956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.226783+0000","last_change":"2023-10-08T12:45:24.220654+0000","last_active":"2023-10-08T12:45:24.226783+0000","last_peered":"2023-10-08T12:45:24.226783+0000","last_clean":"2023-10-08T12:45:24.226783+0000","last_became_active":"2023-10-08T12:45:24.220367+0000","last_became_peered":"2023-10-08T12:45:24.220367+0000","last_unstale":"2023-10-08T12:45:24.226783+0000","last_undegraded":"2023-10-08T12:45:24.226783+0000","last_fullsized":"2023-10-08T12:45:24.226783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:08.251593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.211647+0000","last_change":"2023-10-08T12:45:24.211647+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.211647+0000","last_undegraded":"2023-10-08T12:45:24.211647+0000","last_fullsized":"2023-10-08T12:45:24.211647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.218617+0000","last_change":"2023-10-08T12:45:24.216389+0000","last_active":"2023-10-08T12:45:24.218617+0000","last_peered":"2023-10-08T12:45:24.218617+0000","last_clean":"2023-10-08T12:45:24.218617+0000","last_became_active":"2023-10-08T12:45:24.216111+0000","last_became_peered":"2023-10-08T12:45:24.216111+0000","last_unstale":"2023-10-08T12:45:24.218617+0000","last_undegraded":"2023-10-08T12:45:24.218617+0000","last_fullsized":"2023-10-08T12:45:24.218617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:28.393554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.214398+0000","last_change":"2023-10-08T12:45:24.214398+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.214398+0000","last_undegraded":"2023-10-08T12:45:24.214398+0000","last_fullsized":"2023-10-08T12:45:24.214398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213834+0000","last_change":"2023-10-08T12:45:24.213834+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213834+0000","last_undegraded":"2023-10-08T12:45:24.213834+0000","last_fullsized":"2023-10-08T12:45:24.213834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.208467+0000","last_change":"2023-10-08T12:45:24.208467+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.208467+0000","last_undegraded":"2023-10-08T12:45:24.208467+0000","last_fullsized":"2023-10-08T12:45:24.208467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.212366+0000","last_change":"2023-10-08T12:45:24.212366+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.212366+0000","last_undegraded":"2023-10-08T12:45:24.212366+0000","last_fullsized":"2023-10-08T12:45:24.212366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.211571+0000","last_change":"2023-10-08T12:45:24.211571+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.211571+0000","last_undegraded":"2023-10-08T12:45:24.211571+0000","last_fullsized":"2023-10-08T12:45:24.211571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213860+0000","last_change":"2023-10-08T12:45:24.213860+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213860+0000","last_undegraded":"2023-10-08T12:45:24.213860+0000","last_fullsized":"2023-10-08T12:45:24.213860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.218858+0000","last_change":"2023-10-08T12:45:24.218858+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.218858+0000","last_undegraded":"2023-10-08T12:45:24.218858+0000","last_fullsized":"2023-10-08T12:45:24.218858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.216612+0000","last_change":"2023-10-08T12:45:24.216612+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.216612+0000","last_undegraded":"2023-10-08T12:45:24.216612+0000","last_fullsized":"2023-10-08T12:45:24.216612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.212770+0000","last_change":"2023-10-08T12:45:24.212770+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.212770+0000","last_undegraded":"2023-10-08T12:45:24.212770+0000","last_fullsized":"2023-10-08T12:45:24.212770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210381+0000","last_change":"2023-10-08T12:45:24.210381+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210381+0000","last_undegraded":"2023-10-08T12:45:24.210381+0000","last_fullsized":"2023-10-08T12:45:24.210381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213760+0000","last_change":"2023-10-08T12:45:24.213760+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213760+0000","last_undegraded":"2023-10-08T12:45:24.213760+0000","last_fullsized":"2023-10-08T12:45:24.213760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.212940+0000","last_change":"2023-10-08T12:45:24.212940+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.212940+0000","last_undegraded":"2023-10-08T12:45:24.212940+0000","last_fullsized":"2023-10-08T12:45:24.212940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.212268+0000","last_change":"2023-10-08T12:45:24.212268+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.212268+0000","last_undegraded":"2023-10-08T12:45:24.212268+0000","last_fullsized":"2023-10-08T12:45:24.212268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.215024+0000","last_change":"2023-10-08T12:45:24.215024+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.215024+0000","last_undegraded":"2023-10-08T12:45:24.215024+0000","last_fullsized":"2023-10-08T12:45:24.215024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":774144,"data_stored":648191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":774144,"data_stored":648191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:45:30.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2023-10-08T12:45:30.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.217479+0000', 'last_change': '2023-10-08T12:45:24.217479+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.217479+0000', 'last_undegraded': '2023-10-08T12:45:24.217479+0000', 'last_fullsized': '2023-10-08T12:45:24.217479+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T12:45:30.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3e is not active+clean 2023-10-08T12:45:30.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.217377+0000', 'last_change': '2023-10-08T12:45:24.217377+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.217377+0000', 'last_undegraded': '2023-10-08T12:45:24.217377+0000', 'last_fullsized': '2023-10-08T12:45:24.217377+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T12:45:30.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2023-10-08T12:45:30.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.210475+0000', 'last_change': '2023-10-08T12:45:24.210475+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.210475+0000', 'last_undegraded': '2023-10-08T12:45:24.210475+0000', 'last_fullsized': '2023-10-08T12:45:24.210475+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T12:45:30.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3c is not active+clean 2023-10-08T12:45:30.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.211204+0000', 'last_change': '2023-10-08T12:45:24.211204+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.211204+0000', 'last_undegraded': '2023-10-08T12:45:24.211204+0000', 'last_fullsized': '2023-10-08T12:45:24.211204+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T12:45:30.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2023-10-08T12:45:30.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.218087+0000', 'last_change': '2023-10-08T12:45:24.218087+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.218087+0000', 'last_undegraded': '2023-10-08T12:45:24.218087+0000', 'last_fullsized': '2023-10-08T12:45:24.218087+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T12:45:30.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2023-10-08T12:45:30.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.213469+0000', 'last_change': '2023-10-08T12:45:24.213469+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.213469+0000', 'last_undegraded': '2023-10-08T12:45:24.213469+0000', 'last_fullsized': '2023-10-08T12:45:24.213469+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T12:45:30.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2023-10-08T12:45:30.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.216581+0000', 'last_change': '2023-10-08T12:45:24.216581+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.216581+0000', 'last_undegraded': '2023-10-08T12:45:24.216581+0000', 'last_fullsized': '2023-10-08T12:45:24.216581+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T12:45:30.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.38 is not active+clean 2023-10-08T12:45:30.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.213458+0000', 'last_change': '2023-10-08T12:45:24.213458+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.213458+0000', 'last_undegraded': '2023-10-08T12:45:24.213458+0000', 'last_fullsized': '2023-10-08T12:45:24.213458+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T12:45:30.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.37 is not active+clean 2023-10-08T12:45:30.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.216999+0000', 'last_change': '2023-10-08T12:45:24.216999+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.216999+0000', 'last_undegraded': '2023-10-08T12:45:24.216999+0000', 'last_fullsized': '2023-10-08T12:45:24.216999+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T12:45:30.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2023-10-08T12:45:30.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.214181+0000', 'last_change': '2023-10-08T12:45:24.214181+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.214181+0000', 'last_undegraded': '2023-10-08T12:45:24.214181+0000', 'last_fullsized': '2023-10-08T12:45:24.214181+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T12:45:30.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.35 is not active+clean 2023-10-08T12:45:30.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.215422+0000', 'last_change': '2023-10-08T12:45:24.215422+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.215422+0000', 'last_undegraded': '2023-10-08T12:45:24.215422+0000', 'last_fullsized': '2023-10-08T12:45:24.215422+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T12:45:30.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.34 is not active+clean 2023-10-08T12:45:30.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.210890+0000', 'last_change': '2023-10-08T12:45:24.210890+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.210890+0000', 'last_undegraded': '2023-10-08T12:45:24.210890+0000', 'last_fullsized': '2023-10-08T12:45:24.210890+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T12:45:30.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.33 is not active+clean 2023-10-08T12:45:30.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.213162+0000', 'last_change': '2023-10-08T12:45:24.213162+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.213162+0000', 'last_undegraded': '2023-10-08T12:45:24.213162+0000', 'last_fullsized': '2023-10-08T12:45:24.213162+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T12:45:30.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.32 is not active+clean 2023-10-08T12:45:30.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.211135+0000', 'last_change': '2023-10-08T12:45:24.211135+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.211135+0000', 'last_undegraded': '2023-10-08T12:45:24.211135+0000', 'last_fullsized': '2023-10-08T12:45:24.211135+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T12:45:30.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.31 is not active+clean 2023-10-08T12:45:30.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.217815+0000', 'last_change': '2023-10-08T12:45:24.217815+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.217815+0000', 'last_undegraded': '2023-10-08T12:45:24.217815+0000', 'last_fullsized': '2023-10-08T12:45:24.217815+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T12:45:30.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.30 is not active+clean 2023-10-08T12:45:30.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.211517+0000', 'last_change': '2023-10-08T12:45:24.211517+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.211517+0000', 'last_undegraded': '2023-10-08T12:45:24.211517+0000', 'last_fullsized': '2023-10-08T12:45:24.211517+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T12:45:30.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2f is not active+clean 2023-10-08T12:45:30.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.213043+0000', 'last_change': '2023-10-08T12:45:24.213043+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.213043+0000', 'last_undegraded': '2023-10-08T12:45:24.213043+0000', 'last_fullsized': '2023-10-08T12:45:24.213043+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T12:45:30.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2e is not active+clean 2023-10-08T12:45:30.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.208356+0000', 'last_change': '2023-10-08T12:45:24.208356+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.208356+0000', 'last_undegraded': '2023-10-08T12:45:24.208356+0000', 'last_fullsized': '2023-10-08T12:45:24.208356+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T12:45:30.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2d is not active+clean 2023-10-08T12:45:30.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.220371+0000', 'last_change': '2023-10-08T12:45:24.220371+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.220371+0000', 'last_undegraded': '2023-10-08T12:45:24.220371+0000', 'last_fullsized': '2023-10-08T12:45:24.220371+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T12:45:30.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2023-10-08T12:45:30.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.212448+0000', 'last_change': '2023-10-08T12:45:24.212448+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.212448+0000', 'last_undegraded': '2023-10-08T12:45:24.212448+0000', 'last_fullsized': '2023-10-08T12:45:24.212448+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T12:45:30.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2023-10-08T12:45:30.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.211581+0000', 'last_change': '2023-10-08T12:45:24.211581+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.211581+0000', 'last_undegraded': '2023-10-08T12:45:24.211581+0000', 'last_fullsized': '2023-10-08T12:45:24.211581+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T12:45:30.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2023-10-08T12:45:30.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.214518+0000', 'last_change': '2023-10-08T12:45:24.214518+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.214518+0000', 'last_undegraded': '2023-10-08T12:45:24.214518+0000', 'last_fullsized': '2023-10-08T12:45:24.214518+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T12:45:30.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2023-10-08T12:45:30.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.213937+0000', 'last_change': '2023-10-08T12:45:24.213937+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.213937+0000', 'last_undegraded': '2023-10-08T12:45:24.213937+0000', 'last_fullsized': '2023-10-08T12:45:24.213937+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T12:45:30.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2023-10-08T12:45:30.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.210834+0000', 'last_change': '2023-10-08T12:45:24.210834+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.210834+0000', 'last_undegraded': '2023-10-08T12:45:24.210834+0000', 'last_fullsized': '2023-10-08T12:45:24.210834+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T12:45:30.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2023-10-08T12:45:30.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.211066+0000', 'last_change': '2023-10-08T12:45:24.211066+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.211066+0000', 'last_undegraded': '2023-10-08T12:45:24.211066+0000', 'last_fullsized': '2023-10-08T12:45:24.211066+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T12:45:30.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2023-10-08T12:45:30.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.212628+0000', 'last_change': '2023-10-08T12:45:24.212628+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.212628+0000', 'last_undegraded': '2023-10-08T12:45:24.212628+0000', 'last_fullsized': '2023-10-08T12:45:24.212628+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T12:45:30.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2023-10-08T12:45:30.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.216049+0000', 'last_change': '2023-10-08T12:45:24.216049+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.216049+0000', 'last_undegraded': '2023-10-08T12:45:24.216049+0000', 'last_fullsized': '2023-10-08T12:45:24.216049+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T12:45:30.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2023-10-08T12:45:30.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.213312+0000', 'last_change': '2023-10-08T12:45:24.213312+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.213312+0000', 'last_undegraded': '2023-10-08T12:45:24.213312+0000', 'last_fullsized': '2023-10-08T12:45:24.213312+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T12:45:30.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2023-10-08T12:45:30.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.210977+0000', 'last_change': '2023-10-08T12:45:24.210977+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.210977+0000', 'last_undegraded': '2023-10-08T12:45:24.210977+0000', 'last_fullsized': '2023-10-08T12:45:24.210977+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T12:45:30.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2023-10-08T12:45:30.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.210367+0000', 'last_change': '2023-10-08T12:45:24.210367+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.210367+0000', 'last_undegraded': '2023-10-08T12:45:24.210367+0000', 'last_fullsized': '2023-10-08T12:45:24.210367+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T12:45:30.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2023-10-08T12:45:30.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.219875+0000', 'last_change': '2023-10-08T12:45:24.219875+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.219875+0000', 'last_undegraded': '2023-10-08T12:45:24.219875+0000', 'last_fullsized': '2023-10-08T12:45:24.219875+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T12:45:30.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2023-10-08T12:45:30.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.210495+0000', 'last_change': '2023-10-08T12:45:24.210495+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.210495+0000', 'last_undegraded': '2023-10-08T12:45:24.210495+0000', 'last_fullsized': '2023-10-08T12:45:24.210495+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T12:45:30.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2023-10-08T12:45:30.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.213378+0000', 'last_change': '2023-10-08T12:45:24.213378+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.213378+0000', 'last_undegraded': '2023-10-08T12:45:24.213378+0000', 'last_fullsized': '2023-10-08T12:45:24.213378+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T12:45:30.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2023-10-08T12:45:30.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.213240+0000', 'last_change': '2023-10-08T12:45:24.213240+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.213240+0000', 'last_undegraded': '2023-10-08T12:45:24.213240+0000', 'last_fullsized': '2023-10-08T12:45:24.213240+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T12:45:30.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2023-10-08T12:45:30.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.213636+0000', 'last_change': '2023-10-08T12:45:24.213636+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.213636+0000', 'last_undegraded': '2023-10-08T12:45:24.213636+0000', 'last_fullsized': '2023-10-08T12:45:24.213636+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T12:45:30.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2023-10-08T12:45:30.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.216619+0000', 'last_change': '2023-10-08T12:45:24.216619+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.216619+0000', 'last_undegraded': '2023-10-08T12:45:24.216619+0000', 'last_fullsized': '2023-10-08T12:45:24.216619+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T12:45:30.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2023-10-08T12:45:30.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.213456+0000', 'last_change': '2023-10-08T12:45:24.213456+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.213456+0000', 'last_undegraded': '2023-10-08T12:45:24.213456+0000', 'last_fullsized': '2023-10-08T12:45:24.213456+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T12:45:30.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2023-10-08T12:45:30.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.210301+0000', 'last_change': '2023-10-08T12:45:24.210301+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.210301+0000', 'last_undegraded': '2023-10-08T12:45:24.210301+0000', 'last_fullsized': '2023-10-08T12:45:24.210301+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T12:45:30.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2023-10-08T12:45:30.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.217923+0000', 'last_change': '2023-10-08T12:45:24.217923+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.217923+0000', 'last_undegraded': '2023-10-08T12:45:24.217923+0000', 'last_fullsized': '2023-10-08T12:45:24.217923+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T12:45:30.184 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2023-10-08T12:45:30.184 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.209282+0000', 'last_change': '2023-10-08T12:45:24.209282+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.209282+0000', 'last_undegraded': '2023-10-08T12:45:24.209282+0000', 'last_fullsized': '2023-10-08T12:45:24.209282+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T12:45:30.184 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2023-10-08T12:45:30.184 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.209841+0000', 'last_change': '2023-10-08T12:45:24.209841+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.209841+0000', 'last_undegraded': '2023-10-08T12:45:24.209841+0000', 'last_fullsized': '2023-10-08T12:45:24.209841+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T12:45:30.184 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2023-10-08T12:45:30.184 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.219902+0000', 'last_change': '2023-10-08T12:45:24.219902+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.219902+0000', 'last_undegraded': '2023-10-08T12:45:24.219902+0000', 'last_fullsized': '2023-10-08T12:45:24.219902+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T12:45:30.184 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2023-10-08T12:45:30.184 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.209710+0000', 'last_change': '2023-10-08T12:45:24.209710+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.209710+0000', 'last_undegraded': '2023-10-08T12:45:24.209710+0000', 'last_fullsized': '2023-10-08T12:45:24.209710+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T12:45:30.184 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2023-10-08T12:45:30.185 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.209913+0000', 'last_change': '2023-10-08T12:45:24.209913+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.209913+0000', 'last_undegraded': '2023-10-08T12:45:24.209913+0000', 'last_fullsized': '2023-10-08T12:45:24.209913+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T12:45:30.185 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2023-10-08T12:45:30.185 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.210282+0000', 'last_change': '2023-10-08T12:45:24.210282+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.210282+0000', 'last_undegraded': '2023-10-08T12:45:24.210282+0000', 'last_fullsized': '2023-10-08T12:45:24.210282+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T12:45:30.185 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2023-10-08T12:45:30.185 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.209625+0000', 'last_change': '2023-10-08T12:45:24.209625+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.209625+0000', 'last_undegraded': '2023-10-08T12:45:24.209625+0000', 'last_fullsized': '2023-10-08T12:45:24.209625+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T12:45:30.185 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2023-10-08T12:45:30.185 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.210719+0000', 'last_change': '2023-10-08T12:45:24.210719+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.210719+0000', 'last_undegraded': '2023-10-08T12:45:24.210719+0000', 'last_fullsized': '2023-10-08T12:45:24.210719+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T12:45:30.185 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2023-10-08T12:45:30.185 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.215552+0000', 'last_change': '2023-10-08T12:45:24.215552+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.215552+0000', 'last_undegraded': '2023-10-08T12:45:24.215552+0000', 'last_fullsized': '2023-10-08T12:45:24.215552+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T12:45:30.185 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2023-10-08T12:45:30.186 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.213956+0000', 'last_change': '2023-10-08T12:45:24.213956+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.213956+0000', 'last_undegraded': '2023-10-08T12:45:24.213956+0000', 'last_fullsized': '2023-10-08T12:45:24.213956+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T12:45:30.186 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2023-10-08T12:45:30.186 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.211647+0000', 'last_change': '2023-10-08T12:45:24.211647+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.211647+0000', 'last_undegraded': '2023-10-08T12:45:24.211647+0000', 'last_fullsized': '2023-10-08T12:45:24.211647+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T12:45:30.186 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2023-10-08T12:45:30.186 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.214398+0000', 'last_change': '2023-10-08T12:45:24.214398+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.214398+0000', 'last_undegraded': '2023-10-08T12:45:24.214398+0000', 'last_fullsized': '2023-10-08T12:45:24.214398+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T12:45:30.186 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.20 is not active+clean 2023-10-08T12:45:30.186 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.213834+0000', 'last_change': '2023-10-08T12:45:24.213834+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.213834+0000', 'last_undegraded': '2023-10-08T12:45:24.213834+0000', 'last_fullsized': '2023-10-08T12:45:24.213834+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T12:45:30.186 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.21 is not active+clean 2023-10-08T12:45:30.186 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.208467+0000', 'last_change': '2023-10-08T12:45:24.208467+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.208467+0000', 'last_undegraded': '2023-10-08T12:45:24.208467+0000', 'last_fullsized': '2023-10-08T12:45:24.208467+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T12:45:30.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.22 is not active+clean 2023-10-08T12:45:30.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.212366+0000', 'last_change': '2023-10-08T12:45:24.212366+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.212366+0000', 'last_undegraded': '2023-10-08T12:45:24.212366+0000', 'last_fullsized': '2023-10-08T12:45:24.212366+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T12:45:30.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2023-10-08T12:45:30.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.211571+0000', 'last_change': '2023-10-08T12:45:24.211571+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.211571+0000', 'last_undegraded': '2023-10-08T12:45:24.211571+0000', 'last_fullsized': '2023-10-08T12:45:24.211571+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T12:45:30.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.24 is not active+clean 2023-10-08T12:45:30.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.213860+0000', 'last_change': '2023-10-08T12:45:24.213860+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.213860+0000', 'last_undegraded': '2023-10-08T12:45:24.213860+0000', 'last_fullsized': '2023-10-08T12:45:24.213860+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T12:45:30.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.25 is not active+clean 2023-10-08T12:45:30.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.218858+0000', 'last_change': '2023-10-08T12:45:24.218858+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.218858+0000', 'last_undegraded': '2023-10-08T12:45:24.218858+0000', 'last_fullsized': '2023-10-08T12:45:24.218858+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T12:45:30.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.26 is not active+clean 2023-10-08T12:45:30.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.216612+0000', 'last_change': '2023-10-08T12:45:24.216612+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.216612+0000', 'last_undegraded': '2023-10-08T12:45:24.216612+0000', 'last_fullsized': '2023-10-08T12:45:24.216612+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T12:45:30.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.27 is not active+clean 2023-10-08T12:45:30.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.212770+0000', 'last_change': '2023-10-08T12:45:24.212770+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.212770+0000', 'last_undegraded': '2023-10-08T12:45:24.212770+0000', 'last_fullsized': '2023-10-08T12:45:24.212770+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T12:45:30.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.28 is not active+clean 2023-10-08T12:45:30.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.210381+0000', 'last_change': '2023-10-08T12:45:24.210381+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.210381+0000', 'last_undegraded': '2023-10-08T12:45:24.210381+0000', 'last_fullsized': '2023-10-08T12:45:24.210381+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T12:45:30.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.29 is not active+clean 2023-10-08T12:45:30.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.213760+0000', 'last_change': '2023-10-08T12:45:24.213760+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.213760+0000', 'last_undegraded': '2023-10-08T12:45:24.213760+0000', 'last_fullsized': '2023-10-08T12:45:24.213760+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T12:45:30.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2a is not active+clean 2023-10-08T12:45:30.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.212940+0000', 'last_change': '2023-10-08T12:45:24.212940+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.212940+0000', 'last_undegraded': '2023-10-08T12:45:24.212940+0000', 'last_fullsized': '2023-10-08T12:45:24.212940+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T12:45:30.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2023-10-08T12:45:30.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.212268+0000', 'last_change': '2023-10-08T12:45:24.212268+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.212268+0000', 'last_undegraded': '2023-10-08T12:45:24.212268+0000', 'last_fullsized': '2023-10-08T12:45:24.212268+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T12:45:30.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2c is not active+clean 2023-10-08T12:45:30.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-08T12:45:24.215024+0000', 'last_change': '2023-10-08T12:45:24.215024+0000', 'last_active': '2023-10-08T12:45:24.199834+0000', 'last_peered': '2023-10-08T12:45:24.199834+0000', 'last_clean': '2023-10-08T12:45:24.199834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T12:45:24.215024+0000', 'last_undegraded': '2023-10-08T12:45:24.215024+0000', 'last_fullsized': '2023-10-08T12:45:24.215024+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'last_clean_scrub_stamp': '2023-10-08T12:45:24.199834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T12:45:30.189 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-08T12:45:30.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.328+0000 7fdb08fe5700 1 -- 172.21.15.45:0/3227218415 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb040cfda0 msgr2=0x7fdb040b7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:30.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.328+0000 7fdb08fe5700 1 --2- 172.21.15.45:0/3227218415 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb040cfda0 0x7fdb040b7510 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4009f60 tx=0x7fdaf4009f90 comp rx=0 tx=0).stop 2023-10-08T12:45:30.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.328+0000 7fdb08fe5700 1 -- 172.21.15.45:0/3227218415 shutdown_connections 2023-10-08T12:45:30.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.328+0000 7fdb08fe5700 1 --2- 172.21.15.45:0/3227218415 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb040cfda0 0x7fdb040b7510 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:30.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.328+0000 7fdb08fe5700 1 -- 172.21.15.45:0/3227218415 >> 172.21.15.45:0/3227218415 conn(0x7fdb04071940 msgr2=0x7fdb04071d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:30.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.328+0000 7fdb08fe5700 1 -- 172.21.15.45:0/3227218415 shutdown_connections 2023-10-08T12:45:30.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.328+0000 7fdb08fe5700 1 -- 172.21.15.45:0/3227218415 wait complete. 2023-10-08T12:45:30.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.329+0000 7fdb08fe5700 1 Processor -- start 2023-10-08T12:45:30.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.329+0000 7fdb08fe5700 1 -- start start 2023-10-08T12:45:30.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.330+0000 7fdb08fe5700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdb040ce450 0x7fdb041e4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:30.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.330+0000 7fdb08fe5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb040cfda0 0x7fdb0415e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:30.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.330+0000 7fdb08fe5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb040d14d0 0x7fdb04157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:30.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.330+0000 7fdb08fe5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb041e5240 con 0x7fdb040d14d0 2023-10-08T12:45:30.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.330+0000 7fdb08fe5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb04159530 con 0x7fdb040cfda0 2023-10-08T12:45:30.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.330+0000 7fdb08fe5700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb04159810 con 0x7fdb040ce450 2023-10-08T12:45:30.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.330+0000 7fdb02d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb040d14d0 0x7fdb04157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:30.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.331+0000 7fdb02d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb040d14d0 0x7fdb04157b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34948/0 (socket says 172.21.15.45:34948) 2023-10-08T12:45:30.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.331+0000 7fdb02d9d700 1 -- 172.21.15.45:0/2908037540 learned_addr learned my addr 172.21.15.45:0/2908037540 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:30.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.331+0000 7fdb0259c700 1 --2- 172.21.15.45:0/2908037540 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdb040ce450 0x7fdb041e4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:30.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.331+0000 7fdb01d9b700 1 --2- 172.21.15.45:0/2908037540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb040cfda0 0x7fdb0415e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:30.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.331+0000 7fdb02d9d700 1 -- 172.21.15.45:0/2908037540 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdb040ce450 msgr2=0x7fdb041e4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:30.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.331+0000 7fdb02d9d700 1 --2- 172.21.15.45:0/2908037540 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdb040ce450 0x7fdb041e4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:30.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.331+0000 7fdb02d9d700 1 -- 172.21.15.45:0/2908037540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb040cfda0 msgr2=0x7fdb0415e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:30.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.331+0000 7fdb02d9d700 1 --2- 172.21.15.45:0/2908037540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb040cfda0 0x7fdb0415e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:30.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.331+0000 7fdb02d9d700 1 -- 172.21.15.45:0/2908037540 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf4009c40 con 0x7fdb040d14d0 2023-10-08T12:45:30.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.331+0000 7fdb02d9d700 1 --2- 172.21.15.45:0/2908037540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb040d14d0 0x7fdb04157b10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400b610 tx=0x7fdaf4007f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:30.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.331+0000 7fdafaffd700 1 -- 172.21.15.45:0/2908037540 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf400e040 con 0x7fdb040d14d0 2023-10-08T12:45:30.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.331+0000 7fdafaffd700 1 -- 172.21.15.45:0/2908037540 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdaf4004bb0 con 0x7fdb040d14d0 2023-10-08T12:45:30.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.331+0000 7fdb08fe5700 1 -- 172.21.15.45:0/2908037540 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb04159af0 con 0x7fdb040d14d0 2023-10-08T12:45:30.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.331+0000 7fdafaffd700 1 -- 172.21.15.45:0/2908037540 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4006000 con 0x7fdb040d14d0 2023-10-08T12:45:30.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.331+0000 7fdb08fe5700 1 -- 172.21.15.45:0/2908037540 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb0415a0b0 con 0x7fdb040d14d0 2023-10-08T12:45:30.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.332+0000 7fdb08fe5700 1 -- 172.21.15.45:0/2908037540 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb0406caa0 con 0x7fdb040d14d0 2023-10-08T12:45:30.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.333+0000 7fdafaffd700 1 -- 172.21.15.45:0/2908037540 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdaf401d480 con 0x7fdb040d14d0 2023-10-08T12:45:30.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.333+0000 7fdafaffd700 1 --2- 172.21.15.45:0/2908037540 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fdae406aed0 0x7fdae406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:30.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.333+0000 7fdafaffd700 1 -- 172.21.15.45:0/2908037540 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdaf408ae30 con 0x7fdb040d14d0 2023-10-08T12:45:30.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.333+0000 7fdb0259c700 1 --2- 172.21.15.45:0/2908037540 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fdae406aed0 0x7fdae406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:30.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.334+0000 7fdb0259c700 1 --2- 172.21.15.45:0/2908037540 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fdae406aed0 0x7fdae406d390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdafc007fd0 tx=0x7fdafc007da0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:30.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.338+0000 7fdafaffd700 1 -- 172.21.15.45:0/2908037540 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdaf4055ef0 con 0x7fdb040d14d0 2023-10-08T12:45:30.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.621+0000 7fdb08fe5700 1 -- 172.21.15.45:0/2908037540 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fdb0404e5a0 con 0x7fdb040d14d0 2023-10-08T12:45:30.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.621+0000 7fdafaffd700 1 -- 172.21.15.45:0/2908037540 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1031 (secure 0 0 0) 0x7fdaf4021420 con 0x7fdb040d14d0 2023-10-08T12:45:30.622 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:30.622 INFO:teuthology.orchestra.run.smithi045.stdout:{"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":23,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1696769118,"num_in_osds":8,"osd_in_since":1696769111,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":223993856,"bytes_avail":772870119424,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4372}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-10-08T12:45:07.438954+0000","services":{}},"progress_events":{}} 2023-10-08T12:45:30.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.623+0000 7fdb08fe5700 1 -- 172.21.15.45:0/2908037540 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fdae406aed0 msgr2=0x7fdae406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:30.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.623+0000 7fdb08fe5700 1 --2- 172.21.15.45:0/2908037540 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fdae406aed0 0x7fdae406d390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdafc007fd0 tx=0x7fdafc007da0 comp rx=0 tx=0).stop 2023-10-08T12:45:30.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.623+0000 7fdb08fe5700 1 -- 172.21.15.45:0/2908037540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb040d14d0 msgr2=0x7fdb04157b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:30.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.623+0000 7fdb08fe5700 1 --2- 172.21.15.45:0/2908037540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb040d14d0 0x7fdb04157b10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400b610 tx=0x7fdaf4007f80 comp rx=0 tx=0).stop 2023-10-08T12:45:30.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.623+0000 7fdb08fe5700 1 -- 172.21.15.45:0/2908037540 shutdown_connections 2023-10-08T12:45:30.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.623+0000 7fdb08fe5700 1 --2- 172.21.15.45:0/2908037540 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fdae406aed0 0x7fdae406d390 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:30.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.623+0000 7fdb08fe5700 1 --2- 172.21.15.45:0/2908037540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb040d14d0 0x7fdb04157b10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:30.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.623+0000 7fdb08fe5700 1 --2- 172.21.15.45:0/2908037540 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdb040ce450 0x7fdb041e4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:30.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.623+0000 7fdb08fe5700 1 --2- 172.21.15.45:0/2908037540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb040cfda0 0x7fdb0415e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:30.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.623+0000 7fdb08fe5700 1 -- 172.21.15.45:0/2908037540 >> 172.21.15.45:0/2908037540 conn(0x7fdb04071940 msgr2=0x7fdb040c5570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:30.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.623+0000 7fdb08fe5700 1 -- 172.21.15.45:0/2908037540 shutdown_connections 2023-10-08T12:45:30.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.623+0000 7fdb08fe5700 1 -- 172.21.15.45:0/2908037540 wait complete. 2023-10-08T12:45:30.636 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-08T12:45:30.636 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T12:45:30.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.762+0000 7fe39368b700 1 -- 172.21.15.45:0/3568311417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe38c0cc160 msgr2=0x7fe38c0cc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:30.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.762+0000 7fe39368b700 1 --2- 172.21.15.45:0/3568311417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe38c0cc160 0x7fe38c0cc5e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe38c0cd320 tx=0x7fe388009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:30.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.762+0000 7fe39368b700 1 -- 172.21.15.45:0/3568311417 shutdown_connections 2023-10-08T12:45:30.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.762+0000 7fe39368b700 1 --2- 172.21.15.45:0/3568311417 >> v2:172.21.15.78:3300/0 conn(0x7fe38c0ae380 0x7fe38c0ae7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:30.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.762+0000 7fe39368b700 1 --2- 172.21.15.45:0/3568311417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe38c0cc160 0x7fe38c0cc5e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:30.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.762+0000 7fe39368b700 1 -- 172.21.15.45:0/3568311417 >> 172.21.15.45:0/3568311417 conn(0x7fe38c0cf750 msgr2=0x7fe38c0cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:30.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.762+0000 7fe39368b700 1 -- 172.21.15.45:0/3568311417 shutdown_connections 2023-10-08T12:45:30.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.762+0000 7fe39368b700 1 -- 172.21.15.45:0/3568311417 wait complete. 2023-10-08T12:45:30.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.763+0000 7fe39368b700 1 Processor -- start 2023-10-08T12:45:30.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.763+0000 7fe39368b700 1 -- start start 2023-10-08T12:45:30.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.764+0000 7fe39368b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe38c0ae380 0x7fe38c156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:30.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.764+0000 7fe39368b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe38c0cc160 0x7fe38c156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:30.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.764+0000 7fe39368b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe38c1599f0 0x7fe38c06b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:30.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.764+0000 7fe39368b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c0c6c00 con 0x7fe38c0ae380 2023-10-08T12:45:30.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.764+0000 7fe39368b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c1565b0 con 0x7fe38c0cc160 2023-10-08T12:45:30.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.764+0000 7fe39368b700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c06bc90 con 0x7fe38c1599f0 2023-10-08T12:45:30.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.764+0000 7fe391427700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe38c0ae380 0x7fe38c156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:30.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.764+0000 7fe391427700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe38c0ae380 0x7fe38c156800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34958/0 (socket says 172.21.15.45:34958) 2023-10-08T12:45:30.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.764+0000 7fe391427700 1 -- 172.21.15.45:0/3533176064 learned_addr learned my addr 172.21.15.45:0/3533176064 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:30.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.764+0000 7fe390c26700 1 --2- 172.21.15.45:0/3533176064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe38c0cc160 0x7fe38c156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:30.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.764+0000 7fe391c28700 1 --2- 172.21.15.45:0/3533176064 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe38c1599f0 0x7fe38c06b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:30.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.765+0000 7fe391427700 1 -- 172.21.15.45:0/3533176064 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe38c1599f0 msgr2=0x7fe38c06b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:30.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.765+0000 7fe391427700 1 --2- 172.21.15.45:0/3533176064 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe38c1599f0 0x7fe38c06b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:30.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.765+0000 7fe391427700 1 -- 172.21.15.45:0/3533176064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe38c0cc160 msgr2=0x7fe38c156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:30.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.765+0000 7fe391427700 1 --2- 172.21.15.45:0/3533176064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe38c0cc160 0x7fe38c156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:30.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.765+0000 7fe391427700 1 -- 172.21.15.45:0/3533176064 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3880095f0 con 0x7fe38c0ae380 2023-10-08T12:45:30.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.765+0000 7fe391c28700 1 --2- 172.21.15.45:0/3533176064 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe38c1599f0 0x7fe38c06b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:30.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.765+0000 7fe390c26700 1 --2- 172.21.15.45:0/3533176064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe38c0cc160 0x7fe38c156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:30.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.765+0000 7fe391427700 1 --2- 172.21.15.45:0/3533176064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe38c0ae380 0x7fe38c156800 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe37c00b470 tx=0x7fe37c00b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:30.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.765+0000 7fe381ffb700 1 -- 172.21.15.45:0/3533176064 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37c011830 con 0x7fe38c0ae380 2023-10-08T12:45:30.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.765+0000 7fe381ffb700 1 -- 172.21.15.45:0/3533176064 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe37c011a80 con 0x7fe38c0ae380 2023-10-08T12:45:30.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.765+0000 7fe39368b700 1 -- 172.21.15.45:0/3533176064 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe38c06bf70 con 0x7fe38c0ae380 2023-10-08T12:45:30.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.765+0000 7fe381ffb700 1 -- 172.21.15.45:0/3533176064 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37c011e90 con 0x7fe38c0ae380 2023-10-08T12:45:30.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.765+0000 7fe39368b700 1 -- 172.21.15.45:0/3533176064 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe38c0c6820 con 0x7fe38c0ae380 2023-10-08T12:45:30.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.766+0000 7fe39368b700 1 -- 172.21.15.45:0/3533176064 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe38c04e4c0 con 0x7fe38c0ae380 2023-10-08T12:45:30.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.766+0000 7fe381ffb700 1 -- 172.21.15.45:0/3533176064 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe37c01a400 con 0x7fe38c0ae380 2023-10-08T12:45:30.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.767+0000 7fe381ffb700 1 --2- 172.21.15.45:0/3533176064 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe37006aed0 0x7fe37006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:30.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.767+0000 7fe381ffb700 1 -- 172.21.15.45:0/3533176064 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe37c0898b0 con 0x7fe38c0ae380 2023-10-08T12:45:30.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.767+0000 7fe390c26700 1 --2- 172.21.15.45:0/3533176064 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe37006aed0 0x7fe37006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:30.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.768+0000 7fe390c26700 1 --2- 172.21.15.45:0/3533176064 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe37006aed0 0x7fe37006d390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe388000c00 tx=0x7fe3880047c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:30.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.772+0000 7fe381ffb700 1 -- 172.21.15.45:0/3533176064 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe37c054960 con 0x7fe38c0ae380 2023-10-08T12:45:30.785 INFO:tasks.ceph.mds.d.smithi078.stderr:2023-10-08T12:45:30.785+0000 7f99d78cc700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T12:45:30.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.967+0000 7fe39368b700 1 -- 172.21.15.45:0/3533176064 --> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe38c0aed10 con 0x7fe37006aed0 2023-10-08T12:45:30.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.974+0000 7fe381ffb700 1 -- 172.21.15.45:0/3533176064 <== mgr.4105 v2:172.21.15.78:6832/3438117854 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+259283 (secure 0 0 0) 0x7fe388005430 con 0x7fe37006aed0 2023-10-08T12:45:30.978 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:30.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.977+0000 7fe39368b700 1 -- 172.21.15.45:0/3533176064 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe37006aed0 msgr2=0x7fe37006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:30.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.977+0000 7fe39368b700 1 --2- 172.21.15.45:0/3533176064 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe37006aed0 0x7fe37006d390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe388000c00 tx=0x7fe3880047c0 comp rx=0 tx=0).stop 2023-10-08T12:45:30.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.977+0000 7fe39368b700 1 -- 172.21.15.45:0/3533176064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe38c0ae380 msgr2=0x7fe38c156800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:30.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.977+0000 7fe39368b700 1 --2- 172.21.15.45:0/3533176064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe38c0ae380 0x7fe38c156800 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe37c00b470 tx=0x7fe37c00b830 comp rx=0 tx=0).stop 2023-10-08T12:45:30.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.977+0000 7fe39368b700 1 -- 172.21.15.45:0/3533176064 shutdown_connections 2023-10-08T12:45:30.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.977+0000 7fe39368b700 1 --2- 172.21.15.45:0/3533176064 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe37006aed0 0x7fe37006d390 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:30.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.977+0000 7fe39368b700 1 --2- 172.21.15.45:0/3533176064 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe38c1599f0 0x7fe38c06b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:30.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.977+0000 7fe39368b700 1 --2- 172.21.15.45:0/3533176064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe38c0ae380 0x7fe38c156800 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:30.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.977+0000 7fe39368b700 1 --2- 172.21.15.45:0/3533176064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe38c0cc160 0x7fe38c156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:30.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.977+0000 7fe39368b700 1 -- 172.21.15.45:0/3533176064 >> 172.21.15.45:0/3533176064 conn(0x7fe38c0cf750 msgr2=0x7fe38c0cfb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:30.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.977+0000 7fe39368b700 1 -- 172.21.15.45:0/3533176064 shutdown_connections 2023-10-08T12:45:30.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:30.977+0000 7fe39368b700 1 -- 172.21.15.45:0/3533176064 wait complete. 2023-10-08T12:45:30.981 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-08T12:45:30.990 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-08T12:45:29.128025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218744,"kb_used_data":2568,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755976,"statfs":{"total":773094113280,"available":772870119424,"internally_reserved":0,"allocated":2629632,"data_stored":1643320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001269"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.217479+0000","last_change":"2023-10-08T12:45:24.217479+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.217479+0000","last_undegraded":"2023-10-08T12:45:24.217479+0000","last_fullsized":"2023-10-08T12:45:24.217479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.217377+0000","last_change":"2023-10-08T12:45:24.217377+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.217377+0000","last_undegraded":"2023-10-08T12:45:24.217377+0000","last_fullsized":"2023-10-08T12:45:24.217377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210475+0000","last_change":"2023-10-08T12:45:24.210475+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210475+0000","last_undegraded":"2023-10-08T12:45:24.210475+0000","last_fullsized":"2023-10-08T12:45:24.210475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.211204+0000","last_change":"2023-10-08T12:45:24.211204+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.211204+0000","last_undegraded":"2023-10-08T12:45:24.211204+0000","last_fullsized":"2023-10-08T12:45:24.211204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.218087+0000","last_change":"2023-10-08T12:45:24.218087+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.218087+0000","last_undegraded":"2023-10-08T12:45:24.218087+0000","last_fullsized":"2023-10-08T12:45:24.218087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213469+0000","last_change":"2023-10-08T12:45:24.213469+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213469+0000","last_undegraded":"2023-10-08T12:45:24.213469+0000","last_fullsized":"2023-10-08T12:45:24.213469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.216581+0000","last_change":"2023-10-08T12:45:24.216581+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.216581+0000","last_undegraded":"2023-10-08T12:45:24.216581+0000","last_fullsized":"2023-10-08T12:45:24.216581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213458+0000","last_change":"2023-10-08T12:45:24.213458+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213458+0000","last_undegraded":"2023-10-08T12:45:24.213458+0000","last_fullsized":"2023-10-08T12:45:24.213458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.216999+0000","last_change":"2023-10-08T12:45:24.216999+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.216999+0000","last_undegraded":"2023-10-08T12:45:24.216999+0000","last_fullsized":"2023-10-08T12:45:24.216999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.214181+0000","last_change":"2023-10-08T12:45:24.214181+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.214181+0000","last_undegraded":"2023-10-08T12:45:24.214181+0000","last_fullsized":"2023-10-08T12:45:24.214181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.215422+0000","last_change":"2023-10-08T12:45:24.215422+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.215422+0000","last_undegraded":"2023-10-08T12:45:24.215422+0000","last_fullsized":"2023-10-08T12:45:24.215422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210890+0000","last_change":"2023-10-08T12:45:24.210890+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210890+0000","last_undegraded":"2023-10-08T12:45:24.210890+0000","last_fullsized":"2023-10-08T12:45:24.210890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213162+0000","last_change":"2023-10-08T12:45:24.213162+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213162+0000","last_undegraded":"2023-10-08T12:45:24.213162+0000","last_fullsized":"2023-10-08T12:45:24.213162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.211135+0000","last_change":"2023-10-08T12:45:24.211135+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.211135+0000","last_undegraded":"2023-10-08T12:45:24.211135+0000","last_fullsized":"2023-10-08T12:45:24.211135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.217815+0000","last_change":"2023-10-08T12:45:24.217815+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.217815+0000","last_undegraded":"2023-10-08T12:45:24.217815+0000","last_fullsized":"2023-10-08T12:45:24.217815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.211517+0000","last_change":"2023-10-08T12:45:24.211517+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.211517+0000","last_undegraded":"2023-10-08T12:45:24.211517+0000","last_fullsized":"2023-10-08T12:45:24.211517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213043+0000","last_change":"2023-10-08T12:45:24.213043+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213043+0000","last_undegraded":"2023-10-08T12:45:24.213043+0000","last_fullsized":"2023-10-08T12:45:24.213043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.208356+0000","last_change":"2023-10-08T12:45:24.208356+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.208356+0000","last_undegraded":"2023-10-08T12:45:24.208356+0000","last_fullsized":"2023-10-08T12:45:24.208356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.220371+0000","last_change":"2023-10-08T12:45:24.220371+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.220371+0000","last_undegraded":"2023-10-08T12:45:24.220371+0000","last_fullsized":"2023-10-08T12:45:24.220371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.228806+0000","last_change":"2023-10-08T12:45:24.228061+0000","last_active":"2023-10-08T12:45:24.228806+0000","last_peered":"2023-10-08T12:45:24.228806+0000","last_clean":"2023-10-08T12:45:24.228806+0000","last_became_active":"2023-10-08T12:45:24.227725+0000","last_became_peered":"2023-10-08T12:45:24.227725+0000","last_unstale":"2023-10-08T12:45:24.228806+0000","last_undegraded":"2023-10-08T12:45:24.228806+0000","last_fullsized":"2023-10-08T12:45:24.228806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.212448+0000","last_change":"2023-10-08T12:45:24.212448+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.212448+0000","last_undegraded":"2023-10-08T12:45:24.212448+0000","last_fullsized":"2023-10-08T12:45:24.212448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.227019+0000","last_change":"2023-10-08T12:45:24.224322+0000","last_active":"2023-10-08T12:45:24.227019+0000","last_peered":"2023-10-08T12:45:24.227019+0000","last_clean":"2023-10-08T12:45:24.227019+0000","last_became_active":"2023-10-08T12:45:24.223973+0000","last_became_peered":"2023-10-08T12:45:24.223973+0000","last_unstale":"2023-10-08T12:45:24.227019+0000","last_undegraded":"2023-10-08T12:45:24.227019+0000","last_fullsized":"2023-10-08T12:45:24.227019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.211581+0000","last_change":"2023-10-08T12:45:24.211581+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.211581+0000","last_undegraded":"2023-10-08T12:45:24.211581+0000","last_fullsized":"2023-10-08T12:45:24.211581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.234444+0000","last_change":"2023-10-08T12:45:24.228768+0000","last_active":"2023-10-08T12:45:24.234444+0000","last_peered":"2023-10-08T12:45:24.234444+0000","last_clean":"2023-10-08T12:45:24.234444+0000","last_became_active":"2023-10-08T12:45:24.228469+0000","last_became_peered":"2023-10-08T12:45:24.228469+0000","last_unstale":"2023-10-08T12:45:24.234444+0000","last_undegraded":"2023-10-08T12:45:24.234444+0000","last_fullsized":"2023-10-08T12:45:24.234444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:03:57.184403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.214518+0000","last_change":"2023-10-08T12:45:24.214518+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.214518+0000","last_undegraded":"2023-10-08T12:45:24.214518+0000","last_fullsized":"2023-10-08T12:45:24.214518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.231491+0000","last_change":"2023-10-08T12:45:24.227667+0000","last_active":"2023-10-08T12:45:24.231491+0000","last_peered":"2023-10-08T12:45:24.231491+0000","last_clean":"2023-10-08T12:45:24.231491+0000","last_became_active":"2023-10-08T12:45:24.227346+0000","last_became_peered":"2023-10-08T12:45:24.227346+0000","last_unstale":"2023-10-08T12:45:24.231491+0000","last_undegraded":"2023-10-08T12:45:24.231491+0000","last_fullsized":"2023-10-08T12:45:24.231491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:08.251593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213937+0000","last_change":"2023-10-08T12:45:24.213937+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213937+0000","last_undegraded":"2023-10-08T12:45:24.213937+0000","last_fullsized":"2023-10-08T12:45:24.213937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.228079+0000","last_change":"2023-10-08T12:45:24.225874+0000","last_active":"2023-10-08T12:45:24.228079+0000","last_peered":"2023-10-08T12:45:24.228079+0000","last_clean":"2023-10-08T12:45:24.228079+0000","last_became_active":"2023-10-08T12:45:24.225568+0000","last_became_peered":"2023-10-08T12:45:24.225568+0000","last_unstale":"2023-10-08T12:45:24.228079+0000","last_undegraded":"2023-10-08T12:45:24.228079+0000","last_fullsized":"2023-10-08T12:45:24.228079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:08.251593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210834+0000","last_change":"2023-10-08T12:45:24.210834+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210834+0000","last_undegraded":"2023-10-08T12:45:24.210834+0000","last_fullsized":"2023-10-08T12:45:24.210834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.224588+0000","last_change":"2023-10-08T12:45:24.221289+0000","last_active":"2023-10-08T12:45:24.224588+0000","last_peered":"2023-10-08T12:45:24.224588+0000","last_clean":"2023-10-08T12:45:24.224588+0000","last_became_active":"2023-10-08T12:45:24.220980+0000","last_became_peered":"2023-10-08T12:45:24.220980+0000","last_unstale":"2023-10-08T12:45:24.224588+0000","last_undegraded":"2023-10-08T12:45:24.224588+0000","last_fullsized":"2023-10-08T12:45:24.224588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.211066+0000","last_change":"2023-10-08T12:45:24.211066+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.211066+0000","last_undegraded":"2023-10-08T12:45:24.211066+0000","last_fullsized":"2023-10-08T12:45:24.211066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.227046+0000","last_change":"2023-10-08T12:45:24.223766+0000","last_active":"2023-10-08T12:45:24.227046+0000","last_peered":"2023-10-08T12:45:24.227046+0000","last_clean":"2023-10-08T12:45:24.227046+0000","last_became_active":"2023-10-08T12:45:24.223463+0000","last_became_peered":"2023-10-08T12:45:24.223463+0000","last_unstale":"2023-10-08T12:45:24.227046+0000","last_undegraded":"2023-10-08T12:45:24.227046+0000","last_fullsized":"2023-10-08T12:45:24.227046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:28.393554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.212628+0000","last_change":"2023-10-08T12:45:24.212628+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.212628+0000","last_undegraded":"2023-10-08T12:45:24.212628+0000","last_fullsized":"2023-10-08T12:45:24.212628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.221506+0000","last_change":"2023-10-08T12:45:24.219555+0000","last_active":"2023-10-08T12:45:24.221506+0000","last_peered":"2023-10-08T12:45:24.221506+0000","last_clean":"2023-10-08T12:45:24.221506+0000","last_became_active":"2023-10-08T12:45:24.219262+0000","last_became_peered":"2023-10-08T12:45:24.219262+0000","last_unstale":"2023-10-08T12:45:24.221506+0000","last_undegraded":"2023-10-08T12:45:24.221506+0000","last_fullsized":"2023-10-08T12:45:24.221506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:28.393554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.216049+0000","last_change":"2023-10-08T12:45:24.216049+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.216049+0000","last_undegraded":"2023-10-08T12:45:24.216049+0000","last_fullsized":"2023-10-08T12:45:24.216049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.225678+0000","last_change":"2023-10-08T12:45:24.224004+0000","last_active":"2023-10-08T12:45:24.225678+0000","last_peered":"2023-10-08T12:45:24.225678+0000","last_clean":"2023-10-08T12:45:24.225678+0000","last_became_active":"2023-10-08T12:45:24.223726+0000","last_became_peered":"2023-10-08T12:45:24.223726+0000","last_unstale":"2023-10-08T12:45:24.225678+0000","last_undegraded":"2023-10-08T12:45:24.225678+0000","last_fullsized":"2023-10-08T12:45:24.225678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:15.170657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213312+0000","last_change":"2023-10-08T12:45:24.213312+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213312+0000","last_undegraded":"2023-10-08T12:45:24.213312+0000","last_fullsized":"2023-10-08T12:45:24.213312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.228866+0000","last_change":"2023-10-08T12:45:24.226086+0000","last_active":"2023-10-08T12:45:24.228866+0000","last_peered":"2023-10-08T12:45:24.228866+0000","last_clean":"2023-10-08T12:45:24.228866+0000","last_became_active":"2023-10-08T12:45:24.225807+0000","last_became_peered":"2023-10-08T12:45:24.225807+0000","last_unstale":"2023-10-08T12:45:24.228866+0000","last_undegraded":"2023-10-08T12:45:24.228866+0000","last_fullsized":"2023-10-08T12:45:24.228866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:23.245919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210977+0000","last_change":"2023-10-08T12:45:24.210977+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210977+0000","last_undegraded":"2023-10-08T12:45:24.210977+0000","last_fullsized":"2023-10-08T12:45:24.210977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.228684+0000","last_change":"2023-10-08T12:45:24.226329+0000","last_active":"2023-10-08T12:45:24.228684+0000","last_peered":"2023-10-08T12:45:24.228684+0000","last_clean":"2023-10-08T12:45:24.228684+0000","last_became_active":"2023-10-08T12:45:24.226056+0000","last_became_peered":"2023-10-08T12:45:24.226056+0000","last_unstale":"2023-10-08T12:45:24.228684+0000","last_undegraded":"2023-10-08T12:45:24.228684+0000","last_fullsized":"2023-10-08T12:45:24.228684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210367+0000","last_change":"2023-10-08T12:45:24.210367+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210367+0000","last_undegraded":"2023-10-08T12:45:24.210367+0000","last_fullsized":"2023-10-08T12:45:24.210367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.225639+0000","last_change":"2023-10-08T12:45:24.222786+0000","last_active":"2023-10-08T12:45:24.225639+0000","last_peered":"2023-10-08T12:45:24.225639+0000","last_clean":"2023-10-08T12:45:24.225639+0000","last_became_active":"2023-10-08T12:45:24.222465+0000","last_became_peered":"2023-10-08T12:45:24.222465+0000","last_unstale":"2023-10-08T12:45:24.225639+0000","last_undegraded":"2023-10-08T12:45:24.225639+0000","last_fullsized":"2023-10-08T12:45:24.225639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:08.251593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.219875+0000","last_change":"2023-10-08T12:45:24.219875+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.219875+0000","last_undegraded":"2023-10-08T12:45:24.219875+0000","last_fullsized":"2023-10-08T12:45:24.219875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.223131+0000","last_change":"2023-10-08T12:45:24.221225+0000","last_active":"2023-10-08T12:45:24.223131+0000","last_peered":"2023-10-08T12:45:24.223131+0000","last_clean":"2023-10-08T12:45:24.223131+0000","last_became_active":"2023-10-08T12:45:24.220465+0000","last_became_peered":"2023-10-08T12:45:24.220465+0000","last_unstale":"2023-10-08T12:45:24.223131+0000","last_undegraded":"2023-10-08T12:45:24.223131+0000","last_fullsized":"2023-10-08T12:45:24.223131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:08.251593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210495+0000","last_change":"2023-10-08T12:45:24.210495+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210495+0000","last_undegraded":"2023-10-08T12:45:24.210495+0000","last_fullsized":"2023-10-08T12:45:24.210495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.224486+0000","last_change":"2023-10-08T12:45:24.223071+0000","last_active":"2023-10-08T12:45:24.224486+0000","last_peered":"2023-10-08T12:45:24.224486+0000","last_clean":"2023-10-08T12:45:24.224486+0000","last_became_active":"2023-10-08T12:45:24.222681+0000","last_became_peered":"2023-10-08T12:45:24.222681+0000","last_unstale":"2023-10-08T12:45:24.224486+0000","last_undegraded":"2023-10-08T12:45:24.224486+0000","last_fullsized":"2023-10-08T12:45:24.224486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213378+0000","last_change":"2023-10-08T12:45:24.213378+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213378+0000","last_undegraded":"2023-10-08T12:45:24.213378+0000","last_fullsized":"2023-10-08T12:45:24.213378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.224558+0000","last_change":"2023-10-08T12:45:24.220892+0000","last_active":"2023-10-08T12:45:24.224558+0000","last_peered":"2023-10-08T12:45:24.224558+0000","last_clean":"2023-10-08T12:45:24.224558+0000","last_became_active":"2023-10-08T12:45:24.220573+0000","last_became_peered":"2023-10-08T12:45:24.220573+0000","last_unstale":"2023-10-08T12:45:24.224558+0000","last_undegraded":"2023-10-08T12:45:24.224558+0000","last_fullsized":"2023-10-08T12:45:24.224558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:28.393554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213240+0000","last_change":"2023-10-08T12:45:24.213240+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213240+0000","last_undegraded":"2023-10-08T12:45:24.213240+0000","last_fullsized":"2023-10-08T12:45:24.213240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.226948+0000","last_change":"2023-10-08T12:45:24.225777+0000","last_active":"2023-10-08T12:45:24.226948+0000","last_peered":"2023-10-08T12:45:24.226948+0000","last_clean":"2023-10-08T12:45:24.226948+0000","last_became_active":"2023-10-08T12:45:24.225472+0000","last_became_peered":"2023-10-08T12:45:24.225472+0000","last_unstale":"2023-10-08T12:45:24.226948+0000","last_undegraded":"2023-10-08T12:45:24.226948+0000","last_fullsized":"2023-10-08T12:45:24.226948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:15.170657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213636+0000","last_change":"2023-10-08T12:45:24.213636+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213636+0000","last_undegraded":"2023-10-08T12:45:24.213636+0000","last_fullsized":"2023-10-08T12:45:24.213636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.225971+0000","last_change":"2023-10-08T12:45:24.222110+0000","last_active":"2023-10-08T12:45:24.225971+0000","last_peered":"2023-10-08T12:45:24.225971+0000","last_clean":"2023-10-08T12:45:24.225971+0000","last_became_active":"2023-10-08T12:45:24.221768+0000","last_became_peered":"2023-10-08T12:45:24.221768+0000","last_unstale":"2023-10-08T12:45:24.225971+0000","last_undegraded":"2023-10-08T12:45:24.225971+0000","last_fullsized":"2023-10-08T12:45:24.225971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.216619+0000","last_change":"2023-10-08T12:45:24.216619+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.216619+0000","last_undegraded":"2023-10-08T12:45:24.216619+0000","last_fullsized":"2023-10-08T12:45:24.216619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.228635+0000","last_change":"2023-10-08T12:45:24.225910+0000","last_active":"2023-10-08T12:45:24.228635+0000","last_peered":"2023-10-08T12:45:24.228635+0000","last_clean":"2023-10-08T12:45:24.228635+0000","last_became_active":"2023-10-08T12:45:24.225590+0000","last_became_peered":"2023-10-08T12:45:24.225590+0000","last_unstale":"2023-10-08T12:45:24.228635+0000","last_undegraded":"2023-10-08T12:45:24.228635+0000","last_fullsized":"2023-10-08T12:45:24.228635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:15.170657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213456+0000","last_change":"2023-10-08T12:45:24.213456+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213456+0000","last_undegraded":"2023-10-08T12:45:24.213456+0000","last_fullsized":"2023-10-08T12:45:24.213456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.228742+0000","last_change":"2023-10-08T12:45:24.226194+0000","last_active":"2023-10-08T12:45:24.228742+0000","last_peered":"2023-10-08T12:45:24.228742+0000","last_clean":"2023-10-08T12:45:24.228742+0000","last_became_active":"2023-10-08T12:45:24.225901+0000","last_became_peered":"2023-10-08T12:45:24.225901+0000","last_unstale":"2023-10-08T12:45:24.228742+0000","last_undegraded":"2023-10-08T12:45:24.228742+0000","last_fullsized":"2023-10-08T12:45:24.228742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:15.170657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210301+0000","last_change":"2023-10-08T12:45:24.210301+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210301+0000","last_undegraded":"2023-10-08T12:45:24.210301+0000","last_fullsized":"2023-10-08T12:45:24.210301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.217923+0000","last_change":"2023-10-08T12:45:24.217923+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.217923+0000","last_undegraded":"2023-10-08T12:45:24.217923+0000","last_fullsized":"2023-10-08T12:45:24.217923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.218628+0000","last_change":"2023-10-08T12:45:24.216886+0000","last_active":"2023-10-08T12:45:24.218628+0000","last_peered":"2023-10-08T12:45:24.218628+0000","last_clean":"2023-10-08T12:45:24.218628+0000","last_became_active":"2023-10-08T12:45:24.216435+0000","last_became_peered":"2023-10-08T12:45:24.216435+0000","last_unstale":"2023-10-08T12:45:24.218628+0000","last_undegraded":"2023-10-08T12:45:24.218628+0000","last_fullsized":"2023-10-08T12:45:24.218628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:08.251593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.209282+0000","last_change":"2023-10-08T12:45:24.209282+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.209282+0000","last_undegraded":"2023-10-08T12:45:24.209282+0000","last_fullsized":"2023-10-08T12:45:24.209282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.221461+0000","last_change":"2023-10-08T12:45:24.218750+0000","last_active":"2023-10-08T12:45:24.221461+0000","last_peered":"2023-10-08T12:45:24.221461+0000","last_clean":"2023-10-08T12:45:24.221461+0000","last_became_active":"2023-10-08T12:45:24.218402+0000","last_became_peered":"2023-10-08T12:45:24.218402+0000","last_unstale":"2023-10-08T12:45:24.221461+0000","last_undegraded":"2023-10-08T12:45:24.221461+0000","last_fullsized":"2023-10-08T12:45:24.221461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:08.251593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":163,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.221448+0000","last_change":"2023-10-08T12:45:21.094571+0000","last_active":"2023-10-08T12:45:24.221448+0000","last_peered":"2023-10-08T12:45:24.221448+0000","last_clean":"2023-10-08T12:45:24.221448+0000","last_became_active":"2023-10-08T12:45:21.093551+0000","last_became_peered":"2023-10-08T12:45:21.093551+0000","last_unstale":"2023-10-08T12:45:24.221448+0000","last_undegraded":"2023-10-08T12:45:24.221448+0000","last_fullsized":"2023-10-08T12:45:24.221448+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:19.842786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:19.842786+0000","last_clean_scrub_stamp":"2023-10-08T12:45:19.842786+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:25.041743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.209841+0000","last_change":"2023-10-08T12:45:24.209841+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.209841+0000","last_undegraded":"2023-10-08T12:45:24.209841+0000","last_fullsized":"2023-10-08T12:45:24.209841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.234531+0000","last_change":"2023-10-08T12:45:24.229708+0000","last_active":"2023-10-08T12:45:24.234531+0000","last_peered":"2023-10-08T12:45:24.234531+0000","last_clean":"2023-10-08T12:45:24.234531+0000","last_became_active":"2023-10-08T12:45:24.229494+0000","last_became_peered":"2023-10-08T12:45:24.229494+0000","last_unstale":"2023-10-08T12:45:24.234531+0000","last_undegraded":"2023-10-08T12:45:24.234531+0000","last_fullsized":"2023-10-08T12:45:24.234531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:15.170657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.234464+0000","last_change":"2023-10-08T12:45:24.229122+0000","last_active":"2023-10-08T12:45:24.234464+0000","last_peered":"2023-10-08T12:45:24.234464+0000","last_clean":"2023-10-08T12:45:24.234464+0000","last_became_active":"2023-10-08T12:45:24.228838+0000","last_became_peered":"2023-10-08T12:45:24.228838+0000","last_unstale":"2023-10-08T12:45:24.234464+0000","last_undegraded":"2023-10-08T12:45:24.234464+0000","last_fullsized":"2023-10-08T12:45:24.234464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:19:36.620765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.219902+0000","last_change":"2023-10-08T12:45:24.219902+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.219902+0000","last_undegraded":"2023-10-08T12:45:24.219902+0000","last_fullsized":"2023-10-08T12:45:24.219902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.229064+0000","last_change":"2023-10-08T12:45:24.226993+0000","last_active":"2023-10-08T12:45:24.229064+0000","last_peered":"2023-10-08T12:45:24.229064+0000","last_clean":"2023-10-08T12:45:24.229064+0000","last_became_active":"2023-10-08T12:45:24.226721+0000","last_became_peered":"2023-10-08T12:45:24.226721+0000","last_unstale":"2023-10-08T12:45:24.229064+0000","last_undegraded":"2023-10-08T12:45:24.229064+0000","last_fullsized":"2023-10-08T12:45:24.229064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:03:57.184403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.209710+0000","last_change":"2023-10-08T12:45:24.209710+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.209710+0000","last_undegraded":"2023-10-08T12:45:24.209710+0000","last_fullsized":"2023-10-08T12:45:24.209710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.234227+0000","last_change":"2023-10-08T12:45:24.229198+0000","last_active":"2023-10-08T12:45:24.234227+0000","last_peered":"2023-10-08T12:45:24.234227+0000","last_clean":"2023-10-08T12:45:24.234227+0000","last_became_active":"2023-10-08T12:45:24.228922+0000","last_became_peered":"2023-10-08T12:45:24.228922+0000","last_unstale":"2023-10-08T12:45:24.234227+0000","last_undegraded":"2023-10-08T12:45:24.234227+0000","last_fullsized":"2023-10-08T12:45:24.234227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:23.245919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.209913+0000","last_change":"2023-10-08T12:45:24.209913+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.209913+0000","last_undegraded":"2023-10-08T12:45:24.209913+0000","last_fullsized":"2023-10-08T12:45:24.209913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.231553+0000","last_change":"2023-10-08T12:45:24.228202+0000","last_active":"2023-10-08T12:45:24.231553+0000","last_peered":"2023-10-08T12:45:24.231553+0000","last_clean":"2023-10-08T12:45:24.231553+0000","last_became_active":"2023-10-08T12:45:24.227988+0000","last_became_peered":"2023-10-08T12:45:24.227988+0000","last_unstale":"2023-10-08T12:45:24.231553+0000","last_undegraded":"2023-10-08T12:45:24.231553+0000","last_fullsized":"2023-10-08T12:45:24.231553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210282+0000","last_change":"2023-10-08T12:45:24.210282+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210282+0000","last_undegraded":"2023-10-08T12:45:24.210282+0000","last_fullsized":"2023-10-08T12:45:24.210282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.229119+0000","last_change":"2023-10-08T12:45:24.228028+0000","last_active":"2023-10-08T12:45:24.229119+0000","last_peered":"2023-10-08T12:45:24.229119+0000","last_clean":"2023-10-08T12:45:24.229119+0000","last_became_active":"2023-10-08T12:45:24.227739+0000","last_became_peered":"2023-10-08T12:45:24.227739+0000","last_unstale":"2023-10-08T12:45:24.229119+0000","last_undegraded":"2023-10-08T12:45:24.229119+0000","last_fullsized":"2023-10-08T12:45:24.229119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:23.245919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.209625+0000","last_change":"2023-10-08T12:45:24.209625+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.209625+0000","last_undegraded":"2023-10-08T12:45:24.209625+0000","last_fullsized":"2023-10-08T12:45:24.209625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.227316+0000","last_change":"2023-10-08T12:45:24.222491+0000","last_active":"2023-10-08T12:45:24.227316+0000","last_peered":"2023-10-08T12:45:24.227316+0000","last_clean":"2023-10-08T12:45:24.227316+0000","last_became_active":"2023-10-08T12:45:24.222266+0000","last_became_peered":"2023-10-08T12:45:24.222266+0000","last_unstale":"2023-10-08T12:45:24.227316+0000","last_undegraded":"2023-10-08T12:45:24.227316+0000","last_fullsized":"2023-10-08T12:45:24.227316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:28.393554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210719+0000","last_change":"2023-10-08T12:45:24.210719+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210719+0000","last_undegraded":"2023-10-08T12:45:24.210719+0000","last_fullsized":"2023-10-08T12:45:24.210719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.231530+0000","last_change":"2023-10-08T12:45:24.227674+0000","last_active":"2023-10-08T12:45:24.231530+0000","last_peered":"2023-10-08T12:45:24.231530+0000","last_clean":"2023-10-08T12:45:24.231530+0000","last_became_active":"2023-10-08T12:45:24.227376+0000","last_became_peered":"2023-10-08T12:45:24.227376+0000","last_unstale":"2023-10-08T12:45:24.231530+0000","last_undegraded":"2023-10-08T12:45:24.231530+0000","last_fullsized":"2023-10-08T12:45:24.231530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:23.245919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.215552+0000","last_change":"2023-10-08T12:45:24.215552+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.215552+0000","last_undegraded":"2023-10-08T12:45:24.215552+0000","last_fullsized":"2023-10-08T12:45:24.215552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.218592+0000","last_change":"2023-10-08T12:45:24.215676+0000","last_active":"2023-10-08T12:45:24.218592+0000","last_peered":"2023-10-08T12:45:24.218592+0000","last_clean":"2023-10-08T12:45:24.218592+0000","last_became_active":"2023-10-08T12:45:24.215332+0000","last_became_peered":"2023-10-08T12:45:24.215332+0000","last_unstale":"2023-10-08T12:45:24.218592+0000","last_undegraded":"2023-10-08T12:45:24.218592+0000","last_fullsized":"2023-10-08T12:45:24.218592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:11.034158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213956+0000","last_change":"2023-10-08T12:45:24.213956+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213956+0000","last_undegraded":"2023-10-08T12:45:24.213956+0000","last_fullsized":"2023-10-08T12:45:24.213956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.226783+0000","last_change":"2023-10-08T12:45:24.220654+0000","last_active":"2023-10-08T12:45:24.226783+0000","last_peered":"2023-10-08T12:45:24.226783+0000","last_clean":"2023-10-08T12:45:24.226783+0000","last_became_active":"2023-10-08T12:45:24.220367+0000","last_became_peered":"2023-10-08T12:45:24.220367+0000","last_unstale":"2023-10-08T12:45:24.226783+0000","last_undegraded":"2023-10-08T12:45:24.226783+0000","last_fullsized":"2023-10-08T12:45:24.226783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:08.251593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.211647+0000","last_change":"2023-10-08T12:45:24.211647+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.211647+0000","last_undegraded":"2023-10-08T12:45:24.211647+0000","last_fullsized":"2023-10-08T12:45:24.211647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T12:45:24.218617+0000","last_change":"2023-10-08T12:45:24.216389+0000","last_active":"2023-10-08T12:45:24.218617+0000","last_peered":"2023-10-08T12:45:24.218617+0000","last_clean":"2023-10-08T12:45:24.218617+0000","last_became_active":"2023-10-08T12:45:24.216111+0000","last_became_peered":"2023-10-08T12:45:24.216111+0000","last_unstale":"2023-10-08T12:45:24.218617+0000","last_undegraded":"2023-10-08T12:45:24.218617+0000","last_fullsized":"2023-10-08T12:45:24.218617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:28.393554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.214398+0000","last_change":"2023-10-08T12:45:24.214398+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.214398+0000","last_undegraded":"2023-10-08T12:45:24.214398+0000","last_fullsized":"2023-10-08T12:45:24.214398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213834+0000","last_change":"2023-10-08T12:45:24.213834+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213834+0000","last_undegraded":"2023-10-08T12:45:24.213834+0000","last_fullsized":"2023-10-08T12:45:24.213834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.208467+0000","last_change":"2023-10-08T12:45:24.208467+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.208467+0000","last_undegraded":"2023-10-08T12:45:24.208467+0000","last_fullsized":"2023-10-08T12:45:24.208467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.212366+0000","last_change":"2023-10-08T12:45:24.212366+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.212366+0000","last_undegraded":"2023-10-08T12:45:24.212366+0000","last_fullsized":"2023-10-08T12:45:24.212366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.211571+0000","last_change":"2023-10-08T12:45:24.211571+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.211571+0000","last_undegraded":"2023-10-08T12:45:24.211571+0000","last_fullsized":"2023-10-08T12:45:24.211571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213860+0000","last_change":"2023-10-08T12:45:24.213860+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213860+0000","last_undegraded":"2023-10-08T12:45:24.213860+0000","last_fullsized":"2023-10-08T12:45:24.213860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.218858+0000","last_change":"2023-10-08T12:45:24.218858+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.218858+0000","last_undegraded":"2023-10-08T12:45:24.218858+0000","last_fullsized":"2023-10-08T12:45:24.218858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.216612+0000","last_change":"2023-10-08T12:45:24.216612+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.216612+0000","last_undegraded":"2023-10-08T12:45:24.216612+0000","last_fullsized":"2023-10-08T12:45:24.216612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.212770+0000","last_change":"2023-10-08T12:45:24.212770+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.212770+0000","last_undegraded":"2023-10-08T12:45:24.212770+0000","last_fullsized":"2023-10-08T12:45:24.212770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.210381+0000","last_change":"2023-10-08T12:45:24.210381+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.210381+0000","last_undegraded":"2023-10-08T12:45:24.210381+0000","last_fullsized":"2023-10-08T12:45:24.210381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.213760+0000","last_change":"2023-10-08T12:45:24.213760+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.213760+0000","last_undegraded":"2023-10-08T12:45:24.213760+0000","last_fullsized":"2023-10-08T12:45:24.213760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.212940+0000","last_change":"2023-10-08T12:45:24.212940+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.212940+0000","last_undegraded":"2023-10-08T12:45:24.212940+0000","last_fullsized":"2023-10-08T12:45:24.212940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.212268+0000","last_change":"2023-10-08T12:45:24.212268+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.212268+0000","last_undegraded":"2023-10-08T12:45:24.212268+0000","last_fullsized":"2023-10-08T12:45:24.212268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-08T12:45:24.215024+0000","last_change":"2023-10-08T12:45:24.215024+0000","last_active":"2023-10-08T12:45:24.199834+0000","last_peered":"2023-10-08T12:45:24.199834+0000","last_clean":"2023-10-08T12:45:24.199834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:45:24.215024+0000","last_undegraded":"2023-10-08T12:45:24.215024+0000","last_fullsized":"2023-10-08T12:45:24.215024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":774144,"data_stored":648191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":774144,"data_stored":648191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:45:32.539 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:45:32.541 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:45:33.998 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T12:45:34.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.139+0000 7fc425a4b700 1 -- 172.21.15.45:0/2941942896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc408004850 msgr2=0x7fc408004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:34.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.139+0000 7fc425a4b700 1 --2- 172.21.15.45:0/2941942896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc408004850 0x7fc408004cd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc41000c2e0 tx=0x7fc408005880 comp rx=0 tx=0).stop 2023-10-08T12:45:34.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.139+0000 7fc41f7fe700 1 -- 172.21.15.45:0/2941942896 reap_dead start 2023-10-08T12:45:34.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.139+0000 7fc425a4b700 1 -- 172.21.15.45:0/2941942896 shutdown_connections 2023-10-08T12:45:34.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.139+0000 7fc425a4b700 1 -- 172.21.15.45:0/2941942896 >> 172.21.15.45:0/2941942896 conn(0x7fc42006ba80 msgr2=0x7fc42006be90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:34.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.139+0000 7fc425a4b700 1 -- 172.21.15.45:0/2941942896 shutdown_connections 2023-10-08T12:45:34.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.139+0000 7fc425a4b700 1 -- 172.21.15.45:0/2941942896 wait complete. 2023-10-08T12:45:34.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.140+0000 7fc425a4b700 1 Processor -- start 2023-10-08T12:45:34.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.141+0000 7fc425a4b700 1 -- start start 2023-10-08T12:45:34.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.141+0000 7fc425a4b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc408004850 0x7fc4201f2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:34.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.141+0000 7fc425a4b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc42015d8f0 0x7fc4200c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:34.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.141+0000 7fc425a4b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc42015dd50 0x7fc4200c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:34.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.141+0000 7fc425a4b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4200c54f0 con 0x7fc408004850 2023-10-08T12:45:34.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.141+0000 7fc425a4b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4200c5790 con 0x7fc42015d8f0 2023-10-08T12:45:34.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.141+0000 7fc425a4b700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4200c5a70 con 0x7fc42015dd50 2023-10-08T12:45:34.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.141+0000 7fc41effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc408004850 0x7fc4201f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:34.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.141+0000 7fc41effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc408004850 0x7fc4201f2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34978/0 (socket says 172.21.15.45:34978) 2023-10-08T12:45:34.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.141+0000 7fc41effd700 1 -- 172.21.15.45:0/3841950988 learned_addr learned my addr 172.21.15.45:0/3841950988 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:34.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.142+0000 7fc41e7fc700 1 --2- 172.21.15.45:0/3841950988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc42015d8f0 0x7fc4200c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:34.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.142+0000 7fc41f7fe700 1 --2- 172.21.15.45:0/3841950988 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc42015dd50 0x7fc4200c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:34.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.142+0000 7fc41effd700 1 -- 172.21.15.45:0/3841950988 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc42015dd50 msgr2=0x7fc4200c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:34.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.142+0000 7fc41effd700 1 --2- 172.21.15.45:0/3841950988 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc42015dd50 0x7fc4200c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:34.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.142+0000 7fc41effd700 1 -- 172.21.15.45:0/3841950988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc42015d8f0 msgr2=0x7fc4200c9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:34.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.142+0000 7fc41effd700 1 --2- 172.21.15.45:0/3841950988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc42015d8f0 0x7fc4200c9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:34.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.142+0000 7fc41effd700 1 -- 172.21.15.45:0/3841950988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4200c5d50 con 0x7fc408004850 2023-10-08T12:45:34.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.142+0000 7fc41f7fe700 1 --2- 172.21.15.45:0/3841950988 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc42015dd50 0x7fc4200c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:34.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.142+0000 7fc41effd700 1 --2- 172.21.15.45:0/3841950988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc408004850 0x7fc4201f2fe0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc414011ab0 tx=0x7fc414011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:34.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.142+0000 7fc407fff700 1 -- 172.21.15.45:0/3841950988 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41400fac0 con 0x7fc408004850 2023-10-08T12:45:34.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.142+0000 7fc407fff700 1 -- 172.21.15.45:0/3841950988 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc41400fc20 con 0x7fc408004850 2023-10-08T12:45:34.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.142+0000 7fc425a4b700 1 -- 172.21.15.45:0/3841950988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4200c6030 con 0x7fc408004850 2023-10-08T12:45:34.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.142+0000 7fc407fff700 1 -- 172.21.15.45:0/3841950988 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc414019410 con 0x7fc408004850 2023-10-08T12:45:34.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.142+0000 7fc425a4b700 1 -- 172.21.15.45:0/3841950988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4201f3520 con 0x7fc408004850 2023-10-08T12:45:34.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.143+0000 7fc425a4b700 1 -- 172.21.15.45:0/3841950988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc42004e4c0 con 0x7fc408004850 2023-10-08T12:45:34.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.144+0000 7fc407fff700 1 -- 172.21.15.45:0/3841950988 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc414019590 con 0x7fc408004850 2023-10-08T12:45:34.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.144+0000 7fc407fff700 1 --2- 172.21.15.45:0/3841950988 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc40c06aed0 0x7fc40c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:34.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.144+0000 7fc407fff700 1 -- 172.21.15.45:0/3841950988 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc414089fc0 con 0x7fc408004850 2023-10-08T12:45:34.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.144+0000 7fc41e7fc700 1 --2- 172.21.15.45:0/3841950988 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc40c06aed0 0x7fc40c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:34.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.145+0000 7fc41e7fc700 1 --2- 172.21.15.45:0/3841950988 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc40c06aed0 0x7fc40c06d390 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc410001930 tx=0x7fc410000fe0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:34.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.149+0000 7fc407fff700 1 -- 172.21.15.45:0/3841950988 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc4140bcca0 con 0x7fc408004850 2023-10-08T12:45:34.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.344+0000 7fc425a4b700 1 -- 172.21.15.45:0/3841950988 --> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc4200b44e0 con 0x7fc40c06aed0 2023-10-08T12:45:34.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.352+0000 7fc407fff700 1 -- 172.21.15.45:0/3841950988 <== mgr.4105 v2:172.21.15.78:6832/3438117854 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264675 (secure 0 0 0) 0x7fc4200b44e0 con 0x7fc40c06aed0 2023-10-08T12:45:34.358 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:34.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.354+0000 7fc425a4b700 1 -- 172.21.15.45:0/3841950988 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc40c06aed0 msgr2=0x7fc40c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:34.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.354+0000 7fc425a4b700 1 --2- 172.21.15.45:0/3841950988 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc40c06aed0 0x7fc40c06d390 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc410001930 tx=0x7fc410000fe0 comp rx=0 tx=0).stop 2023-10-08T12:45:34.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.354+0000 7fc425a4b700 1 -- 172.21.15.45:0/3841950988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc408004850 msgr2=0x7fc4201f2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:34.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.354+0000 7fc425a4b700 1 --2- 172.21.15.45:0/3841950988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc408004850 0x7fc4201f2fe0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc414011ab0 tx=0x7fc414011dc0 comp rx=0 tx=0).stop 2023-10-08T12:45:34.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.354+0000 7fc425a4b700 1 -- 172.21.15.45:0/3841950988 shutdown_connections 2023-10-08T12:45:34.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.355+0000 7fc425a4b700 1 --2- 172.21.15.45:0/3841950988 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc40c06aed0 0x7fc40c06d390 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:34.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.355+0000 7fc425a4b700 1 --2- 172.21.15.45:0/3841950988 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc42015dd50 0x7fc4200c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:34.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.355+0000 7fc425a4b700 1 --2- 172.21.15.45:0/3841950988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc408004850 0x7fc4201f2fe0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:34.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.355+0000 7fc425a4b700 1 --2- 172.21.15.45:0/3841950988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc42015d8f0 0x7fc4200c9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:34.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.355+0000 7fc425a4b700 1 -- 172.21.15.45:0/3841950988 >> 172.21.15.45:0/3841950988 conn(0x7fc42006ba80 msgr2=0x7fc4200b1400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:34.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.355+0000 7fc425a4b700 1 -- 172.21.15.45:0/3841950988 shutdown_connections 2023-10-08T12:45:34.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.355+0000 7fc425a4b700 1 -- 172.21.15.45:0/3841950988 wait complete. 2023-10-08T12:45:34.363 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-08T12:45:34.367 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-08T12:45:33.129306+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":181,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219016,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755704,"statfs":{"total":773094113280,"available":772869840896,"internally_reserved":0,"allocated":2891776,"data_stored":1752740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002550"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427435+0000","last_change":"2023-10-08T12:45:25.234814+0000","last_active":"2023-10-08T12:45:26.427435+0000","last_peered":"2023-10-08T12:45:26.427435+0000","last_clean":"2023-10-08T12:45:26.427435+0000","last_became_active":"2023-10-08T12:45:25.234312+0000","last_became_peered":"2023-10-08T12:45:25.234312+0000","last_unstale":"2023-10-08T12:45:26.427435+0000","last_undegraded":"2023-10-08T12:45:26.427435+0000","last_fullsized":"2023-10-08T12:45:26.427435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:04:40.256365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427240+0000","last_change":"2023-10-08T12:45:25.237535+0000","last_active":"2023-10-08T12:45:26.427240+0000","last_peered":"2023-10-08T12:45:26.427240+0000","last_clean":"2023-10-08T12:45:26.427240+0000","last_became_active":"2023-10-08T12:45:25.237106+0000","last_became_peered":"2023-10-08T12:45:25.237106+0000","last_unstale":"2023-10-08T12:45:26.427240+0000","last_undegraded":"2023-10-08T12:45:26.427240+0000","last_fullsized":"2023-10-08T12:45:26.427240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:04:54.376133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427308+0000","last_change":"2023-10-08T12:45:25.224344+0000","last_active":"2023-10-08T12:45:26.427308+0000","last_peered":"2023-10-08T12:45:26.427308+0000","last_clean":"2023-10-08T12:45:26.427308+0000","last_became_active":"2023-10-08T12:45:25.224047+0000","last_became_peered":"2023-10-08T12:45:25.224047+0000","last_unstale":"2023-10-08T12:45:26.427308+0000","last_undegraded":"2023-10-08T12:45:26.427308+0000","last_fullsized":"2023-10-08T12:45:26.427308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:41.055637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211657+0000","last_change":"2023-10-08T12:45:25.238941+0000","last_active":"2023-10-08T12:45:26.211657+0000","last_peered":"2023-10-08T12:45:26.211657+0000","last_clean":"2023-10-08T12:45:26.211657+0000","last_became_active":"2023-10-08T12:45:25.238025+0000","last_became_peered":"2023-10-08T12:45:25.238025+0000","last_unstale":"2023-10-08T12:45:26.211657+0000","last_undegraded":"2023-10-08T12:45:26.211657+0000","last_fullsized":"2023-10-08T12:45:26.211657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:49:50.098137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426928+0000","last_change":"2023-10-08T12:45:25.234488+0000","last_active":"2023-10-08T12:45:26.426928+0000","last_peered":"2023-10-08T12:45:26.426928+0000","last_clean":"2023-10-08T12:45:26.426928+0000","last_became_active":"2023-10-08T12:45:25.234222+0000","last_became_peered":"2023-10-08T12:45:25.234222+0000","last_unstale":"2023-10-08T12:45:26.426928+0000","last_undegraded":"2023-10-08T12:45:26.426928+0000","last_fullsized":"2023-10-08T12:45:26.426928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:15.909104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.210706+0000","last_change":"2023-10-08T12:45:25.239298+0000","last_active":"2023-10-08T12:45:26.210706+0000","last_peered":"2023-10-08T12:45:26.210706+0000","last_clean":"2023-10-08T12:45:26.210706+0000","last_became_active":"2023-10-08T12:45:25.238959+0000","last_became_peered":"2023-10-08T12:45:25.238959+0000","last_unstale":"2023-10-08T12:45:26.210706+0000","last_undegraded":"2023-10-08T12:45:26.210706+0000","last_fullsized":"2023-10-08T12:45:26.210706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:47:19.248207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426883+0000","last_change":"2023-10-08T12:45:25.237303+0000","last_active":"2023-10-08T12:45:26.426883+0000","last_peered":"2023-10-08T12:45:26.426883+0000","last_clean":"2023-10-08T12:45:26.426883+0000","last_became_active":"2023-10-08T12:45:25.237013+0000","last_became_peered":"2023-10-08T12:45:25.237013+0000","last_unstale":"2023-10-08T12:45:26.426883+0000","last_undegraded":"2023-10-08T12:45:26.426883+0000","last_fullsized":"2023-10-08T12:45:26.426883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:56:33.493223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426665+0000","last_change":"2023-10-08T12:45:25.232154+0000","last_active":"2023-10-08T12:45:26.426665+0000","last_peered":"2023-10-08T12:45:26.426665+0000","last_clean":"2023-10-08T12:45:26.426665+0000","last_became_active":"2023-10-08T12:45:25.231838+0000","last_became_peered":"2023-10-08T12:45:25.231838+0000","last_unstale":"2023-10-08T12:45:26.426665+0000","last_undegraded":"2023-10-08T12:45:26.426665+0000","last_fullsized":"2023-10-08T12:45:26.426665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:41.055637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427423+0000","last_change":"2023-10-08T12:45:25.235235+0000","last_active":"2023-10-08T12:45:26.427423+0000","last_peered":"2023-10-08T12:45:26.427423+0000","last_clean":"2023-10-08T12:45:26.427423+0000","last_became_active":"2023-10-08T12:45:25.234979+0000","last_became_peered":"2023-10-08T12:45:25.234979+0000","last_unstale":"2023-10-08T12:45:26.427423+0000","last_undegraded":"2023-10-08T12:45:26.427423+0000","last_fullsized":"2023-10-08T12:45:26.427423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:49:46.849372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427454+0000","last_change":"2023-10-08T12:45:25.231507+0000","last_active":"2023-10-08T12:45:26.427454+0000","last_peered":"2023-10-08T12:45:26.427454+0000","last_clean":"2023-10-08T12:45:26.427454+0000","last_became_active":"2023-10-08T12:45:25.231239+0000","last_became_peered":"2023-10-08T12:45:25.231239+0000","last_unstale":"2023-10-08T12:45:26.427454+0000","last_undegraded":"2023-10-08T12:45:26.427454+0000","last_fullsized":"2023-10-08T12:45:26.427454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:56:33.493223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427009+0000","last_change":"2023-10-08T12:45:25.233027+0000","last_active":"2023-10-08T12:45:26.427009+0000","last_peered":"2023-10-08T12:45:26.427009+0000","last_clean":"2023-10-08T12:45:26.427009+0000","last_became_active":"2023-10-08T12:45:25.232719+0000","last_became_peered":"2023-10-08T12:45:25.232719+0000","last_unstale":"2023-10-08T12:45:26.427009+0000","last_undegraded":"2023-10-08T12:45:26.427009+0000","last_fullsized":"2023-10-08T12:45:26.427009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:08:35.730146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211814+0000","last_change":"2023-10-08T12:45:25.233147+0000","last_active":"2023-10-08T12:45:26.211814+0000","last_peered":"2023-10-08T12:45:26.211814+0000","last_clean":"2023-10-08T12:45:26.211814+0000","last_became_active":"2023-10-08T12:45:25.232834+0000","last_became_peered":"2023-10-08T12:45:25.232834+0000","last_unstale":"2023-10-08T12:45:26.211814+0000","last_undegraded":"2023-10-08T12:45:26.211814+0000","last_fullsized":"2023-10-08T12:45:26.211814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:49:32.959621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427758+0000","last_change":"2023-10-08T12:45:25.232818+0000","last_active":"2023-10-08T12:45:26.427758+0000","last_peered":"2023-10-08T12:45:26.427758+0000","last_clean":"2023-10-08T12:45:26.427758+0000","last_became_active":"2023-10-08T12:45:25.232543+0000","last_became_peered":"2023-10-08T12:45:25.232543+0000","last_unstale":"2023-10-08T12:45:26.427758+0000","last_undegraded":"2023-10-08T12:45:26.427758+0000","last_fullsized":"2023-10-08T12:45:26.427758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:04:54.376133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427500+0000","last_change":"2023-10-08T12:45:25.220806+0000","last_active":"2023-10-08T12:45:26.427500+0000","last_peered":"2023-10-08T12:45:26.427500+0000","last_clean":"2023-10-08T12:45:26.427500+0000","last_became_active":"2023-10-08T12:45:25.220465+0000","last_became_peered":"2023-10-08T12:45:25.220465+0000","last_unstale":"2023-10-08T12:45:26.427500+0000","last_undegraded":"2023-10-08T12:45:26.427500+0000","last_fullsized":"2023-10-08T12:45:26.427500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:32:46.148901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426409+0000","last_change":"2023-10-08T12:45:25.221755+0000","last_active":"2023-10-08T12:45:26.426409+0000","last_peered":"2023-10-08T12:45:26.426409+0000","last_clean":"2023-10-08T12:45:26.426409+0000","last_became_active":"2023-10-08T12:45:25.221252+0000","last_became_peered":"2023-10-08T12:45:25.221252+0000","last_unstale":"2023-10-08T12:45:26.426409+0000","last_undegraded":"2023-10-08T12:45:26.426409+0000","last_fullsized":"2023-10-08T12:45:26.426409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:48.216433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.210444+0000","last_change":"2023-10-08T12:45:25.239140+0000","last_active":"2023-10-08T12:45:26.210444+0000","last_peered":"2023-10-08T12:45:26.210444+0000","last_clean":"2023-10-08T12:45:26.210444+0000","last_became_active":"2023-10-08T12:45:25.238448+0000","last_became_peered":"2023-10-08T12:45:25.238448+0000","last_unstale":"2023-10-08T12:45:26.210444+0000","last_undegraded":"2023-10-08T12:45:26.210444+0000","last_fullsized":"2023-10-08T12:45:26.210444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:08:35.730146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211858+0000","last_change":"2023-10-08T12:45:25.230732+0000","last_active":"2023-10-08T12:45:26.211858+0000","last_peered":"2023-10-08T12:45:26.211858+0000","last_clean":"2023-10-08T12:45:26.211858+0000","last_became_active":"2023-10-08T12:45:25.230446+0000","last_became_peered":"2023-10-08T12:45:25.230446+0000","last_unstale":"2023-10-08T12:45:26.211858+0000","last_undegraded":"2023-10-08T12:45:26.211858+0000","last_fullsized":"2023-10-08T12:45:26.211858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:49:46.849372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.209782+0000","last_change":"2023-10-08T12:45:25.233903+0000","last_active":"2023-10-08T12:45:26.209782+0000","last_peered":"2023-10-08T12:45:26.209782+0000","last_clean":"2023-10-08T12:45:26.209782+0000","last_became_active":"2023-10-08T12:45:25.233592+0000","last_became_peered":"2023-10-08T12:45:25.233592+0000","last_unstale":"2023-10-08T12:45:26.209782+0000","last_undegraded":"2023-10-08T12:45:26.209782+0000","last_fullsized":"2023-10-08T12:45:26.209782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:49:32.959621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426890+0000","last_change":"2023-10-08T12:45:25.227128+0000","last_active":"2023-10-08T12:45:26.426890+0000","last_peered":"2023-10-08T12:45:26.426890+0000","last_clean":"2023-10-08T12:45:26.426890+0000","last_became_active":"2023-10-08T12:45:25.226861+0000","last_became_peered":"2023-10-08T12:45:25.226861+0000","last_unstale":"2023-10-08T12:45:26.426890+0000","last_undegraded":"2023-10-08T12:45:26.426890+0000","last_fullsized":"2023-10-08T12:45:26.426890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:49:29.699634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.240615+0000","last_change":"2023-10-08T12:45:24.228061+0000","last_active":"2023-10-08T12:45:25.240615+0000","last_peered":"2023-10-08T12:45:25.240615+0000","last_clean":"2023-10-08T12:45:25.240615+0000","last_became_active":"2023-10-08T12:45:24.227725+0000","last_became_peered":"2023-10-08T12:45:24.227725+0000","last_unstale":"2023-10-08T12:45:25.240615+0000","last_undegraded":"2023-10-08T12:45:25.240615+0000","last_fullsized":"2023-10-08T12:45:25.240615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:23:14.697499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.428110+0000","last_change":"2023-10-08T12:45:25.233268+0000","last_active":"2023-10-08T12:45:26.428110+0000","last_peered":"2023-10-08T12:45:26.428110+0000","last_clean":"2023-10-08T12:45:26.428110+0000","last_became_active":"2023-10-08T12:45:25.232988+0000","last_became_peered":"2023-10-08T12:45:25.232988+0000","last_unstale":"2023-10-08T12:45:26.428110+0000","last_undegraded":"2023-10-08T12:45:26.428110+0000","last_fullsized":"2023-10-08T12:45:26.428110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:49:29.699634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.234965+0000","last_change":"2023-10-08T12:45:24.224322+0000","last_active":"2023-10-08T12:45:25.234965+0000","last_peered":"2023-10-08T12:45:25.234965+0000","last_clean":"2023-10-08T12:45:25.234965+0000","last_became_active":"2023-10-08T12:45:24.223973+0000","last_became_peered":"2023-10-08T12:45:24.223973+0000","last_unstale":"2023-10-08T12:45:25.234965+0000","last_undegraded":"2023-10-08T12:45:25.234965+0000","last_fullsized":"2023-10-08T12:45:25.234965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:48:34.401677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427286+0000","last_change":"2023-10-08T12:45:25.232327+0000","last_active":"2023-10-08T12:45:26.427286+0000","last_peered":"2023-10-08T12:45:26.427286+0000","last_clean":"2023-10-08T12:45:26.427286+0000","last_became_active":"2023-10-08T12:45:25.231896+0000","last_became_peered":"2023-10-08T12:45:25.231896+0000","last_unstale":"2023-10-08T12:45:26.427286+0000","last_undegraded":"2023-10-08T12:45:26.427286+0000","last_fullsized":"2023-10-08T12:45:26.427286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:48:35.406914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.234734+0000","last_change":"2023-10-08T12:45:24.228768+0000","last_active":"2023-10-08T12:45:25.234734+0000","last_peered":"2023-10-08T12:45:25.234734+0000","last_clean":"2023-10-08T12:45:25.234734+0000","last_became_active":"2023-10-08T12:45:24.228469+0000","last_became_peered":"2023-10-08T12:45:24.228469+0000","last_unstale":"2023-10-08T12:45:25.234734+0000","last_undegraded":"2023-10-08T12:45:25.234734+0000","last_fullsized":"2023-10-08T12:45:25.234734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:47.211196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211536+0000","last_change":"2023-10-08T12:45:25.233150+0000","last_active":"2023-10-08T12:45:26.211536+0000","last_peered":"2023-10-08T12:45:26.211536+0000","last_clean":"2023-10-08T12:45:26.211536+0000","last_became_active":"2023-10-08T12:45:25.231798+0000","last_became_peered":"2023-10-08T12:45:25.231798+0000","last_unstale":"2023-10-08T12:45:26.211536+0000","last_undegraded":"2023-10-08T12:45:26.211536+0000","last_fullsized":"2023-10-08T12:45:26.211536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:18:01.792375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.234600+0000","last_change":"2023-10-08T12:45:24.227667+0000","last_active":"2023-10-08T12:45:25.234600+0000","last_peered":"2023-10-08T12:45:25.234600+0000","last_clean":"2023-10-08T12:45:25.234600+0000","last_became_active":"2023-10-08T12:45:24.227346+0000","last_became_peered":"2023-10-08T12:45:24.227346+0000","last_unstale":"2023-10-08T12:45:25.234600+0000","last_undegraded":"2023-10-08T12:45:25.234600+0000","last_fullsized":"2023-10-08T12:45:25.234600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:01:09.066012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.210909+0000","last_change":"2023-10-08T12:45:25.231656+0000","last_active":"2023-10-08T12:45:26.210909+0000","last_peered":"2023-10-08T12:45:26.210909+0000","last_clean":"2023-10-08T12:45:26.210909+0000","last_became_active":"2023-10-08T12:45:25.231336+0000","last_became_peered":"2023-10-08T12:45:25.231336+0000","last_unstale":"2023-10-08T12:45:26.210909+0000","last_undegraded":"2023-10-08T12:45:26.210909+0000","last_fullsized":"2023-10-08T12:45:26.210909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:49:29.699634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.227889+0000","last_change":"2023-10-08T12:45:24.225874+0000","last_active":"2023-10-08T12:45:25.227889+0000","last_peered":"2023-10-08T12:45:25.227889+0000","last_clean":"2023-10-08T12:45:25.227889+0000","last_became_active":"2023-10-08T12:45:24.225568+0000","last_became_peered":"2023-10-08T12:45:24.225568+0000","last_unstale":"2023-10-08T12:45:25.227889+0000","last_undegraded":"2023-10-08T12:45:25.227889+0000","last_fullsized":"2023-10-08T12:45:25.227889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:44:03.829859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211248+0000","last_change":"2023-10-08T12:45:25.217589+0000","last_active":"2023-10-08T12:45:26.211248+0000","last_peered":"2023-10-08T12:45:26.211248+0000","last_clean":"2023-10-08T12:45:26.211248+0000","last_became_active":"2023-10-08T12:45:25.217318+0000","last_became_peered":"2023-10-08T12:45:25.217318+0000","last_unstale":"2023-10-08T12:45:26.211248+0000","last_undegraded":"2023-10-08T12:45:26.211248+0000","last_fullsized":"2023-10-08T12:45:26.211248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:41.446646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.233120+0000","last_change":"2023-10-08T12:45:24.221289+0000","last_active":"2023-10-08T12:45:25.233120+0000","last_peered":"2023-10-08T12:45:25.233120+0000","last_clean":"2023-10-08T12:45:25.233120+0000","last_became_active":"2023-10-08T12:45:24.220980+0000","last_became_peered":"2023-10-08T12:45:24.220980+0000","last_unstale":"2023-10-08T12:45:25.233120+0000","last_undegraded":"2023-10-08T12:45:25.233120+0000","last_fullsized":"2023-10-08T12:45:25.233120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:48:34.401677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427697+0000","last_change":"2023-10-08T12:45:25.215738+0000","last_active":"2023-10-08T12:45:26.427697+0000","last_peered":"2023-10-08T12:45:26.427697+0000","last_clean":"2023-10-08T12:45:26.427697+0000","last_became_active":"2023-10-08T12:45:25.215434+0000","last_became_peered":"2023-10-08T12:45:25.215434+0000","last_unstale":"2023-10-08T12:45:26.427697+0000","last_undegraded":"2023-10-08T12:45:26.427697+0000","last_fullsized":"2023-10-08T12:45:26.427697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:47:19.248207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.218954+0000","last_change":"2023-10-08T12:45:24.223766+0000","last_active":"2023-10-08T12:45:25.218954+0000","last_peered":"2023-10-08T12:45:25.218954+0000","last_clean":"2023-10-08T12:45:25.218954+0000","last_became_active":"2023-10-08T12:45:24.223463+0000","last_became_peered":"2023-10-08T12:45:24.223463+0000","last_unstale":"2023-10-08T12:45:25.218954+0000","last_undegraded":"2023-10-08T12:45:25.218954+0000","last_fullsized":"2023-10-08T12:45:25.218954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:38:47.162600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426854+0000","last_change":"2023-10-08T12:45:25.235554+0000","last_active":"2023-10-08T12:45:26.426854+0000","last_peered":"2023-10-08T12:45:26.426854+0000","last_clean":"2023-10-08T12:45:26.426854+0000","last_became_active":"2023-10-08T12:45:25.235272+0000","last_became_peered":"2023-10-08T12:45:25.235272+0000","last_unstale":"2023-10-08T12:45:26.426854+0000","last_undegraded":"2023-10-08T12:45:26.426854+0000","last_fullsized":"2023-10-08T12:45:26.426854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:32:46.148901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.226704+0000","last_change":"2023-10-08T12:45:24.219555+0000","last_active":"2023-10-08T12:45:25.226704+0000","last_peered":"2023-10-08T12:45:25.226704+0000","last_clean":"2023-10-08T12:45:25.226704+0000","last_became_active":"2023-10-08T12:45:24.219262+0000","last_became_peered":"2023-10-08T12:45:24.219262+0000","last_unstale":"2023-10-08T12:45:25.226704+0000","last_undegraded":"2023-10-08T12:45:25.226704+0000","last_fullsized":"2023-10-08T12:45:25.226704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:40.050400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427422+0000","last_change":"2023-10-08T12:45:25.227790+0000","last_active":"2023-10-08T12:45:26.427422+0000","last_peered":"2023-10-08T12:45:26.427422+0000","last_clean":"2023-10-08T12:45:26.427422+0000","last_became_active":"2023-10-08T12:45:25.227499+0000","last_became_peered":"2023-10-08T12:45:25.227499+0000","last_unstale":"2023-10-08T12:45:26.427422+0000","last_undegraded":"2023-10-08T12:45:26.427422+0000","last_fullsized":"2023-10-08T12:45:26.427422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:47:19.248207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.215553+0000","last_change":"2023-10-08T12:45:24.224004+0000","last_active":"2023-10-08T12:45:25.215553+0000","last_peered":"2023-10-08T12:45:25.215553+0000","last_clean":"2023-10-08T12:45:25.215553+0000","last_became_active":"2023-10-08T12:45:24.223726+0000","last_became_peered":"2023-10-08T12:45:24.223726+0000","last_unstale":"2023-10-08T12:45:25.215553+0000","last_undegraded":"2023-10-08T12:45:25.215553+0000","last_fullsized":"2023-10-08T12:45:25.215553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:15.178667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211144+0000","last_change":"2023-10-08T12:45:25.230677+0000","last_active":"2023-10-08T12:45:26.211144+0000","last_peered":"2023-10-08T12:45:26.211144+0000","last_clean":"2023-10-08T12:45:26.211144+0000","last_became_active":"2023-10-08T12:45:25.230414+0000","last_became_peered":"2023-10-08T12:45:25.230414+0000","last_unstale":"2023-10-08T12:45:26.211144+0000","last_undegraded":"2023-10-08T12:45:26.211144+0000","last_fullsized":"2023-10-08T12:45:26.211144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:32:02.258575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.227176+0000","last_change":"2023-10-08T12:45:24.226086+0000","last_active":"2023-10-08T12:45:25.227176+0000","last_peered":"2023-10-08T12:45:25.227176+0000","last_clean":"2023-10-08T12:45:25.227176+0000","last_became_active":"2023-10-08T12:45:24.225807+0000","last_became_peered":"2023-10-08T12:45:24.225807+0000","last_unstale":"2023-10-08T12:45:25.227176+0000","last_undegraded":"2023-10-08T12:45:25.227176+0000","last_fullsized":"2023-10-08T12:45:25.227176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:25.788386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427575+0000","last_change":"2023-10-08T12:45:25.233121+0000","last_active":"2023-10-08T12:45:26.427575+0000","last_peered":"2023-10-08T12:45:26.427575+0000","last_clean":"2023-10-08T12:45:26.427575+0000","last_became_active":"2023-10-08T12:45:25.232807+0000","last_became_peered":"2023-10-08T12:45:25.232807+0000","last_unstale":"2023-10-08T12:45:26.427575+0000","last_undegraded":"2023-10-08T12:45:26.427575+0000","last_fullsized":"2023-10-08T12:45:26.427575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:04:54.376133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.240194+0000","last_change":"2023-10-08T12:45:24.226329+0000","last_active":"2023-10-08T12:45:25.240194+0000","last_peered":"2023-10-08T12:45:25.240194+0000","last_clean":"2023-10-08T12:45:25.240194+0000","last_became_active":"2023-10-08T12:45:24.226056+0000","last_became_peered":"2023-10-08T12:45:24.226056+0000","last_unstale":"2023-10-08T12:45:25.240194+0000","last_undegraded":"2023-10-08T12:45:25.240194+0000","last_fullsized":"2023-10-08T12:45:25.240194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:48:34.401677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211648+0000","last_change":"2023-10-08T12:45:25.225089+0000","last_active":"2023-10-08T12:45:26.211648+0000","last_peered":"2023-10-08T12:45:26.211648+0000","last_clean":"2023-10-08T12:45:26.211648+0000","last_became_active":"2023-10-08T12:45:25.224125+0000","last_became_peered":"2023-10-08T12:45:25.224125+0000","last_unstale":"2023-10-08T12:45:26.211648+0000","last_undegraded":"2023-10-08T12:45:26.211648+0000","last_fullsized":"2023-10-08T12:45:26.211648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:16:14.249377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.243231+0000","last_change":"2023-10-08T12:45:24.222786+0000","last_active":"2023-10-08T12:45:25.243231+0000","last_peered":"2023-10-08T12:45:25.243231+0000","last_clean":"2023-10-08T12:45:25.243231+0000","last_became_active":"2023-10-08T12:45:24.222465+0000","last_became_peered":"2023-10-08T12:45:24.222465+0000","last_unstale":"2023-10-08T12:45:25.243231+0000","last_undegraded":"2023-10-08T12:45:25.243231+0000","last_fullsized":"2023-10-08T12:45:25.243231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:38:47.162600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427068+0000","last_change":"2023-10-08T12:45:25.224662+0000","last_active":"2023-10-08T12:45:26.427068+0000","last_peered":"2023-10-08T12:45:26.427068+0000","last_clean":"2023-10-08T12:45:26.427068+0000","last_became_active":"2023-10-08T12:45:25.224168+0000","last_became_peered":"2023-10-08T12:45:25.224168+0000","last_unstale":"2023-10-08T12:45:26.427068+0000","last_undegraded":"2023-10-08T12:45:26.427068+0000","last_fullsized":"2023-10-08T12:45:26.427068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:18:01.792375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.237395+0000","last_change":"2023-10-08T12:45:24.221225+0000","last_active":"2023-10-08T12:45:25.237395+0000","last_peered":"2023-10-08T12:45:25.237395+0000","last_clean":"2023-10-08T12:45:25.237395+0000","last_became_active":"2023-10-08T12:45:24.220465+0000","last_became_peered":"2023-10-08T12:45:24.220465+0000","last_unstale":"2023-10-08T12:45:25.237395+0000","last_undegraded":"2023-10-08T12:45:25.237395+0000","last_fullsized":"2023-10-08T12:45:25.237395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:40.441409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426979+0000","last_change":"2023-10-08T12:45:25.223301+0000","last_active":"2023-10-08T12:45:26.426979+0000","last_peered":"2023-10-08T12:45:26.426979+0000","last_clean":"2023-10-08T12:45:26.426979+0000","last_became_active":"2023-10-08T12:45:25.223017+0000","last_became_peered":"2023-10-08T12:45:25.223017+0000","last_unstale":"2023-10-08T12:45:26.426979+0000","last_undegraded":"2023-10-08T12:45:26.426979+0000","last_fullsized":"2023-10-08T12:45:26.426979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:38:48.167837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.227386+0000","last_change":"2023-10-08T12:45:24.223071+0000","last_active":"2023-10-08T12:45:25.227386+0000","last_peered":"2023-10-08T12:45:25.227386+0000","last_clean":"2023-10-08T12:45:25.227386+0000","last_became_active":"2023-10-08T12:45:24.222681+0000","last_became_peered":"2023-10-08T12:45:24.222681+0000","last_unstale":"2023-10-08T12:45:25.227386+0000","last_undegraded":"2023-10-08T12:45:25.227386+0000","last_fullsized":"2023-10-08T12:45:25.227386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:32:45.143664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426987+0000","last_change":"2023-10-08T12:45:25.235762+0000","last_active":"2023-10-08T12:45:26.426987+0000","last_peered":"2023-10-08T12:45:26.426987+0000","last_clean":"2023-10-08T12:45:26.426987+0000","last_became_active":"2023-10-08T12:45:25.235232+0000","last_became_peered":"2023-10-08T12:45:25.235232+0000","last_unstale":"2023-10-08T12:45:26.426987+0000","last_undegraded":"2023-10-08T12:45:26.426987+0000","last_fullsized":"2023-10-08T12:45:26.426987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:33:43.081367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.215694+0000","last_change":"2023-10-08T12:45:24.220892+0000","last_active":"2023-10-08T12:45:25.215694+0000","last_peered":"2023-10-08T12:45:25.215694+0000","last_clean":"2023-10-08T12:45:25.215694+0000","last_became_active":"2023-10-08T12:45:24.220573+0000","last_became_peered":"2023-10-08T12:45:24.220573+0000","last_unstale":"2023-10-08T12:45:25.215694+0000","last_undegraded":"2023-10-08T12:45:25.215694+0000","last_fullsized":"2023-10-08T12:45:25.215694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:40.441409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426430+0000","last_change":"2023-10-08T12:45:25.239496+0000","last_active":"2023-10-08T12:45:26.426430+0000","last_peered":"2023-10-08T12:45:26.426430+0000","last_clean":"2023-10-08T12:45:26.426430+0000","last_became_active":"2023-10-08T12:45:25.239106+0000","last_became_peered":"2023-10-08T12:45:25.239106+0000","last_unstale":"2023-10-08T12:45:26.426430+0000","last_undegraded":"2023-10-08T12:45:26.426430+0000","last_fullsized":"2023-10-08T12:45:26.426430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:48.216433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.241993+0000","last_change":"2023-10-08T12:45:24.225777+0000","last_active":"2023-10-08T12:45:25.241993+0000","last_peered":"2023-10-08T12:45:25.241993+0000","last_clean":"2023-10-08T12:45:25.241993+0000","last_became_active":"2023-10-08T12:45:24.225472+0000","last_became_peered":"2023-10-08T12:45:24.225472+0000","last_unstale":"2023-10-08T12:45:25.241993+0000","last_undegraded":"2023-10-08T12:45:25.241993+0000","last_fullsized":"2023-10-08T12:45:25.241993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:23:14.697499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427263+0000","last_change":"2023-10-08T12:45:25.235732+0000","last_active":"2023-10-08T12:45:26.427263+0000","last_peered":"2023-10-08T12:45:26.427263+0000","last_clean":"2023-10-08T12:45:26.427263+0000","last_became_active":"2023-10-08T12:45:25.235444+0000","last_became_peered":"2023-10-08T12:45:25.235444+0000","last_unstale":"2023-10-08T12:45:26.427263+0000","last_undegraded":"2023-10-08T12:45:26.427263+0000","last_fullsized":"2023-10-08T12:45:26.427263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:48.280304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.237752+0000","last_change":"2023-10-08T12:45:24.222110+0000","last_active":"2023-10-08T12:45:25.237752+0000","last_peered":"2023-10-08T12:45:25.237752+0000","last_clean":"2023-10-08T12:45:25.237752+0000","last_became_active":"2023-10-08T12:45:24.221768+0000","last_became_peered":"2023-10-08T12:45:24.221768+0000","last_unstale":"2023-10-08T12:45:25.237752+0000","last_undegraded":"2023-10-08T12:45:25.237752+0000","last_fullsized":"2023-10-08T12:45:25.237752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:23:14.697499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427029+0000","last_change":"2023-10-08T12:45:25.222582+0000","last_active":"2023-10-08T12:45:26.427029+0000","last_peered":"2023-10-08T12:45:26.427029+0000","last_clean":"2023-10-08T12:45:26.427029+0000","last_became_active":"2023-10-08T12:45:25.222312+0000","last_became_peered":"2023-10-08T12:45:25.222312+0000","last_unstale":"2023-10-08T12:45:26.427029+0000","last_undegraded":"2023-10-08T12:45:26.427029+0000","last_fullsized":"2023-10-08T12:45:26.427029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:32:02.258575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.212828+0000","last_change":"2023-10-08T12:45:24.225910+0000","last_active":"2023-10-08T12:45:25.212828+0000","last_peered":"2023-10-08T12:45:25.212828+0000","last_clean":"2023-10-08T12:45:25.212828+0000","last_became_active":"2023-10-08T12:45:24.225590+0000","last_became_peered":"2023-10-08T12:45:24.225590+0000","last_unstale":"2023-10-08T12:45:25.212828+0000","last_undegraded":"2023-10-08T12:45:25.212828+0000","last_fullsized":"2023-10-08T12:45:25.212828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:40.050400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211014+0000","last_change":"2023-10-08T12:45:25.238269+0000","last_active":"2023-10-08T12:45:26.211014+0000","last_peered":"2023-10-08T12:45:26.211014+0000","last_clean":"2023-10-08T12:45:26.211014+0000","last_became_active":"2023-10-08T12:45:25.237899+0000","last_became_peered":"2023-10-08T12:45:25.237899+0000","last_unstale":"2023-10-08T12:45:26.211014+0000","last_undegraded":"2023-10-08T12:45:26.211014+0000","last_fullsized":"2023-10-08T12:45:26.211014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:15.909104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.227253+0000","last_change":"2023-10-08T12:45:24.226194+0000","last_active":"2023-10-08T12:45:25.227253+0000","last_peered":"2023-10-08T12:45:25.227253+0000","last_clean":"2023-10-08T12:45:25.227253+0000","last_became_active":"2023-10-08T12:45:24.225901+0000","last_became_peered":"2023-10-08T12:45:24.225901+0000","last_unstale":"2023-10-08T12:45:25.227253+0000","last_undegraded":"2023-10-08T12:45:25.227253+0000","last_fullsized":"2023-10-08T12:45:25.227253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:47.211196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211763+0000","last_change":"2023-10-08T12:45:25.234627+0000","last_active":"2023-10-08T12:45:26.211763+0000","last_peered":"2023-10-08T12:45:26.211763+0000","last_clean":"2023-10-08T12:45:26.211763+0000","last_became_active":"2023-10-08T12:45:25.234323+0000","last_became_peered":"2023-10-08T12:45:25.234323+0000","last_unstale":"2023-10-08T12:45:26.211763+0000","last_undegraded":"2023-10-08T12:45:26.211763+0000","last_fullsized":"2023-10-08T12:45:26.211763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:56:56.850111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426376+0000","last_change":"2023-10-08T12:45:25.224549+0000","last_active":"2023-10-08T12:45:26.426376+0000","last_peered":"2023-10-08T12:45:26.426376+0000","last_clean":"2023-10-08T12:45:26.426376+0000","last_became_active":"2023-10-08T12:45:25.223606+0000","last_became_peered":"2023-10-08T12:45:25.223606+0000","last_unstale":"2023-10-08T12:45:26.426376+0000","last_undegraded":"2023-10-08T12:45:26.426376+0000","last_fullsized":"2023-10-08T12:45:26.426376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:26.793623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.218337+0000","last_change":"2023-10-08T12:45:24.216886+0000","last_active":"2023-10-08T12:45:25.218337+0000","last_peered":"2023-10-08T12:45:25.218337+0000","last_clean":"2023-10-08T12:45:25.218337+0000","last_became_active":"2023-10-08T12:45:24.216435+0000","last_became_peered":"2023-10-08T12:45:24.216435+0000","last_unstale":"2023-10-08T12:45:25.218337+0000","last_undegraded":"2023-10-08T12:45:25.218337+0000","last_fullsized":"2023-10-08T12:45:25.218337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:16:13.244140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427721+0000","last_change":"2023-10-08T12:45:25.234200+0000","last_active":"2023-10-08T12:45:26.427721+0000","last_peered":"2023-10-08T12:45:26.427721+0000","last_clean":"2023-10-08T12:45:26.427721+0000","last_became_active":"2023-10-08T12:45:25.233861+0000","last_became_peered":"2023-10-08T12:45:25.233861+0000","last_unstale":"2023-10-08T12:45:26.427721+0000","last_undegraded":"2023-10-08T12:45:26.427721+0000","last_fullsized":"2023-10-08T12:45:26.427721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:08:35.730146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.226650+0000","last_change":"2023-10-08T12:45:24.218750+0000","last_active":"2023-10-08T12:45:25.226650+0000","last_peered":"2023-10-08T12:45:25.226650+0000","last_clean":"2023-10-08T12:45:25.226650+0000","last_became_active":"2023-10-08T12:45:24.218402+0000","last_became_peered":"2023-10-08T12:45:24.218402+0000","last_unstale":"2023-10-08T12:45:25.226650+0000","last_undegraded":"2023-10-08T12:45:25.226650+0000","last_fullsized":"2023-10-08T12:45:25.226650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:48:34.401677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.215229+0000","last_change":"2023-10-08T12:45:21.094571+0000","last_active":"2023-10-08T12:45:25.215229+0000","last_peered":"2023-10-08T12:45:25.215229+0000","last_clean":"2023-10-08T12:45:25.215229+0000","last_became_active":"2023-10-08T12:45:21.093551+0000","last_became_peered":"2023-10-08T12:45:21.093551+0000","last_unstale":"2023-10-08T12:45:25.215229+0000","last_undegraded":"2023-10-08T12:45:25.215229+0000","last_fullsized":"2023-10-08T12:45:25.215229+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:19.842786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:19.842786+0000","last_clean_scrub_stamp":"2023-10-08T12:45:19.842786+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:25.041743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426946+0000","last_change":"2023-10-08T12:45:25.215819+0000","last_active":"2023-10-08T12:45:26.426946+0000","last_peered":"2023-10-08T12:45:26.426946+0000","last_clean":"2023-10-08T12:45:26.426946+0000","last_became_active":"2023-10-08T12:45:25.215352+0000","last_became_peered":"2023-10-08T12:45:25.215352+0000","last_unstale":"2023-10-08T12:45:26.426946+0000","last_undegraded":"2023-10-08T12:45:26.426946+0000","last_fullsized":"2023-10-08T12:45:26.426946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:26.793623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.215346+0000","last_change":"2023-10-08T12:45:24.229708+0000","last_active":"2023-10-08T12:45:25.215346+0000","last_peered":"2023-10-08T12:45:25.215346+0000","last_clean":"2023-10-08T12:45:25.215346+0000","last_became_active":"2023-10-08T12:45:24.229494+0000","last_became_peered":"2023-10-08T12:45:24.229494+0000","last_unstale":"2023-10-08T12:45:25.215346+0000","last_undegraded":"2023-10-08T12:45:25.215346+0000","last_fullsized":"2023-10-08T12:45:25.215346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:16:13.244140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.217629+0000","last_change":"2023-10-08T12:45:24.229122+0000","last_active":"2023-10-08T12:45:25.217629+0000","last_peered":"2023-10-08T12:45:25.217629+0000","last_clean":"2023-10-08T12:45:25.217629+0000","last_became_active":"2023-10-08T12:45:24.228838+0000","last_became_peered":"2023-10-08T12:45:24.228838+0000","last_unstale":"2023-10-08T12:45:25.217629+0000","last_undegraded":"2023-10-08T12:45:25.217629+0000","last_fullsized":"2023-10-08T12:45:25.217629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:25.788386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427195+0000","last_change":"2023-10-08T12:45:25.224118+0000","last_active":"2023-10-08T12:45:26.427195+0000","last_peered":"2023-10-08T12:45:26.427195+0000","last_clean":"2023-10-08T12:45:26.427195+0000","last_became_active":"2023-10-08T12:45:25.223850+0000","last_became_peered":"2023-10-08T12:45:25.223850+0000","last_unstale":"2023-10-08T12:45:26.427195+0000","last_undegraded":"2023-10-08T12:45:26.427195+0000","last_fullsized":"2023-10-08T12:45:26.427195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:08:35.730146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.212320+0000","last_change":"2023-10-08T12:45:24.226993+0000","last_active":"2023-10-08T12:45:25.212320+0000","last_peered":"2023-10-08T12:45:25.212320+0000","last_clean":"2023-10-08T12:45:25.212320+0000","last_became_active":"2023-10-08T12:45:24.226721+0000","last_became_peered":"2023-10-08T12:45:24.226721+0000","last_unstale":"2023-10-08T12:45:25.212320+0000","last_undegraded":"2023-10-08T12:45:25.212320+0000","last_fullsized":"2023-10-08T12:45:25.212320+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:38:47.162600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.428284+0000","last_change":"2023-10-08T12:45:25.224548+0000","last_active":"2023-10-08T12:45:26.428284+0000","last_peered":"2023-10-08T12:45:26.428284+0000","last_clean":"2023-10-08T12:45:26.428284+0000","last_became_active":"2023-10-08T12:45:25.224094+0000","last_became_peered":"2023-10-08T12:45:25.224094+0000","last_unstale":"2023-10-08T12:45:26.428284+0000","last_undegraded":"2023-10-08T12:45:26.428284+0000","last_fullsized":"2023-10-08T12:45:26.428284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:33:43.081367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.236382+0000","last_change":"2023-10-08T12:45:24.229198+0000","last_active":"2023-10-08T12:45:25.236382+0000","last_peered":"2023-10-08T12:45:25.236382+0000","last_clean":"2023-10-08T12:45:25.236382+0000","last_became_active":"2023-10-08T12:45:24.228922+0000","last_became_peered":"2023-10-08T12:45:24.228922+0000","last_unstale":"2023-10-08T12:45:25.236382+0000","last_undegraded":"2023-10-08T12:45:25.236382+0000","last_fullsized":"2023-10-08T12:45:25.236382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:23:14.697499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426950+0000","last_change":"2023-10-08T12:45:25.220801+0000","last_active":"2023-10-08T12:45:26.426950+0000","last_peered":"2023-10-08T12:45:26.426950+0000","last_clean":"2023-10-08T12:45:26.426950+0000","last_became_active":"2023-10-08T12:45:25.220473+0000","last_became_peered":"2023-10-08T12:45:25.220473+0000","last_unstale":"2023-10-08T12:45:26.426950+0000","last_undegraded":"2023-10-08T12:45:26.426950+0000","last_fullsized":"2023-10-08T12:45:26.426950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:01:10.071249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.215157+0000","last_change":"2023-10-08T12:45:24.228202+0000","last_active":"2023-10-08T12:45:25.215157+0000","last_peered":"2023-10-08T12:45:25.215157+0000","last_clean":"2023-10-08T12:45:25.215157+0000","last_became_active":"2023-10-08T12:45:24.227988+0000","last_became_peered":"2023-10-08T12:45:24.227988+0000","last_unstale":"2023-10-08T12:45:25.215157+0000","last_undegraded":"2023-10-08T12:45:25.215157+0000","last_fullsized":"2023-10-08T12:45:25.215157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:40.441409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211154+0000","last_change":"2023-10-08T12:45:25.227542+0000","last_active":"2023-10-08T12:45:26.211154+0000","last_peered":"2023-10-08T12:45:26.211154+0000","last_clean":"2023-10-08T12:45:26.211154+0000","last_became_active":"2023-10-08T12:45:25.227279+0000","last_became_peered":"2023-10-08T12:45:25.227279+0000","last_unstale":"2023-10-08T12:45:26.211154+0000","last_undegraded":"2023-10-08T12:45:26.211154+0000","last_fullsized":"2023-10-08T12:45:26.211154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:16.183904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.211960+0000","last_change":"2023-10-08T12:45:24.228028+0000","last_active":"2023-10-08T12:45:25.211960+0000","last_peered":"2023-10-08T12:45:25.211960+0000","last_clean":"2023-10-08T12:45:25.211960+0000","last_became_active":"2023-10-08T12:45:24.227739+0000","last_became_peered":"2023-10-08T12:45:24.227739+0000","last_unstale":"2023-10-08T12:45:25.211960+0000","last_undegraded":"2023-10-08T12:45:25.211960+0000","last_fullsized":"2023-10-08T12:45:25.211960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:49:31.954384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426680+0000","last_change":"2023-10-08T12:45:25.236177+0000","last_active":"2023-10-08T12:45:26.426680+0000","last_peered":"2023-10-08T12:45:26.426680+0000","last_clean":"2023-10-08T12:45:26.426680+0000","last_became_active":"2023-10-08T12:45:25.235890+0000","last_became_peered":"2023-10-08T12:45:25.235890+0000","last_unstale":"2023-10-08T12:45:26.426680+0000","last_undegraded":"2023-10-08T12:45:26.426680+0000","last_fullsized":"2023-10-08T12:45:26.426680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:26.793623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.211878+0000","last_change":"2023-10-08T12:45:24.222491+0000","last_active":"2023-10-08T12:45:25.211878+0000","last_peered":"2023-10-08T12:45:25.211878+0000","last_clean":"2023-10-08T12:45:25.211878+0000","last_became_active":"2023-10-08T12:45:24.222266+0000","last_became_peered":"2023-10-08T12:45:24.222266+0000","last_unstale":"2023-10-08T12:45:25.211878+0000","last_undegraded":"2023-10-08T12:45:25.211878+0000","last_fullsized":"2023-10-08T12:45:25.211878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:56:55.844874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427967+0000","last_change":"2023-10-08T12:45:25.234548+0000","last_active":"2023-10-08T12:45:26.427967+0000","last_peered":"2023-10-08T12:45:26.427967+0000","last_clean":"2023-10-08T12:45:26.427967+0000","last_became_active":"2023-10-08T12:45:25.234277+0000","last_became_peered":"2023-10-08T12:45:25.234277+0000","last_unstale":"2023-10-08T12:45:26.427967+0000","last_undegraded":"2023-10-08T12:45:26.427967+0000","last_fullsized":"2023-10-08T12:45:26.427967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:56:33.493223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.235588+0000","last_change":"2023-10-08T12:45:24.227674+0000","last_active":"2023-10-08T12:45:25.235588+0000","last_peered":"2023-10-08T12:45:25.235588+0000","last_clean":"2023-10-08T12:45:25.235588+0000","last_became_active":"2023-10-08T12:45:24.227376+0000","last_became_peered":"2023-10-08T12:45:24.227376+0000","last_unstale":"2023-10-08T12:45:25.235588+0000","last_undegraded":"2023-10-08T12:45:25.235588+0000","last_fullsized":"2023-10-08T12:45:25.235588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:04:53.370896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427083+0000","last_change":"2023-10-08T12:45:25.228511+0000","last_active":"2023-10-08T12:45:26.427083+0000","last_peered":"2023-10-08T12:45:26.427083+0000","last_clean":"2023-10-08T12:45:26.427083+0000","last_became_active":"2023-10-08T12:45:25.227866+0000","last_became_peered":"2023-10-08T12:45:25.227866+0000","last_unstale":"2023-10-08T12:45:26.427083+0000","last_undegraded":"2023-10-08T12:45:26.427083+0000","last_fullsized":"2023-10-08T12:45:26.427083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:04:54.376133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.218171+0000","last_change":"2023-10-08T12:45:24.215676+0000","last_active":"2023-10-08T12:45:25.218171+0000","last_peered":"2023-10-08T12:45:25.218171+0000","last_clean":"2023-10-08T12:45:25.218171+0000","last_became_active":"2023-10-08T12:45:24.215332+0000","last_became_peered":"2023-10-08T12:45:24.215332+0000","last_unstale":"2023-10-08T12:45:25.218171+0000","last_undegraded":"2023-10-08T12:45:25.218171+0000","last_fullsized":"2023-10-08T12:45:25.218171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:40.441409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427302+0000","last_change":"2023-10-08T12:45:25.235593+0000","last_active":"2023-10-08T12:45:26.427302+0000","last_peered":"2023-10-08T12:45:26.427302+0000","last_clean":"2023-10-08T12:45:26.427302+0000","last_became_active":"2023-10-08T12:45:25.234710+0000","last_became_peered":"2023-10-08T12:45:25.234710+0000","last_unstale":"2023-10-08T12:45:26.427302+0000","last_undegraded":"2023-10-08T12:45:26.427302+0000","last_fullsized":"2023-10-08T12:45:26.427302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:49:50.098137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.240294+0000","last_change":"2023-10-08T12:45:24.220654+0000","last_active":"2023-10-08T12:45:25.240294+0000","last_peered":"2023-10-08T12:45:25.240294+0000","last_clean":"2023-10-08T12:45:25.240294+0000","last_became_active":"2023-10-08T12:45:24.220367+0000","last_became_peered":"2023-10-08T12:45:24.220367+0000","last_unstale":"2023-10-08T12:45:25.240294+0000","last_undegraded":"2023-10-08T12:45:25.240294+0000","last_fullsized":"2023-10-08T12:45:25.240294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:44:03.829859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211649+0000","last_change":"2023-10-08T12:45:25.239597+0000","last_active":"2023-10-08T12:45:26.211649+0000","last_peered":"2023-10-08T12:45:26.211649+0000","last_clean":"2023-10-08T12:45:26.211649+0000","last_became_active":"2023-10-08T12:45:25.238424+0000","last_became_peered":"2023-10-08T12:45:25.238424+0000","last_unstale":"2023-10-08T12:45:26.211649+0000","last_undegraded":"2023-10-08T12:45:26.211649+0000","last_fullsized":"2023-10-08T12:45:26.211649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:48.280304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.237785+0000","last_change":"2023-10-08T12:45:24.216389+0000","last_active":"2023-10-08T12:45:25.237785+0000","last_peered":"2023-10-08T12:45:25.237785+0000","last_clean":"2023-10-08T12:45:25.237785+0000","last_became_active":"2023-10-08T12:45:24.216111+0000","last_became_peered":"2023-10-08T12:45:24.216111+0000","last_unstale":"2023-10-08T12:45:25.237785+0000","last_undegraded":"2023-10-08T12:45:25.237785+0000","last_fullsized":"2023-10-08T12:45:25.237785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:15.178667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427542+0000","last_change":"2023-10-08T12:45:25.236292+0000","last_active":"2023-10-08T12:45:26.427542+0000","last_peered":"2023-10-08T12:45:26.427542+0000","last_clean":"2023-10-08T12:45:26.427542+0000","last_became_active":"2023-10-08T12:45:25.235946+0000","last_became_peered":"2023-10-08T12:45:25.235946+0000","last_unstale":"2023-10-08T12:45:26.427542+0000","last_undegraded":"2023-10-08T12:45:26.427542+0000","last_fullsized":"2023-10-08T12:45:26.427542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:49:50.149459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426418+0000","last_change":"2023-10-08T12:45:25.239059+0000","last_active":"2023-10-08T12:45:26.426418+0000","last_peered":"2023-10-08T12:45:26.426418+0000","last_clean":"2023-10-08T12:45:26.426418+0000","last_became_active":"2023-10-08T12:45:25.238760+0000","last_became_peered":"2023-10-08T12:45:25.238760+0000","last_unstale":"2023-10-08T12:45:26.426418+0000","last_undegraded":"2023-10-08T12:45:26.426418+0000","last_fullsized":"2023-10-08T12:45:26.426418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:26.793623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.209670+0000","last_change":"2023-10-08T12:45:25.231384+0000","last_active":"2023-10-08T12:45:26.209670+0000","last_peered":"2023-10-08T12:45:26.209670+0000","last_clean":"2023-10-08T12:45:26.209670+0000","last_became_active":"2023-10-08T12:45:25.231107+0000","last_became_peered":"2023-10-08T12:45:25.231107+0000","last_unstale":"2023-10-08T12:45:26.209670+0000","last_undegraded":"2023-10-08T12:45:26.209670+0000","last_fullsized":"2023-10-08T12:45:26.209670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:56:56.850111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211086+0000","last_change":"2023-10-08T12:45:25.240154+0000","last_active":"2023-10-08T12:45:26.211086+0000","last_peered":"2023-10-08T12:45:26.211086+0000","last_clean":"2023-10-08T12:45:26.211086+0000","last_became_active":"2023-10-08T12:45:25.239707+0000","last_became_peered":"2023-10-08T12:45:25.239707+0000","last_unstale":"2023-10-08T12:45:26.211086+0000","last_undegraded":"2023-10-08T12:45:26.211086+0000","last_fullsized":"2023-10-08T12:45:26.211086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:33:43.081367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427580+0000","last_change":"2023-10-08T12:45:25.226125+0000","last_active":"2023-10-08T12:45:26.427580+0000","last_peered":"2023-10-08T12:45:26.427580+0000","last_clean":"2023-10-08T12:45:26.427580+0000","last_became_active":"2023-10-08T12:45:25.225857+0000","last_became_peered":"2023-10-08T12:45:25.225857+0000","last_unstale":"2023-10-08T12:45:26.427580+0000","last_undegraded":"2023-10-08T12:45:26.427580+0000","last_fullsized":"2023-10-08T12:45:26.427580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:08:35.730146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427934+0000","last_change":"2023-10-08T12:45:25.233903+0000","last_active":"2023-10-08T12:45:26.427934+0000","last_peered":"2023-10-08T12:45:26.427934+0000","last_clean":"2023-10-08T12:45:26.427934+0000","last_became_active":"2023-10-08T12:45:25.233623+0000","last_became_peered":"2023-10-08T12:45:25.233623+0000","last_unstale":"2023-10-08T12:45:26.427934+0000","last_undegraded":"2023-10-08T12:45:26.427934+0000","last_fullsized":"2023-10-08T12:45:26.427934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:47:19.248207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427126+0000","last_change":"2023-10-08T12:45:25.226278+0000","last_active":"2023-10-08T12:45:26.427126+0000","last_peered":"2023-10-08T12:45:26.427126+0000","last_clean":"2023-10-08T12:45:26.427126+0000","last_became_active":"2023-10-08T12:45:25.225029+0000","last_became_peered":"2023-10-08T12:45:25.225029+0000","last_unstale":"2023-10-08T12:45:26.427126+0000","last_undegraded":"2023-10-08T12:45:26.427126+0000","last_fullsized":"2023-10-08T12:45:26.427126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:32:46.148901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427244+0000","last_change":"2023-10-08T12:45:25.237094+0000","last_active":"2023-10-08T12:45:26.427244+0000","last_peered":"2023-10-08T12:45:26.427244+0000","last_clean":"2023-10-08T12:45:26.427244+0000","last_became_active":"2023-10-08T12:45:25.236619+0000","last_became_peered":"2023-10-08T12:45:25.236619+0000","last_unstale":"2023-10-08T12:45:26.427244+0000","last_undegraded":"2023-10-08T12:45:26.427244+0000","last_fullsized":"2023-10-08T12:45:26.427244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:47:19.248207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.428124+0000","last_change":"2023-10-08T12:45:25.224087+0000","last_active":"2023-10-08T12:45:26.428124+0000","last_peered":"2023-10-08T12:45:26.428124+0000","last_clean":"2023-10-08T12:45:26.428124+0000","last_became_active":"2023-10-08T12:45:25.223774+0000","last_became_peered":"2023-10-08T12:45:25.223774+0000","last_unstale":"2023-10-08T12:45:26.428124+0000","last_undegraded":"2023-10-08T12:45:26.428124+0000","last_fullsized":"2023-10-08T12:45:26.428124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:15.909104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.210640+0000","last_change":"2023-10-08T12:45:25.238966+0000","last_active":"2023-10-08T12:45:26.210640+0000","last_peered":"2023-10-08T12:45:26.210640+0000","last_clean":"2023-10-08T12:45:26.210640+0000","last_became_active":"2023-10-08T12:45:25.238579+0000","last_became_peered":"2023-10-08T12:45:25.238579+0000","last_unstale":"2023-10-08T12:45:26.210640+0000","last_undegraded":"2023-10-08T12:45:26.210640+0000","last_fullsized":"2023-10-08T12:45:26.210640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:04:54.376133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426808+0000","last_change":"2023-10-08T12:45:25.227703+0000","last_active":"2023-10-08T12:45:26.426808+0000","last_peered":"2023-10-08T12:45:26.426808+0000","last_clean":"2023-10-08T12:45:26.426808+0000","last_became_active":"2023-10-08T12:45:25.227400+0000","last_became_peered":"2023-10-08T12:45:25.227400+0000","last_unstale":"2023-10-08T12:45:26.426808+0000","last_undegraded":"2023-10-08T12:45:26.426808+0000","last_fullsized":"2023-10-08T12:45:26.426808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:48.216433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.210891+0000","last_change":"2023-10-08T12:45:25.231956+0000","last_active":"2023-10-08T12:45:26.210891+0000","last_peered":"2023-10-08T12:45:26.210891+0000","last_clean":"2023-10-08T12:45:26.210891+0000","last_became_active":"2023-10-08T12:45:25.231669+0000","last_became_peered":"2023-10-08T12:45:25.231669+0000","last_unstale":"2023-10-08T12:45:26.210891+0000","last_undegraded":"2023-10-08T12:45:26.210891+0000","last_fullsized":"2023-10-08T12:45:26.210891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:56:33.493223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427412+0000","last_change":"2023-10-08T12:45:25.228975+0000","last_active":"2023-10-08T12:45:26.427412+0000","last_peered":"2023-10-08T12:45:26.427412+0000","last_clean":"2023-10-08T12:45:26.427412+0000","last_became_active":"2023-10-08T12:45:25.224678+0000","last_became_peered":"2023-10-08T12:45:25.224678+0000","last_unstale":"2023-10-08T12:45:26.427412+0000","last_undegraded":"2023-10-08T12:45:26.427412+0000","last_fullsized":"2023-10-08T12:45:26.427412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:48.216433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426772+0000","last_change":"2023-10-08T12:45:25.234967+0000","last_active":"2023-10-08T12:45:26.426772+0000","last_peered":"2023-10-08T12:45:26.426772+0000","last_clean":"2023-10-08T12:45:26.426772+0000","last_became_active":"2023-10-08T12:45:25.234563+0000","last_became_peered":"2023-10-08T12:45:25.234563+0000","last_unstale":"2023-10-08T12:45:26.426772+0000","last_undegraded":"2023-10-08T12:45:26.426772+0000","last_fullsized":"2023-10-08T12:45:26.426772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:32:46.148901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.222}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3130000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.5589999999999993}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8360000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:45:34.374 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T12:45:34.375 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2023-10-08T12:45:34.375 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-08T12:45:34.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.535+0000 7f2b9089e700 1 -- 172.21.15.45:0/791840031 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2b8c0ae380 msgr2=0x7f2b8c0ae7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:34.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.535+0000 7f2b9089e700 1 --2- 172.21.15.45:0/791840031 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2b8c0ae380 0x7f2b8c0ae7f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2b84009fd0 tx=0x7f2b8400b380 comp rx=0 tx=0).stop 2023-10-08T12:45:34.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.535+0000 7f2b9089e700 1 -- 172.21.15.45:0/791840031 shutdown_connections 2023-10-08T12:45:34.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.535+0000 7f2b9089e700 1 --2- 172.21.15.45:0/791840031 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2b8c0ae380 0x7f2b8c0ae7f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:34.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.535+0000 7f2b9089e700 1 --2- 172.21.15.45:0/791840031 >> v2:172.21.15.78:3300/0 conn(0x7f2b8c0cc160 0x7f2b8c0cc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:34.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.535+0000 7f2b9089e700 1 -- 172.21.15.45:0/791840031 >> 172.21.15.45:0/791840031 conn(0x7f2b8c0cf750 msgr2=0x7f2b8c0cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:34.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.535+0000 7f2b9089e700 1 -- 172.21.15.45:0/791840031 shutdown_connections 2023-10-08T12:45:34.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.535+0000 7f2b9089e700 1 -- 172.21.15.45:0/791840031 wait complete. 2023-10-08T12:45:34.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.536+0000 7f2b9089e700 1 Processor -- start 2023-10-08T12:45:34.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.536+0000 7f2b9089e700 1 -- start start 2023-10-08T12:45:34.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.537+0000 7f2b9089e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b8c0ae380 0x7f2b8c1ef9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:34.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.537+0000 7f2b9089e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b8c0cc160 0x7f2b8c0ad4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:34.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.537+0000 7f2b9089e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2b8c1599f0 0x7f2b8c0ada20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:34.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.537+0000 7f2b9089e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c1476d0 con 0x7f2b8c0ae380 2023-10-08T12:45:34.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.537+0000 7f2b9089e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c14a950 con 0x7f2b8c0cc160 2023-10-08T12:45:34.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.537+0000 7f2b9089e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c14a670 con 0x7f2b8c1599f0 2023-10-08T12:45:34.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.537+0000 7f2b8a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b8c0ae380 0x7f2b8c1ef9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:34.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.537+0000 7f2b8a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b8c0ae380 0x7f2b8c1ef9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34992/0 (socket says 172.21.15.45:34992) 2023-10-08T12:45:34.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.537+0000 7f2b8a59c700 1 -- 172.21.15.45:0/417958041 learned_addr learned my addr 172.21.15.45:0/417958041 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:34.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.537+0000 7f2b89d9b700 1 --2- 172.21.15.45:0/417958041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b8c0cc160 0x7f2b8c0ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:34.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.537+0000 7f2b8ad9d700 1 --2- 172.21.15.45:0/417958041 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2b8c1599f0 0x7f2b8c0ada20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:34.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.538+0000 7f2b8a59c700 1 -- 172.21.15.45:0/417958041 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2b8c1599f0 msgr2=0x7f2b8c0ada20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:34.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.538+0000 7f2b8a59c700 1 --2- 172.21.15.45:0/417958041 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2b8c1599f0 0x7f2b8c0ada20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:34.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.538+0000 7f2b8a59c700 1 -- 172.21.15.45:0/417958041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b8c0cc160 msgr2=0x7f2b8c0ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:34.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.538+0000 7f2b8a59c700 1 --2- 172.21.15.45:0/417958041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b8c0cc160 0x7f2b8c0ad4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:34.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.538+0000 7f2b8a59c700 1 -- 172.21.15.45:0/417958041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b74009520 con 0x7f2b8c0ae380 2023-10-08T12:45:34.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.538+0000 7f2b8a59c700 1 --2- 172.21.15.45:0/417958041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b8c0ae380 0x7f2b8c1ef9f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c00c4c0 tx=0x7f2b7c00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:34.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.538+0000 7f2b82ffd700 1 -- 172.21.15.45:0/417958041 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c0052d0 con 0x7f2b8c0ae380 2023-10-08T12:45:34.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.538+0000 7f2b82ffd700 1 -- 172.21.15.45:0/417958041 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2b7c00ce90 con 0x7f2b8c0ae380 2023-10-08T12:45:34.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.538+0000 7f2b9089e700 1 -- 172.21.15.45:0/417958041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b84009d00 con 0x7f2b8c0ae380 2023-10-08T12:45:34.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.538+0000 7f2b82ffd700 1 -- 172.21.15.45:0/417958041 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c005580 con 0x7f2b8c0ae380 2023-10-08T12:45:34.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.538+0000 7f2b9089e700 1 -- 172.21.15.45:0/417958041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b8c147d50 con 0x7f2b8c0ae380 2023-10-08T12:45:34.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.539+0000 7f2b9089e700 1 -- 172.21.15.45:0/417958041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b8c06eaa0 con 0x7f2b8c0ae380 2023-10-08T12:45:34.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.539+0000 7f2b82ffd700 1 -- 172.21.15.45:0/417958041 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2b7c003680 con 0x7f2b8c0ae380 2023-10-08T12:45:34.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.540+0000 7f2b82ffd700 1 --2- 172.21.15.45:0/417958041 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f2b6c06aed0 0x7f2b6c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:34.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.540+0000 7f2b82ffd700 1 -- 172.21.15.45:0/417958041 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b7c0889d0 con 0x7f2b8c0ae380 2023-10-08T12:45:34.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.540+0000 7f2b89d9b700 1 --2- 172.21.15.45:0/417958041 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f2b6c06aed0 0x7f2b6c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:34.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.541+0000 7f2b89d9b700 1 --2- 172.21.15.45:0/417958041 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f2b6c06aed0 0x7f2b6c06d390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c09d6b0 tx=0x7f2b74009260 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:34.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.545+0000 7f2b82ffd700 1 -- 172.21.15.45:0/417958041 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2b7c053a80 con 0x7f2b8c0ae380 2023-10-08T12:45:34.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.745+0000 7f2b9089e700 1 -- 172.21.15.45:0/417958041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) v1 -- 0x7f2b8c04e4c0 con 0x7f2b8c0ae380 2023-10-08T12:45:34.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.746+0000 7f2b82ffd700 1 -- 172.21.15.45:0/417958041 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v30) v1 ==== 86+0+160 (secure 0 0 0) 0x7f2b7c0570a0 con 0x7f2b8c0ae380 2023-10-08T12:45:34.747 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:34.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.748+0000 7f2b9089e700 1 -- 172.21.15.45:0/417958041 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f2b6c06aed0 msgr2=0x7f2b6c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:34.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.748+0000 7f2b9089e700 1 --2- 172.21.15.45:0/417958041 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f2b6c06aed0 0x7f2b6c06d390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c09d6b0 tx=0x7f2b74009260 comp rx=0 tx=0).stop 2023-10-08T12:45:34.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.748+0000 7f2b9089e700 1 -- 172.21.15.45:0/417958041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b8c0ae380 msgr2=0x7f2b8c1ef9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:34.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.748+0000 7f2b9089e700 1 --2- 172.21.15.45:0/417958041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b8c0ae380 0x7f2b8c1ef9f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c00c4c0 tx=0x7f2b7c00c7d0 comp rx=0 tx=0).stop 2023-10-08T12:45:34.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.748+0000 7f2b9089e700 1 -- 172.21.15.45:0/417958041 shutdown_connections 2023-10-08T12:45:34.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.748+0000 7f2b9089e700 1 --2- 172.21.15.45:0/417958041 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f2b6c06aed0 0x7f2b6c06d390 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:34.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.748+0000 7f2b9089e700 1 --2- 172.21.15.45:0/417958041 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2b8c1599f0 0x7f2b8c0ada20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:34.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.748+0000 7f2b9089e700 1 --2- 172.21.15.45:0/417958041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b8c0ae380 0x7f2b8c1ef9f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:34.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.748+0000 7f2b9089e700 1 --2- 172.21.15.45:0/417958041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b8c0cc160 0x7f2b8c0ad4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:34.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.748+0000 7f2b9089e700 1 -- 172.21.15.45:0/417958041 >> 172.21.15.45:0/417958041 conn(0x7f2b8c0cf750 msgr2=0x7f2b8c0cfb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:34.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.748+0000 7f2b9089e700 1 -- 172.21.15.45:0/417958041 shutdown_connections 2023-10-08T12:45:34.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.748+0000 7f2b9089e700 1 -- 172.21.15.45:0/417958041 wait complete. 2023-10-08T12:45:34.760 INFO:teuthology.orchestra.run.smithi045.stdout:[{"version":30,"timestamp":"2023-10-08T12:45:18.600734+0000","name":"","changes":[{"name":"osd.7/osd_mclock_max_capacity_iops_ssd","new_value":"6046.334866"}]}] 2023-10-08T12:45:34.761 INFO:tasks.ceph_manager:config epoch is 30 2023-10-08T12:45:34.761 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-08T12:45:34.761 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-08T12:45:34.761 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-08T12:45:34.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.888+0000 7f5e5f6c0700 1 -- 172.21.15.45:0/2707245796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e44004850 msgr2=0x7f5e44004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:34.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.888+0000 7f5e5f6c0700 1 --2- 172.21.15.45:0/2707245796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e44004850 0x7f5e44004cd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5e4800c2e0 tx=0x7f5e44005880 comp rx=0 tx=0).stop 2023-10-08T12:45:34.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.888+0000 7f5e5dc5d700 1 -- 172.21.15.45:0/2707245796 reap_dead start 2023-10-08T12:45:34.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.888+0000 7f5e5f6c0700 1 -- 172.21.15.45:0/2707245796 shutdown_connections 2023-10-08T12:45:34.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.888+0000 7f5e5f6c0700 1 -- 172.21.15.45:0/2707245796 >> 172.21.15.45:0/2707245796 conn(0x7f5e580b0430 msgr2=0x7f5e580b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:34.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.888+0000 7f5e5f6c0700 1 -- 172.21.15.45:0/2707245796 shutdown_connections 2023-10-08T12:45:34.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.888+0000 7f5e5f6c0700 1 -- 172.21.15.45:0/2707245796 wait complete. 2023-10-08T12:45:34.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.889+0000 7f5e5f6c0700 1 Processor -- start 2023-10-08T12:45:34.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.889+0000 7f5e5f6c0700 1 -- start start 2023-10-08T12:45:34.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.890+0000 7f5e5f6c0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e44004850 0x7f5e5814cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:34.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.890+0000 7f5e5f6c0700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5e580c6e20 0x7f5e58158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:34.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.890+0000 7f5e5f6c0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e5815afc0 0x7f5e5815b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:34.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.890+0000 7f5e5f6c0700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5815a410 con 0x7f5e44004850 2023-10-08T12:45:34.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.890+0000 7f5e5f6c0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5815b990 con 0x7f5e5815afc0 2023-10-08T12:45:34.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.890+0000 7f5e5f6c0700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e58159790 con 0x7f5e580c6e20 2023-10-08T12:45:34.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.890+0000 7f5e5d45c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e44004850 0x7f5e5814cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:34.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.890+0000 7f5e5d45c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e44004850 0x7f5e5814cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35012/0 (socket says 172.21.15.45:35012) 2023-10-08T12:45:34.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.890+0000 7f5e5d45c700 1 -- 172.21.15.45:0/1938934260 learned_addr learned my addr 172.21.15.45:0/1938934260 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:34.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.890+0000 7f5e5d45c700 1 -- 172.21.15.45:0/1938934260 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5e580c6e20 msgr2=0x7f5e58158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:34.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.890+0000 7f5e5cc5b700 1 --2- 172.21.15.45:0/1938934260 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5e580c6e20 0x7f5e58158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:34.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.890+0000 7f5e5dc5d700 1 --2- 172.21.15.45:0/1938934260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e5815afc0 0x7f5e5815b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:34.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.890+0000 7f5e5d45c700 1 --2- 172.21.15.45:0/1938934260 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5e580c6e20 0x7f5e58158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:34.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.890+0000 7f5e5d45c700 1 -- 172.21.15.45:0/1938934260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e5815afc0 msgr2=0x7f5e5815b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:34.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.890+0000 7f5e5d45c700 1 --2- 172.21.15.45:0/1938934260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e5815afc0 0x7f5e5815b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:34.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.890+0000 7f5e5d45c700 1 -- 172.21.15.45:0/1938934260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e58072890 con 0x7f5e44004850 2023-10-08T12:45:34.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.890+0000 7f5e5cc5b700 1 --2- 172.21.15.45:0/1938934260 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5e580c6e20 0x7f5e58158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:45:34.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.890+0000 7f5e5dc5d700 1 --2- 172.21.15.45:0/1938934260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e5815afc0 0x7f5e5815b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:45:34.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.890+0000 7f5e5d45c700 1 --2- 172.21.15.45:0/1938934260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e44004850 0x7f5e5814cab0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5e54011ab0 tx=0x7f5e54011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:34.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.890+0000 7f5e4dffb700 1 -- 172.21.15.45:0/1938934260 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5400fac0 con 0x7f5e44004850 2023-10-08T12:45:34.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.890+0000 7f5e4dffb700 1 -- 172.21.15.45:0/1938934260 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5e5400fc20 con 0x7f5e44004850 2023-10-08T12:45:34.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.890+0000 7f5e5f6c0700 1 -- 172.21.15.45:0/1938934260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e58159a70 con 0x7f5e44004850 2023-10-08T12:45:34.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.890+0000 7f5e4dffb700 1 -- 172.21.15.45:0/1938934260 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e54019410 con 0x7f5e44004850 2023-10-08T12:45:34.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.891+0000 7f5e5f6c0700 1 -- 172.21.15.45:0/1938934260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e5815a030 con 0x7f5e44004850 2023-10-08T12:45:34.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.892+0000 7f5e5f6c0700 1 -- 172.21.15.45:0/1938934260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e580732c0 con 0x7f5e44004850 2023-10-08T12:45:34.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.892+0000 7f5e4dffb700 1 -- 172.21.15.45:0/1938934260 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5e54019570 con 0x7f5e44004850 2023-10-08T12:45:34.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.892+0000 7f5e4dffb700 1 --2- 172.21.15.45:0/1938934260 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f5e3c06aed0 0x7f5e3c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:34.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.892+0000 7f5e4dffb700 1 -- 172.21.15.45:0/1938934260 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e54089fa0 con 0x7f5e44004850 2023-10-08T12:45:34.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.892+0000 7f5e5cc5b700 1 --2- 172.21.15.45:0/1938934260 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f5e3c06aed0 0x7f5e3c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:34.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.893+0000 7f5e5cc5b700 1 --2- 172.21.15.45:0/1938934260 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f5e3c06aed0 0x7f5e3c06d390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5e48012040 tx=0x7f5e48001a00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:34.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:34.897+0000 7f5e4dffb700 1 -- 172.21.15.45:0/1938934260 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5e540bcca0 con 0x7f5e44004850 2023-10-08T12:45:35.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.155+0000 7f5e5f6c0700 1 -- 172.21.15.45:0/1938934260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f5e5804e4c0 con 0x7f5e44004850 2023-10-08T12:45:35.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.158+0000 7f5e4dffb700 1 -- 172.21.15.45:0/1938934260 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171028 (secure 0 0 0) 0x7f5e540bac30 con 0x7f5e44004850 2023-10-08T12:45:35.160 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:35.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.160+0000 7f5e5f6c0700 1 -- 172.21.15.45:0/1938934260 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f5e3c06aed0 msgr2=0x7f5e3c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:35.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.160+0000 7f5e5f6c0700 1 --2- 172.21.15.45:0/1938934260 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f5e3c06aed0 0x7f5e3c06d390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5e48012040 tx=0x7f5e48001a00 comp rx=0 tx=0).stop 2023-10-08T12:45:35.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.160+0000 7f5e5f6c0700 1 -- 172.21.15.45:0/1938934260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e44004850 msgr2=0x7f5e5814cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:35.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.160+0000 7f5e5f6c0700 1 --2- 172.21.15.45:0/1938934260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e44004850 0x7f5e5814cab0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5e54011ab0 tx=0x7f5e54011e70 comp rx=0 tx=0).stop 2023-10-08T12:45:35.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.161+0000 7f5e5f6c0700 1 -- 172.21.15.45:0/1938934260 shutdown_connections 2023-10-08T12:45:35.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.161+0000 7f5e5f6c0700 1 --2- 172.21.15.45:0/1938934260 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f5e3c06aed0 0x7f5e3c06d390 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:35.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.161+0000 7f5e5f6c0700 1 --2- 172.21.15.45:0/1938934260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e5815afc0 0x7f5e5815b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:35.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.161+0000 7f5e5f6c0700 1 --2- 172.21.15.45:0/1938934260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e44004850 0x7f5e5814cab0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:35.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.161+0000 7f5e5f6c0700 1 --2- 172.21.15.45:0/1938934260 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5e580c6e20 0x7f5e58158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:35.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.161+0000 7f5e5f6c0700 1 -- 172.21.15.45:0/1938934260 >> 172.21.15.45:0/1938934260 conn(0x7f5e580b0430 msgr2=0x7f5e5814ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:35.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.161+0000 7f5e5f6c0700 1 -- 172.21.15.45:0/1938934260 shutdown_connections 2023-10-08T12:45:35.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.161+0000 7f5e5f6c0700 1 -- 172.21.15.45:0/1938934260 wait complete. 2023-10-08T12:45:35.173 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":5,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3438117854},{"type":"v1","addr":"172.21.15.78:6833","nonce":3438117854}]},"active_addr":"172.21.15.78:6833/3438117854","active_change":"2023-10-08T12:45:13.119471+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4111,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":714842622}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":3483923435}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":585356314}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":3318831803}]}]} 2023-10-08T12:45:35.179 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-08T12:45:35.179 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-08T12:45:35.179 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:45:35.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.305+0000 7f9953e5c700 1 -- 172.21.15.45:0/3929636295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f994c0cc990 msgr2=0x7f994c0d0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:35.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.305+0000 7f9953e5c700 1 --2- 172.21.15.45:0/3929636295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f994c0cc990 0x7f994c0d0d80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f993c005fd0 tx=0x7f993c009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:35.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.305+0000 7f9953e5c700 1 -- 172.21.15.45:0/3929636295 shutdown_connections 2023-10-08T12:45:35.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.305+0000 7f9953e5c700 1 --2- 172.21.15.45:0/3929636295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f994c0cc990 0x7f994c0d0d80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:35.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.305+0000 7f9953e5c700 1 -- 172.21.15.45:0/3929636295 >> 172.21.15.45:0/3929636295 conn(0x7f994c071940 msgr2=0x7f994c071d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:35.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.306+0000 7f9953e5c700 1 -- 172.21.15.45:0/3929636295 shutdown_connections 2023-10-08T12:45:35.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.306+0000 7f9953e5c700 1 -- 172.21.15.45:0/3929636295 wait complete. 2023-10-08T12:45:35.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.307+0000 7f9953e5c700 1 Processor -- start 2023-10-08T12:45:35.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.307+0000 7f9953e5c700 1 -- start start 2023-10-08T12:45:35.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.308+0000 7f9953e5c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f994c0b5020 0x7f994c0c7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:35.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.308+0000 7f9953e5c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f994c0cc990 0x7f994c1e5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:35.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.308+0000 7f9953e5c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f994c0ccd70 0x7f994c155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:35.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.308+0000 7f9953e5c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994c1422e0 con 0x7f994c0ccd70 2023-10-08T12:45:35.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.308+0000 7f9953e5c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994c1425c0 con 0x7f994c0cc990 2023-10-08T12:45:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.308+0000 7f9953e5c700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f994c1428a0 con 0x7f994c0b5020 2023-10-08T12:45:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.308+0000 7f99523f9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f994c0ccd70 0x7f994c155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.308+0000 7f99523f9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f994c0ccd70 0x7f994c155900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35030/0 (socket says 172.21.15.45:35030) 2023-10-08T12:45:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.308+0000 7f99523f9700 1 -- 172.21.15.45:0/1509866728 learned_addr learned my addr 172.21.15.45:0/1509866728 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.308+0000 7f99513f7700 1 --2- 172.21.15.45:0/1509866728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f994c0cc990 0x7f994c1e5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.308+0000 7f9951bf8700 1 --2- 172.21.15.45:0/1509866728 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f994c0b5020 0x7f994c0c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.309+0000 7f99523f9700 1 -- 172.21.15.45:0/1509866728 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f994c0b5020 msgr2=0x7f994c0c7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.309+0000 7f99523f9700 1 --2- 172.21.15.45:0/1509866728 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f994c0b5020 0x7f994c0c7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.309+0000 7f99523f9700 1 -- 172.21.15.45:0/1509866728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f994c0cc990 msgr2=0x7f994c1e5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:35.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.309+0000 7f99523f9700 1 --2- 172.21.15.45:0/1509866728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f994c0cc990 0x7f994c1e5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:35.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.309+0000 7f99523f9700 1 -- 172.21.15.45:0/1509866728 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993c0095f0 con 0x7f994c0ccd70 2023-10-08T12:45:35.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.309+0000 7f99523f9700 1 --2- 172.21.15.45:0/1509866728 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f994c0ccd70 0x7f994c155900 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f994400cba0 tx=0x7f994400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:35.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.309+0000 7f99427fc700 1 -- 172.21.15.45:0/1509866728 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9944003c00 con 0x7f994c0ccd70 2023-10-08T12:45:35.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.309+0000 7f99427fc700 1 -- 172.21.15.45:0/1509866728 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9944003d60 con 0x7f994c0ccd70 2023-10-08T12:45:35.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.309+0000 7f9953e5c700 1 -- 172.21.15.45:0/1509866728 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f994c142b80 con 0x7f994c0ccd70 2023-10-08T12:45:35.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.309+0000 7f99427fc700 1 -- 172.21.15.45:0/1509866728 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994400abe0 con 0x7f994c0ccd70 2023-10-08T12:45:35.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.309+0000 7f9953e5c700 1 -- 172.21.15.45:0/1509866728 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f994c0c7980 con 0x7f994c0ccd70 2023-10-08T12:45:35.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.310+0000 7f9953e5c700 1 -- 172.21.15.45:0/1509866728 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f994c1430a0 con 0x7f994c0ccd70 2023-10-08T12:45:35.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.310+0000 7f99427fc700 1 -- 172.21.15.45:0/1509866728 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f994400ad40 con 0x7f994c0ccd70 2023-10-08T12:45:35.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.311+0000 7f99427fc700 1 --2- 172.21.15.45:0/1509866728 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f993006aed0 0x7f993006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:35.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.311+0000 7f99427fc700 1 -- 172.21.15.45:0/1509866728 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9944089860 con 0x7f994c0ccd70 2023-10-08T12:45:35.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.311+0000 7f9951bf8700 1 --2- 172.21.15.45:0/1509866728 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f993006aed0 0x7f993006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:35.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.311+0000 7f9951bf8700 1 --2- 172.21.15.45:0/1509866728 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f993006aed0 0x7f993006d390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f993c005e00 tx=0x7f993c0047c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:35.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.315+0000 7f99427fc700 1 -- 172.21.15.45:0/1509866728 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f994c1430a0 con 0x7f994c0ccd70 2023-10-08T12:45:35.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.516+0000 7f9953e5c700 1 -- 172.21.15.45:0/1509866728 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f994c1430a0 con 0x7f994c0ccd70 2023-10-08T12:45:35.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.517+0000 7f99427fc700 1 -- 172.21.15.45:0/1509866728 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f994c1430a0 con 0x7f994c0ccd70 2023-10-08T12:45:35.518 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:35.519 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:45:26.206424+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:45:19.183651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:45:22.277383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:45:23.606639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.412453+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.351925+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.428025+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.437246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.441119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.388608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.415524+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.401835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:45:35.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.519+0000 7f9953e5c700 1 -- 172.21.15.45:0/1509866728 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f993006aed0 msgr2=0x7f993006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:35.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.519+0000 7f9953e5c700 1 --2- 172.21.15.45:0/1509866728 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f993006aed0 0x7f993006d390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f993c005e00 tx=0x7f993c0047c0 comp rx=0 tx=0).stop 2023-10-08T12:45:35.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.519+0000 7f9953e5c700 1 -- 172.21.15.45:0/1509866728 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f994c0ccd70 msgr2=0x7f994c155900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:35.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.519+0000 7f9953e5c700 1 --2- 172.21.15.45:0/1509866728 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f994c0ccd70 0x7f994c155900 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f994400cba0 tx=0x7f994400cf60 comp rx=0 tx=0).stop 2023-10-08T12:45:35.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.519+0000 7f9953e5c700 1 -- 172.21.15.45:0/1509866728 shutdown_connections 2023-10-08T12:45:35.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.519+0000 7f9953e5c700 1 --2- 172.21.15.45:0/1509866728 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f993006aed0 0x7f993006d390 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:35.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.519+0000 7f9953e5c700 1 --2- 172.21.15.45:0/1509866728 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f994c0ccd70 0x7f994c155900 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:35.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.520+0000 7f9953e5c700 1 --2- 172.21.15.45:0/1509866728 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f994c0b5020 0x7f994c0c7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:35.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.520+0000 7f9953e5c700 1 --2- 172.21.15.45:0/1509866728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f994c0cc990 0x7f994c1e5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:35.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.520+0000 7f9953e5c700 1 -- 172.21.15.45:0/1509866728 >> 172.21.15.45:0/1509866728 conn(0x7f994c071940 msgr2=0x7f994c0c7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:35.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.520+0000 7f9953e5c700 1 -- 172.21.15.45:0/1509866728 shutdown_connections 2023-10-08T12:45:35.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.520+0000 7f9953e5c700 1 -- 172.21.15.45:0/1509866728 wait complete. 2023-10-08T12:45:35.533 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-08T12:45:35.533 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:45:35.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.659+0000 7fb3e6e5b700 1 -- 172.21.15.45:0/1974441216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3d0005210 msgr2=0x7fb3d000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:35.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.659+0000 7fb3e6e5b700 1 --2- 172.21.15.45:0/1974441216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3d0005210 0x7fb3d000ba10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8001e10 tx=0x7fb3d0005880 comp rx=0 tx=0).stop 2023-10-08T12:45:35.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.659+0000 7fb3e6e5b700 1 -- 172.21.15.45:0/1974441216 shutdown_connections 2023-10-08T12:45:35.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.659+0000 7fb3e6e5b700 1 --2- 172.21.15.45:0/1974441216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3d0005210 0x7fb3d000ba10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:35.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.659+0000 7fb3e6e5b700 1 -- 172.21.15.45:0/1974441216 >> 172.21.15.45:0/1974441216 conn(0x7fb3e0071940 msgr2=0x7fb3e0071d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:35.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.659+0000 7fb3e6e5b700 1 -- 172.21.15.45:0/1974441216 shutdown_connections 2023-10-08T12:45:35.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.659+0000 7fb3e6e5b700 1 -- 172.21.15.45:0/1974441216 wait complete. 2023-10-08T12:45:35.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.660+0000 7fb3e6e5b700 1 Processor -- start 2023-10-08T12:45:35.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.660+0000 7fb3e6e5b700 1 -- start start 2023-10-08T12:45:35.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.661+0000 7fb3e6e5b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3d0005210 0x7fb3e01f32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:35.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.661+0000 7fb3e6e5b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3e0154440 0x7fb3e015eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:35.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.661+0000 7fb3e6e5b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3e015f070 0x7fb3e015c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:35.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.661+0000 7fb3e6e5b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e015f4f0 con 0x7fb3d0005210 2023-10-08T12:45:35.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.661+0000 7fb3e6e5b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e00c9990 con 0x7fb3e0154440 2023-10-08T12:45:35.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.661+0000 7fb3e6e5b700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e01f3800 con 0x7fb3e015f070 2023-10-08T12:45:35.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.661+0000 7fb3e4bf7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3d0005210 0x7fb3e01f32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:35.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.661+0000 7fb3e4bf7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3d0005210 0x7fb3e01f32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35048/0 (socket says 172.21.15.45:35048) 2023-10-08T12:45:35.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.661+0000 7fb3e4bf7700 1 -- 172.21.15.45:0/3992547173 learned_addr learned my addr 172.21.15.45:0/3992547173 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:35.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.661+0000 7fb3e53f8700 1 --2- 172.21.15.45:0/3992547173 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3e015f070 0x7fb3e015c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:35.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.661+0000 7fb3dffff700 1 --2- 172.21.15.45:0/3992547173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3e0154440 0x7fb3e015eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:35.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.661+0000 7fb3e4bf7700 1 -- 172.21.15.45:0/3992547173 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3e015f070 msgr2=0x7fb3e015c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:35.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.661+0000 7fb3e4bf7700 1 --2- 172.21.15.45:0/3992547173 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3e015f070 0x7fb3e015c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:35.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.661+0000 7fb3e4bf7700 1 -- 172.21.15.45:0/3992547173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3e0154440 msgr2=0x7fb3e015eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:35.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.661+0000 7fb3e4bf7700 1 --2- 172.21.15.45:0/3992547173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3e0154440 0x7fb3e015eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:35.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.661+0000 7fb3e4bf7700 1 -- 172.21.15.45:0/3992547173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e00c8d80 con 0x7fb3d0005210 2023-10-08T12:45:35.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.662+0000 7fb3e4bf7700 1 --2- 172.21.15.45:0/3992547173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3d0005210 0x7fb3e01f32c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4006630 tx=0x7fb3d4003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:35.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.662+0000 7fb3dd7fa700 1 -- 172.21.15.45:0/3992547173 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d4011430 con 0x7fb3d0005210 2023-10-08T12:45:35.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.662+0000 7fb3dd7fa700 1 -- 172.21.15.45:0/3992547173 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb3d4011590 con 0x7fb3d0005210 2023-10-08T12:45:35.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.662+0000 7fb3dd7fa700 1 -- 172.21.15.45:0/3992547173 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d4011960 con 0x7fb3d0005210 2023-10-08T12:45:35.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.662+0000 7fb3e6e5b700 1 -- 172.21.15.45:0/3992547173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e00c9060 con 0x7fb3d0005210 2023-10-08T12:45:35.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.662+0000 7fb3e6e5b700 1 -- 172.21.15.45:0/3992547173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e00c9620 con 0x7fb3d0005210 2023-10-08T12:45:35.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.663+0000 7fb3e6e5b700 1 -- 172.21.15.45:0/3992547173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e00c97e0 con 0x7fb3d0005210 2023-10-08T12:45:35.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.663+0000 7fb3dd7fa700 1 -- 172.21.15.45:0/3992547173 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb3d4011ac0 con 0x7fb3d0005210 2023-10-08T12:45:35.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.664+0000 7fb3dd7fa700 1 --2- 172.21.15.45:0/3992547173 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb3c406aed0 0x7fb3c406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:35.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.664+0000 7fb3dd7fa700 1 -- 172.21.15.45:0/3992547173 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3d408a340 con 0x7fb3d0005210 2023-10-08T12:45:35.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.664+0000 7fb3dffff700 1 --2- 172.21.15.45:0/3992547173 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb3c406aed0 0x7fb3c406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:35.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.664+0000 7fb3dffff700 1 --2- 172.21.15.45:0/3992547173 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb3c406aed0 0x7fb3c406d390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb3e00b3e90 tx=0x7fb3cc009260 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:35.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.668+0000 7fb3dd7fa700 1 -- 172.21.15.45:0/3992547173 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb3d40553f0 con 0x7fb3d0005210 2023-10-08T12:45:35.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.871+0000 7fb3e6e5b700 1 -- 172.21.15.45:0/3992547173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3e004e4c0 con 0x7fb3d0005210 2023-10-08T12:45:35.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.872+0000 7fb3dd7fa700 1 -- 172.21.15.45:0/3992547173 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7fb3d4058a10 con 0x7fb3d0005210 2023-10-08T12:45:35.873 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:35.873 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:45:26.206424+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:45:19.183651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:45:22.277383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:45:23.606639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.412453+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.351925+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.428025+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.437246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.441119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.388608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.415524+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.401835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:45:35.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.874+0000 7fb3e6e5b700 1 -- 172.21.15.45:0/3992547173 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb3c406aed0 msgr2=0x7fb3c406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:35.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.874+0000 7fb3e6e5b700 1 --2- 172.21.15.45:0/3992547173 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb3c406aed0 0x7fb3c406d390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb3e00b3e90 tx=0x7fb3cc009260 comp rx=0 tx=0).stop 2023-10-08T12:45:35.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.874+0000 7fb3e6e5b700 1 -- 172.21.15.45:0/3992547173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3d0005210 msgr2=0x7fb3e01f32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:35.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.874+0000 7fb3e6e5b700 1 --2- 172.21.15.45:0/3992547173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3d0005210 0x7fb3e01f32c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4006630 tx=0x7fb3d4003960 comp rx=0 tx=0).stop 2023-10-08T12:45:35.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.874+0000 7fb3e6e5b700 1 -- 172.21.15.45:0/3992547173 shutdown_connections 2023-10-08T12:45:35.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.874+0000 7fb3e6e5b700 1 --2- 172.21.15.45:0/3992547173 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb3c406aed0 0x7fb3c406d390 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:35.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.874+0000 7fb3e6e5b700 1 --2- 172.21.15.45:0/3992547173 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3e015f070 0x7fb3e015c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:35.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.874+0000 7fb3e6e5b700 1 --2- 172.21.15.45:0/3992547173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3d0005210 0x7fb3e01f32c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:35.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.874+0000 7fb3e6e5b700 1 --2- 172.21.15.45:0/3992547173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3e0154440 0x7fb3e015eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:35.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.874+0000 7fb3e6e5b700 1 -- 172.21.15.45:0/3992547173 >> 172.21.15.45:0/3992547173 conn(0x7fb3e0071940 msgr2=0x7fb3e00b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:35.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.874+0000 7fb3e6e5b700 1 -- 172.21.15.45:0/3992547173 shutdown_connections 2023-10-08T12:45:35.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:35.874+0000 7fb3e6e5b700 1 -- 172.21.15.45:0/3992547173 wait complete. 2023-10-08T12:45:35.888 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-08T12:45:35.888 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-08T12:45:35.888 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-08T12:45:35.889 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-08T12:45:35.889 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-08T12:45:35.890 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-08T12:45:35.890 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-08T12:45:35.890 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-08T12:45:36.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.105+0000 7f1046d0e700 1 -- 172.21.15.45:0/2124618048 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1040141220 msgr2=0x7f1040141600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.105+0000 7f1046d0e700 1 --2- 172.21.15.45:0/2124618048 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1040141220 0x7f1040141600 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f10300098c0 tx=0x7f1030009bd0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.111+0000 7f1046d0e700 1 -- 172.21.15.45:0/2124618048 shutdown_connections 2023-10-08T12:45:36.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.111+0000 7f1046d0e700 1 --2- 172.21.15.45:0/2124618048 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1040141220 0x7f1040141600 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.111+0000 7f1046d0e700 1 --2- 172.21.15.45:0/2124618048 >> v2:172.21.15.78:3300/0 conn(0x7f10400b32e0 0x7f104015c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.111+0000 7f1046d0e700 1 -- 172.21.15.45:0/2124618048 >> 172.21.15.45:0/2124618048 conn(0x7f104006e010 msgr2=0x7f104006e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.111+0000 7f9552dbb700 1 -- 172.21.15.45:0/2653917122 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f954c0724c0 msgr2=0x7f954c0c9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.111+0000 7f9552dbb700 1 --2- 172.21.15.45:0/2653917122 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f954c0724c0 0x7f954c0c9ff0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f954c06d490 tx=0x7f954400b380 comp rx=0 tx=0).stop 2023-10-08T12:45:36.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.112+0000 7f1046d0e700 1 -- 172.21.15.45:0/2124618048 shutdown_connections 2023-10-08T12:45:36.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.112+0000 7f1046d0e700 1 -- 172.21.15.45:0/2124618048 wait complete. 2023-10-08T12:45:36.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.114+0000 7f1046d0e700 1 Processor -- start 2023-10-08T12:45:36.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.115+0000 7f9552dbb700 1 -- 172.21.15.45:0/2653917122 shutdown_connections 2023-10-08T12:45:36.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.115+0000 7f9552dbb700 1 --2- 172.21.15.45:0/2653917122 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f954c0724c0 0x7f954c0c9ff0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.115+0000 7f9552dbb700 1 --2- 172.21.15.45:0/2653917122 >> v2:172.21.15.45:3300/0 conn(0x7f954c158950 0x7f954c0cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.115+0000 7f9552dbb700 1 --2- 172.21.15.45:0/2653917122 >> v2:172.21.15.78:3300/0 conn(0x7f954c15c320 0x7f954c071f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.115+0000 7f9552dbb700 1 -- 172.21.15.45:0/2653917122 >> 172.21.15.45:0/2653917122 conn(0x7f954c0b0430 msgr2=0x7f954c0b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.114+0000 7f1046d0e700 1 -- start start 2023-10-08T12:45:36.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.116+0000 7f1046d0e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10400b32e0 0x7f10401f9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.116+0000 7f1046d0e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1040141220 0x7f104013c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.116+0000 7f1046d0e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f104015c580 0x7f1040140350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.116+0000 7f1046d0e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10400ae620 con 0x7f10400b32e0 2023-10-08T12:45:36.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.116+0000 7f1046d0e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104013c1c0 con 0x7f1040141220 2023-10-08T12:45:36.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.116+0000 7f1046d0e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10400ada10 con 0x7f104015c580 2023-10-08T12:45:36.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.116+0000 7f103ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1040141220 0x7f104013c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.116+0000 7f103ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1040141220 0x7f104013c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.45:46532/0 (socket says 172.21.15.45:46532) 2023-10-08T12:45:36.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.116+0000 7f103ffff700 1 -- 172.21.15.45:0/2423555417 learned_addr learned my addr 172.21.15.45:0/2423555417 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:36.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.116+0000 7f10452ab700 1 --2- 172.21.15.45:0/2423555417 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f104015c580 0x7f1040140350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.116+0000 7f1044aaa700 1 --2- 172.21.15.45:0/2423555417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10400b32e0 0x7f10401f9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.117+0000 7f103ffff700 1 -- 172.21.15.45:0/2423555417 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f104015c580 msgr2=0x7f1040140350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.117+0000 7f103ffff700 1 --2- 172.21.15.45:0/2423555417 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f104015c580 0x7f1040140350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.117+0000 7f103ffff700 1 -- 172.21.15.45:0/2423555417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10400b32e0 msgr2=0x7f10401f9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.117+0000 7f103ffff700 1 --2- 172.21.15.45:0/2423555417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10400b32e0 0x7f10401f9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.117+0000 7f103ffff700 1 -- 172.21.15.45:0/2423555417 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1030009520 con 0x7f1040141220 2023-10-08T12:45:36.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.116+0000 7fa488702700 1 -- 172.21.15.45:0/3464827147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa48006f580 msgr2=0x7fa48015f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.116+0000 7fa488702700 1 --2- 172.21.15.45:0/3464827147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa48006f580 0x7fa48015f5e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa470005fd0 tx=0x7fa470009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:36.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.117+0000 7fa488702700 1 -- 172.21.15.45:0/3464827147 shutdown_connections 2023-10-08T12:45:36.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.117+0000 7fa488702700 1 --2- 172.21.15.45:0/3464827147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa48006f580 0x7fa48015f5e0 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa470005fd0 tx=0x7fa470009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:36.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.117+0000 7fa488702700 1 -- 172.21.15.45:0/3464827147 >> 172.21.15.45:0/3464827147 conn(0x7fa4800afae0 msgr2=0x7fa4800afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.117+0000 7f9552dbb700 1 -- 172.21.15.45:0/2653917122 shutdown_connections 2023-10-08T12:45:36.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.117+0000 7f103ffff700 1 --2- 172.21.15.45:0/2423555417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1040141220 0x7f104013c610 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f103800a420 tx=0x7f103800a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.117+0000 7f103d7fa700 1 -- 172.21.15.45:0/2423555417 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103800ae60 con 0x7f1040141220 2023-10-08T12:45:36.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.117+0000 7f9422101700 1 -- 172.21.15.45:0/2052666866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f941c15c320 msgr2=0x7f941c071f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.117+0000 7f9422101700 1 --2- 172.21.15.45:0/2052666866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f941c15c320 0x7f941c071f80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f941c06cd70 tx=0x7f940c009ba0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.117+0000 7f9422101700 1 -- 172.21.15.45:0/2052666866 shutdown_connections 2023-10-08T12:45:36.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.117+0000 7f9422101700 1 --2- 172.21.15.45:0/2052666866 >> v2:172.21.15.45:3300/0 conn(0x7f941c0724c0 0x7f941c0c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.117+0000 7f9422101700 1 --2- 172.21.15.45:0/2052666866 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f941c158950 0x7f941c0cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.117+0000 7f9422101700 1 --2- 172.21.15.45:0/2052666866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f941c15c320 0x7f941c071f80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.117+0000 7f9422101700 1 -- 172.21.15.45:0/2052666866 >> 172.21.15.45:0/2052666866 conn(0x7f941c0b0430 msgr2=0x7f941c0b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.117+0000 7f103d7fa700 1 -- 172.21.15.45:0/2423555417 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1038004bb0 con 0x7f1040141220 2023-10-08T12:45:36.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.117+0000 7f103d7fa700 1 -- 172.21.15.45:0/2423555417 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1038008560 con 0x7f1040141220 2023-10-08T12:45:36.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.117+0000 7fa488702700 1 -- 172.21.15.45:0/3464827147 shutdown_connections 2023-10-08T12:45:36.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.117+0000 7f1046d0e700 1 -- 172.21.15.45:0/2423555417 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10400adcf0 con 0x7f1040141220 2023-10-08T12:45:36.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.117+0000 7f1046d0e700 1 -- 172.21.15.45:0/2423555417 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10400ae2b0 con 0x7f1040141220 2023-10-08T12:45:36.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.118+0000 7f1046d0e700 1 -- 172.21.15.45:0/2423555417 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f104015fd40 con 0x7f1040141220 2023-10-08T12:45:36.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.117+0000 7f9552dbb700 1 -- 172.21.15.45:0/2653917122 wait complete. 2023-10-08T12:45:36.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.117+0000 7fa488702700 1 -- 172.21.15.45:0/3464827147 wait complete. 2023-10-08T12:45:36.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.119+0000 7f9552dbb700 1 Processor -- start 2023-10-08T12:45:36.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.119+0000 7f9422101700 1 -- 172.21.15.45:0/2052666866 shutdown_connections 2023-10-08T12:45:36.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.119+0000 7fa488702700 1 Processor -- start 2023-10-08T12:45:36.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.119+0000 7fa488702700 1 -- start start 2023-10-08T12:45:36.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.120+0000 7fa488702700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4800c8640 0x7fa4800c1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7fa488702700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4801595c0 0x7fa4801fe950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7fa488702700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa4800cc450 0x7fa48015b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7fa488702700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa480168fc0 con 0x7fa4800c8640 2023-10-08T12:45:36.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7fa488702700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4800b1ff0 con 0x7fa4801595c0 2023-10-08T12:45:36.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7fa488702700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4800c4400 con 0x7fa4800cc450 2023-10-08T12:45:36.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.119+0000 7f9552dbb700 1 -- start start 2023-10-08T12:45:36.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.120+0000 7f2544d24700 1 -- 172.21.15.45:0/1631187631 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2540072400 msgr2=0x7f25400cca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.120+0000 7f2544d24700 1 --2- 172.21.15.45:0/1631187631 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2540072400 0x7f25400cca10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f25280098c0 tx=0x7f2528009bd0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.120+0000 7f103d7fa700 1 -- 172.21.15.45:0/2423555417 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f10380086c0 con 0x7f1040141220 2023-10-08T12:45:36.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7f103d7fa700 1 --2- 172.21.15.45:0/2423555417 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f102c06af00 0x7f102c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7f103d7fa700 1 -- 172.21.15.45:0/2423555417 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f103808a5f0 con 0x7f1040141220 2023-10-08T12:45:36.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.120+0000 7f9422101700 1 -- 172.21.15.45:0/2052666866 wait complete. 2023-10-08T12:45:36.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.120+0000 7f4d830a2700 1 -- 172.21.15.45:0/3151979517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d7c15c580 msgr2=0x7f4d7c13d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.120+0000 7f4d830a2700 1 --2- 172.21.15.45:0/3151979517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d7c15c580 0x7f4d7c13d760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4d74009f60 tx=0x7f4d74009f90 comp rx=0 tx=0).stop 2023-10-08T12:45:36.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.120+0000 7f9552dbb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f954c0724c0 0x7f954c0c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.120+0000 7f9552dbb700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f954c158950 0x7f954c201b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.120+0000 7f9552dbb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f954c15c320 0x7f954c0c5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.120+0000 7f9552dbb700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954c1598f0 con 0x7f954c15c320 2023-10-08T12:45:36.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.120+0000 7f9552dbb700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954c0c7a10 con 0x7f954c0724c0 2023-10-08T12:45:36.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.120+0000 7f9552dbb700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f954c158fc0 con 0x7f954c158950 2023-10-08T12:45:36.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7f9550b57700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f954c0724c0 0x7f954c0c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7f9551358700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f954c15c320 0x7f954c0c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7f9551358700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f954c15c320 0x7f954c0c5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35096/0 (socket says 172.21.15.45:35096) 2023-10-08T12:45:36.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7f9551358700 1 -- 172.21.15.45:0/1152156469 learned_addr learned my addr 172.21.15.45:0/1152156469 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:36.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7f103d7fa700 1 --2- 172.21.15.45:0/2423555417 >> [v2:172.21.15.78:6809/3188968439,v1:172.21.15.78:6811/3188968439] conn(0x7f102c073120 0x7f102c075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7f103d7fa700 1 -- 172.21.15.45:0/2423555417 --> [v2:172.21.15.78:6809/3188968439,v1:172.21.15.78:6811/3188968439] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f102c075bf0 con 0x7f102c073120 2023-10-08T12:45:36.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7f103d7fa700 1 -- 172.21.15.45:0/2423555417 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f103808a9a0 con 0x7f1040141220 2023-10-08T12:45:36.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7fa485c9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4801595c0 0x7fa4801fe950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7f1044aaa700 1 --2- 172.21.15.45:0/2423555417 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f102c06af00 0x7f102c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7fa486c9f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa4800cc450 0x7fa48015b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7fa486c9f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa4800cc450 0x7fa48015b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.45:36950/0 (socket says 172.21.15.45:36950) 2023-10-08T12:45:36.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7fa486c9f700 1 -- 172.21.15.45:0/2915076627 learned_addr learned my addr 172.21.15.45:0/2915076627 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:36.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7f2544d24700 1 -- 172.21.15.45:0/1631187631 shutdown_connections 2023-10-08T12:45:36.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7f2544d24700 1 --2- 172.21.15.45:0/1631187631 >> v2:172.21.15.78:3300/0 conn(0x7f2540072020 0x7f25400c3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7f2544d24700 1 --2- 172.21.15.45:0/1631187631 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2540072400 0x7f25400cca10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7f2544d24700 1 -- 172.21.15.45:0/1631187631 >> 172.21.15.45:0/1631187631 conn(0x7f25400ce7e0 msgr2=0x7f25400cebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7f9551358700 1 -- 172.21.15.45:0/1152156469 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f954c158950 msgr2=0x7f954c201b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7f9551358700 1 --2- 172.21.15.45:0/1152156469 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f954c158950 0x7f954c201b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7f9551358700 1 -- 172.21.15.45:0/1152156469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f954c0724c0 msgr2=0x7f954c0c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7f9551358700 1 --2- 172.21.15.45:0/1152156469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f954c0724c0 0x7f954c0c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7f9551358700 1 -- 172.21.15.45:0/1152156469 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9544009d00 con 0x7f954c15c320 2023-10-08T12:45:36.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7f9550b57700 1 --2- 172.21.15.45:0/1152156469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f954c0724c0 0x7f954c0c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:36.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7f2544d24700 1 -- 172.21.15.45:0/1631187631 shutdown_connections 2023-10-08T12:45:36.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7f10452ab700 1 --2- 172.21.15.45:0/2423555417 >> [v2:172.21.15.78:6809/3188968439,v1:172.21.15.78:6811/3188968439] conn(0x7f102c073120 0x7f102c075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7f2544d24700 1 -- 172.21.15.45:0/1631187631 wait complete. 2023-10-08T12:45:36.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.122+0000 7f9551358700 1 --2- 172.21.15.45:0/1152156469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f954c15c320 0x7f954c0c5930 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9544009fd0 tx=0x7f9544007c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.122+0000 7f9422101700 1 Processor -- start 2023-10-08T12:45:36.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.122+0000 7f1044aaa700 1 --2- 172.21.15.45:0/2423555417 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f102c06af00 0x7f102c06d3c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1030009810 tx=0x7f1030019040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.122+0000 7f10452ab700 1 --2- 172.21.15.45:0/2423555417 >> [v2:172.21.15.78:6809/3188968439,v1:172.21.15.78:6811/3188968439] conn(0x7f102c073120 0x7f102c075540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.122+0000 7f95497fa700 1 -- 172.21.15.45:0/1152156469 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954400e040 con 0x7f954c15c320 2023-10-08T12:45:36.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.122+0000 7f9552dbb700 1 -- 172.21.15.45:0/1152156469 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f954c1592a0 con 0x7f954c15c320 2023-10-08T12:45:36.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.122+0000 7f9552dbb700 1 -- 172.21.15.45:0/1152156469 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f954c202090 con 0x7f954c15c320 2023-10-08T12:45:36.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.123+0000 7f103d7fa700 1 -- 172.21.15.45:0/2423555417 <== osd.7 v2:172.21.15.78:6809/3188968439 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f102c075bf0 con 0x7f102c073120 2023-10-08T12:45:36.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.121+0000 7fa48649e700 1 --2- 172.21.15.45:0/2915076627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4800c8640 0x7fa4800c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.122+0000 7fa485c9d700 1 -- 172.21.15.45:0/2915076627 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa4800cc450 msgr2=0x7fa48015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.122+0000 7fa485c9d700 1 --2- 172.21.15.45:0/2915076627 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa4800cc450 0x7fa48015b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.122+0000 7fa485c9d700 1 -- 172.21.15.45:0/2915076627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4800c8640 msgr2=0x7fa4800c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.122+0000 7fa485c9d700 1 --2- 172.21.15.45:0/2915076627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4800c8640 0x7fa4800c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.122+0000 7fa485c9d700 1 -- 172.21.15.45:0/2915076627 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4700095f0 con 0x7fa4801595c0 2023-10-08T12:45:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.122+0000 7fa485c9d700 1 --2- 172.21.15.45:0/2915076627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4801595c0 0x7fa4801fe950 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00c430 tx=0x7fa47c00c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.122+0000 7fa476ffd700 1 -- 172.21.15.45:0/2915076627 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c011790 con 0x7fa4801595c0 2023-10-08T12:45:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.122+0000 7fa476ffd700 1 -- 172.21.15.45:0/2915076627 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa47c0119e0 con 0x7fa4801595c0 2023-10-08T12:45:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.122+0000 7fa488702700 1 -- 172.21.15.45:0/2915076627 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4800c3b60 con 0x7fa4801595c0 2023-10-08T12:45:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.122+0000 7fa488702700 1 -- 172.21.15.45:0/2915076627 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4800c4120 con 0x7fa4801595c0 2023-10-08T12:45:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.122+0000 7fa476ffd700 1 -- 172.21.15.45:0/2915076627 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c011df0 con 0x7fa4801595c0 2023-10-08T12:45:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.123+0000 7f4d830a2700 1 -- 172.21.15.45:0/3151979517 shutdown_connections 2023-10-08T12:45:36.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.123+0000 7f4d830a2700 1 --2- 172.21.15.45:0/3151979517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d7c15c580 0x7f4d7c13d760 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.123+0000 7f4d830a2700 1 --2- 172.21.15.45:0/3151979517 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4d7c0b32e0 0x7f4d7c15c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.123+0000 7f4d830a2700 1 -- 172.21.15.45:0/3151979517 >> 172.21.15.45:0/3151979517 conn(0x7f4d7c06e010 msgr2=0x7f4d7c06e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.122+0000 7f9422101700 1 -- start start 2023-10-08T12:45:36.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.123+0000 7f9422101700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f941c0724c0 0x7f941c15a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.123+0000 7f9422101700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f941c158950 0x7f941c146ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.123+0000 7f9422101700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f941c15c320 0x7f941c1471e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.123+0000 7f9422101700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c15af20 con 0x7f941c158950 2023-10-08T12:45:36.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.123+0000 7f9422101700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c15a960 con 0x7f941c15c320 2023-10-08T12:45:36.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.123+0000 7f9422101700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941c15ac40 con 0x7f941c0724c0 2023-10-08T12:45:36.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.123+0000 7f941b7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f941c0724c0 0x7f941c15a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.123+0000 7f941b7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f941c0724c0 0x7f941c15a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.45:36960/0 (socket says 172.21.15.45:36960) 2023-10-08T12:45:36.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.124+0000 7f2544d24700 1 Processor -- start 2023-10-08T12:45:36.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.124+0000 7f2544d24700 1 -- start start 2023-10-08T12:45:36.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.123+0000 7f941b7fe700 1 -- 172.21.15.45:0/3137003044 learned_addr learned my addr 172.21.15.45:0/3137003044 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:36.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.123+0000 7f941bfff700 1 --2- 172.21.15.45:0/3137003044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f941c15c320 0x7f941c1471e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.124+0000 7f941affd700 1 --2- 172.21.15.45:0/3137003044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f941c158950 0x7f941c146ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.124+0000 7f941b7fe700 1 -- 172.21.15.45:0/3137003044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f941c15c320 msgr2=0x7f941c1471e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.124+0000 7f941b7fe700 1 --2- 172.21.15.45:0/3137003044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f941c15c320 0x7f941c1471e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.124+0000 7f941b7fe700 1 -- 172.21.15.45:0/3137003044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f941c158950 msgr2=0x7f941c146ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.124+0000 7f941b7fe700 1 --2- 172.21.15.45:0/3137003044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f941c158950 0x7f941c146ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.124+0000 7f941b7fe700 1 -- 172.21.15.45:0/3137003044 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940c009520 con 0x7f941c0724c0 2023-10-08T12:45:36.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.124+0000 7f941b7fe700 1 --2- 172.21.15.45:0/3137003044 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f941c0724c0 0x7f941c15a380 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f941000d980 tx=0x7f941000dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.123+0000 7f95497fa700 1 -- 172.21.15.45:0/1152156469 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9544009b80 con 0x7f954c15c320 2023-10-08T12:45:36.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.123+0000 7f95497fa700 1 -- 172.21.15.45:0/1152156469 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954401daf0 con 0x7f954c15c320 2023-10-08T12:45:36.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.124+0000 7f9552dbb700 1 -- 172.21.15.45:0/1152156469 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f952c000fc0 con 0x7f954c15c320 2023-10-08T12:45:36.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.125+0000 7fa89fea0700 1 -- 172.21.15.45:0/2962163067 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa8980d1d40 msgr2=0x7fa8980b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.125+0000 7fa89fea0700 1 --2- 172.21.15.45:0/2962163067 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa8980d1d40 0x7fa8980b5020 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa8880098c0 tx=0x7fa888009bd0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.124+0000 7f9403fff700 1 -- 172.21.15.45:0/3137003044 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9410009930 con 0x7f941c0724c0 2023-10-08T12:45:36.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.124+0000 7f9403fff700 1 -- 172.21.15.45:0/3137003044 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9410009b80 con 0x7f941c0724c0 2023-10-08T12:45:36.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.124+0000 7f9403fff700 1 -- 172.21.15.45:0/3137003044 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9410010460 con 0x7f941c0724c0 2023-10-08T12:45:36.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.125+0000 7f9422101700 1 -- 172.21.15.45:0/3137003044 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941c1464a0 con 0x7f941c0724c0 2023-10-08T12:45:36.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.125+0000 7f9422101700 1 -- 172.21.15.45:0/3137003044 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941c15bb40 con 0x7f941c0724c0 2023-10-08T12:45:36.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.126+0000 7fa476ffd700 1 -- 172.21.15.45:0/2915076627 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa47c01c460 con 0x7fa4801595c0 2023-10-08T12:45:36.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.126+0000 7fa476ffd700 1 --2- 172.21.15.45:0/2915076627 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa46406af20 0x7fa46406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.127+0000 7fa476ffd700 1 -- 172.21.15.45:0/2915076627 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa47c0892d0 con 0x7fa4801595c0 2023-10-08T12:45:36.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.127+0000 7fa48649e700 1 --2- 172.21.15.45:0/2915076627 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa46406af20 0x7fa46406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.127+0000 7fa48649e700 1 --2- 172.21.15.45:0/2915076627 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa46406af20 0x7fa46406d3e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa480070610 tx=0x7fa4700047c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.127+0000 7f95497fa700 1 -- 172.21.15.45:0/1152156469 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f954401dc50 con 0x7f954c15c320 2023-10-08T12:45:36.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.127+0000 7f95497fa700 1 --2- 172.21.15.45:0/1152156469 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f953006aed0 0x7f953006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.127+0000 7f95497fa700 1 -- 172.21.15.45:0/1152156469 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f954408ba80 con 0x7f954c15c320 2023-10-08T12:45:36.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.125+0000 7f2544d24700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2540072020 0x7f2540147160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.125+0000 7f2544d24700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2540072400 0x7f2540153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.125+0000 7f2544d24700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25400ccf50 0x7f2540154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.125+0000 7f2544d24700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254014b260 con 0x7f25400ccf50 2023-10-08T12:45:36.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.125+0000 7f2544d24700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2540152810 con 0x7f2540072400 2023-10-08T12:45:36.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.125+0000 7f2544d24700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2540154790 con 0x7f2540072020 2023-10-08T12:45:36.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.126+0000 7f253e59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2540072020 0x7f2540147160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.126+0000 7f253e59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2540072020 0x7f2540147160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.45:36968/0 (socket says 172.21.15.45:36968) 2023-10-08T12:45:36.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.126+0000 7f253e59c700 1 -- 172.21.15.45:0/4172124358 learned_addr learned my addr 172.21.15.45:0/4172124358 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:36.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.126+0000 7f253ed9d700 1 --2- 172.21.15.45:0/4172124358 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25400ccf50 0x7f2540154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.126+0000 7f2535d9b700 1 --2- 172.21.15.45:0/4172124358 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2540072400 0x7f2540153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.126+0000 7f253ed9d700 1 -- 172.21.15.45:0/4172124358 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2540072020 msgr2=0x7f2540147160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.126+0000 7f253ed9d700 1 --2- 172.21.15.45:0/4172124358 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2540072020 0x7f2540147160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.126+0000 7f253ed9d700 1 -- 172.21.15.45:0/4172124358 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2540072400 msgr2=0x7f2540153c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.126+0000 7f253ed9d700 1 --2- 172.21.15.45:0/4172124358 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2540072400 0x7f2540153c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.126+0000 7f253ed9d700 1 -- 172.21.15.45:0/4172124358 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2528009520 con 0x7f25400ccf50 2023-10-08T12:45:36.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.126+0000 7fa89fea0700 1 -- 172.21.15.45:0/2962163067 shutdown_connections 2023-10-08T12:45:36.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.126+0000 7fa89fea0700 1 --2- 172.21.15.45:0/2962163067 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa8980d1d40 0x7fa8980b5020 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.126+0000 7fa89fea0700 1 --2- 172.21.15.45:0/2962163067 >> v2:172.21.15.78:3300/0 conn(0x7fa8980ccc00 0x7fa8980d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.126+0000 7fa89fea0700 1 --2- 172.21.15.45:0/2962163067 >> v2:172.21.15.45:3300/0 conn(0x7fa8980ccfe0 0x7fa8980d1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.126+0000 7fa89fea0700 1 -- 172.21.15.45:0/2962163067 >> 172.21.15.45:0/2962163067 conn(0x7fa898071940 msgr2=0x7fa898071d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.127+0000 7fa89fea0700 1 -- 172.21.15.45:0/2962163067 shutdown_connections 2023-10-08T12:45:36.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.127+0000 7fa89fea0700 1 -- 172.21.15.45:0/2962163067 wait complete. 2023-10-08T12:45:36.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.128+0000 7f95497fa700 1 --2- 172.21.15.45:0/1152156469 >> [v2:172.21.15.45:6808/3709844603,v1:172.21.15.45:6809/3709844603] conn(0x7f9530073070 0x7f9530075490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.128+0000 7f95497fa700 1 -- 172.21.15.45:0/1152156469 --> [v2:172.21.15.45:6808/3709844603,v1:172.21.15.45:6809/3709844603] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9530075b40 con 0x7f9530073070 2023-10-08T12:45:36.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.128+0000 7f95497fa700 1 -- 172.21.15.45:0/1152156469 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f954408bed0 con 0x7f954c15c320 2023-10-08T12:45:36.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.127+0000 7f4d830a2700 1 -- 172.21.15.45:0/3151979517 shutdown_connections 2023-10-08T12:45:36.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.126+0000 7f9422101700 1 -- 172.21.15.45:0/3137003044 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f93fc000fc0 con 0x7f941c0724c0 2023-10-08T12:45:36.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.128+0000 7f4d830a2700 1 -- 172.21.15.45:0/3151979517 wait complete. 2023-10-08T12:45:36.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.128+0000 7f954bfff700 1 --2- 172.21.15.45:0/1152156469 >> [v2:172.21.15.45:6808/3709844603,v1:172.21.15.45:6809/3709844603] conn(0x7f9530073070 0x7f9530075490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.128+0000 7f9403fff700 1 -- 172.21.15.45:0/3137003044 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f94100105c0 con 0x7f941c0724c0 2023-10-08T12:45:36.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.128+0000 7f954bfff700 1 --2- 172.21.15.45:0/1152156469 >> [v2:172.21.15.45:6808/3709844603,v1:172.21.15.45:6809/3709844603] conn(0x7f9530073070 0x7f9530075490 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.129+0000 7f253e59c700 1 --2- 172.21.15.45:0/4172124358 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2540072020 0x7f2540147160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:36.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.129+0000 7f9403fff700 1 --2- 172.21.15.45:0/3137003044 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f940806aed0 0x7f940806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.128+0000 7fa89fea0700 1 Processor -- start 2023-10-08T12:45:36.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.129+0000 7f253ed9d700 1 --2- 172.21.15.45:0/4172124358 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25400ccf50 0x7f2540154160 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f253800c780 tx=0x7f253800ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.129+0000 7f9403fff700 1 -- 172.21.15.45:0/3137003044 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f941008a260 con 0x7f941c0724c0 2023-10-08T12:45:36.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.129+0000 7f9403fff700 1 --2- 172.21.15.45:0/3137003044 >> [v2:172.21.15.78:6800/1354746290,v1:172.21.15.78:6801/1354746290] conn(0x7f9408073070 0x7f9408075490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.129+0000 7f9403fff700 1 -- 172.21.15.45:0/3137003044 --> [v2:172.21.15.78:6800/1354746290,v1:172.21.15.78:6801/1354746290] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9408075b40 con 0x7f9408073070 2023-10-08T12:45:36.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.129+0000 7f9403fff700 1 -- 172.21.15.45:0/3137003044 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f941008a610 con 0x7f941c0724c0 2023-10-08T12:45:36.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.129+0000 7fa488702700 1 --2- 172.21.15.45:0/2915076627 >> [v2:172.21.15.45:6816/2931618923,v1:172.21.15.45:6817/2931618923] conn(0x7fa4680015e0 0x7fa468003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.129+0000 7fa488702700 1 -- 172.21.15.45:0/2915076627 --> [v2:172.21.15.45:6816/2931618923,v1:172.21.15.45:6817/2931618923] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa468006bd0 con 0x7fa4680015e0 2023-10-08T12:45:36.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.129+0000 7f941affd700 1 --2- 172.21.15.45:0/3137003044 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f940806aed0 0x7f940806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.129+0000 7f9550b57700 1 --2- 172.21.15.45:0/1152156469 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f953006aed0 0x7f953006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.129+0000 7f941bfff700 1 --2- 172.21.15.45:0/3137003044 >> [v2:172.21.15.78:6800/1354746290,v1:172.21.15.78:6801/1354746290] conn(0x7f9408073070 0x7f9408075490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.129+0000 7fa486c9f700 1 --2- 172.21.15.45:0/2915076627 >> [v2:172.21.15.45:6816/2931618923,v1:172.21.15.45:6817/2931618923] conn(0x7fa4680015e0 0x7fa468003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.129+0000 7f25377fe700 1 -- 172.21.15.45:0/4172124358 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2538003e30 con 0x7f25400ccf50 2023-10-08T12:45:36.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.129+0000 7f25377fe700 1 -- 172.21.15.45:0/4172124358 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f25380050d0 con 0x7f25400ccf50 2023-10-08T12:45:36.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.129+0000 7f2544d24700 1 -- 172.21.15.45:0/4172124358 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2540152ad0 con 0x7f25400ccf50 2023-10-08T12:45:36.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.129+0000 7f25377fe700 1 -- 172.21.15.45:0/4172124358 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25380054e0 con 0x7f25400ccf50 2023-10-08T12:45:36.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.129+0000 7fa89fea0700 1 -- start start 2023-10-08T12:45:36.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.130+0000 7f9550b57700 1 --2- 172.21.15.45:0/1152156469 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f953006aed0 0x7f953006d390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f954000bc70 tx=0x7f954000b2c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.130+0000 7f2544d24700 1 -- 172.21.15.45:0/4172124358 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2540153090 con 0x7f25400ccf50 2023-10-08T12:45:36.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.130+0000 7fa486c9f700 1 --2- 172.21.15.45:0/2915076627 >> [v2:172.21.15.45:6816/2931618923,v1:172.21.15.45:6817/2931618923] conn(0x7fa4680015e0 0x7fa468003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.130+0000 7f4d830a2700 1 Processor -- start 2023-10-08T12:45:36.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.130+0000 7f4d830a2700 1 -- start start 2023-10-08T12:45:36.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.130+0000 7f941affd700 1 --2- 172.21.15.45:0/3137003044 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f940806aed0 0x7f940806d390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f940c009810 tx=0x7f940c0047c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.130+0000 7fa89fea0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8980ccc00 0x7fa8981f69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.130+0000 7fa89fea0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8980ccfe0 0x7fa898154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.130+0000 7fa89fea0700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa8980d1d40 0x7fa898154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.130+0000 7fa89fea0700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa898148200 con 0x7fa8980ccc00 2023-10-08T12:45:36.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.130+0000 7fa89fea0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8981484e0 con 0x7fa8980ccfe0 2023-10-08T12:45:36.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.130+0000 7fa89fea0700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8981487c0 con 0x7fa8980d1d40 2023-10-08T12:45:36.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.131+0000 7fa89e43d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa8980d1d40 0x7fa898154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.131+0000 7fa89e43d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa8980d1d40 0x7fa898154d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.45:36988/0 (socket says 172.21.15.45:36988) 2023-10-08T12:45:36.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.131+0000 7fa89e43d700 1 -- 172.21.15.45:0/265326228 learned_addr learned my addr 172.21.15.45:0/265326228 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:36.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.131+0000 7fa89dc3c700 1 --2- 172.21.15.45:0/265326228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8980ccc00 0x7fa8981f69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.131+0000 7f4d830a2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d7c0b32e0 0x7f4d7c139110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.131+0000 7f4d830a2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d7c141220 0x7f4d7c143d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.131+0000 7f4d830a2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4d7c15c580 0x7f4d7c144250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.131+0000 7f4d830a2700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c1f6bb0 con 0x7f4d7c141220 2023-10-08T12:45:36.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.131+0000 7f4d830a2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c13f220 con 0x7f4d7c0b32e0 2023-10-08T12:45:36.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.131+0000 7f4d830a2700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c1f7b60 con 0x7f4d7c15c580 2023-10-08T12:45:36.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.131+0000 7fa89dc3c700 1 -- 172.21.15.45:0/265326228 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa8980d1d40 msgr2=0x7fa898154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.131+0000 7fa89dc3c700 1 --2- 172.21.15.45:0/265326228 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa8980d1d40 0x7fa898154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.131+0000 7fa89dc3c700 1 -- 172.21.15.45:0/265326228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8980ccfe0 msgr2=0x7fa898154810 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T12:45:36.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.131+0000 7fa89dc3c700 1 --2- 172.21.15.45:0/265326228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8980ccfe0 0x7fa898154810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.131+0000 7fa89dc3c700 1 -- 172.21.15.45:0/265326228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa888009520 con 0x7fa8980ccc00 2023-10-08T12:45:36.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.131+0000 7f4d80e3e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d7c0b32e0 0x7f4d7c139110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.131+0000 7f4d80e3e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d7c0b32e0 0x7f4d7c139110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.45:46598/0 (socket says 172.21.15.45:46598) 2023-10-08T12:45:36.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.131+0000 7f4d80e3e700 1 -- 172.21.15.45:0/3565520604 learned_addr learned my addr 172.21.15.45:0/3565520604 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:36.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.130+0000 7f95497fa700 1 -- 172.21.15.45:0/1152156469 <== osd.2 v2:172.21.15.45:6808/3709844603 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f9530075b40 con 0x7f9530073070 2023-10-08T12:45:36.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.130+0000 7f2544d24700 1 -- 172.21.15.45:0/4172124358 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f254006ef30 con 0x7f25400ccf50 2023-10-08T12:45:36.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.132+0000 7fa476ffd700 1 -- 172.21.15.45:0/2915076627 <== osd.0 v2:172.21.15.45:6816/2931618923 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fa468006bd0 con 0x7fa4680015e0 2023-10-08T12:45:36.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.132+0000 7fa89dc3c700 1 --2- 172.21.15.45:0/265326228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8980ccc00 0x7fa8981f69c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa890007fd0 tx=0x7fa89000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.132+0000 7f4d7bfff700 1 --2- 172.21.15.45:0/3565520604 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d7c141220 0x7f4d7c143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.132+0000 7f4d80e3e700 1 -- 172.21.15.45:0/3565520604 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4d7c15c580 msgr2=0x7f4d7c144250 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T12:45:36.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.132+0000 7f4d80e3e700 1 --2- 172.21.15.45:0/3565520604 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4d7c15c580 0x7f4d7c144250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.132+0000 7f4d80e3e700 1 -- 172.21.15.45:0/3565520604 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d7c141220 msgr2=0x7f4d7c143d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.132+0000 7f4d80e3e700 1 --2- 172.21.15.45:0/3565520604 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d7c141220 0x7f4d7c143d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.132+0000 7f4d80e3e700 1 -- 172.21.15.45:0/3565520604 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d74009c40 con 0x7f4d7c0b32e0 2023-10-08T12:45:36.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.132+0000 7f25377fe700 1 -- 172.21.15.45:0/4172124358 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2538005640 con 0x7f25400ccf50 2023-10-08T12:45:36.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.132+0000 7fa88e7fc700 1 -- 172.21.15.45:0/265326228 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89000ddd0 con 0x7fa8980ccc00 2023-10-08T12:45:36.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.132+0000 7fa88e7fc700 1 -- 172.21.15.45:0/265326228 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa89000f040 con 0x7fa8980ccc00 2023-10-08T12:45:36.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.132+0000 7fa88e7fc700 1 -- 172.21.15.45:0/265326228 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa890015660 con 0x7fa8980ccc00 2023-10-08T12:45:36.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.132+0000 7f4d80e3e700 1 --2- 172.21.15.45:0/3565520604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d7c0b32e0 0x7f4d7c139110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4d6800c650 tx=0x7f4d6800ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.132+0000 7f25377fe700 1 --2- 172.21.15.45:0/4172124358 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f252006aed0 0x7f252006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.132+0000 7fa89fea0700 1 -- 172.21.15.45:0/265326228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa898148aa0 con 0x7fa8980ccc00 2023-10-08T12:45:36.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.132+0000 7fa89fea0700 1 -- 172.21.15.45:0/265326228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8981f6f00 con 0x7fa8980ccc00 2023-10-08T12:45:36.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.133+0000 7fa89fea0700 1 -- 172.21.15.45:0/265326228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa89804e4c0 con 0x7fa8980ccc00 2023-10-08T12:45:36.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.134+0000 7f941bfff700 1 --2- 172.21.15.45:0/3137003044 >> [v2:172.21.15.78:6800/1354746290,v1:172.21.15.78:6801/1354746290] conn(0x7f9408073070 0x7f9408075490 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.133+0000 7f25377fe700 1 -- 172.21.15.45:0/4172124358 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2538089570 con 0x7f25400ccf50 2023-10-08T12:45:36.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.133+0000 7f25377fe700 1 --2- 172.21.15.45:0/4172124358 >> [v2:172.21.15.45:6824/2255775238,v1:172.21.15.45:6825/2255775238] conn(0x7f25200730f0 0x7f2520075510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.133+0000 7f25377fe700 1 -- 172.21.15.45:0/4172124358 --> [v2:172.21.15.45:6824/2255775238,v1:172.21.15.45:6825/2255775238] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2520075bc0 con 0x7f25200730f0 2023-10-08T12:45:36.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.133+0000 7f25377fe700 1 -- 172.21.15.45:0/4172124358 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2538089920 con 0x7f25400ccf50 2023-10-08T12:45:36.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.133+0000 7f2535d9b700 1 --2- 172.21.15.45:0/4172124358 >> [v2:172.21.15.45:6824/2255775238,v1:172.21.15.45:6825/2255775238] conn(0x7f25200730f0 0x7f2520075510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.134+0000 7f253e59c700 1 --2- 172.21.15.45:0/4172124358 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f252006aed0 0x7f252006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.134+0000 7f4d797fa700 1 -- 172.21.15.45:0/3565520604 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d68005480 con 0x7f4d7c0b32e0 2023-10-08T12:45:36.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.134+0000 7f4d797fa700 1 -- 172.21.15.45:0/3565520604 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4d68003680 con 0x7f4d7c0b32e0 2023-10-08T12:45:36.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.134+0000 7f4d797fa700 1 -- 172.21.15.45:0/3565520604 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d68003a70 con 0x7f4d7c0b32e0 2023-10-08T12:45:36.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.134+0000 7f4d830a2700 1 -- 172.21.15.45:0/3565520604 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7c1f6da0 con 0x7f4d7c0b32e0 2023-10-08T12:45:36.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.134+0000 7f2535d9b700 1 --2- 172.21.15.45:0/4172124358 >> [v2:172.21.15.45:6824/2255775238,v1:172.21.15.45:6825/2255775238] conn(0x7f25200730f0 0x7f2520075510 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.135+0000 7f253e59c700 1 --2- 172.21.15.45:0/4172124358 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f252006aed0 0x7f252006d390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2530011550 tx=0x7f2530009260 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.134+0000 7fa88e7fc700 1 -- 172.21.15.45:0/265326228 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa8900157c0 con 0x7fa8980ccc00 2023-10-08T12:45:36.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.135+0000 7fa88e7fc700 1 --2- 172.21.15.45:0/265326228 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa87c06aed0 0x7fa87c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.135+0000 7fa88e7fc700 1 -- 172.21.15.45:0/265326228 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa89008a280 con 0x7fa8980ccc00 2023-10-08T12:45:36.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.135+0000 7fa88e7fc700 1 --2- 172.21.15.45:0/265326228 >> [v2:172.21.15.78:6808/162875330,v1:172.21.15.78:6810/162875330] conn(0x7fa87c0730f0 0x7fa87c075510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.135+0000 7fa88e7fc700 1 -- 172.21.15.45:0/265326228 --> [v2:172.21.15.78:6808/162875330,v1:172.21.15.78:6810/162875330] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa87c075bc0 con 0x7fa87c0730f0 2023-10-08T12:45:36.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.135+0000 7fa88e7fc700 1 -- 172.21.15.45:0/265326228 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa89008a630 con 0x7fa8980ccc00 2023-10-08T12:45:36.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.135+0000 7f9403fff700 1 -- 172.21.15.45:0/3137003044 <== osd.4 v2:172.21.15.78:6800/1354746290 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f9408075b40 con 0x7f9408073070 2023-10-08T12:45:36.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.134+0000 7f4d830a2700 1 -- 172.21.15.45:0/3565520604 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d7c1f7360 con 0x7f4d7c0b32e0 2023-10-08T12:45:36.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.135+0000 7fa89e43d700 1 --2- 172.21.15.45:0/265326228 >> [v2:172.21.15.78:6808/162875330,v1:172.21.15.78:6810/162875330] conn(0x7fa87c0730f0 0x7fa87c075510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.135+0000 7fa89d43b700 1 --2- 172.21.15.45:0/265326228 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa87c06aed0 0x7fa87c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.135+0000 7f4d830a2700 1 -- 172.21.15.45:0/3565520604 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4d7c0b3950 con 0x7f4d7c0b32e0 2023-10-08T12:45:36.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.136+0000 7fa89e43d700 1 --2- 172.21.15.45:0/265326228 >> [v2:172.21.15.78:6808/162875330,v1:172.21.15.78:6810/162875330] conn(0x7fa87c0730f0 0x7fa87c075510 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.136+0000 7fa89d43b700 1 --2- 172.21.15.45:0/265326228 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa87c06aed0 0x7fa87c06d390 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa89814dcc0 tx=0x7fa894006cb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.136+0000 7f25377fe700 1 -- 172.21.15.45:0/4172124358 <== osd.3 v2:172.21.15.45:6824/2255775238 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f2520075bc0 con 0x7f25200730f0 2023-10-08T12:45:36.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.136+0000 7fa88e7fc700 1 -- 172.21.15.45:0/265326228 <== osd.6 v2:172.21.15.78:6808/162875330 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fa87c075bc0 con 0x7fa87c0730f0 2023-10-08T12:45:36.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.137+0000 7f4d797fa700 1 -- 172.21.15.45:0/3565520604 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4d68003bd0 con 0x7f4d7c0b32e0 2023-10-08T12:45:36.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.137+0000 7f4d797fa700 1 --2- 172.21.15.45:0/3565520604 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4d6c06b130 0x7f4d6c06d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.138+0000 7f4d797fa700 1 -- 172.21.15.45:0/3565520604 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d68088c10 con 0x7f4d7c0b32e0 2023-10-08T12:45:36.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.138+0000 7f4d7bfff700 1 --2- 172.21.15.45:0/3565520604 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4d6c06b130 0x7f4d6c06d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.138+0000 7f4d797fa700 1 --2- 172.21.15.45:0/3565520604 >> [v2:172.21.15.45:6800/4238026647,v1:172.21.15.45:6801/4238026647] conn(0x7f4d6c0732d0 0x7f4d6c0756f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.138+0000 7f4d797fa700 1 -- 172.21.15.45:0/3565520604 --> [v2:172.21.15.45:6800/4238026647,v1:172.21.15.45:6801/4238026647] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d6c075da0 con 0x7f4d6c0732d0 2023-10-08T12:45:36.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.138+0000 7f4d8163f700 1 --2- 172.21.15.45:0/3565520604 >> [v2:172.21.15.45:6800/4238026647,v1:172.21.15.45:6801/4238026647] conn(0x7f4d6c0732d0 0x7f4d6c0756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.138+0000 7f4d7bfff700 1 --2- 172.21.15.45:0/3565520604 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4d6c06b130 0x7f4d6c06d5f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c141090 tx=0x7f4d70008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.139+0000 7f4d8163f700 1 --2- 172.21.15.45:0/3565520604 >> [v2:172.21.15.45:6800/4238026647,v1:172.21.15.45:6801/4238026647] conn(0x7f4d6c0732d0 0x7f4d6c0756f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.139+0000 7f4d797fa700 1 -- 172.21.15.45:0/3565520604 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d68053d50 con 0x7f4d7c0b32e0 2023-10-08T12:45:36.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.139+0000 7f42170b0700 1 -- 172.21.15.45:0/2694107278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42101688d0 msgr2=0x7f421016c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.139+0000 7f42170b0700 1 --2- 172.21.15.45:0/2694107278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42101688d0 0x7f421016c290 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4200005fd0 tx=0x7f4200009b30 comp rx=0 tx=0).stop 2023-10-08T12:45:36.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.140+0000 7f4d797fa700 1 -- 172.21.15.45:0/3565520604 <== osd.1 v2:172.21.15.45:6800/4238026647 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f4d6c075da0 con 0x7f4d6c0732d0 2023-10-08T12:45:36.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.141+0000 7f42170b0700 1 -- 172.21.15.45:0/2694107278 shutdown_connections 2023-10-08T12:45:36.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.141+0000 7f42170b0700 1 --2- 172.21.15.45:0/2694107278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42101688d0 0x7f421016c290 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.141+0000 7f42170b0700 1 --2- 172.21.15.45:0/2694107278 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f421016c7d0 0x7f421016cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.141+0000 7f42170b0700 1 -- 172.21.15.45:0/2694107278 >> 172.21.15.45:0/2694107278 conn(0x7f421006e010 msgr2=0x7f421006e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.149+0000 7f1046d0e700 1 -- 172.21.15.45:0/2423555417 --> [v2:172.21.15.78:6809/3188968439,v1:172.21.15.78:6811/3188968439] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f104004e4c0 con 0x7f102c073120 2023-10-08T12:45:36.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.149+0000 7f42170b0700 1 -- 172.21.15.45:0/2694107278 shutdown_connections 2023-10-08T12:45:36.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.149+0000 7f42170b0700 1 -- 172.21.15.45:0/2694107278 wait complete. 2023-10-08T12:45:36.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.149+0000 7f103d7fa700 1 -- 172.21.15.45:0/2423555417 <== osd.7 v2:172.21.15.78:6809/3188968439 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f104004e4c0 con 0x7f102c073120 2023-10-08T12:45:36.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.150+0000 7f42170b0700 1 Processor -- start 2023-10-08T12:45:36.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.150+0000 7f42170b0700 1 -- start start 2023-10-08T12:45:36.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.151+0000 7f42170b0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4210070b20 0x7f421015efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.151+0000 7f42170b0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42101688d0 0x7f421016b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.151+0000 7f42170b0700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f421016c7d0 0x7f421016d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.151+0000 7f42170b0700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42101605c0 con 0x7f4210070b20 2023-10-08T12:45:36.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.151+0000 7f42170b0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42101608a0 con 0x7f42101688d0 2023-10-08T12:45:36.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.151+0000 7f42170b0700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4210160b80 con 0x7f421016c7d0 2023-10-08T12:45:36.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.151+0000 7f421564d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f421016c7d0 0x7f421016d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.151+0000 7f421564d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f421016c7d0 0x7f421016d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.45:37016/0 (socket says 172.21.15.45:37016) 2023-10-08T12:45:36.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.151+0000 7f421564d700 1 -- 172.21.15.45:0/3718343886 learned_addr learned my addr 172.21.15.45:0/3718343886 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:36.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.151+0000 7f420ffff700 1 --2- 172.21.15.45:0/3718343886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42101688d0 0x7f421016b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.152+0000 7f421564d700 1 -- 172.21.15.45:0/3718343886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42101688d0 msgr2=0x7f421016b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.152+0000 7f421564d700 1 --2- 172.21.15.45:0/3718343886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42101688d0 0x7f421016b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.152+0000 7f421564d700 1 -- 172.21.15.45:0/3718343886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4210070b20 msgr2=0x7f421015efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.152+0000 7f421564d700 1 --2- 172.21.15.45:0/3718343886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4210070b20 0x7f421015efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.152+0000 7f421564d700 1 -- 172.21.15.45:0/3718343886 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4204009520 con 0x7f421016c7d0 2023-10-08T12:45:36.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.152+0000 7f421564d700 1 --2- 172.21.15.45:0/3718343886 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f421016c7d0 0x7f421016d5c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f420800b970 tx=0x7f420800bc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.158+0000 7f1046d0e700 1 -- 172.21.15.45:0/2423555417 >> [v2:172.21.15.78:6809/3188968439,v1:172.21.15.78:6811/3188968439] conn(0x7f102c073120 msgr2=0x7f102c075540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.158+0000 7f1046d0e700 1 --2- 172.21.15.45:0/2423555417 >> [v2:172.21.15.78:6809/3188968439,v1:172.21.15.78:6811/3188968439] conn(0x7f102c073120 0x7f102c075540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.158+0000 7f1046d0e700 1 -- 172.21.15.45:0/2423555417 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f102c06af00 msgr2=0x7f102c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.158+0000 7f1046d0e700 1 --2- 172.21.15.45:0/2423555417 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f102c06af00 0x7f102c06d3c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1030009810 tx=0x7f1030019040 comp rx=0 tx=0).stop 2023-10-08T12:45:36.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.158+0000 7f1046d0e700 1 -- 172.21.15.45:0/2423555417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1040141220 msgr2=0x7f104013c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.158+0000 7f1046d0e700 1 --2- 172.21.15.45:0/2423555417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1040141220 0x7f104013c610 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f103800a420 tx=0x7f103800a730 comp rx=0 tx=0).stop 2023-10-08T12:45:36.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.158+0000 7f10452ab700 1 -- 172.21.15.45:0/2423555417 reap_dead start 2023-10-08T12:45:36.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.158+0000 7f1046d0e700 1 -- 172.21.15.45:0/2423555417 shutdown_connections 2023-10-08T12:45:36.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.158+0000 7f1046d0e700 1 -- 172.21.15.45:0/2423555417 >> 172.21.15.45:0/2423555417 conn(0x7f104006e010 msgr2=0x7f104015dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.158+0000 7f1046d0e700 1 -- 172.21.15.45:0/2423555417 shutdown_connections 2023-10-08T12:45:36.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.158+0000 7f1046d0e700 1 -- 172.21.15.45:0/2423555417 wait complete. 2023-10-08T12:45:36.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.159+0000 7f420d7fa700 1 -- 172.21.15.45:0/3718343886 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420800c930 con 0x7f421016c7d0 2023-10-08T12:45:36.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.159+0000 7f420d7fa700 1 -- 172.21.15.45:0/3718343886 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f420800cba0 con 0x7f421016c7d0 2023-10-08T12:45:36.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.159+0000 7f420d7fa700 1 -- 172.21.15.45:0/3718343886 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4208014440 con 0x7f421016c7d0 2023-10-08T12:45:36.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.159+0000 7f42170b0700 1 -- 172.21.15.45:0/3718343886 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42000094c0 con 0x7f421016c7d0 2023-10-08T12:45:36.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.159+0000 7f42170b0700 1 -- 172.21.15.45:0/3718343886 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4210161140 con 0x7f421016c7d0 2023-10-08T12:45:36.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.162+0000 7f2544d24700 1 -- 172.21.15.45:0/4172124358 --> [v2:172.21.15.45:6824/2255775238,v1:172.21.15.45:6825/2255775238] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2540153280 con 0x7f25200730f0 2023-10-08T12:45:36.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.161+0000 7f420d7fa700 1 -- 172.21.15.45:0/3718343886 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f420801d3b0 con 0x7f421016c7d0 2023-10-08T12:45:36.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.162+0000 7f420d7fa700 1 --2- 172.21.15.45:0/3718343886 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f41fc06af20 0x7f41fc06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.162+0000 7f420d7fa700 1 -- 172.21.15.45:0/3718343886 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42080892b0 con 0x7f421016c7d0 2023-10-08T12:45:36.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.163+0000 7f25377fe700 1 -- 172.21.15.45:0/4172124358 <== osd.3 v2:172.21.15.45:6824/2255775238 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2540153280 con 0x7f25200730f0 2023-10-08T12:45:36.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.163+0000 7f2544d24700 1 -- 172.21.15.45:0/4172124358 >> [v2:172.21.15.45:6824/2255775238,v1:172.21.15.45:6825/2255775238] conn(0x7f25200730f0 msgr2=0x7f2520075510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.164+0000 7f2544d24700 1 --2- 172.21.15.45:0/4172124358 >> [v2:172.21.15.45:6824/2255775238,v1:172.21.15.45:6825/2255775238] conn(0x7f25200730f0 0x7f2520075510 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.164+0000 7f4214e4c700 1 --2- 172.21.15.45:0/3718343886 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f41fc06af20 0x7f41fc06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.165+0000 7f42170b0700 1 --2- 172.21.15.45:0/3718343886 >> [v2:172.21.15.78:6824/1101719457,v1:172.21.15.78:6825/1101719457] conn(0x7f41f00015e0 0x7f41f0003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.165+0000 7f42170b0700 1 -- 172.21.15.45:0/3718343886 --> [v2:172.21.15.78:6824/1101719457,v1:172.21.15.78:6825/1101719457] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f41f0006bd0 con 0x7f41f00015e0 2023-10-08T12:45:36.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.165+0000 7f2544d24700 1 -- 172.21.15.45:0/4172124358 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f252006aed0 msgr2=0x7f252006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.165+0000 7f2544d24700 1 --2- 172.21.15.45:0/4172124358 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f252006aed0 0x7f252006d390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2530011550 tx=0x7f2530009260 comp rx=0 tx=0).stop 2023-10-08T12:45:36.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.165+0000 7f2544d24700 1 -- 172.21.15.45:0/4172124358 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25400ccf50 msgr2=0x7f2540154160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.165+0000 7f2544d24700 1 --2- 172.21.15.45:0/4172124358 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25400ccf50 0x7f2540154160 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f253800c780 tx=0x7f253800ca90 comp rx=0 tx=0).stop 2023-10-08T12:45:36.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.165+0000 7f420ffff700 1 --2- 172.21.15.45:0/3718343886 >> [v2:172.21.15.78:6824/1101719457,v1:172.21.15.78:6825/1101719457] conn(0x7f41f00015e0 0x7f41f0003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.165+0000 7fa488702700 1 -- 172.21.15.45:0/2915076627 --> [v2:172.21.15.45:6816/2931618923,v1:172.21.15.45:6817/2931618923] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa468005cb0 con 0x7fa4680015e0 2023-10-08T12:45:36.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.165+0000 7f4214e4c700 1 --2- 172.21.15.45:0/3718343886 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f41fc06af20 0x7f41fc06d3e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4200009720 tx=0x7f4200004750 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.166+0000 7f420ffff700 1 --2- 172.21.15.45:0/3718343886 >> [v2:172.21.15.78:6824/1101719457,v1:172.21.15.78:6825/1101719457] conn(0x7f41f00015e0 0x7f41f0003aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.166+0000 7f420d7fa700 1 -- 172.21.15.45:0/3718343886 <== osd.5 v2:172.21.15.78:6824/1101719457 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f41f0006bd0 con 0x7f41f00015e0 2023-10-08T12:45:36.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.167+0000 7f253ed9d700 1 -- 172.21.15.45:0/4172124358 reap_dead start 2023-10-08T12:45:36.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.167+0000 7f2544d24700 1 -- 172.21.15.45:0/4172124358 shutdown_connections 2023-10-08T12:45:36.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.167+0000 7f2544d24700 1 -- 172.21.15.45:0/4172124358 >> 172.21.15.45:0/4172124358 conn(0x7f25400ce7e0 msgr2=0x7f254014e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.167+0000 7f2544d24700 1 -- 172.21.15.45:0/4172124358 shutdown_connections 2023-10-08T12:45:36.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.167+0000 7f2544d24700 1 -- 172.21.15.45:0/4172124358 wait complete. 2023-10-08T12:45:36.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.168+0000 7f9422101700 1 -- 172.21.15.45:0/3137003044 --> [v2:172.21.15.78:6800/1354746290,v1:172.21.15.78:6801/1354746290] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f93fc002d40 con 0x7f9408073070 2023-10-08T12:45:36.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.169+0000 7fa476ffd700 1 -- 172.21.15.45:0/2915076627 <== osd.0 v2:172.21.15.45:6816/2931618923 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa468005cb0 con 0x7fa4680015e0 2023-10-08T12:45:36.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.169+0000 7f9403fff700 1 -- 172.21.15.45:0/3137003044 <== osd.4 v2:172.21.15.78:6800/1354746290 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f93fc002d40 con 0x7f9408073070 2023-10-08T12:45:36.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.169+0000 7f9422101700 1 -- 172.21.15.45:0/3137003044 >> [v2:172.21.15.78:6800/1354746290,v1:172.21.15.78:6801/1354746290] conn(0x7f9408073070 msgr2=0x7f9408075490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.169+0000 7f9422101700 1 --2- 172.21.15.45:0/3137003044 >> [v2:172.21.15.78:6800/1354746290,v1:172.21.15.78:6801/1354746290] conn(0x7f9408073070 0x7f9408075490 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.170+0000 7fa488702700 1 -- 172.21.15.45:0/2915076627 >> [v2:172.21.15.45:6816/2931618923,v1:172.21.15.45:6817/2931618923] conn(0x7fa4680015e0 msgr2=0x7fa468003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.170+0000 7fa488702700 1 --2- 172.21.15.45:0/2915076627 >> [v2:172.21.15.45:6816/2931618923,v1:172.21.15.45:6817/2931618923] conn(0x7fa4680015e0 0x7fa468003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.170+0000 7fa488702700 1 -- 172.21.15.45:0/2915076627 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa46406af20 msgr2=0x7fa46406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.170+0000 7fa488702700 1 --2- 172.21.15.45:0/2915076627 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa46406af20 0x7fa46406d3e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa480070610 tx=0x7fa4700047c0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.170+0000 7fa488702700 1 -- 172.21.15.45:0/2915076627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4801595c0 msgr2=0x7fa4801fe950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.170+0000 7fa488702700 1 --2- 172.21.15.45:0/2915076627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4801595c0 0x7fa4801fe950 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00c430 tx=0x7fa47c00c740 comp rx=0 tx=0).stop 2023-10-08T12:45:36.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.170+0000 7fa486c9f700 1 -- 172.21.15.45:0/2915076627 reap_dead start 2023-10-08T12:45:36.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.170+0000 7fa488702700 1 -- 172.21.15.45:0/2915076627 shutdown_connections 2023-10-08T12:45:36.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.170+0000 7fa488702700 1 -- 172.21.15.45:0/2915076627 >> 172.21.15.45:0/2915076627 conn(0x7fa4800afae0 msgr2=0x7fa48015c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.170+0000 7f9422101700 1 -- 172.21.15.45:0/3137003044 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f940806aed0 msgr2=0x7f940806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.170+0000 7f9422101700 1 --2- 172.21.15.45:0/3137003044 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f940806aed0 0x7f940806d390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f940c009810 tx=0x7f940c0047c0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.170+0000 7f9422101700 1 -- 172.21.15.45:0/3137003044 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f941c0724c0 msgr2=0x7f941c15a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.170+0000 7f9422101700 1 --2- 172.21.15.45:0/3137003044 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f941c0724c0 0x7f941c15a380 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f941000d980 tx=0x7f941000dc90 comp rx=0 tx=0).stop 2023-10-08T12:45:36.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.170+0000 7f9552dbb700 1 -- 172.21.15.45:0/1152156469 --> [v2:172.21.15.45:6808/3709844603,v1:172.21.15.45:6809/3709844603] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f952c002d40 con 0x7f9530073070 2023-10-08T12:45:36.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.171+0000 7f941bfff700 1 -- 172.21.15.45:0/3137003044 reap_dead start 2023-10-08T12:45:36.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.171+0000 7f9422101700 1 -- 172.21.15.45:0/3137003044 shutdown_connections 2023-10-08T12:45:36.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.171+0000 7f9422101700 1 -- 172.21.15.45:0/3137003044 >> 172.21.15.45:0/3137003044 conn(0x7f941c0b0430 msgr2=0x7f941c06a210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.171+0000 7f9422101700 1 -- 172.21.15.45:0/3137003044 shutdown_connections 2023-10-08T12:45:36.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.171+0000 7f9422101700 1 -- 172.21.15.45:0/3137003044 wait complete. 2023-10-08T12:45:36.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.171+0000 7fa89fea0700 1 -- 172.21.15.45:0/265326228 --> [v2:172.21.15.78:6808/162875330,v1:172.21.15.78:6810/162875330] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa898148fc0 con 0x7fa87c0730f0 2023-10-08T12:45:36.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.172+0000 7fa488702700 1 -- 172.21.15.45:0/2915076627 shutdown_connections 2023-10-08T12:45:36.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.172+0000 7f95497fa700 1 -- 172.21.15.45:0/1152156469 <== osd.2 v2:172.21.15.45:6808/3709844603 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f952c002d40 con 0x7f9530073070 2023-10-08T12:45:36.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.172+0000 7fa88e7fc700 1 -- 172.21.15.45:0/265326228 <== osd.6 v2:172.21.15.78:6808/162875330 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa898148fc0 con 0x7fa87c0730f0 2023-10-08T12:45:36.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.172+0000 7f9552dbb700 1 -- 172.21.15.45:0/1152156469 >> [v2:172.21.15.45:6808/3709844603,v1:172.21.15.45:6809/3709844603] conn(0x7f9530073070 msgr2=0x7f9530075490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.172+0000 7f9552dbb700 1 --2- 172.21.15.45:0/1152156469 >> [v2:172.21.15.45:6808/3709844603,v1:172.21.15.45:6809/3709844603] conn(0x7f9530073070 0x7f9530075490 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.172+0000 7f9552dbb700 1 -- 172.21.15.45:0/1152156469 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f953006aed0 msgr2=0x7f953006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.172+0000 7f9552dbb700 1 --2- 172.21.15.45:0/1152156469 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f953006aed0 0x7f953006d390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f954000bc70 tx=0x7f954000b2c0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.172+0000 7f9552dbb700 1 -- 172.21.15.45:0/1152156469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f954c15c320 msgr2=0x7f954c0c5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.172+0000 7f9552dbb700 1 --2- 172.21.15.45:0/1152156469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f954c15c320 0x7f954c0c5930 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9544009fd0 tx=0x7f9544007c10 comp rx=0 tx=0).stop 2023-10-08T12:45:36.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.172+0000 7f9551358700 1 -- 172.21.15.45:0/1152156469 reap_dead start 2023-10-08T12:45:36.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.173+0000 7f9552dbb700 1 -- 172.21.15.45:0/1152156469 shutdown_connections 2023-10-08T12:45:36.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.173+0000 7f9552dbb700 1 -- 172.21.15.45:0/1152156469 >> 172.21.15.45:0/1152156469 conn(0x7f954c0b0430 msgr2=0x7f954c0b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.173+0000 7f9552dbb700 1 -- 172.21.15.45:0/1152156469 shutdown_connections 2023-10-08T12:45:36.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.173+0000 7f9552dbb700 1 -- 172.21.15.45:0/1152156469 wait complete. 2023-10-08T12:45:36.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.176+0000 7fa89fea0700 1 -- 172.21.15.45:0/265326228 >> [v2:172.21.15.78:6808/162875330,v1:172.21.15.78:6810/162875330] conn(0x7fa87c0730f0 msgr2=0x7fa87c075510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.177+0000 7fa89fea0700 1 --2- 172.21.15.45:0/265326228 >> [v2:172.21.15.78:6808/162875330,v1:172.21.15.78:6810/162875330] conn(0x7fa87c0730f0 0x7fa87c075510 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.194 INFO:teuthology.orchestra.run.smithi045.stdout:55834574855 2023-10-08T12:45:36.195 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-08T12:45:36.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.178+0000 7fa488702700 1 -- 172.21.15.45:0/2915076627 wait complete. 2023-10-08T12:45:36.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.178+0000 7f4d830a2700 1 -- 172.21.15.45:0/3565520604 --> [v2:172.21.15.45:6800/4238026647,v1:172.21.15.45:6801/4238026647] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4d7c04e4c0 con 0x7f4d6c0732d0 2023-10-08T12:45:36.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.179+0000 7f4d797fa700 1 -- 172.21.15.45:0/3565520604 <== osd.1 v2:172.21.15.45:6800/4238026647 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4d7c04e4c0 con 0x7f4d6c0732d0 2023-10-08T12:45:36.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.179+0000 7f4d830a2700 1 -- 172.21.15.45:0/3565520604 >> [v2:172.21.15.45:6800/4238026647,v1:172.21.15.45:6801/4238026647] conn(0x7f4d6c0732d0 msgr2=0x7f4d6c0756f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.179+0000 7f4d830a2700 1 --2- 172.21.15.45:0/3565520604 >> [v2:172.21.15.45:6800/4238026647,v1:172.21.15.45:6801/4238026647] conn(0x7f4d6c0732d0 0x7f4d6c0756f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.179+0000 7f4d830a2700 1 -- 172.21.15.45:0/3565520604 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4d6c06b130 msgr2=0x7f4d6c06d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.179+0000 7f4d830a2700 1 --2- 172.21.15.45:0/3565520604 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4d6c06b130 0x7f4d6c06d5f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c141090 tx=0x7f4d70008040 comp rx=0 tx=0).stop 2023-10-08T12:45:36.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.179+0000 7f4d830a2700 1 -- 172.21.15.45:0/3565520604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d7c0b32e0 msgr2=0x7f4d7c139110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.179+0000 7f4d830a2700 1 --2- 172.21.15.45:0/3565520604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d7c0b32e0 0x7f4d7c139110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4d6800c650 tx=0x7f4d6800ca10 comp rx=0 tx=0).stop 2023-10-08T12:45:36.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.179+0000 7f4d8163f700 1 -- 172.21.15.45:0/3565520604 reap_dead start 2023-10-08T12:45:36.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.183+0000 7fa89fea0700 1 -- 172.21.15.45:0/265326228 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa87c06aed0 msgr2=0x7fa87c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.183+0000 7fa89fea0700 1 --2- 172.21.15.45:0/265326228 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa87c06aed0 0x7fa87c06d390 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa89814dcc0 tx=0x7fa894006cb0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.183+0000 7fa89fea0700 1 -- 172.21.15.45:0/265326228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8980ccc00 msgr2=0x7fa8981f69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.183+0000 7fa89fea0700 1 --2- 172.21.15.45:0/265326228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8980ccc00 0x7fa8981f69c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa890007fd0 tx=0x7fa89000d3b0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.183+0000 7f4d830a2700 1 -- 172.21.15.45:0/3565520604 shutdown_connections 2023-10-08T12:45:36.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.183+0000 7f4d830a2700 1 -- 172.21.15.45:0/3565520604 >> 172.21.15.45:0/3565520604 conn(0x7f4d7c06e010 msgr2=0x7f4d7c06e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.184+0000 7f4d830a2700 1 -- 172.21.15.45:0/3565520604 shutdown_connections 2023-10-08T12:45:36.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.184+0000 7f4d830a2700 1 -- 172.21.15.45:0/3565520604 wait complete. 2023-10-08T12:45:36.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.184+0000 7fa89e43d700 1 -- 172.21.15.45:0/265326228 reap_dead start 2023-10-08T12:45:36.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.184+0000 7fa89fea0700 1 -- 172.21.15.45:0/265326228 shutdown_connections 2023-10-08T12:45:36.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.184+0000 7fa89fea0700 1 -- 172.21.15.45:0/265326228 >> 172.21.15.45:0/265326228 conn(0x7fa898071940 msgr2=0x7fa898150b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.199 INFO:teuthology.orchestra.run.smithi045.stdout:55834574855 2023-10-08T12:45:36.199 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-08T12:45:36.200 INFO:teuthology.orchestra.run.smithi045.stdout:55834574855 2023-10-08T12:45:36.201 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T12:45:36.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.193+0000 7fa89fea0700 1 -- 172.21.15.45:0/265326228 shutdown_connections 2023-10-08T12:45:36.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.193+0000 7fa89fea0700 1 -- 172.21.15.45:0/265326228 wait complete. 2023-10-08T12:45:36.202 INFO:teuthology.orchestra.run.smithi045.stdout:55834574855 2023-10-08T12:45:36.202 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-08T12:45:36.203 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2023-10-08T12:45:36.203 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T12:45:36.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.198+0000 7f42170b0700 1 -- 172.21.15.45:0/3718343886 --> [v2:172.21.15.78:6824/1101719457,v1:172.21.15.78:6825/1101719457] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f41f0005cb0 con 0x7f41f00015e0 2023-10-08T12:45:36.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.199+0000 7f420d7fa700 1 -- 172.21.15.45:0/3718343886 <== osd.5 v2:172.21.15.78:6824/1101719457 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f41f0005cb0 con 0x7f41f00015e0 2023-10-08T12:45:36.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.199+0000 7f42170b0700 1 -- 172.21.15.45:0/3718343886 >> [v2:172.21.15.78:6824/1101719457,v1:172.21.15.78:6825/1101719457] conn(0x7f41f00015e0 msgr2=0x7f41f0003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.199+0000 7f42170b0700 1 --2- 172.21.15.45:0/3718343886 >> [v2:172.21.15.78:6824/1101719457,v1:172.21.15.78:6825/1101719457] conn(0x7f41f00015e0 0x7f41f0003aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.199+0000 7f42170b0700 1 -- 172.21.15.45:0/3718343886 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f41fc06af20 msgr2=0x7f41fc06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.199+0000 7f42170b0700 1 --2- 172.21.15.45:0/3718343886 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f41fc06af20 0x7f41fc06d3e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4200009720 tx=0x7f4200004750 comp rx=0 tx=0).stop 2023-10-08T12:45:36.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.199+0000 7f42170b0700 1 -- 172.21.15.45:0/3718343886 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f421016c7d0 msgr2=0x7f421016d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.199+0000 7f42170b0700 1 --2- 172.21.15.45:0/3718343886 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f421016c7d0 0x7f421016d5c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f420800b970 tx=0x7f420800bc80 comp rx=0 tx=0).stop 2023-10-08T12:45:36.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.199+0000 7f421564d700 1 -- 172.21.15.45:0/3718343886 reap_dead start 2023-10-08T12:45:36.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.200+0000 7f42170b0700 1 -- 172.21.15.45:0/3718343886 shutdown_connections 2023-10-08T12:45:36.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.200+0000 7f42170b0700 1 -- 172.21.15.45:0/3718343886 >> 172.21.15.45:0/3718343886 conn(0x7f421006e010 msgr2=0x7f4210070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.200+0000 7f42170b0700 1 -- 172.21.15.45:0/3718343886 shutdown_connections 2023-10-08T12:45:36.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.200+0000 7f42170b0700 1 -- 172.21.15.45:0/3718343886 wait complete. 2023-10-08T12:45:36.207 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2023-10-08T12:45:36.207 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T12:45:36.213 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2023-10-08T12:45:36.214 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-08T12:45:36.218 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2023-10-08T12:45:36.218 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-08T12:45:36.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.399+0000 7f597e781700 1 -- 172.21.15.45:0/490673031 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5960004850 msgr2=0x7f5960004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.399+0000 7f597e781700 1 --2- 172.21.15.45:0/490673031 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5960004850 0x7f5960004cd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f59680099c0 tx=0x7f5960005880 comp rx=0 tx=0).stop 2023-10-08T12:45:36.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.399+0000 7f597e781700 1 -- 172.21.15.45:0/490673031 shutdown_connections 2023-10-08T12:45:36.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.399+0000 7f597e781700 1 --2- 172.21.15.45:0/490673031 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5960004850 0x7f5960004cd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.399+0000 7f597e781700 1 -- 172.21.15.45:0/490673031 >> 172.21.15.45:0/490673031 conn(0x7f597806e010 msgr2=0x7f597806e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.399+0000 7f597e781700 1 -- 172.21.15.45:0/490673031 shutdown_connections 2023-10-08T12:45:36.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.399+0000 7f597e781700 1 -- 172.21.15.45:0/490673031 wait complete. 2023-10-08T12:45:36.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.401+0000 7f597e781700 1 Processor -- start 2023-10-08T12:45:36.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.401+0000 7f597e781700 1 -- start start 2023-10-08T12:45:36.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.403+0000 7f597e781700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5960004850 0x7f5978153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.403+0000 7f597e781700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5978136e40 0x7f5978140130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.403+0000 7f597e781700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5978140670 0x7f5978144710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.403+0000 7f597e781700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5978140b20 con 0x7f5978140670 2023-10-08T12:45:36.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.403+0000 7f597e781700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59780afd70 con 0x7f5978136e40 2023-10-08T12:45:36.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.403+0000 7f597e781700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59780affc0 con 0x7f5960004850 2023-10-08T12:45:36.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.403+0000 7f597cd1e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5978140670 0x7f5978144710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.403+0000 7f597cd1e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5978140670 0x7f5978144710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35188/0 (socket says 172.21.15.45:35188) 2023-10-08T12:45:36.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.403+0000 7f597cd1e700 1 -- 172.21.15.45:0/1987631860 learned_addr learned my addr 172.21.15.45:0/1987631860 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:36.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.404+0000 7f597cd1e700 1 -- 172.21.15.45:0/1987631860 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5960004850 msgr2=0x7f5978153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.404+0000 7f597cd1e700 1 --2- 172.21.15.45:0/1987631860 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5960004850 0x7f5978153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.404+0000 7f597cd1e700 1 -- 172.21.15.45:0/1987631860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5978136e40 msgr2=0x7f5978140130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T12:45:36.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.404+0000 7f597cd1e700 1 --2- 172.21.15.45:0/1987631860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5978136e40 0x7f5978140130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.404+0000 7f597cd1e700 1 -- 172.21.15.45:0/1987631860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59780b02a0 con 0x7f5978140670 2023-10-08T12:45:36.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.404+0000 7f597cd1e700 1 --2- 172.21.15.45:0/1987631860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5978140670 0x7f5978144710 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f59780ab090 tx=0x7f596c009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.406+0000 7f5974ff9700 1 -- 172.21.15.45:0/1987631860 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596c004230 con 0x7f5978140670 2023-10-08T12:45:36.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.406+0000 7f5974ff9700 1 -- 172.21.15.45:0/1987631860 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f596c0044a0 con 0x7f5978140670 2023-10-08T12:45:36.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.406+0000 7f5974ff9700 1 -- 172.21.15.45:0/1987631860 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596c002970 con 0x7f5978140670 2023-10-08T12:45:36.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.406+0000 7f597e781700 1 -- 172.21.15.45:0/1987631860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5978143c30 con 0x7f5978140670 2023-10-08T12:45:36.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.407+0000 7f597e781700 1 -- 172.21.15.45:0/1987631860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59781441f0 con 0x7f5978140670 2023-10-08T12:45:36.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.409+0000 7f5974ff9700 1 -- 172.21.15.45:0/1987631860 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f596c002ad0 con 0x7f5978140670 2023-10-08T12:45:36.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.410+0000 7f5974ff9700 1 --2- 172.21.15.45:0/1987631860 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f596406af50 0x7f596406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.410+0000 7f5974ff9700 1 -- 172.21.15.45:0/1987631860 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f596c0885a0 con 0x7f5978140670 2023-10-08T12:45:36.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.410+0000 7f5977fff700 1 --2- 172.21.15.45:0/1987631860 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f596406af50 0x7f596406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.411+0000 7f5977fff700 1 --2- 172.21.15.45:0/1987631860 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f596406af50 0x7f596406d410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5970001b20 tx=0x7f59700017f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.422+0000 7f597e781700 1 -- 172.21.15.45:0/1987631860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59580052f0 con 0x7f5978140670 2023-10-08T12:45:36.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.425+0000 7fc025491700 1 -- 172.21.15.45:0/1586626012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0200b32e0 msgr2=0x7fc02015c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.425+0000 7fc025491700 1 --2- 172.21.15.45:0/1586626012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0200b32e0 0x7fc02015c040 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc0200b1ff0 tx=0x7fc010009ba0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.425+0000 7fc025491700 1 -- 172.21.15.45:0/1586626012 shutdown_connections 2023-10-08T12:45:36.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.425+0000 7fc025491700 1 --2- 172.21.15.45:0/1586626012 >> v2:172.21.15.45:3300/0 conn(0x7fc02015c580 0x7fc02013d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.425+0000 7fc025491700 1 --2- 172.21.15.45:0/1586626012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0200b32e0 0x7fc02015c040 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.425+0000 7fc025491700 1 -- 172.21.15.45:0/1586626012 >> 172.21.15.45:0/1586626012 conn(0x7fc02006e010 msgr2=0x7fc02006e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.426+0000 7fc025491700 1 -- 172.21.15.45:0/1586626012 shutdown_connections 2023-10-08T12:45:36.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.427+0000 7fc025491700 1 -- 172.21.15.45:0/1586626012 wait complete. 2023-10-08T12:45:36.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.429+0000 7fc025491700 1 Processor -- start 2023-10-08T12:45:36.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.430+0000 7f58c1e8f700 1 -- 172.21.15.45:0/841795240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58bc0b32e0 msgr2=0x7f58bc15c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.430+0000 7f58c1e8f700 1 --2- 172.21.15.45:0/841795240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58bc0b32e0 0x7f58bc15c040 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f58b4009f60 tx=0x7f58b4009f90 comp rx=0 tx=0).stop 2023-10-08T12:45:36.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.430+0000 7f58c1e8f700 1 -- 172.21.15.45:0/841795240 shutdown_connections 2023-10-08T12:45:36.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.430+0000 7f58c1e8f700 1 --2- 172.21.15.45:0/841795240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58bc0b32e0 0x7f58bc15c040 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.430+0000 7f58c1e8f700 1 -- 172.21.15.45:0/841795240 >> 172.21.15.45:0/841795240 conn(0x7f58bc06e010 msgr2=0x7f58bc06e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.430+0000 7f58c1e8f700 1 -- 172.21.15.45:0/841795240 shutdown_connections 2023-10-08T12:45:36.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.430+0000 7f58c1e8f700 1 -- 172.21.15.45:0/841795240 wait complete. 2023-10-08T12:45:36.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.429+0000 7fc025491700 1 -- start start 2023-10-08T12:45:36.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.430+0000 7fc025491700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0200b32e0 0x7fc0200ad4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.430+0000 7fc025491700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc020141220 0x7fc0201fe500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.430+0000 7fc025491700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc02015c580 0x7fc020140140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.430+0000 7fc025491700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02013fcb0 con 0x7fc0200b32e0 2023-10-08T12:45:36.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.430+0000 7fc025491700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0200ae380 con 0x7fc020141220 2023-10-08T12:45:36.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.430+0000 7fc025491700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0200addc0 con 0x7fc02015c580 2023-10-08T12:45:36.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.430+0000 7fc01e7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc020141220 0x7fc0201fe500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.430+0000 7fc01effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0200b32e0 0x7fc0200ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.430+0000 7fc01e7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc020141220 0x7fc0201fe500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.45:46658/0 (socket says 172.21.15.45:46658) 2023-10-08T12:45:36.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.430+0000 7fc01e7fc700 1 -- 172.21.15.45:0/1430655382 learned_addr learned my addr 172.21.15.45:0/1430655382 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:36.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.431+0000 7fc01e7fc700 1 -- 172.21.15.45:0/1430655382 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc02015c580 msgr2=0x7fc020140140 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T12:45:36.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.431+0000 7fc01e7fc700 1 --2- 172.21.15.45:0/1430655382 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc02015c580 0x7fc020140140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.431+0000 7fc01e7fc700 1 -- 172.21.15.45:0/1430655382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0200b32e0 msgr2=0x7fc0200ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.431+0000 7fc01e7fc700 1 --2- 172.21.15.45:0/1430655382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0200b32e0 0x7fc0200ad4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.431+0000 7fc01e7fc700 1 -- 172.21.15.45:0/1430655382 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc010009520 con 0x7fc020141220 2023-10-08T12:45:36.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.432+0000 7f58c1e8f700 1 Processor -- start 2023-10-08T12:45:36.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.432+0000 7f5974ff9700 1 -- 172.21.15.45:0/1987631860 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f596c0537e0 con 0x7f5978140670 2023-10-08T12:45:36.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.432+0000 7f58c1e8f700 1 -- start start 2023-10-08T12:45:36.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.432+0000 7fc01e7fc700 1 --2- 172.21.15.45:0/1430655382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc020141220 0x7fc0201fe500 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc010004000 tx=0x7fc010004260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.433+0000 7fc0077fe700 1 -- 172.21.15.45:0/1430655382 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01000b9b0 con 0x7fc020141220 2023-10-08T12:45:36.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.433+0000 7fc0077fe700 1 -- 172.21.15.45:0/1430655382 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc01000bb10 con 0x7fc020141220 2023-10-08T12:45:36.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.433+0000 7fc0077fe700 1 -- 172.21.15.45:0/1430655382 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01000bee0 con 0x7fc020141220 2023-10-08T12:45:36.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.433+0000 7fc025491700 1 -- 172.21.15.45:0/1430655382 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0200ae0a0 con 0x7fc020141220 2023-10-08T12:45:36.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.433+0000 7fc025491700 1 -- 172.21.15.45:0/1430655382 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0200ada20 con 0x7fc020141220 2023-10-08T12:45:36.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.433+0000 7f58c1e8f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f58bc0b32e0 0x7f58bc13ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.433+0000 7f58c1e8f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58bc141220 0x7f58bc0ac640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.433+0000 7f58c1e8f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58bc15c580 0x7f58bc0acb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.433+0000 7f58c1e8f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc155e30 con 0x7f58bc141220 2023-10-08T12:45:36.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.433+0000 7f58c1e8f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc1f6520 con 0x7f58bc15c580 2023-10-08T12:45:36.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.433+0000 7f58c1e8f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc152910 con 0x7f58bc0b32e0 2023-10-08T12:45:36.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.434+0000 7f58bbfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58bc15c580 0x7f58bc0acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.434+0000 7f58bbfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58bc15c580 0x7f58bc0acb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.45:46670/0 (socket says 172.21.15.45:46670) 2023-10-08T12:45:36.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.434+0000 7f58bbfff700 1 -- 172.21.15.45:0/2118260916 learned_addr learned my addr 172.21.15.45:0/2118260916 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:36.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.434+0000 7f58baffd700 1 --2- 172.21.15.45:0/2118260916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58bc141220 0x7f58bc0ac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.434+0000 7f58bb7fe700 1 --2- 172.21.15.45:0/2118260916 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f58bc0b32e0 0x7f58bc13ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.434+0000 7f58bbfff700 1 -- 172.21.15.45:0/2118260916 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f58bc0b32e0 msgr2=0x7f58bc13ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.434+0000 7f58bbfff700 1 --2- 172.21.15.45:0/2118260916 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f58bc0b32e0 0x7f58bc13ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.434+0000 7f58bbfff700 1 -- 172.21.15.45:0/2118260916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58bc141220 msgr2=0x7f58bc0ac640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.434+0000 7f58bbfff700 1 --2- 172.21.15.45:0/2118260916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58bc141220 0x7f58bc0ac640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.434+0000 7f58bbfff700 1 -- 172.21.15.45:0/2118260916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b4009c40 con 0x7f58bc15c580 2023-10-08T12:45:36.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.435+0000 7f58bbfff700 1 --2- 172.21.15.45:0/2118260916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58bc15c580 0x7f58bc0acb80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f58ac00c420 tx=0x7f58ac00c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.436+0000 7f58a3fff700 1 -- 172.21.15.45:0/2118260916 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ac0052d0 con 0x7f58bc15c580 2023-10-08T12:45:36.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.436+0000 7f58a3fff700 1 -- 172.21.15.45:0/2118260916 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f58ac005520 con 0x7f58bc15c580 2023-10-08T12:45:36.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.436+0000 7f58a3fff700 1 -- 172.21.15.45:0/2118260916 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ac006ac0 con 0x7f58bc15c580 2023-10-08T12:45:36.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.436+0000 7f0b81695700 1 -- 172.21.15.45:0/2645819249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b7c0cccf0 msgr2=0x7f0b7c0cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.436+0000 7f0b81695700 1 --2- 172.21.15.45:0/2645819249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b7c0cccf0 0x7f0b7c0cd120 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0b7400c150 tx=0x7f0b7400c460 comp rx=0 tx=0).stop 2023-10-08T12:45:36.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.436+0000 7f0b81695700 1 -- 172.21.15.45:0/2645819249 shutdown_connections 2023-10-08T12:45:36.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.436+0000 7f0b81695700 1 --2- 172.21.15.45:0/2645819249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b7c0cccf0 0x7f0b7c0cd120 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.436+0000 7f0b81695700 1 --2- 172.21.15.45:0/2645819249 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0b7c0c8950 0x7f0b7c0c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.437+0000 7f0b81695700 1 -- 172.21.15.45:0/2645819249 >> 172.21.15.45:0/2645819249 conn(0x7f0b7c0afae0 msgr2=0x7f0b7c0afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.436+0000 7fc0077fe700 1 -- 172.21.15.45:0/1430655382 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc010029460 con 0x7fc020141220 2023-10-08T12:45:36.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.436+0000 7fc0077fe700 1 --2- 172.21.15.45:0/1430655382 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc00c06afa0 0x7fc00c06d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.436+0000 7fc0077fe700 1 -- 172.21.15.45:0/1430655382 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc01008b8a0 con 0x7fc020141220 2023-10-08T12:45:36.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.437+0000 7fc01effd700 1 --2- 172.21.15.45:0/1430655382 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc00c06afa0 0x7fc00c06d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.437+0000 7f58c1e8f700 1 -- 172.21.15.45:0/2118260916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58bc155770 con 0x7f58bc15c580 2023-10-08T12:45:36.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.437+0000 7f58c1e8f700 1 -- 172.21.15.45:0/2118260916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58bc152550 con 0x7f58bc15c580 2023-10-08T12:45:36.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.437+0000 7f0b81695700 1 -- 172.21.15.45:0/2645819249 shutdown_connections 2023-10-08T12:45:36.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.437+0000 7f0b81695700 1 -- 172.21.15.45:0/2645819249 wait complete. 2023-10-08T12:45:36.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.438+0000 7f4c65958700 1 -- 172.21.15.45:0/4089806939 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4c60141220 msgr2=0x7f4c601416a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.438+0000 7f4c65958700 1 --2- 172.21.15.45:0/4089806939 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4c60141220 0x7f4c601416a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4c540098c0 tx=0x7f4c54009bd0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.438+0000 7fc01effd700 1 --2- 172.21.15.45:0/1430655382 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc00c06afa0 0x7fc00c06d460 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc014007fd0 tx=0x7fc014009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.439+0000 7f58c1e8f700 1 -- 172.21.15.45:0/2118260916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58bc155f70 con 0x7f58bc15c580 2023-10-08T12:45:36.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.439+0000 7f4c65958700 1 -- 172.21.15.45:0/4089806939 shutdown_connections 2023-10-08T12:45:36.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.439+0000 7f4c65958700 1 --2- 172.21.15.45:0/4089806939 >> v2:172.21.15.78:3300/0 conn(0x7f4c6015c040 0x7f4c6015c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.439+0000 7f4c65958700 1 --2- 172.21.15.45:0/4089806939 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4c60141220 0x7f4c601416a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.439+0000 7f4c65958700 1 -- 172.21.15.45:0/4089806939 >> 172.21.15.45:0/4089806939 conn(0x7f4c6006e010 msgr2=0x7f4c6006e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.439+0000 7f0b81695700 1 Processor -- start 2023-10-08T12:45:36.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.440+0000 7f58a3fff700 1 -- 172.21.15.45:0/2118260916 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f58ac003680 con 0x7f58bc15c580 2023-10-08T12:45:36.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.439+0000 7f0b81695700 1 -- start start 2023-10-08T12:45:36.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.440+0000 7fc025491700 1 -- 172.21.15.45:0/1430655382 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0000052f0 con 0x7fc020141220 2023-10-08T12:45:36.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.440+0000 7f0b81695700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b7c0bedc0 0x7f0b7c0c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.440+0000 7f0b81695700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0b7c0c8950 0x7f0b7c15aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.440+0000 7f0b81695700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b7c0cccf0 0x7f0b7c0b2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.440+0000 7f0b81695700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c098d30 con 0x7f0b7c0cccf0 2023-10-08T12:45:36.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.440+0000 7f0b81695700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c0c8730 con 0x7f0b7c0bedc0 2023-10-08T12:45:36.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.440+0000 7f0b81695700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c0c5e10 con 0x7f0b7c0c8950 2023-10-08T12:45:36.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.440+0000 7f58a3fff700 1 --2- 172.21.15.45:0/2118260916 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f58a806aed0 0x7f58a806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.441+0000 7f0b7b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b7c0cccf0 0x7f0b7c0b2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.441+0000 7f0b7b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b7c0cccf0 0x7f0b7c0b2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35236/0 (socket says 172.21.15.45:35236) 2023-10-08T12:45:36.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.441+0000 7f0b7b7fe700 1 -- 172.21.15.45:0/1667276266 learned_addr learned my addr 172.21.15.45:0/1667276266 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:36.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.441+0000 7f58a3fff700 1 -- 172.21.15.45:0/2118260916 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58ac088a50 con 0x7f58bc15c580 2023-10-08T12:45:36.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.441+0000 7f0b7affd700 1 --2- 172.21.15.45:0/1667276266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b7c0bedc0 0x7f0b7c0c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.441+0000 7f0b7b7fe700 1 -- 172.21.15.45:0/1667276266 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0b7c0c8950 msgr2=0x7f0b7c15aee0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T12:45:36.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.441+0000 7f0b7b7fe700 1 --2- 172.21.15.45:0/1667276266 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0b7c0c8950 0x7f0b7c15aee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.441+0000 7f0b7b7fe700 1 -- 172.21.15.45:0/1667276266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b7c0bedc0 msgr2=0x7f0b7c0c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.441+0000 7f0b7b7fe700 1 --2- 172.21.15.45:0/1667276266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b7c0bedc0 0x7f0b7c0c58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.441+0000 7f0b7b7fe700 1 -- 172.21.15.45:0/1667276266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7400ad50 con 0x7f0b7c0cccf0 2023-10-08T12:45:36.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.441+0000 7f0b7affd700 1 --2- 172.21.15.45:0/1667276266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b7c0bedc0 0x7f0b7c0c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:36.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.441+0000 7f0b7b7fe700 1 --2- 172.21.15.45:0/1667276266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b7c0cccf0 0x7f0b7c0b2b40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0b7400c7b0 tx=0x7f0b74003ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.442+0000 7f0b637fe700 1 -- 172.21.15.45:0/1667276266 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7400f040 con 0x7f0b7c0cccf0 2023-10-08T12:45:36.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.442+0000 7f0b81695700 1 -- 172.21.15.45:0/1667276266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b7c15b420 con 0x7f0b7c0cccf0 2023-10-08T12:45:36.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.442+0000 7f0b81695700 1 -- 172.21.15.45:0/1667276266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b7c0c8170 con 0x7f0b7c0cccf0 2023-10-08T12:45:36.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.442+0000 7f0b637fe700 1 -- 172.21.15.45:0/1667276266 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0b74009c10 con 0x7f0b7c0cccf0 2023-10-08T12:45:36.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.442+0000 7f0b637fe700 1 -- 172.21.15.45:0/1667276266 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b74004040 con 0x7f0b7c0cccf0 2023-10-08T12:45:36.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.444+0000 7f0b81695700 1 -- 172.21.15.45:0/1667276266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b7c0674a0 con 0x7f0b7c0cccf0 2023-10-08T12:45:36.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.444+0000 7f0b637fe700 1 -- 172.21.15.45:0/1667276266 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0b740041a0 con 0x7f0b7c0cccf0 2023-10-08T12:45:36.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.444+0000 7f0b637fe700 1 --2- 172.21.15.45:0/1667276266 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0b6406b380 0x7f0b6406d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.444+0000 7f0b637fe700 1 -- 172.21.15.45:0/1667276266 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b7408cc50 con 0x7f0b7c0cccf0 2023-10-08T12:45:36.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.444+0000 7f0b7affd700 1 --2- 172.21.15.45:0/1667276266 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0b6406b380 0x7f0b6406d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.446+0000 7f4c65958700 1 -- 172.21.15.45:0/4089806939 shutdown_connections 2023-10-08T12:45:36.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.446+0000 7f58a3fff700 1 -- 172.21.15.45:0/2118260916 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f58bc155f70 con 0x7f58bc15c580 2023-10-08T12:45:36.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.446+0000 7f58bb7fe700 1 --2- 172.21.15.45:0/2118260916 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f58a806aed0 0x7f58a806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.446+0000 7f4c65958700 1 -- 172.21.15.45:0/4089806939 wait complete. 2023-10-08T12:45:36.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.448+0000 7f4c65958700 1 Processor -- start 2023-10-08T12:45:36.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.446+0000 7f58bb7fe700 1 --2- 172.21.15.45:0/2118260916 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f58a806aed0 0x7f58a806d390 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f58bc0ab4d0 tx=0x7f58b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.448+0000 7f4c65958700 1 -- start start 2023-10-08T12:45:36.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.449+0000 7f4c65958700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c6013ec20 0x7f4c600a7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.449+0000 7f4c65958700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4c60141220 0x7f4c600a66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.449+0000 7f4c65958700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c6015c040 0x7f4c600a92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.449+0000 7f4c65958700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c60153630 con 0x7f4c6013ec20 2023-10-08T12:45:36.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.449+0000 7f4c65958700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c600a7770 con 0x7f4c6015c040 2023-10-08T12:45:36.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.449+0000 7f4c65958700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c600a7a50 con 0x7f4c60141220 2023-10-08T12:45:36.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.450+0000 7f4c5f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c6015c040 0x7f4c600a92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.450+0000 7f4c5f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c6015c040 0x7f4c600a92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.45:46702/0 (socket says 172.21.15.45:46702) 2023-10-08T12:45:36.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.450+0000 7f4c5f7fe700 1 -- 172.21.15.45:0/3955339267 learned_addr learned my addr 172.21.15.45:0/3955339267 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:36.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.450+0000 7f4c5effd700 1 --2- 172.21.15.45:0/3955339267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c6013ec20 0x7f4c600a7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.452+0000 7f707eca9700 1 -- 172.21.15.45:0/4176261696 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7078158950 msgr2=0x7f70780cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.452+0000 7f707eca9700 1 --2- 172.21.15.45:0/4176261696 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7078158950 0x7f70780cdf60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f706c009990 tx=0x7f706c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.452+0000 7f707eca9700 1 -- 172.21.15.45:0/4176261696 shutdown_connections 2023-10-08T12:45:36.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.452+0000 7f707eca9700 1 --2- 172.21.15.45:0/4176261696 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7078158950 0x7f70780cdf60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.452+0000 7f707eca9700 1 -- 172.21.15.45:0/4176261696 >> 172.21.15.45:0/4176261696 conn(0x7f70780b0430 msgr2=0x7f70780b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.454+0000 7f707eca9700 1 -- 172.21.15.45:0/4176261696 shutdown_connections 2023-10-08T12:45:36.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.454+0000 7f707eca9700 1 -- 172.21.15.45:0/4176261696 wait complete. 2023-10-08T12:45:36.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.450+0000 7f4c5e7fc700 1 --2- 172.21.15.45:0/3955339267 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4c60141220 0x7f4c600a66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.451+0000 7f4c5effd700 1 -- 172.21.15.45:0/3955339267 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4c60141220 msgr2=0x7f4c600a66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.451+0000 7f4c5effd700 1 --2- 172.21.15.45:0/3955339267 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4c60141220 0x7f4c600a66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.451+0000 7f4c5effd700 1 -- 172.21.15.45:0/3955339267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c6015c040 msgr2=0x7f4c600a92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.451+0000 7f4c5effd700 1 --2- 172.21.15.45:0/3955339267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c6015c040 0x7f4c600a92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.451+0000 7f4c5effd700 1 -- 172.21.15.45:0/3955339267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c54009520 con 0x7f4c6013ec20 2023-10-08T12:45:36.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.452+0000 7f4c5effd700 1 --2- 172.21.15.45:0/3955339267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c6013ec20 0x7f4c600a7190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4c5000c4d0 tx=0x7f4c5000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.452+0000 7f4c47fff700 1 -- 172.21.15.45:0/3955339267 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c50011790 con 0x7f4c6013ec20 2023-10-08T12:45:36.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.452+0000 7f4c47fff700 1 -- 172.21.15.45:0/3955339267 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4c500119e0 con 0x7f4c6013ec20 2023-10-08T12:45:36.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.452+0000 7f4c65958700 1 -- 172.21.15.45:0/3955339267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c601538d0 con 0x7f4c6013ec20 2023-10-08T12:45:36.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.452+0000 7f4c47fff700 1 -- 172.21.15.45:0/3955339267 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c50011d90 con 0x7f4c6013ec20 2023-10-08T12:45:36.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.452+0000 7f4c65958700 1 -- 172.21.15.45:0/3955339267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c600a7d30 con 0x7f4c6013ec20 2023-10-08T12:45:36.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.454+0000 7f4c47fff700 1 -- 172.21.15.45:0/3955339267 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4c5001c460 con 0x7f4c6013ec20 2023-10-08T12:45:36.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.455+0000 7f4c47fff700 1 --2- 172.21.15.45:0/3955339267 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4c4c06aed0 0x7f4c4c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.455+0000 7f4c47fff700 1 -- 172.21.15.45:0/3955339267 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c500895d0 con 0x7f4c6013ec20 2023-10-08T12:45:36.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.450+0000 7f0b637fe700 1 -- 172.21.15.45:0/1667276266 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0b74092020 con 0x7f0b7c0cccf0 2023-10-08T12:45:36.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.451+0000 7fc0077fe700 1 -- 172.21.15.45:0/1430655382 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc010056ae0 con 0x7fc020141220 2023-10-08T12:45:36.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.456+0000 7f707eca9700 1 Processor -- start 2023-10-08T12:45:36.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.456+0000 7f707eca9700 1 -- start start 2023-10-08T12:45:36.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.457+0000 7f707eca9700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f70780c9ff0 0x7f70781470a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.457+0000 7f707eca9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7078158950 0x7f707814f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.457+0000 7f707eca9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f707814bcb0 0x7f707814d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.457+0000 7f707eca9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70780ce4a0 con 0x7f707814bcb0 2023-10-08T12:45:36.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.457+0000 7f707eca9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707814f830 con 0x7f7078158950 2023-10-08T12:45:36.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.457+0000 7f707eca9700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70781475e0 con 0x7f70780c9ff0 2023-10-08T12:45:36.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.457+0000 7f7077fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7078158950 0x7f707814f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.458+0000 7f7077fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7078158950 0x7f707814f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.45:46718/0 (socket says 172.21.15.45:46718) 2023-10-08T12:45:36.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.458+0000 7f7077fff700 1 -- 172.21.15.45:0/2860476848 learned_addr learned my addr 172.21.15.45:0/2860476848 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:36.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.458+0000 7f4c65958700 1 -- 172.21.15.45:0/3955339267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c6004e4c0 con 0x7f4c6013ec20 2023-10-08T12:45:36.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.459+0000 7f707ca45700 1 --2- 172.21.15.45:0/2860476848 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f70780c9ff0 0x7f70781470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.461+0000 7f7077fff700 1 -- 172.21.15.45:0/2860476848 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f70780c9ff0 msgr2=0x7f70781470a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.461+0000 7f7077fff700 1 --2- 172.21.15.45:0/2860476848 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f70780c9ff0 0x7f70781470a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.461+0000 7f7077fff700 1 -- 172.21.15.45:0/2860476848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f707814bcb0 msgr2=0x7f707814d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.461+0000 7f7077fff700 1 --2- 172.21.15.45:0/2860476848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f707814bcb0 0x7f707814d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.461+0000 7f7077fff700 1 -- 172.21.15.45:0/2860476848 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706c0095f0 con 0x7f7078158950 2023-10-08T12:45:36.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.461+0000 7f7077fff700 1 --2- 172.21.15.45:0/2860476848 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7078158950 0x7f707814f030 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f706400c430 tx=0x7f706400c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.467+0000 7f4c5e7fc700 1 --2- 172.21.15.45:0/3955339267 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4c4c06aed0 0x7f4c4c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.452+0000 7f0b7affd700 1 --2- 172.21.15.45:0/1667276266 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0b6406b380 0x7f0b6406d840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c0011e0 tx=0x7f0b6c007db0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.468+0000 7fde881d4700 1 -- 172.21.15.45:0/465241888 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde800ca700 msgr2=0x7fde8015c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.468+0000 7fde881d4700 1 --2- 172.21.15.45:0/465241888 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde800ca700 0x7fde8015c320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fde78009f90 tx=0x7fde7800b330 comp rx=0 tx=0).stop 2023-10-08T12:45:36.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.468+0000 7f4c5e7fc700 1 --2- 172.21.15.45:0/3955339267 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4c4c06aed0 0x7f4c4c06d390 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4c54009230 tx=0x7f4c540047c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.468+0000 7f4c47fff700 1 -- 172.21.15.45:0/3955339267 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4c500546b0 con 0x7f4c6013ec20 2023-10-08T12:45:36.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.468+0000 7fde881d4700 1 -- 172.21.15.45:0/465241888 shutdown_connections 2023-10-08T12:45:36.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.468+0000 7fde881d4700 1 --2- 172.21.15.45:0/465241888 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde800ca700 0x7fde8015c320 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.468+0000 7fde881d4700 1 -- 172.21.15.45:0/465241888 >> 172.21.15.45:0/465241888 conn(0x7fde800b0430 msgr2=0x7fde800b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.469+0000 7fde881d4700 1 -- 172.21.15.45:0/465241888 shutdown_connections 2023-10-08T12:45:36.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.470+0000 7f70757fa700 1 -- 172.21.15.45:0/2860476848 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70640054e0 con 0x7f7078158950 2023-10-08T12:45:36.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.470+0000 7f70757fa700 1 -- 172.21.15.45:0/2860476848 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f70640036a0 con 0x7f7078158950 2023-10-08T12:45:36.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.470+0000 7f70757fa700 1 -- 172.21.15.45:0/2860476848 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7064003ab0 con 0x7f7078158950 2023-10-08T12:45:36.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.470+0000 7f707eca9700 1 -- 172.21.15.45:0/2860476848 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f707814f570 con 0x7f7078158950 2023-10-08T12:45:36.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.470+0000 7f707eca9700 1 -- 172.21.15.45:0/2860476848 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f707814b1d0 con 0x7f7078158950 2023-10-08T12:45:36.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.472+0000 7f70757fa700 1 -- 172.21.15.45:0/2860476848 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7064003c10 con 0x7f7078158950 2023-10-08T12:45:36.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.472+0000 7f70757fa700 1 --2- 172.21.15.45:0/2860476848 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f705c06afa0 0x7f705c06d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.473+0000 7f70757fa700 1 -- 172.21.15.45:0/2860476848 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7064088ad0 con 0x7f7078158950 2023-10-08T12:45:36.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.473+0000 7f707ca45700 1 --2- 172.21.15.45:0/2860476848 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f705c06afa0 0x7f705c06d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.473+0000 7f707ca45700 1 --2- 172.21.15.45:0/2860476848 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f705c06afa0 0x7f705c06d460 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f706c000c00 tx=0x7f706c011040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.474+0000 7f707eca9700 1 -- 172.21.15.45:0/2860476848 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70580052f0 con 0x7f7078158950 2023-10-08T12:45:36.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.479+0000 7f70757fa700 1 -- 172.21.15.45:0/2860476848 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7064017020 con 0x7f7078158950 2023-10-08T12:45:36.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.479+0000 7fde881d4700 1 -- 172.21.15.45:0/465241888 wait complete. 2023-10-08T12:45:36.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.481+0000 7fde881d4700 1 Processor -- start 2023-10-08T12:45:36.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.481+0000 7fde881d4700 1 -- start start 2023-10-08T12:45:36.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.482+0000 7fde881d4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde800ca700 0x7fde8015b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.482+0000 7fde881d4700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde800cdf60 0x7fde801f4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.482+0000 7fde881d4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde80158950 0x7fde8006a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.482+0000 7fde881d4700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde800c6e70 con 0x7fde80158950 2023-10-08T12:45:36.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.482+0000 7fde881d4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde800c5dd0 con 0x7fde800ca700 2023-10-08T12:45:36.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.483+0000 7fde881d4700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde800c60b0 con 0x7fde800cdf60 2023-10-08T12:45:36.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.485+0000 7fde8576f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde800cdf60 0x7fde801f4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.485+0000 7fde85f70700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde800ca700 0x7fde8015b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.485+0000 7fde8576f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde800cdf60 0x7fde801f4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.45:37118/0 (socket says 172.21.15.45:37118) 2023-10-08T12:45:36.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.485+0000 7fde8576f700 1 -- 172.21.15.45:0/4005947366 learned_addr learned my addr 172.21.15.45:0/4005947366 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:36.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.485+0000 7fde86771700 1 --2- 172.21.15.45:0/4005947366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde80158950 0x7fde8006a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.486+0000 7fde86771700 1 -- 172.21.15.45:0/4005947366 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde800cdf60 msgr2=0x7fde801f4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.486+0000 7fde86771700 1 --2- 172.21.15.45:0/4005947366 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde800cdf60 0x7fde801f4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.486+0000 7fde86771700 1 -- 172.21.15.45:0/4005947366 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde800ca700 msgr2=0x7fde8015b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.486+0000 7fde86771700 1 --2- 172.21.15.45:0/4005947366 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde800ca700 0x7fde8015b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.486+0000 7fde86771700 1 -- 172.21.15.45:0/4005947366 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde78009c40 con 0x7fde80158950 2023-10-08T12:45:36.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.486+0000 7fde86771700 1 --2- 172.21.15.45:0/4005947366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde80158950 0x7fde8006a210 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fde78013000 tx=0x7fde7800bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.487+0000 7fde85f70700 1 --2- 172.21.15.45:0/4005947366 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde800ca700 0x7fde8015b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:45:36.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.487+0000 7fde767fc700 1 -- 172.21.15.45:0/4005947366 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7800e070 con 0x7fde80158950 2023-10-08T12:45:36.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.487+0000 7fde767fc700 1 -- 172.21.15.45:0/4005947366 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fde7800f040 con 0x7fde80158950 2023-10-08T12:45:36.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.487+0000 7fde767fc700 1 -- 172.21.15.45:0/4005947366 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde78004d60 con 0x7fde80158950 2023-10-08T12:45:36.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.487+0000 7fde881d4700 1 -- 172.21.15.45:0/4005947366 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde800c6390 con 0x7fde80158950 2023-10-08T12:45:36.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.487+0000 7fde881d4700 1 -- 172.21.15.45:0/4005947366 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde800c6950 con 0x7fde80158950 2023-10-08T12:45:36.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.491+0000 7fde767fc700 1 -- 172.21.15.45:0/4005947366 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fde78004380 con 0x7fde80158950 2023-10-08T12:45:36.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.492+0000 7fde767fc700 1 --2- 172.21.15.45:0/4005947366 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fde6406afa0 0x7fde6406d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.492+0000 7fde767fc700 1 -- 172.21.15.45:0/4005947366 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde7808a120 con 0x7fde80158950 2023-10-08T12:45:36.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.492+0000 7fde85f70700 1 --2- 172.21.15.45:0/4005947366 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fde6406afa0 0x7fde6406d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.493+0000 7fde881d4700 1 -- 172.21.15.45:0/4005947366 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde680052f0 con 0x7fde80158950 2023-10-08T12:45:36.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.503+0000 7fde767fc700 1 -- 172.21.15.45:0/4005947366 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fde780551c0 con 0x7fde80158950 2023-10-08T12:45:36.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.504+0000 7fde85f70700 1 --2- 172.21.15.45:0/4005947366 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fde6406afa0 0x7fde6406d460 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fde7c001800 tx=0x7fde7c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.536+0000 7f223999d700 1 -- 172.21.15.45:0/2099242922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22341688d0 msgr2=0x7f223416c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.536+0000 7f223999d700 1 --2- 172.21.15.45:0/2099242922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22341688d0 0x7f223416c290 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f222c009fd0 tx=0x7f222c00b380 comp rx=0 tx=0).stop 2023-10-08T12:45:36.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.536+0000 7f223999d700 1 -- 172.21.15.45:0/2099242922 shutdown_connections 2023-10-08T12:45:36.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.536+0000 7f223999d700 1 --2- 172.21.15.45:0/2099242922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22341688d0 0x7f223416c290 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.536+0000 7f223999d700 1 -- 172.21.15.45:0/2099242922 >> 172.21.15.45:0/2099242922 conn(0x7f223406e010 msgr2=0x7f223406e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.536+0000 7f223999d700 1 -- 172.21.15.45:0/2099242922 shutdown_connections 2023-10-08T12:45:36.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.536+0000 7f223999d700 1 -- 172.21.15.45:0/2099242922 wait complete. 2023-10-08T12:45:36.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.538+0000 7f223999d700 1 Processor -- start 2023-10-08T12:45:36.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.539+0000 7f223999d700 1 -- start start 2023-10-08T12:45:36.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.540+0000 7f223999d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2234071b30 0x7f2234177310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.540+0000 7f223999d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22341688d0 0x7f223417cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.540+0000 7f223999d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f223416c7d0 0x7f223417d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.540+0000 7f223999d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223417b810 con 0x7f22341688d0 2023-10-08T12:45:36.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.540+0000 7f223999d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223417ac00 con 0x7f2234071b30 2023-10-08T12:45:36.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.540+0000 7f223999d700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223417aee0 con 0x7f223416c7d0 2023-10-08T12:45:36.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.541+0000 7f22327fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22341688d0 0x7f223417cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.541+0000 7f22327fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22341688d0 0x7f223417cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35280/0 (socket says 172.21.15.45:35280) 2023-10-08T12:45:36.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.541+0000 7f22327fc700 1 -- 172.21.15.45:0/1615441383 learned_addr learned my addr 172.21.15.45:0/1615441383 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:36.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.541+0000 7f22327fc700 1 -- 172.21.15.45:0/1615441383 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f223416c7d0 msgr2=0x7f223417d220 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T12:45:36.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.541+0000 7f22327fc700 1 --2- 172.21.15.45:0/1615441383 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f223416c7d0 0x7f223417d220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.541+0000 7f22327fc700 1 -- 172.21.15.45:0/1615441383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2234071b30 msgr2=0x7f2234177310 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T12:45:36.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.541+0000 7f22327fc700 1 --2- 172.21.15.45:0/1615441383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2234071b30 0x7f2234177310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.541+0000 7f22327fc700 1 -- 172.21.15.45:0/1615441383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f222c009d00 con 0x7f22341688d0 2023-10-08T12:45:36.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.541+0000 7f22327fc700 1 --2- 172.21.15.45:0/1615441383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22341688d0 0x7f223417cce0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f222800b450 tx=0x7f222800b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.544+0000 7f2223fff700 1 -- 172.21.15.45:0/1615441383 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2228011630 con 0x7f22341688d0 2023-10-08T12:45:36.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.544+0000 7f2223fff700 1 -- 172.21.15.45:0/1615441383 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f22280118a0 con 0x7f22341688d0 2023-10-08T12:45:36.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.544+0000 7f2223fff700 1 -- 172.21.15.45:0/1615441383 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2228011cb0 con 0x7f22341688d0 2023-10-08T12:45:36.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.544+0000 7f223999d700 1 -- 172.21.15.45:0/1615441383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f223417b1c0 con 0x7f22341688d0 2023-10-08T12:45:36.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.544+0000 7f223999d700 1 -- 172.21.15.45:0/1615441383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223417a890 con 0x7f22341688d0 2023-10-08T12:45:36.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.549+0000 7f2223fff700 1 -- 172.21.15.45:0/1615441383 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f222805e410 con 0x7f22341688d0 2023-10-08T12:45:36.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.550+0000 7f2223fff700 1 --2- 172.21.15.45:0/1615441383 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f221806afa0 0x7f221806d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:36.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.550+0000 7f2223fff700 1 -- 172.21.15.45:0/1615441383 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22280cd7b0 con 0x7f22341688d0 2023-10-08T12:45:36.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.551+0000 7f2232ffd700 1 --2- 172.21.15.45:0/1615441383 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f221806afa0 0x7f221806d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:36.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.551+0000 7f223999d700 1 -- 172.21.15.45:0/1615441383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22100052f0 con 0x7f22341688d0 2023-10-08T12:45:36.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.561+0000 7f2223fff700 1 -- 172.21.15.45:0/1615441383 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2228098840 con 0x7f22341688d0 2023-10-08T12:45:36.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.561+0000 7f2232ffd700 1 --2- 172.21.15.45:0/1615441383 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f221806afa0 0x7f221806d460 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2234151a20 tx=0x7f222c004b40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:36.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.831+0000 7f597e781700 1 -- 172.21.15.45:0/1987631860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5958005160 con 0x7f5978140670 2023-10-08T12:45:36.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.831+0000 7f5974ff9700 1 -- 172.21.15.45:0/1987631860 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f596c017070 con 0x7f5978140670 2023-10-08T12:45:36.835 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2023-10-08T12:45:36.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.835+0000 7f597e781700 1 -- 172.21.15.45:0/1987631860 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f596406af50 msgr2=0x7f596406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.835+0000 7f597e781700 1 --2- 172.21.15.45:0/1987631860 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f596406af50 0x7f596406d410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5970001b20 tx=0x7f59700017f0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.835+0000 7f597e781700 1 -- 172.21.15.45:0/1987631860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5978140670 msgr2=0x7f5978144710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.835+0000 7f597e781700 1 --2- 172.21.15.45:0/1987631860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5978140670 0x7f5978144710 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f59780ab090 tx=0x7f596c009700 comp rx=0 tx=0).stop 2023-10-08T12:45:36.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.835+0000 7f597e781700 1 -- 172.21.15.45:0/1987631860 shutdown_connections 2023-10-08T12:45:36.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.835+0000 7f597e781700 1 --2- 172.21.15.45:0/1987631860 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f596406af50 0x7f596406d410 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5970001b20 tx=0x7f59700017f0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.835+0000 7f597e781700 1 --2- 172.21.15.45:0/1987631860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5978140670 0x7f5978144710 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.835+0000 7f597e781700 1 --2- 172.21.15.45:0/1987631860 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5960004850 0x7f5978153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.835+0000 7f597e781700 1 --2- 172.21.15.45:0/1987631860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5978136e40 0x7f5978140130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.835+0000 7f597e781700 1 -- 172.21.15.45:0/1987631860 >> 172.21.15.45:0/1987631860 conn(0x7f597806e010 msgr2=0x7f597806e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.836+0000 7f597e781700 1 -- 172.21.15.45:0/1987631860 shutdown_connections 2023-10-08T12:45:36.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.836+0000 7f597e781700 1 -- 172.21.15.45:0/1987631860 wait complete. 2023-10-08T12:45:36.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2023-10-08T12:45:36.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.854+0000 7f58c1e8f700 1 -- 172.21.15.45:0/2118260916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f58bc155f70 con 0x7f58bc15c580 2023-10-08T12:45:36.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.855+0000 7f58a3fff700 1 -- 172.21.15.45:0/2118260916 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f58bc155f70 con 0x7f58bc15c580 2023-10-08T12:45:36.856 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2023-10-08T12:45:36.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.859+0000 7f58c1e8f700 1 -- 172.21.15.45:0/2118260916 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f58a806aed0 msgr2=0x7f58a806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.859+0000 7f58c1e8f700 1 --2- 172.21.15.45:0/2118260916 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f58a806aed0 0x7f58a806d390 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f58bc0ab4d0 tx=0x7f58b0009040 comp rx=0 tx=0).stop 2023-10-08T12:45:36.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.859+0000 7f58c1e8f700 1 -- 172.21.15.45:0/2118260916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58bc15c580 msgr2=0x7f58bc0acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.859+0000 7f58c1e8f700 1 --2- 172.21.15.45:0/2118260916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58bc15c580 0x7f58bc0acb80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f58ac00c420 tx=0x7f58ac00c730 comp rx=0 tx=0).stop 2023-10-08T12:45:36.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.859+0000 7f58c1e8f700 1 -- 172.21.15.45:0/2118260916 shutdown_connections 2023-10-08T12:45:36.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.859+0000 7f58c1e8f700 1 --2- 172.21.15.45:0/2118260916 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f58a806aed0 0x7f58a806d390 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.859+0000 7f58c1e8f700 1 --2- 172.21.15.45:0/2118260916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58bc15c580 0x7f58bc0acb80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.859+0000 7f58c1e8f700 1 --2- 172.21.15.45:0/2118260916 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f58bc0b32e0 0x7f58bc13ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.859+0000 7f58c1e8f700 1 --2- 172.21.15.45:0/2118260916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58bc141220 0x7f58bc0ac640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.859+0000 7f58c1e8f700 1 -- 172.21.15.45:0/2118260916 >> 172.21.15.45:0/2118260916 conn(0x7f58bc06e010 msgr2=0x7f58bc13dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.859+0000 7f58c1e8f700 1 -- 172.21.15.45:0/2118260916 shutdown_connections 2023-10-08T12:45:36.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.859+0000 7f58c1e8f700 1 -- 172.21.15.45:0/2118260916 wait complete. 2023-10-08T12:45:36.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.860+0000 7fc025491700 1 -- 172.21.15.45:0/1430655382 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc000005160 con 0x7fc020141220 2023-10-08T12:45:36.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.860+0000 7fc0077fe700 1 -- 172.21.15.45:0/1430655382 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc01005a100 con 0x7fc020141220 2023-10-08T12:45:36.864 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-10-08T12:45:36.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.864+0000 7fc025491700 1 -- 172.21.15.45:0/1430655382 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc00c06afa0 msgr2=0x7fc00c06d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.864+0000 7fc025491700 1 --2- 172.21.15.45:0/1430655382 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc00c06afa0 0x7fc00c06d460 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc014007fd0 tx=0x7fc014009040 comp rx=0 tx=0).stop 2023-10-08T12:45:36.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.864+0000 7fc025491700 1 -- 172.21.15.45:0/1430655382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc020141220 msgr2=0x7fc0201fe500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.864+0000 7fc025491700 1 --2- 172.21.15.45:0/1430655382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc020141220 0x7fc0201fe500 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc010004000 tx=0x7fc010004260 comp rx=0 tx=0).stop 2023-10-08T12:45:36.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.866+0000 7fc025491700 1 -- 172.21.15.45:0/1430655382 shutdown_connections 2023-10-08T12:45:36.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.866+0000 7fc025491700 1 --2- 172.21.15.45:0/1430655382 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc00c06afa0 0x7fc00c06d460 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.866+0000 7fc025491700 1 --2- 172.21.15.45:0/1430655382 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc02015c580 0x7fc020140140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.866+0000 7fc025491700 1 --2- 172.21.15.45:0/1430655382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0200b32e0 0x7fc0200ad4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.866+0000 7fc025491700 1 --2- 172.21.15.45:0/1430655382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc020141220 0x7fc0201fe500 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.866+0000 7fc025491700 1 -- 172.21.15.45:0/1430655382 >> 172.21.15.45:0/1430655382 conn(0x7fc02006e010 msgr2=0x7fc02015d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.866+0000 7f0b81695700 1 -- 172.21.15.45:0/1667276266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0b7c0bf220 con 0x7f0b7c0cccf0 2023-10-08T12:45:36.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.867+0000 7f0b637fe700 1 -- 172.21.15.45:0/1667276266 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0b7405b7a0 con 0x7f0b7c0cccf0 2023-10-08T12:45:36.868 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2023-10-08T12:45:36.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.869+0000 7fc025491700 1 -- 172.21.15.45:0/1430655382 shutdown_connections 2023-10-08T12:45:36.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.870+0000 7fc025491700 1 -- 172.21.15.45:0/1430655382 wait complete. 2023-10-08T12:45:36.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.870+0000 7f0b81695700 1 -- 172.21.15.45:0/1667276266 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0b6406b380 msgr2=0x7f0b6406d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.870+0000 7f0b81695700 1 --2- 172.21.15.45:0/1667276266 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0b6406b380 0x7f0b6406d840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c0011e0 tx=0x7f0b6c007db0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.870+0000 7f0b81695700 1 -- 172.21.15.45:0/1667276266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b7c0cccf0 msgr2=0x7f0b7c0b2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.870+0000 7f0b81695700 1 --2- 172.21.15.45:0/1667276266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b7c0cccf0 0x7f0b7c0b2b40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0b7400c7b0 tx=0x7f0b74003ef0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.876+0000 7f0b81695700 1 -- 172.21.15.45:0/1667276266 shutdown_connections 2023-10-08T12:45:36.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.876+0000 7f0b81695700 1 --2- 172.21.15.45:0/1667276266 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0b6406b380 0x7f0b6406d840 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.876+0000 7f0b81695700 1 --2- 172.21.15.45:0/1667276266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b7c0cccf0 0x7f0b7c0b2b40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.876+0000 7f0b81695700 1 --2- 172.21.15.45:0/1667276266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b7c0bedc0 0x7f0b7c0c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.876+0000 7f0b81695700 1 --2- 172.21.15.45:0/1667276266 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0b7c0c8950 0x7f0b7c15aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.876+0000 7f0b81695700 1 -- 172.21.15.45:0/1667276266 >> 172.21.15.45:0/1667276266 conn(0x7f0b7c0afae0 msgr2=0x7f0b7c06d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.876+0000 7f0b81695700 1 -- 172.21.15.45:0/1667276266 shutdown_connections 2023-10-08T12:45:36.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.876+0000 7f0b81695700 1 -- 172.21.15.45:0/1667276266 wait complete. 2023-10-08T12:45:36.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2023-10-08T12:45:36.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.884+0000 7f4c65958700 1 -- 172.21.15.45:0/3955339267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4c600aa9d0 con 0x7f4c6013ec20 2023-10-08T12:45:36.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.885+0000 7f4c47fff700 1 -- 172.21.15.45:0/3955339267 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4c50057cb0 con 0x7f4c6013ec20 2023-10-08T12:45:36.885 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2023-10-08T12:45:36.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.889+0000 7f4c65958700 1 -- 172.21.15.45:0/3955339267 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4c4c06aed0 msgr2=0x7f4c4c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.889+0000 7f4c65958700 1 --2- 172.21.15.45:0/3955339267 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4c4c06aed0 0x7f4c4c06d390 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4c54009230 tx=0x7f4c540047c0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.889+0000 7f4c65958700 1 -- 172.21.15.45:0/3955339267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c6013ec20 msgr2=0x7f4c600a7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.889+0000 7f4c65958700 1 --2- 172.21.15.45:0/3955339267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c6013ec20 0x7f4c600a7190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4c5000c4d0 tx=0x7f4c5000c7e0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.891 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-10-08T12:45:36.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.890+0000 7f4c65958700 1 -- 172.21.15.45:0/3955339267 shutdown_connections 2023-10-08T12:45:36.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.890+0000 7f4c65958700 1 --2- 172.21.15.45:0/3955339267 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4c4c06aed0 0x7f4c4c06d390 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.890+0000 7f4c65958700 1 --2- 172.21.15.45:0/3955339267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c6015c040 0x7f4c600a92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.890+0000 7f4c65958700 1 --2- 172.21.15.45:0/3955339267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c6013ec20 0x7f4c600a7190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.890+0000 7f4c65958700 1 --2- 172.21.15.45:0/3955339267 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4c60141220 0x7f4c600a66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.890+0000 7f4c65958700 1 -- 172.21.15.45:0/3955339267 >> 172.21.15.45:0/3955339267 conn(0x7f4c6006e010 msgr2=0x7f4c6015d270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.890+0000 7f4c65958700 1 -- 172.21.15.45:0/3955339267 shutdown_connections 2023-10-08T12:45:36.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.890+0000 7f4c65958700 1 -- 172.21.15.45:0/3955339267 wait complete. 2023-10-08T12:45:36.895 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2023-10-08T12:45:36.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.897+0000 7fde881d4700 1 -- 172.21.15.45:0/4005947366 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fde68005160 con 0x7fde80158950 2023-10-08T12:45:36.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.897+0000 7fde767fc700 1 -- 172.21.15.45:0/4005947366 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fde78020070 con 0x7fde80158950 2023-10-08T12:45:36.898 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-10-08T12:45:36.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.898+0000 7f707eca9700 1 -- 172.21.15.45:0/2860476848 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7058005160 con 0x7f7078158950 2023-10-08T12:45:36.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.899+0000 7f70757fa700 1 -- 172.21.15.45:0/2860476848 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7064053c10 con 0x7f7078158950 2023-10-08T12:45:36.900 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-10-08T12:45:36.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.899+0000 7fde881d4700 1 -- 172.21.15.45:0/4005947366 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fde6406afa0 msgr2=0x7fde6406d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.899+0000 7fde881d4700 1 --2- 172.21.15.45:0/4005947366 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fde6406afa0 0x7fde6406d460 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fde7c001800 tx=0x7fde7c009040 comp rx=0 tx=0).stop 2023-10-08T12:45:36.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.899+0000 7fde881d4700 1 -- 172.21.15.45:0/4005947366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde80158950 msgr2=0x7fde8006a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.899+0000 7fde881d4700 1 --2- 172.21.15.45:0/4005947366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde80158950 0x7fde8006a210 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fde78013000 tx=0x7fde7800bf80 comp rx=0 tx=0).stop 2023-10-08T12:45:36.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.901+0000 7fde881d4700 1 -- 172.21.15.45:0/4005947366 shutdown_connections 2023-10-08T12:45:36.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.901+0000 7fde881d4700 1 --2- 172.21.15.45:0/4005947366 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fde6406afa0 0x7fde6406d460 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.901+0000 7fde881d4700 1 --2- 172.21.15.45:0/4005947366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde80158950 0x7fde8006a210 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.901+0000 7fde881d4700 1 --2- 172.21.15.45:0/4005947366 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde800ca700 0x7fde8015b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.901+0000 7fde881d4700 1 --2- 172.21.15.45:0/4005947366 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde800cdf60 0x7fde801f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.901+0000 7fde881d4700 1 -- 172.21.15.45:0/4005947366 >> 172.21.15.45:0/4005947366 conn(0x7fde800b0430 msgr2=0x7fde80071f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.901+0000 7fde881d4700 1 -- 172.21.15.45:0/4005947366 shutdown_connections 2023-10-08T12:45:36.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.901+0000 7fde881d4700 1 -- 172.21.15.45:0/4005947366 wait complete. 2023-10-08T12:45:36.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.902+0000 7f707eca9700 1 -- 172.21.15.45:0/2860476848 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f705c06afa0 msgr2=0x7f705c06d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.902+0000 7f707eca9700 1 --2- 172.21.15.45:0/2860476848 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f705c06afa0 0x7f705c06d460 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f706c000c00 tx=0x7f706c011040 comp rx=0 tx=0).stop 2023-10-08T12:45:36.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.902+0000 7f707eca9700 1 -- 172.21.15.45:0/2860476848 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7078158950 msgr2=0x7f707814f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.902+0000 7f707eca9700 1 --2- 172.21.15.45:0/2860476848 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7078158950 0x7f707814f030 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f706400c430 tx=0x7f706400c7f0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.903+0000 7f707eca9700 1 -- 172.21.15.45:0/2860476848 shutdown_connections 2023-10-08T12:45:36.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.903+0000 7f707eca9700 1 --2- 172.21.15.45:0/2860476848 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f705c06afa0 0x7f705c06d460 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.903+0000 7f707eca9700 1 --2- 172.21.15.45:0/2860476848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f707814bcb0 0x7f707814d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.903+0000 7f707eca9700 1 --2- 172.21.15.45:0/2860476848 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f70780c9ff0 0x7f70781470a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.903+0000 7f707eca9700 1 --2- 172.21.15.45:0/2860476848 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7078158950 0x7f707814f030 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.903+0000 7f707eca9700 1 -- 172.21.15.45:0/2860476848 >> 172.21.15.45:0/2860476848 conn(0x7f70780b0430 msgr2=0x7f70780cc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.903+0000 7f707eca9700 1 -- 172.21.15.45:0/2860476848 shutdown_connections 2023-10-08T12:45:36.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.903+0000 7f707eca9700 1 -- 172.21.15.45:0/2860476848 wait complete. 2023-10-08T12:45:36.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2023-10-08T12:45:36.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-10-08T12:45:36.917 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-10-08T12:45:36.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.923+0000 7f223999d700 1 -- 172.21.15.45:0/1615441383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f2210005160 con 0x7f22341688d0 2023-10-08T12:45:36.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.924+0000 7f2223fff700 1 -- 172.21.15.45:0/1615441383 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f222809be60 con 0x7f22341688d0 2023-10-08T12:45:36.925 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-10-08T12:45:36.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.926+0000 7f223999d700 1 -- 172.21.15.45:0/1615441383 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f221806afa0 msgr2=0x7f221806d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.926+0000 7f223999d700 1 --2- 172.21.15.45:0/1615441383 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f221806afa0 0x7f221806d460 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2234151a20 tx=0x7f222c004b40 comp rx=0 tx=0).stop 2023-10-08T12:45:36.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.926+0000 7f223999d700 1 -- 172.21.15.45:0/1615441383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22341688d0 msgr2=0x7f223417cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:36.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.926+0000 7f223999d700 1 --2- 172.21.15.45:0/1615441383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22341688d0 0x7f223417cce0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f222800b450 tx=0x7f222800b810 comp rx=0 tx=0).stop 2023-10-08T12:45:36.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.926+0000 7f223999d700 1 -- 172.21.15.45:0/1615441383 shutdown_connections 2023-10-08T12:45:36.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.926+0000 7f223999d700 1 --2- 172.21.15.45:0/1615441383 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f221806afa0 0x7f221806d460 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.926+0000 7f223999d700 1 --2- 172.21.15.45:0/1615441383 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f223416c7d0 0x7f223417d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.926+0000 7f223999d700 1 --2- 172.21.15.45:0/1615441383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2234071b30 0x7f2234177310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.926+0000 7f223999d700 1 --2- 172.21.15.45:0/1615441383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22341688d0 0x7f223417cce0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:36.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.926+0000 7f223999d700 1 -- 172.21.15.45:0/1615441383 >> 172.21.15.45:0/1615441383 conn(0x7f223406e010 msgr2=0x7f22340b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:36.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.926+0000 7f223999d700 1 -- 172.21.15.45:0/1615441383 shutdown_connections 2023-10-08T12:45:36.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:36.926+0000 7f223999d700 1 -- 172.21.15.45:0/1615441383 wait complete. 2023-10-08T12:45:36.939 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-10-08T12:45:37.856 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T12:45:37.882 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-08T12:45:37.892 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T12:45:37.896 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-08T12:45:37.908 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-08T12:45:37.916 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-08T12:45:37.918 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T12:45:37.939 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-08T12:45:38.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.065+0000 7fd6b9289700 1 -- 172.21.15.45:0/890511992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6b4141220 msgr2=0x7fd6b4141600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.065+0000 7fd6b9289700 1 --2- 172.21.15.45:0/890511992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6b4141220 0x7fd6b4141600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac009fd0 tx=0x7fd6ac00b380 comp rx=0 tx=0).stop 2023-10-08T12:45:38.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.066+0000 7fd6b9289700 1 -- 172.21.15.45:0/890511992 shutdown_connections 2023-10-08T12:45:38.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.066+0000 7fd6b9289700 1 --2- 172.21.15.45:0/890511992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6b4141220 0x7fd6b4141600 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.066+0000 7fd6b9289700 1 -- 172.21.15.45:0/890511992 >> 172.21.15.45:0/890511992 conn(0x7fd6b406e010 msgr2=0x7fd6b406e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:38.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.066+0000 7fd6b9289700 1 -- 172.21.15.45:0/890511992 shutdown_connections 2023-10-08T12:45:38.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.066+0000 7fd6b9289700 1 -- 172.21.15.45:0/890511992 wait complete. 2023-10-08T12:45:38.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.068+0000 7fd6b9289700 1 Processor -- start 2023-10-08T12:45:38.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.068+0000 7fd6b9289700 1 -- start start 2023-10-08T12:45:38.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.070+0000 7fd6b9289700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6b40b32e0 0x7fd6b41fe7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.070+0000 7fd6b9289700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6b4141220 0x7fd6b40af6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.070+0000 7fd6b9289700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6b415c750 0x7fd6b40afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.070+0000 7fd6b9289700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b40a9470 con 0x7fd6b4141220 2023-10-08T12:45:38.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.070+0000 7fd6b9289700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b41398c0 con 0x7fd6b415c750 2023-10-08T12:45:38.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.070+0000 7fd6b9289700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b41fece0 con 0x7fd6b40b32e0 2023-10-08T12:45:38.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.070+0000 7fd6b27fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6b4141220 0x7fd6b40af6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.070+0000 7fd6b27fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6b4141220 0x7fd6b40af6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35294/0 (socket says 172.21.15.45:35294) 2023-10-08T12:45:38.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.070+0000 7fd6b27fc700 1 -- 172.21.15.45:0/3291180546 learned_addr learned my addr 172.21.15.45:0/3291180546 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:38.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.070+0000 7fd6b2ffd700 1 --2- 172.21.15.45:0/3291180546 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6b40b32e0 0x7fd6b41fe7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.070+0000 7fd6b37fe700 1 --2- 172.21.15.45:0/3291180546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6b415c750 0x7fd6b40afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.071+0000 7fd6b2ffd700 1 -- 172.21.15.45:0/3291180546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6b415c750 msgr2=0x7fd6b40afbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.071+0000 7fd6b2ffd700 1 --2- 172.21.15.45:0/3291180546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6b415c750 0x7fd6b40afbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.071+0000 7fd6b2ffd700 1 -- 172.21.15.45:0/3291180546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6b4141220 msgr2=0x7fd6b40af6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.071+0000 7fd6b2ffd700 1 --2- 172.21.15.45:0/3291180546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6b4141220 0x7fd6b40af6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.071+0000 7fd6b2ffd700 1 -- 172.21.15.45:0/3291180546 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ac009d00 con 0x7fd6b40b32e0 2023-10-08T12:45:38.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.072+0000 7fd6b2ffd700 1 --2- 172.21.15.45:0/3291180546 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6b40b32e0 0x7fd6b41fe7a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac014000 tx=0x7fd6ac006210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:38.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.072+0000 7fd69b7fe700 1 -- 172.21.15.45:0/3291180546 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac00e050 con 0x7fd6b40b32e0 2023-10-08T12:45:38.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.072+0000 7fd69b7fe700 1 -- 172.21.15.45:0/3291180546 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd6ac007bc0 con 0x7fd6b40b32e0 2023-10-08T12:45:38.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.072+0000 7fd69b7fe700 1 -- 172.21.15.45:0/3291180546 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac004030 con 0x7fd6b40b32e0 2023-10-08T12:45:38.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.073+0000 7fd6b9289700 1 -- 172.21.15.45:0/3291180546 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b4154240 con 0x7fd6b40b32e0 2023-10-08T12:45:38.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.073+0000 7fd6b9289700 1 -- 172.21.15.45:0/3291180546 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b40a9980 con 0x7fd6b40b32e0 2023-10-08T12:45:38.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.076+0000 7fd69b7fe700 1 -- 172.21.15.45:0/3291180546 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd6ac019040 con 0x7fd6b40b32e0 2023-10-08T12:45:38.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.076+0000 7fd69b7fe700 1 --2- 172.21.15.45:0/3291180546 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd6a006afa0 0x7fd6a006d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.076+0000 7fd69b7fe700 1 -- 172.21.15.45:0/3291180546 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6ac08a7a0 con 0x7fd6b40b32e0 2023-10-08T12:45:38.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.077+0000 7fd6b9289700 1 -- 172.21.15.45:0/3291180546 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b415cb60 con 0x7fd6b40b32e0 2023-10-08T12:45:38.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.077+0000 7fd6b27fc700 1 --2- 172.21.15.45:0/3291180546 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd6a006afa0 0x7fd6a006d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.078+0000 7fd6b27fc700 1 --2- 172.21.15.45:0/3291180546 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd6a006afa0 0x7fd6a006d460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd6b40cc8e0 tx=0x7fd6a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:38.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.083+0000 7fd69b7fe700 1 -- 172.21.15.45:0/3291180546 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd6b415cb60 con 0x7fd6b40b32e0 2023-10-08T12:45:38.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.096+0000 7f9c93eb2700 1 -- 172.21.15.45:0/4107566925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c78003a30 msgr2=0x7f9c78003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.096+0000 7f9c93eb2700 1 --2- 172.21.15.45:0/4107566925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c78003a30 0x7f9c78003e30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800c360 tx=0x7f9c78005880 comp rx=0 tx=0).stop 2023-10-08T12:45:38.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.107+0000 7f9c9244f700 1 -- 172.21.15.45:0/4107566925 reap_dead start 2023-10-08T12:45:38.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.107+0000 7f9c93eb2700 1 -- 172.21.15.45:0/4107566925 shutdown_connections 2023-10-08T12:45:38.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.107+0000 7f9c93eb2700 1 -- 172.21.15.45:0/4107566925 >> 172.21.15.45:0/4107566925 conn(0x7f9c8c06a210 msgr2=0x7f9c8c06a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:38.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.107+0000 7f9c93eb2700 1 -- 172.21.15.45:0/4107566925 shutdown_connections 2023-10-08T12:45:38.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.107+0000 7f9c93eb2700 1 -- 172.21.15.45:0/4107566925 wait complete. 2023-10-08T12:45:38.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.109+0000 7f9c93eb2700 1 Processor -- start 2023-10-08T12:45:38.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.109+0000 7f9c93eb2700 1 -- start start 2023-10-08T12:45:38.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.110+0000 7f9c93eb2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c8c147980 0x7f9c8c0a6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.111+0000 7f9c93eb2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9c8c147d60 0x7f9c8c0a8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.111+0000 7f9c93eb2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c8c0a8660 0x7f9c8c156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.111+0000 7f9c93eb2700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c0a6cd0 con 0x7f9c8c0a8660 2023-10-08T12:45:38.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.111+0000 7f9c93eb2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c159ba0 con 0x7f9c8c147980 2023-10-08T12:45:38.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.111+0000 7f9c93eb2700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c159e80 con 0x7f9c8c147d60 2023-10-08T12:45:38.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.111+0000 7f9c9244f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c8c0a8660 0x7f9c8c156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.111+0000 7f9c9244f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c8c0a8660 0x7f9c8c156080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35320/0 (socket says 172.21.15.45:35320) 2023-10-08T12:45:38.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.111+0000 7f9c9244f700 1 -- 172.21.15.45:0/1530300572 learned_addr learned my addr 172.21.15.45:0/1530300572 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:38.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.111+0000 7f9c9144d700 1 --2- 172.21.15.45:0/1530300572 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9c8c147d60 0x7f9c8c0a8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.111+0000 7f9c91c4e700 1 --2- 172.21.15.45:0/1530300572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c8c147980 0x7f9c8c0a6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.112+0000 7f9c9244f700 1 -- 172.21.15.45:0/1530300572 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9c8c147d60 msgr2=0x7f9c8c0a8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.112+0000 7f9c9244f700 1 --2- 172.21.15.45:0/1530300572 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9c8c147d60 0x7f9c8c0a8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.112+0000 7f9c9244f700 1 -- 172.21.15.45:0/1530300572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c8c147980 msgr2=0x7f9c8c0a6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.112+0000 7f9c9244f700 1 --2- 172.21.15.45:0/1530300572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c8c147980 0x7f9c8c0a6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.112+0000 7f9c9244f700 1 -- 172.21.15.45:0/1530300572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8c15a160 con 0x7f9c8c0a8660 2023-10-08T12:45:38.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.112+0000 7f9c9244f700 1 --2- 172.21.15.45:0/1530300572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c8c0a8660 0x7f9c8c156080 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c0cd620 tx=0x7f9c7c009720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:38.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.113+0000 7f9c827fc700 1 -- 172.21.15.45:0/1530300572 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c003ae0 con 0x7f9c8c0a8660 2023-10-08T12:45:38.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.113+0000 7f9c827fc700 1 -- 172.21.15.45:0/1530300572 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9c7c003d30 con 0x7f9c8c0a8660 2023-10-08T12:45:38.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.113+0000 7f9c827fc700 1 -- 172.21.15.45:0/1530300572 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c003ea0 con 0x7f9c8c0a8660 2023-10-08T12:45:38.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.114+0000 7f9c93eb2700 1 -- 172.21.15.45:0/1530300572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c8c15a440 con 0x7f9c8c0a8660 2023-10-08T12:45:38.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.114+0000 7f9c93eb2700 1 -- 172.21.15.45:0/1530300572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c8c156f70 con 0x7f9c8c0a8660 2023-10-08T12:45:38.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.116+0000 7f22071a1700 1 -- 172.21.15.45:0/64079463 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2200141220 msgr2=0x7f2200141600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.116+0000 7f22071a1700 1 --2- 172.21.15.45:0/64079463 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2200141220 0x7f2200141600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f21f0005fd0 tx=0x7f21f0009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:38.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.115+0000 7f9c93eb2700 1 -- 172.21.15.45:0/1530300572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c8c159ce0 con 0x7f9c8c0a8660 2023-10-08T12:45:38.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.117+0000 7f22071a1700 1 -- 172.21.15.45:0/64079463 shutdown_connections 2023-10-08T12:45:38.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.117+0000 7f22071a1700 1 --2- 172.21.15.45:0/64079463 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2200141220 0x7f2200141600 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.117+0000 7f22071a1700 1 --2- 172.21.15.45:0/64079463 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f22000b32e0 0x7f220015c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.117+0000 7f22071a1700 1 -- 172.21.15.45:0/64079463 >> 172.21.15.45:0/64079463 conn(0x7f220006e010 msgr2=0x7f220006e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:38.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.117+0000 7f22071a1700 1 -- 172.21.15.45:0/64079463 shutdown_connections 2023-10-08T12:45:38.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.117+0000 7f9c827fc700 1 -- 172.21.15.45:0/1530300572 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9c7c0052d0 con 0x7f9c8c0a8660 2023-10-08T12:45:38.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.118+0000 7f9c827fc700 1 --2- 172.21.15.45:0/1530300572 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f9c7006afa0 0x7f9c7006d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.118+0000 7f9c827fc700 1 -- 172.21.15.45:0/1530300572 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c7c088c50 con 0x7f9c8c0a8660 2023-10-08T12:45:38.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.117+0000 7f22071a1700 1 -- 172.21.15.45:0/64079463 wait complete. 2023-10-08T12:45:38.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.119+0000 7f22071a1700 1 Processor -- start 2023-10-08T12:45:38.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.119+0000 7f22071a1700 1 -- start start 2023-10-08T12:45:38.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.121+0000 7f22071a1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22000b32e0 0x7f22001f95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.121+0000 7f22071a1700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2200141220 0x7f22000aa150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.121+0000 7f22071a1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f220015c580 0x7f22001f6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.121+0000 7f22071a1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2200142e30 con 0x7f220015c580 2023-10-08T12:45:38.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.121+0000 7f22071a1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2200143110 con 0x7f22000b32e0 2023-10-08T12:45:38.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.121+0000 7f22071a1700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220013bef0 con 0x7f2200141220 2023-10-08T12:45:38.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.121+0000 7f9c91c4e700 1 --2- 172.21.15.45:0/1530300572 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f9c7006afa0 0x7f9c7006d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.121+0000 7f21fffff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2200141220 0x7f22000aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.121+0000 7f2204f3d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22000b32e0 0x7f22001f95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.121+0000 7f220573e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f220015c580 0x7f22001f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.121+0000 7f220573e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f220015c580 0x7f22001f6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35334/0 (socket says 172.21.15.45:35334) 2023-10-08T12:45:38.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.121+0000 7f220573e700 1 -- 172.21.15.45:0/1139442783 learned_addr learned my addr 172.21.15.45:0/1139442783 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:38.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.122+0000 7f2204f3d700 1 -- 172.21.15.45:0/1139442783 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2200141220 msgr2=0x7f22000aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.122+0000 7f2204f3d700 1 --2- 172.21.15.45:0/1139442783 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2200141220 0x7f22000aa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.122+0000 7f2204f3d700 1 -- 172.21.15.45:0/1139442783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f220015c580 msgr2=0x7f22001f6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.122+0000 7f2204f3d700 1 --2- 172.21.15.45:0/1139442783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f220015c580 0x7f22001f6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.122+0000 7f2204f3d700 1 -- 172.21.15.45:0/1139442783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f00095f0 con 0x7f22000b32e0 2023-10-08T12:45:38.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.122+0000 7f9c91c4e700 1 --2- 172.21.15.45:0/1530300572 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f9c7006afa0 0x7f9c7006d460 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800c280 tx=0x7f9c8800f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:38.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.122+0000 7f2204f3d700 1 --2- 172.21.15.45:0/1139442783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22000b32e0 0x7f22001f95a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f21f0015000 tx=0x7f21f0004a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:38.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.123+0000 7f21fd7fa700 1 -- 172.21.15.45:0/1139442783 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f001d070 con 0x7f22000b32e0 2023-10-08T12:45:38.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.123+0000 7f21fd7fa700 1 -- 172.21.15.45:0/1139442783 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f21f0005000 con 0x7f22000b32e0 2023-10-08T12:45:38.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.123+0000 7f22071a1700 1 -- 172.21.15.45:0/1139442783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f220013c1d0 con 0x7f22000b32e0 2023-10-08T12:45:38.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.123+0000 7f22071a1700 1 -- 172.21.15.45:0/1139442783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2200142930 con 0x7f22000b32e0 2023-10-08T12:45:38.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.123+0000 7f21fd7fa700 1 -- 172.21.15.45:0/1139442783 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f00053f0 con 0x7f22000b32e0 2023-10-08T12:45:38.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.125+0000 7f22071a1700 1 -- 172.21.15.45:0/1139442783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21dc0052f0 con 0x7f22000b32e0 2023-10-08T12:45:38.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.126+0000 7f9c827fc700 1 -- 172.21.15.45:0/1530300572 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9c7c088e60 con 0x7f9c8c0a8660 2023-10-08T12:45:38.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.126+0000 7f21fd7fa700 1 -- 172.21.15.45:0/1139442783 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f21f0005550 con 0x7f22000b32e0 2023-10-08T12:45:38.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.127+0000 7f21fd7fa700 1 --2- 172.21.15.45:0/1139442783 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f21e406aed0 0x7f21e406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.127+0000 7f21fd7fa700 1 -- 172.21.15.45:0/1139442783 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21f008ac60 con 0x7f22000b32e0 2023-10-08T12:45:38.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.128+0000 7f21fffff700 1 --2- 172.21.15.45:0/1139442783 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f21e406aed0 0x7f21e406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.130+0000 7f21fd7fa700 1 -- 172.21.15.45:0/1139442783 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f21f0055ea0 con 0x7f22000b32e0 2023-10-08T12:45:38.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.127+0000 7f0606da5700 1 -- 172.21.15.45:0/651391442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06001688d0 msgr2=0x7f060016c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.127+0000 7f0606da5700 1 --2- 172.21.15.45:0/651391442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06001688d0 0x7f060016c290 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f06000721a0 tx=0x7f05f0009ba0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.127+0000 7f0606da5700 1 -- 172.21.15.45:0/651391442 shutdown_connections 2023-10-08T12:45:38.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.127+0000 7f0606da5700 1 --2- 172.21.15.45:0/651391442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06001688d0 0x7f060016c290 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.127+0000 7f0606da5700 1 --2- 172.21.15.45:0/651391442 >> v2:172.21.15.78:3300/0 conn(0x7f060016c7d0 0x7f060016cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.127+0000 7f0606da5700 1 -- 172.21.15.45:0/651391442 >> 172.21.15.45:0/651391442 conn(0x7f060006e010 msgr2=0x7f060006e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:38.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.127+0000 7f0606da5700 1 -- 172.21.15.45:0/651391442 shutdown_connections 2023-10-08T12:45:38.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.127+0000 7f0606da5700 1 -- 172.21.15.45:0/651391442 wait complete. 2023-10-08T12:45:38.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.129+0000 7f0606da5700 1 Processor -- start 2023-10-08T12:45:38.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.129+0000 7f0606da5700 1 -- start start 2023-10-08T12:45:38.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.131+0000 7f0606da5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0600070b20 0x7f06001674b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.131+0000 7f0606da5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06001688d0 0x7f06000a8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.131+0000 7f0606da5700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f060016c7d0 0x7f0600158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.131+0000 7f0606da5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06001679f0 con 0x7f06001688d0 2023-10-08T12:45:38.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.131+0000 7f0606da5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06000a7e50 con 0x7f0600070b20 2023-10-08T12:45:38.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.131+0000 7f0606da5700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0600165680 con 0x7f060016c7d0 2023-10-08T12:45:38.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.131+0000 7f0605342700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f060016c7d0 0x7f0600158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.131+0000 7f0605342700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f060016c7d0 0x7f0600158d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.45:37184/0 (socket says 172.21.15.45:37184) 2023-10-08T12:45:38.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.131+0000 7f0605342700 1 -- 172.21.15.45:0/3975945890 learned_addr learned my addr 172.21.15.45:0/3975945890 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:38.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.131+0000 7f0604b41700 1 --2- 172.21.15.45:0/3975945890 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0600070b20 0x7f06001674b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.132+0000 7f05fffff700 1 --2- 172.21.15.45:0/3975945890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06001688d0 0x7f06000a8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.132+0000 7f0605342700 1 -- 172.21.15.45:0/3975945890 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0600070b20 msgr2=0x7f06001674b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.132+0000 7f0605342700 1 --2- 172.21.15.45:0/3975945890 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0600070b20 0x7f06001674b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.132+0000 7f0605342700 1 -- 172.21.15.45:0/3975945890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06001688d0 msgr2=0x7f06000a8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.132+0000 7f0605342700 1 --2- 172.21.15.45:0/3975945890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06001688d0 0x7f06000a8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.132+0000 7f0605342700 1 -- 172.21.15.45:0/3975945890 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f0009520 con 0x7f060016c7d0 2023-10-08T12:45:38.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.132+0000 7f0605342700 1 --2- 172.21.15.45:0/3975945890 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f060016c7d0 0x7f0600158d90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f05f800cbc0 tx=0x7f05f800cf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:38.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.133+0000 7f05fd7fa700 1 -- 172.21.15.45:0/3975945890 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f8003c00 con 0x7f060016c7d0 2023-10-08T12:45:38.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.133+0000 7f05fd7fa700 1 -- 172.21.15.45:0/3975945890 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f05f8003e70 con 0x7f060016c7d0 2023-10-08T12:45:38.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.133+0000 7f05fd7fa700 1 -- 172.21.15.45:0/3975945890 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f800ab30 con 0x7f060016c7d0 2023-10-08T12:45:38.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.133+0000 7f0606da5700 1 -- 172.21.15.45:0/3975945890 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0600165960 con 0x7f060016c7d0 2023-10-08T12:45:38.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.133+0000 7f0606da5700 1 -- 172.21.15.45:0/3975945890 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06000a8fb0 con 0x7f060016c7d0 2023-10-08T12:45:38.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.134+0000 7f0606da5700 1 -- 172.21.15.45:0/3975945890 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f060004e4c0 con 0x7f060016c7d0 2023-10-08T12:45:38.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.135+0000 7f21fffff700 1 --2- 172.21.15.45:0/1139442783 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f21e406aed0 0x7f21e406d390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f21f400a7b0 tx=0x7f21f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:38.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.136+0000 7f05fd7fa700 1 -- 172.21.15.45:0/3975945890 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f05f800ac90 con 0x7f060016c7d0 2023-10-08T12:45:38.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.137+0000 7f05fd7fa700 1 --2- 172.21.15.45:0/3975945890 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f05ec06af20 0x7f05ec06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.137+0000 7f05fd7fa700 1 -- 172.21.15.45:0/3975945890 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05f808a5d0 con 0x7f060016c7d0 2023-10-08T12:45:38.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.137+0000 7f0604b41700 1 --2- 172.21.15.45:0/3975945890 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f05ec06af20 0x7f05ec06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.138+0000 7f0604b41700 1 --2- 172.21.15.45:0/3975945890 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f05ec06af20 0x7f05ec06d3e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f05f0000c00 tx=0x7f05f0012040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:38.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.145+0000 7f05fd7fa700 1 -- 172.21.15.45:0/3975945890 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f05f80557f0 con 0x7f060016c7d0 2023-10-08T12:45:38.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.179+0000 7fa2de7e3700 1 -- 172.21.15.45:0/1112498723 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa2d8141220 msgr2=0x7fa2d81416a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.179+0000 7fa2de7e3700 1 --2- 172.21.15.45:0/1112498723 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa2d8141220 0x7fa2d81416a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0005fd0 tx=0x7fa2d0009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:38.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.179+0000 7fa2de7e3700 1 -- 172.21.15.45:0/1112498723 shutdown_connections 2023-10-08T12:45:38.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.179+0000 7fa2de7e3700 1 --2- 172.21.15.45:0/1112498723 >> v2:172.21.15.78:3300/0 conn(0x7fa2d813ec20 0x7fa2d80b3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.179+0000 7fa2de7e3700 1 --2- 172.21.15.45:0/1112498723 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa2d8141220 0x7fa2d81416a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.179+0000 7fa2de7e3700 1 -- 172.21.15.45:0/1112498723 >> 172.21.15.45:0/1112498723 conn(0x7fa2d806e010 msgr2=0x7fa2d806e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:38.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.179+0000 7fa2de7e3700 1 -- 172.21.15.45:0/1112498723 shutdown_connections 2023-10-08T12:45:38.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.179+0000 7fa2de7e3700 1 -- 172.21.15.45:0/1112498723 wait complete. 2023-10-08T12:45:38.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.181+0000 7fa2de7e3700 1 Processor -- start 2023-10-08T12:45:38.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.183+0000 7f8a6adb9700 1 -- 172.21.15.45:0/3971314166 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8a64141220 msgr2=0x7f8a64141600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.183+0000 7f8a6adb9700 1 --2- 172.21.15.45:0/3971314166 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8a64141220 0x7f8a64141600 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8a500098c0 tx=0x7f8a50009bd0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.183+0000 7f8a6adb9700 1 -- 172.21.15.45:0/3971314166 shutdown_connections 2023-10-08T12:45:38.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.183+0000 7f8a6adb9700 1 --2- 172.21.15.45:0/3971314166 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8a64141220 0x7f8a64141600 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8a500098c0 tx=0x7f8a50009bd0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.183+0000 7f8a6adb9700 1 --2- 172.21.15.45:0/3971314166 >> v2:172.21.15.78:3300/0 conn(0x7f8a640b32e0 0x7f8a6415c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.183+0000 7f8a6adb9700 1 -- 172.21.15.45:0/3971314166 >> 172.21.15.45:0/3971314166 conn(0x7f8a6406e010 msgr2=0x7f8a6406e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:38.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.181+0000 7fa2de7e3700 1 -- start start 2023-10-08T12:45:38.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.183+0000 7fa2de7e3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2d813ec20 0x7fa2d8201b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.183+0000 7fa2de7e3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa2d8141220 0x7fa2d81f17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.183+0000 7fa2de7e3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2d815c040 0x7fa2d81f1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.183+0000 7fa2de7e3700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d81ff000 con 0x7fa2d813ec20 2023-10-08T12:45:38.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.183+0000 7fa2de7e3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d81ff2e0 con 0x7fa2d815c040 2023-10-08T12:45:38.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.183+0000 7fa2de7e3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d81ff5c0 con 0x7fa2d8141220 2023-10-08T12:45:38.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.183+0000 7fa2d77fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa2d8141220 0x7fa2d81f17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.183+0000 7fa2d7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2d813ec20 0x7fa2d8201b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.183+0000 7fa2d7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2d813ec20 0x7fa2d8201b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35362/0 (socket says 172.21.15.45:35362) 2023-10-08T12:45:38.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.183+0000 7fa2d7fff700 1 -- 172.21.15.45:0/978186357 learned_addr learned my addr 172.21.15.45:0/978186357 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:38.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.183+0000 7fa2dcd80700 1 --2- 172.21.15.45:0/978186357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2d815c040 0x7fa2d81f1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.184+0000 7fa2d7fff700 1 -- 172.21.15.45:0/978186357 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa2d8141220 msgr2=0x7fa2d81f17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.184+0000 7fa2d7fff700 1 --2- 172.21.15.45:0/978186357 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa2d8141220 0x7fa2d81f17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.184+0000 7fa2d7fff700 1 -- 172.21.15.45:0/978186357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2d815c040 msgr2=0x7fa2d81f1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.184+0000 7fa2d7fff700 1 --2- 172.21.15.45:0/978186357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2d815c040 0x7fa2d81f1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.184+0000 7fa2d7fff700 1 -- 172.21.15.45:0/978186357 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d00095f0 con 0x7fa2d813ec20 2023-10-08T12:45:38.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.184+0000 7fa2d7fff700 1 --2- 172.21.15.45:0/978186357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2d813ec20 0x7fa2d8201b80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc00b530 tx=0x7fa2cc00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:38.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.185+0000 7fa2d4ff9700 1 -- 172.21.15.45:0/978186357 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc011830 con 0x7fa2d813ec20 2023-10-08T12:45:38.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.185+0000 7fa2d4ff9700 1 -- 172.21.15.45:0/978186357 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa2cc011a80 con 0x7fa2d813ec20 2023-10-08T12:45:38.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.185+0000 7fa2d4ff9700 1 -- 172.21.15.45:0/978186357 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc011e90 con 0x7fa2d813ec20 2023-10-08T12:45:38.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.185+0000 7fa2de7e3700 1 -- 172.21.15.45:0/978186357 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d80b3930 con 0x7fa2d813ec20 2023-10-08T12:45:38.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.185+0000 7fa2de7e3700 1 -- 172.21.15.45:0/978186357 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d81fec80 con 0x7fa2d813ec20 2023-10-08T12:45:38.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.186+0000 7f4ac4642700 1 -- 172.21.15.45:0/3924540323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4abc141220 msgr2=0x7f4abc141600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.186+0000 7f4ac4642700 1 --2- 172.21.15.45:0/3924540323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4abc141220 0x7f4abc141600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4ab80098c0 tx=0x7f4ab8009bd0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.187+0000 7fa2de7e3700 1 -- 172.21.15.45:0/978186357 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d81ff140 con 0x7fa2d813ec20 2023-10-08T12:45:38.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.187+0000 7f4ac4642700 1 -- 172.21.15.45:0/3924540323 shutdown_connections 2023-10-08T12:45:38.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.187+0000 7f4ac4642700 1 --2- 172.21.15.45:0/3924540323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4abc141220 0x7f4abc141600 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.187+0000 7f4ac4642700 1 --2- 172.21.15.45:0/3924540323 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4abc0b32e0 0x7f4abc15c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.187+0000 7f4ac4642700 1 -- 172.21.15.45:0/3924540323 >> 172.21.15.45:0/3924540323 conn(0x7f4abc06e010 msgr2=0x7f4abc06e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:38.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.187+0000 7f8a6adb9700 1 -- 172.21.15.45:0/3971314166 shutdown_connections 2023-10-08T12:45:38.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.187+0000 7f8a6adb9700 1 -- 172.21.15.45:0/3971314166 wait complete. 2023-10-08T12:45:38.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.188+0000 7fa2d4ff9700 1 -- 172.21.15.45:0/978186357 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa2cc024440 con 0x7fa2d813ec20 2023-10-08T12:45:38.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.188+0000 7fa2d4ff9700 1 --2- 172.21.15.45:0/978186357 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa2c406af20 0x7fa2c406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.189+0000 7fa2d4ff9700 1 -- 172.21.15.45:0/978186357 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa2cc089ab0 con 0x7fa2d813ec20 2023-10-08T12:45:38.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.189+0000 7fa2d77fe700 1 --2- 172.21.15.45:0/978186357 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa2c406af20 0x7fa2c406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.189+0000 7f4ac4642700 1 -- 172.21.15.45:0/3924540323 shutdown_connections 2023-10-08T12:45:38.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.189+0000 7f8a6adb9700 1 Processor -- start 2023-10-08T12:45:38.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.189+0000 7fa2d77fe700 1 --2- 172.21.15.45:0/978186357 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa2c406af20 0x7fa2c406d3e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00098e0 tx=0x7fa2d00047c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:38.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.189+0000 7f4ac4642700 1 -- 172.21.15.45:0/3924540323 wait complete. 2023-10-08T12:45:38.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.191+0000 7f4ac4642700 1 Processor -- start 2023-10-08T12:45:38.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.191+0000 7f8a6adb9700 1 -- start start 2023-10-08T12:45:38.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.193+0000 7f8a6adb9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a640b32e0 0x7f8a64155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.193+0000 7f8a6adb9700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8a6415c580 0x7f8a640a6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.193+0000 7f8a6adb9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6413a820 0x7f8a640a6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.193+0000 7f8a6adb9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a641562a0 con 0x7f8a640b32e0 2023-10-08T12:45:38.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.193+0000 7f8a6adb9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6413a390 con 0x7f8a6413a820 2023-10-08T12:45:38.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.193+0000 7f8a6adb9700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a64128540 con 0x7f8a6415c580 2023-10-08T12:45:38.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.193+0000 7f4ac4642700 1 -- start start 2023-10-08T12:45:38.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.194+0000 7f4ac4642700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4abc0b32e0 0x7f4abc143320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.194+0000 7f4ac4642700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4abc141220 0x7f4abc13dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.194+0000 7f4ac4642700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4abc15c580 0x7f4abc13e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.194+0000 7f4ac4642700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc0af3e0 con 0x7f4abc0b32e0 2023-10-08T12:45:38.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.194+0000 7f4ac4642700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc143b70 con 0x7f4abc15c580 2023-10-08T12:45:38.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.194+0000 7f4ac4642700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc0aeab0 con 0x7f4abc141220 2023-10-08T12:45:38.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.193+0000 7f8a69356700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6413a820 0x7f8a640a6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.193+0000 7f8a69356700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6413a820 0x7f8a640a6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.45:46826/0 (socket says 172.21.15.45:46826) 2023-10-08T12:45:38.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.193+0000 7f8a69356700 1 -- 172.21.15.45:0/1918319425 learned_addr learned my addr 172.21.15.45:0/1918319425 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:38.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.193+0000 7f8a69356700 1 -- 172.21.15.45:0/1918319425 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8a6415c580 msgr2=0x7f8a640a6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.193+0000 7f8a69356700 1 --2- 172.21.15.45:0/1918319425 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8a6415c580 0x7f8a640a6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.193+0000 7f8a69356700 1 -- 172.21.15.45:0/1918319425 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a640b32e0 msgr2=0x7f8a64155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.193+0000 7f8a69356700 1 --2- 172.21.15.45:0/1918319425 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a640b32e0 0x7f8a64155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.193+0000 7f8a69356700 1 -- 172.21.15.45:0/1918319425 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a50009520 con 0x7f8a6413a820 2023-10-08T12:45:38.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.194+0000 7f8a69356700 1 --2- 172.21.15.45:0/1918319425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6413a820 0x7f8a640a6c60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c00cae0 tx=0x7f8a5c00cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:38.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.194+0000 7f8a617fa700 1 -- 172.21.15.45:0/1918319425 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c003c00 con 0x7f8a6413a820 2023-10-08T12:45:38.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.194+0000 7f8a617fa700 1 -- 172.21.15.45:0/1918319425 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8a5c003e50 con 0x7f8a6413a820 2023-10-08T12:45:38.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.194+0000 7f8a617fa700 1 -- 172.21.15.45:0/1918319425 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c00aaa0 con 0x7f8a6413a820 2023-10-08T12:45:38.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.195+0000 7f4ac2bdf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4abc15c580 0x7f4abc13e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.195+0000 7f4ac2bdf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4abc15c580 0x7f4abc13e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.45:46832/0 (socket says 172.21.15.45:46832) 2023-10-08T12:45:38.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.195+0000 7f4ac2bdf700 1 -- 172.21.15.45:0/3307953294 learned_addr learned my addr 172.21.15.45:0/3307953294 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:38.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.195+0000 7f4ac1bdd700 1 --2- 172.21.15.45:0/3307953294 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4abc141220 0x7f4abc13dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.195+0000 7f4ac2bdf700 1 -- 172.21.15.45:0/3307953294 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4abc141220 msgr2=0x7f4abc13dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.195+0000 7f4ac2bdf700 1 --2- 172.21.15.45:0/3307953294 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4abc141220 0x7f4abc13dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.195+0000 7f4ac2bdf700 1 -- 172.21.15.45:0/3307953294 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4abc0b32e0 msgr2=0x7f4abc143320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.195+0000 7f4ac2bdf700 1 --2- 172.21.15.45:0/3307953294 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4abc0b32e0 0x7f4abc143320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.195+0000 7f4ac2bdf700 1 -- 172.21.15.45:0/3307953294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab8009520 con 0x7f4abc15c580 2023-10-08T12:45:38.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.195+0000 7f8a6adb9700 1 -- 172.21.15.45:0/1918319425 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a64139a60 con 0x7f8a6413a820 2023-10-08T12:45:38.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.195+0000 7f8a6adb9700 1 -- 172.21.15.45:0/1918319425 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a6413a020 con 0x7f8a6413a820 2023-10-08T12:45:38.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.196+0000 7fa2d4ff9700 1 -- 172.21.15.45:0/978186357 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa2cc054d00 con 0x7fa2d813ec20 2023-10-08T12:45:38.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.198+0000 7f8a617fa700 1 -- 172.21.15.45:0/1918319425 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8a5c00ac00 con 0x7f8a6413a820 2023-10-08T12:45:38.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.198+0000 7f8a6adb9700 1 -- 172.21.15.45:0/1918319425 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a6404e4c0 con 0x7f8a6413a820 2023-10-08T12:45:38.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.198+0000 7f8a617fa700 1 --2- 172.21.15.45:0/1918319425 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f8a4806aed0 0x7f8a4806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.198+0000 7f8a617fa700 1 -- 172.21.15.45:0/1918319425 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a5c089590 con 0x7f8a6413a820 2023-10-08T12:45:38.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.198+0000 7f8a68b55700 1 --2- 172.21.15.45:0/1918319425 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f8a4806aed0 0x7f8a4806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.199+0000 7f4ac2bdf700 1 --2- 172.21.15.45:0/3307953294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4abc15c580 0x7f4abc13e140 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4ab400c810 tx=0x7f4ab400cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:38.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.200+0000 7f8a68b55700 1 --2- 172.21.15.45:0/1918319425 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f8a4806aed0 0x7f8a4806d390 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8a640b0560 tx=0x7f8a50004750 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:38.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.204+0000 7f4ab2ffd700 1 -- 172.21.15.45:0/3307953294 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4003e30 con 0x7f4abc15c580 2023-10-08T12:45:38.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.205+0000 7f8a617fa700 1 -- 172.21.15.45:0/1918319425 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8a5c054630 con 0x7f8a6413a820 2023-10-08T12:45:38.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.204+0000 7f4ab2ffd700 1 -- 172.21.15.45:0/3307953294 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4ab4005070 con 0x7f4abc15c580 2023-10-08T12:45:38.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.204+0000 7f4ac4642700 1 -- 172.21.15.45:0/3307953294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4abc0aed90 con 0x7f4abc15c580 2023-10-08T12:45:38.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.204+0000 7f4ac4642700 1 -- 172.21.15.45:0/3307953294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4abc143860 con 0x7f4abc15c580 2023-10-08T12:45:38.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.204+0000 7f4ab2ffd700 1 -- 172.21.15.45:0/3307953294 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4005480 con 0x7f4abc15c580 2023-10-08T12:45:38.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.205+0000 7f4ac4642700 1 -- 172.21.15.45:0/3307953294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa40052f0 con 0x7f4abc15c580 2023-10-08T12:45:38.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.206+0000 7f4ab2ffd700 1 -- 172.21.15.45:0/3307953294 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4ab40055e0 con 0x7f4abc15c580 2023-10-08T12:45:38.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.206+0000 7f3e454ad700 1 -- 172.21.15.45:0/1044789582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e400cd0f0 msgr2=0x7f3e4015a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.206+0000 7f3e454ad700 1 --2- 172.21.15.45:0/1044789582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e400cd0f0 0x7f3e4015a7d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3e34005fd0 tx=0x7f3e34009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:38.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.206+0000 7f3e454ad700 1 -- 172.21.15.45:0/1044789582 shutdown_connections 2023-10-08T12:45:38.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.206+0000 7f3e454ad700 1 --2- 172.21.15.45:0/1044789582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e400cd0f0 0x7f3e4015a7d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.206+0000 7f3e454ad700 1 --2- 172.21.15.45:0/1044789582 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3e400cb250 0x7f3e40158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.206+0000 7f3e454ad700 1 -- 172.21.15.45:0/1044789582 >> 172.21.15.45:0/1044789582 conn(0x7f3e4006e010 msgr2=0x7f3e4006e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:38.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.206+0000 7f4ab2ffd700 1 --2- 172.21.15.45:0/3307953294 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4aa006af20 0x7f4aa006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.207+0000 7f4ab2ffd700 1 -- 172.21.15.45:0/3307953294 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ab4089320 con 0x7f4abc15c580 2023-10-08T12:45:38.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.207+0000 7f3e454ad700 1 -- 172.21.15.45:0/1044789582 shutdown_connections 2023-10-08T12:45:38.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.207+0000 7f3e454ad700 1 -- 172.21.15.45:0/1044789582 wait complete. 2023-10-08T12:45:38.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.208+0000 7f3e454ad700 1 Processor -- start 2023-10-08T12:45:38.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.209+0000 7f4ac23de700 1 --2- 172.21.15.45:0/3307953294 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4aa006af20 0x7f4aa006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.208+0000 7f3e454ad700 1 -- start start 2023-10-08T12:45:38.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.209+0000 7f3e454ad700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e400ad060 0x7f3e401fa440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.209+0000 7f3e454ad700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3e400cb250 0x7f3e401522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.209+0000 7f3e454ad700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e400cd0f0 0x7f3e400a6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.209+0000 7f3e454ad700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e401fa980 con 0x7f3e400ad060 2023-10-08T12:45:38.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.209+0000 7f3e454ad700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e40156150 con 0x7f3e400cd0f0 2023-10-08T12:45:38.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.209+0000 7f3e454ad700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e40156430 con 0x7f3e400cb250 2023-10-08T12:45:38.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.209+0000 7f3e3effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e400ad060 0x7f3e401fa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.209+0000 7f3e3effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e400ad060 0x7f3e401fa440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35394/0 (socket says 172.21.15.45:35394) 2023-10-08T12:45:38.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.209+0000 7f3e3effd700 1 -- 172.21.15.45:0/3468870828 learned_addr learned my addr 172.21.15.45:0/3468870828 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:38.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.209+0000 7f3e3f7fe700 1 --2- 172.21.15.45:0/3468870828 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e400cd0f0 0x7f3e400a6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.210+0000 7f3e3effd700 1 -- 172.21.15.45:0/3468870828 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3e400cb250 msgr2=0x7f3e401522b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T12:45:38.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.210+0000 7f3e3effd700 1 --2- 172.21.15.45:0/3468870828 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3e400cb250 0x7f3e401522b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.210+0000 7f3e3effd700 1 -- 172.21.15.45:0/3468870828 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e400cd0f0 msgr2=0x7f3e400a6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.210+0000 7f3e3effd700 1 --2- 172.21.15.45:0/3468870828 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e400cd0f0 0x7f3e400a6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.210+0000 7f3e3effd700 1 -- 172.21.15.45:0/3468870828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e340095f0 con 0x7f3e400ad060 2023-10-08T12:45:38.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.210+0000 7f3e3effd700 1 --2- 172.21.15.45:0/3468870828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e400ad060 0x7f3e401fa440 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3e3000b530 tx=0x7f3e3000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:38.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.210+0000 7f3e277fe700 1 -- 172.21.15.45:0/3468870828 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e30011830 con 0x7f3e400ad060 2023-10-08T12:45:38.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.210+0000 7f3e277fe700 1 -- 172.21.15.45:0/3468870828 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3e30011aa0 con 0x7f3e400ad060 2023-10-08T12:45:38.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.210+0000 7f3e277fe700 1 -- 172.21.15.45:0/3468870828 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e30010380 con 0x7f3e400ad060 2023-10-08T12:45:38.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.211+0000 7f3e454ad700 1 -- 172.21.15.45:0/3468870828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e40156710 con 0x7f3e400ad060 2023-10-08T12:45:38.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.211+0000 7f3e454ad700 1 -- 172.21.15.45:0/3468870828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e40156cd0 con 0x7f3e400ad060 2023-10-08T12:45:38.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.212+0000 7f3e454ad700 1 -- 172.21.15.45:0/3468870828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e40156ef0 con 0x7f3e400ad060 2023-10-08T12:45:38.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.213+0000 7f3e277fe700 1 -- 172.21.15.45:0/3468870828 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3e300104e0 con 0x7f3e400ad060 2023-10-08T12:45:38.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.213+0000 7f3e277fe700 1 --2- 172.21.15.45:0/3468870828 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3e2c06aed0 0x7f3e2c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.213+0000 7f3e277fe700 1 -- 172.21.15.45:0/3468870828 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e30089d90 con 0x7f3e400ad060 2023-10-08T12:45:38.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.214+0000 7f4ac23de700 1 --2- 172.21.15.45:0/3307953294 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4aa006af20 0x7f4aa006d3e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8000c00 tx=0x7f4ab8004750 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:38.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.218+0000 7f4ab2ffd700 1 -- 172.21.15.45:0/3307953294 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4ab4057f40 con 0x7f4abc15c580 2023-10-08T12:45:38.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.218+0000 7f3e3e7fc700 1 --2- 172.21.15.45:0/3468870828 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3e2c06aed0 0x7f3e2c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.219+0000 7f3e3e7fc700 1 --2- 172.21.15.45:0/3468870828 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3e2c06aed0 0x7f3e2c06d390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3e380012e0 tx=0x7f3e38001710 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:38.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.226+0000 7f3e277fe700 1 -- 172.21.15.45:0/3468870828 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3e30054fb0 con 0x7f3e400ad060 2023-10-08T12:45:38.493 INFO:teuthology.orchestra.run.smithi045.stdout:55834574855 2023-10-08T12:45:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.486+0000 7fd6b9289700 1 -- 172.21.15.45:0/3291180546 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd6b415cb60 con 0x7fd6b40b32e0 2023-10-08T12:45:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.486+0000 7fd69b7fe700 1 -- 172.21.15.45:0/3291180546 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd6b415cb60 con 0x7fd6b40b32e0 2023-10-08T12:45:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.493+0000 7fd6b9289700 1 -- 172.21.15.45:0/3291180546 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd6a006afa0 msgr2=0x7fd6a006d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.493+0000 7fd6b9289700 1 --2- 172.21.15.45:0/3291180546 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd6a006afa0 0x7fd6a006d460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd6b40cc8e0 tx=0x7fd6a4009040 comp rx=0 tx=0).stop 2023-10-08T12:45:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.493+0000 7fd6b9289700 1 -- 172.21.15.45:0/3291180546 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6b40b32e0 msgr2=0x7fd6b41fe7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.493+0000 7fd6b9289700 1 --2- 172.21.15.45:0/3291180546 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6b40b32e0 0x7fd6b41fe7a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac014000 tx=0x7fd6ac006210 comp rx=0 tx=0).stop 2023-10-08T12:45:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.494+0000 7fd6b9289700 1 -- 172.21.15.45:0/3291180546 shutdown_connections 2023-10-08T12:45:38.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.494+0000 7fd6b9289700 1 --2- 172.21.15.45:0/3291180546 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd6a006afa0 0x7fd6a006d460 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.494+0000 7fd6b9289700 1 --2- 172.21.15.45:0/3291180546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6b415c750 0x7fd6b40afbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.494+0000 7fd6b9289700 1 --2- 172.21.15.45:0/3291180546 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6b40b32e0 0x7fd6b41fe7a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.494+0000 7fd6b9289700 1 --2- 172.21.15.45:0/3291180546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6b4141220 0x7fd6b40af6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.494+0000 7fd6b9289700 1 -- 172.21.15.45:0/3291180546 >> 172.21.15.45:0/3291180546 conn(0x7fd6b406e010 msgr2=0x7fd6b4070b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:38.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.494+0000 7fd6b9289700 1 -- 172.21.15.45:0/3291180546 shutdown_connections 2023-10-08T12:45:38.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.494+0000 7fd6b9289700 1 -- 172.21.15.45:0/3291180546 wait complete. 2023-10-08T12:45:38.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2023-10-08T12:45:38.514 DEBUG:teuthology.parallel:result is None 2023-10-08T12:45:38.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.524+0000 7f9c93eb2700 1 -- 172.21.15.45:0/1530300572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9c8c159ce0 con 0x7f9c8c0a8660 2023-10-08T12:45:38.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.525+0000 7f9c827fc700 1 -- 172.21.15.45:0/1530300572 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9c7c020020 con 0x7f9c8c0a8660 2023-10-08T12:45:38.526 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2023-10-08T12:45:38.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.529+0000 7f9c93eb2700 1 -- 172.21.15.45:0/1530300572 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f9c7006afa0 msgr2=0x7f9c7006d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.529+0000 7f9c93eb2700 1 --2- 172.21.15.45:0/1530300572 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f9c7006afa0 0x7f9c7006d460 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800c280 tx=0x7f9c8800f000 comp rx=0 tx=0).stop 2023-10-08T12:45:38.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.529+0000 7f9c93eb2700 1 -- 172.21.15.45:0/1530300572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c8c0a8660 msgr2=0x7f9c8c156080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.529+0000 7f9c93eb2700 1 --2- 172.21.15.45:0/1530300572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c8c0a8660 0x7f9c8c156080 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c0cd620 tx=0x7f9c7c009720 comp rx=0 tx=0).stop 2023-10-08T12:45:38.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.530+0000 7f9c93eb2700 1 -- 172.21.15.45:0/1530300572 shutdown_connections 2023-10-08T12:45:38.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.530+0000 7f9c93eb2700 1 --2- 172.21.15.45:0/1530300572 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f9c7006afa0 0x7f9c7006d460 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.530+0000 7f9c93eb2700 1 --2- 172.21.15.45:0/1530300572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c8c0a8660 0x7f9c8c156080 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.530+0000 7f9c93eb2700 1 --2- 172.21.15.45:0/1530300572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c8c147980 0x7f9c8c0a6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.530+0000 7f9c93eb2700 1 --2- 172.21.15.45:0/1530300572 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9c8c147d60 0x7f9c8c0a8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.530+0000 7f9c93eb2700 1 -- 172.21.15.45:0/1530300572 >> 172.21.15.45:0/1530300572 conn(0x7f9c8c06a210 msgr2=0x7f9c8c0cc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:38.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.534+0000 7f9c93eb2700 1 -- 172.21.15.45:0/1530300572 shutdown_connections 2023-10-08T12:45:38.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.534+0000 7f9c93eb2700 1 -- 172.21.15.45:0/1530300572 wait complete. 2023-10-08T12:45:38.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-10-08T12:45:38.553 DEBUG:teuthology.parallel:result is None 2023-10-08T12:45:38.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.560+0000 7f22071a1700 1 -- 172.21.15.45:0/1139442783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f21dc005160 con 0x7f22000b32e0 2023-10-08T12:45:38.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.561+0000 7f21fd7fa700 1 -- 172.21.15.45:0/1139442783 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f21f0027020 con 0x7f22000b32e0 2023-10-08T12:45:38.561 INFO:teuthology.orchestra.run.smithi045.stdout:55834574855 2023-10-08T12:45:38.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.563+0000 7f0606da5700 1 -- 172.21.15.45:0/3975945890 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f06000b3270 con 0x7f060016c7d0 2023-10-08T12:45:38.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.563+0000 7f05fd7fa700 1 -- 172.21.15.45:0/3975945890 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f05f8058e10 con 0x7f060016c7d0 2023-10-08T12:45:38.564 INFO:teuthology.orchestra.run.smithi045.stdout:55834574855 2023-10-08T12:45:38.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.564+0000 7f22071a1700 1 -- 172.21.15.45:0/1139442783 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f21e406aed0 msgr2=0x7f21e406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.564+0000 7f22071a1700 1 --2- 172.21.15.45:0/1139442783 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f21e406aed0 0x7f21e406d390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f21f400a7b0 tx=0x7f21f4008040 comp rx=0 tx=0).stop 2023-10-08T12:45:38.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.564+0000 7f22071a1700 1 -- 172.21.15.45:0/1139442783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22000b32e0 msgr2=0x7f22001f95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.564+0000 7f22071a1700 1 --2- 172.21.15.45:0/1139442783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22000b32e0 0x7f22001f95a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f21f0015000 tx=0x7f21f0004a60 comp rx=0 tx=0).stop 2023-10-08T12:45:38.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.566+0000 7f22071a1700 1 -- 172.21.15.45:0/1139442783 shutdown_connections 2023-10-08T12:45:38.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.566+0000 7f22071a1700 1 --2- 172.21.15.45:0/1139442783 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f21e406aed0 0x7f21e406d390 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.566+0000 7f22071a1700 1 --2- 172.21.15.45:0/1139442783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f220015c580 0x7f22001f6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.566+0000 7f22071a1700 1 --2- 172.21.15.45:0/1139442783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22000b32e0 0x7f22001f95a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.566+0000 7f22071a1700 1 --2- 172.21.15.45:0/1139442783 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2200141220 0x7f22000aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.566+0000 7f22071a1700 1 -- 172.21.15.45:0/1139442783 >> 172.21.15.45:0/1139442783 conn(0x7f220006e010 msgr2=0x7f220006e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:38.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.566+0000 7f22071a1700 1 -- 172.21.15.45:0/1139442783 shutdown_connections 2023-10-08T12:45:38.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.566+0000 7f22071a1700 1 -- 172.21.15.45:0/1139442783 wait complete. 2023-10-08T12:45:38.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.567+0000 7f0606da5700 1 -- 172.21.15.45:0/3975945890 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f05ec06af20 msgr2=0x7f05ec06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.567+0000 7f0606da5700 1 --2- 172.21.15.45:0/3975945890 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f05ec06af20 0x7f05ec06d3e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f05f0000c00 tx=0x7f05f0012040 comp rx=0 tx=0).stop 2023-10-08T12:45:38.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.567+0000 7f0606da5700 1 -- 172.21.15.45:0/3975945890 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f060016c7d0 msgr2=0x7f0600158d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.567+0000 7f0606da5700 1 --2- 172.21.15.45:0/3975945890 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f060016c7d0 0x7f0600158d90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f05f800cbc0 tx=0x7f05f800cf80 comp rx=0 tx=0).stop 2023-10-08T12:45:38.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.567+0000 7f0606da5700 1 -- 172.21.15.45:0/3975945890 shutdown_connections 2023-10-08T12:45:38.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.567+0000 7f0606da5700 1 --2- 172.21.15.45:0/3975945890 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f05ec06af20 0x7f05ec06d3e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.567+0000 7f0606da5700 1 --2- 172.21.15.45:0/3975945890 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f060016c7d0 0x7f0600158d90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.567+0000 7f0606da5700 1 --2- 172.21.15.45:0/3975945890 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0600070b20 0x7f06001674b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.567+0000 7f0606da5700 1 --2- 172.21.15.45:0/3975945890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06001688d0 0x7f06000a8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.567+0000 7f0606da5700 1 -- 172.21.15.45:0/3975945890 >> 172.21.15.45:0/3975945890 conn(0x7f060006e010 msgr2=0x7f0600164060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:38.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.567+0000 7f0606da5700 1 -- 172.21.15.45:0/3975945890 shutdown_connections 2023-10-08T12:45:38.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.567+0000 7f0606da5700 1 -- 172.21.15.45:0/3975945890 wait complete. 2023-10-08T12:45:38.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.580+0000 7fa2de7e3700 1 -- 172.21.15.45:0/978186357 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa2d81ff140 con 0x7fa2d813ec20 2023-10-08T12:45:38.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.580+0000 7fa2d4ff9700 1 -- 172.21.15.45:0/978186357 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa2d81ff140 con 0x7fa2d813ec20 2023-10-08T12:45:38.581 INFO:teuthology.orchestra.run.smithi045.stdout:55834574855 2023-10-08T12:45:38.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.584+0000 7fa2de7e3700 1 -- 172.21.15.45:0/978186357 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa2c406af20 msgr2=0x7fa2c406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.584+0000 7fa2de7e3700 1 --2- 172.21.15.45:0/978186357 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa2c406af20 0x7fa2c406d3e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00098e0 tx=0x7fa2d00047c0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.584+0000 7fa2de7e3700 1 -- 172.21.15.45:0/978186357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2d813ec20 msgr2=0x7fa2d8201b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.584+0000 7fa2de7e3700 1 --2- 172.21.15.45:0/978186357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2d813ec20 0x7fa2d8201b80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc00b530 tx=0x7fa2cc00b840 comp rx=0 tx=0).stop 2023-10-08T12:45:38.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.584+0000 7fa2de7e3700 1 -- 172.21.15.45:0/978186357 shutdown_connections 2023-10-08T12:45:38.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.584+0000 7fa2de7e3700 1 --2- 172.21.15.45:0/978186357 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa2c406af20 0x7fa2c406d3e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.584+0000 7fa2de7e3700 1 --2- 172.21.15.45:0/978186357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2d815c040 0x7fa2d81f1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.584+0000 7fa2de7e3700 1 --2- 172.21.15.45:0/978186357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2d813ec20 0x7fa2d8201b80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.584+0000 7fa2de7e3700 1 --2- 172.21.15.45:0/978186357 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa2d8141220 0x7fa2d81f17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.584+0000 7fa2de7e3700 1 -- 172.21.15.45:0/978186357 >> 172.21.15.45:0/978186357 conn(0x7fa2d806e010 msgr2=0x7fa2d813cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:38.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.584+0000 7fa2de7e3700 1 -- 172.21.15.45:0/978186357 shutdown_connections 2023-10-08T12:45:38.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.584+0000 7fa2de7e3700 1 -- 172.21.15.45:0/978186357 wait complete. 2023-10-08T12:45:38.586 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2023-10-08T12:45:38.586 DEBUG:teuthology.parallel:result is None 2023-10-08T12:45:38.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2023-10-08T12:45:38.588 DEBUG:teuthology.parallel:result is None 2023-10-08T12:45:38.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.593+0000 7f3e454ad700 1 -- 172.21.15.45:0/3468870828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f3e4004e4c0 con 0x7f3e400ad060 2023-10-08T12:45:38.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.593+0000 7f3e277fe700 1 -- 172.21.15.45:0/3468870828 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3e30015090 con 0x7f3e400ad060 2023-10-08T12:45:38.594 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2023-10-08T12:45:38.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.595+0000 7f3e454ad700 1 -- 172.21.15.45:0/3468870828 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3e2c06aed0 msgr2=0x7f3e2c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.595+0000 7f3e454ad700 1 --2- 172.21.15.45:0/3468870828 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3e2c06aed0 0x7f3e2c06d390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3e380012e0 tx=0x7f3e38001710 comp rx=0 tx=0).stop 2023-10-08T12:45:38.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.595+0000 7f3e454ad700 1 -- 172.21.15.45:0/3468870828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e400ad060 msgr2=0x7f3e401fa440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.595+0000 7f3e454ad700 1 --2- 172.21.15.45:0/3468870828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e400ad060 0x7f3e401fa440 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3e3000b530 tx=0x7f3e3000b8f0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.596+0000 7f3e454ad700 1 -- 172.21.15.45:0/3468870828 shutdown_connections 2023-10-08T12:45:38.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.596+0000 7f3e454ad700 1 --2- 172.21.15.45:0/3468870828 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3e2c06aed0 0x7f3e2c06d390 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.596+0000 7f3e454ad700 1 --2- 172.21.15.45:0/3468870828 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e400cd0f0 0x7f3e400a6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.596+0000 7f3e454ad700 1 --2- 172.21.15.45:0/3468870828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e400ad060 0x7f3e401fa440 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.596+0000 7f3e454ad700 1 --2- 172.21.15.45:0/3468870828 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3e400cb250 0x7f3e401522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.596+0000 7f3e454ad700 1 -- 172.21.15.45:0/3468870828 >> 172.21.15.45:0/3468870828 conn(0x7f3e4006e010 msgr2=0x7f3e400ae790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:38.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.596+0000 7f3e454ad700 1 -- 172.21.15.45:0/3468870828 shutdown_connections 2023-10-08T12:45:38.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.596+0000 7f3e454ad700 1 -- 172.21.15.45:0/3468870828 wait complete. 2023-10-08T12:45:38.603 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2023-10-08T12:45:38.603 DEBUG:teuthology.parallel:result is None 2023-10-08T12:45:38.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.604+0000 7f8a6adb9700 1 -- 172.21.15.45:0/1918319425 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f8a6413a4d0 con 0x7f8a6413a820 2023-10-08T12:45:38.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.605+0000 7f8a617fa700 1 -- 172.21.15.45:0/1918319425 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8a5c057c50 con 0x7f8a6413a820 2023-10-08T12:45:38.605 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2023-10-08T12:45:38.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.607+0000 7f8a6adb9700 1 -- 172.21.15.45:0/1918319425 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f8a4806aed0 msgr2=0x7f8a4806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.607+0000 7f8a6adb9700 1 --2- 172.21.15.45:0/1918319425 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f8a4806aed0 0x7f8a4806d390 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8a640b0560 tx=0x7f8a50004750 comp rx=0 tx=0).stop 2023-10-08T12:45:38.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.607+0000 7f8a6adb9700 1 -- 172.21.15.45:0/1918319425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6413a820 msgr2=0x7f8a640a6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.607+0000 7f8a6adb9700 1 --2- 172.21.15.45:0/1918319425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6413a820 0x7f8a640a6c60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c00cae0 tx=0x7f8a5c00cea0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.607+0000 7f8a6adb9700 1 -- 172.21.15.45:0/1918319425 shutdown_connections 2023-10-08T12:45:38.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.607+0000 7f8a6adb9700 1 --2- 172.21.15.45:0/1918319425 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f8a4806aed0 0x7f8a4806d390 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.607+0000 7f8a6adb9700 1 --2- 172.21.15.45:0/1918319425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6413a820 0x7f8a640a6c60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.607+0000 7f8a6adb9700 1 --2- 172.21.15.45:0/1918319425 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a640b32e0 0x7f8a64155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.607+0000 7f8a6adb9700 1 --2- 172.21.15.45:0/1918319425 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8a6415c580 0x7f8a640a6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.607+0000 7f8a6adb9700 1 -- 172.21.15.45:0/1918319425 >> 172.21.15.45:0/1918319425 conn(0x7f8a6406e010 msgr2=0x7f8a640abcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:38.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.607+0000 7f8a6adb9700 1 -- 172.21.15.45:0/1918319425 shutdown_connections 2023-10-08T12:45:38.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.607+0000 7f8a6adb9700 1 -- 172.21.15.45:0/1918319425 wait complete. 2023-10-08T12:45:38.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-10-08T12:45:38.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.610+0000 7f4ac4642700 1 -- 172.21.15.45:0/3307953294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4aa4005160 con 0x7f4abc15c580 2023-10-08T12:45:38.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.610+0000 7f4ab2ffd700 1 -- 172.21.15.45:0/3307953294 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4ab4001870 con 0x7f4abc15c580 2023-10-08T12:45:38.611 DEBUG:teuthology.parallel:result is None 2023-10-08T12:45:38.611 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2023-10-08T12:45:38.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.612+0000 7f4ac4642700 1 -- 172.21.15.45:0/3307953294 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4aa006af20 msgr2=0x7f4aa006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.612+0000 7f4ac4642700 1 --2- 172.21.15.45:0/3307953294 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4aa006af20 0x7f4aa006d3e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8000c00 tx=0x7f4ab8004750 comp rx=0 tx=0).stop 2023-10-08T12:45:38.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.612+0000 7f4ac4642700 1 -- 172.21.15.45:0/3307953294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4abc15c580 msgr2=0x7f4abc13e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.612+0000 7f4ac4642700 1 --2- 172.21.15.45:0/3307953294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4abc15c580 0x7f4abc13e140 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4ab400c810 tx=0x7f4ab400cbd0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.612+0000 7f4ac4642700 1 -- 172.21.15.45:0/3307953294 shutdown_connections 2023-10-08T12:45:38.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.612+0000 7f4ac4642700 1 --2- 172.21.15.45:0/3307953294 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4aa006af20 0x7f4aa006d3e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.612+0000 7f4ac4642700 1 --2- 172.21.15.45:0/3307953294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4abc15c580 0x7f4abc13e140 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.612+0000 7f4ac4642700 1 --2- 172.21.15.45:0/3307953294 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4abc0b32e0 0x7f4abc143320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.612+0000 7f4ac4642700 1 --2- 172.21.15.45:0/3307953294 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4abc141220 0x7f4abc13dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.612+0000 7f4ac4642700 1 -- 172.21.15.45:0/3307953294 >> 172.21.15.45:0/3307953294 conn(0x7f4abc06e010 msgr2=0x7f4abc071500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:38.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.613+0000 7f4ac4642700 1 -- 172.21.15.45:0/3307953294 shutdown_connections 2023-10-08T12:45:38.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.613+0000 7f4ac4642700 1 -- 172.21.15.45:0/3307953294 wait complete. 2023-10-08T12:45:38.622 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-10-08T12:45:38.622 DEBUG:teuthology.parallel:result is None 2023-10-08T12:45:38.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-10-08T12:45:38.626 DEBUG:teuthology.parallel:result is None 2023-10-08T12:45:38.626 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-08T12:45:38.626 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T12:45:38.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.792+0000 7ff4dd145700 1 -- 172.21.15.45:0/3148588454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d815c320 msgr2=0x7ff4d8071f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.792+0000 7ff4dd145700 1 --2- 172.21.15.45:0/3148588454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d815c320 0x7ff4d8071f80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff4d80cf960 tx=0x7ff4c0009ba0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.792+0000 7ff4dd145700 1 -- 172.21.15.45:0/3148588454 shutdown_connections 2023-10-08T12:45:38.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.792+0000 7ff4dd145700 1 --2- 172.21.15.45:0/3148588454 >> v2:172.21.15.78:3300/0 conn(0x7ff4d8158950 0x7ff4d80cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.792+0000 7ff4dd145700 1 --2- 172.21.15.45:0/3148588454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d815c320 0x7ff4d8071f80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.792+0000 7ff4dd145700 1 -- 172.21.15.45:0/3148588454 >> 172.21.15.45:0/3148588454 conn(0x7ff4d80b0430 msgr2=0x7ff4d80b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:38.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.792+0000 7ff4dd145700 1 -- 172.21.15.45:0/3148588454 shutdown_connections 2023-10-08T12:45:38.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.793+0000 7ff4dd145700 1 -- 172.21.15.45:0/3148588454 wait complete. 2023-10-08T12:45:38.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.794+0000 7ff4dd145700 1 Processor -- start 2023-10-08T12:45:38.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.794+0000 7ff4dd145700 1 -- start start 2023-10-08T12:45:38.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.795+0000 7ff4dd145700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff4d80724c0 0x7ff4d81f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.795+0000 7ff4dd145700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d8158950 0x7ff4d8155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.795+0000 7ff4dd145700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4d815c320 0x7ff4d81e3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.795+0000 7ff4dd145700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d80c8540 con 0x7ff4d8158950 2023-10-08T12:45:38.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.795+0000 7ff4dd145700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d81f42d0 con 0x7ff4d815c320 2023-10-08T12:45:38.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.795+0000 7ff4dd145700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d81e4460 con 0x7ff4d80724c0 2023-10-08T12:45:38.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.795+0000 7ff4d659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d8158950 0x7ff4d8155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.795+0000 7ff4d659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d8158950 0x7ff4d8155a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35410/0 (socket says 172.21.15.45:35410) 2023-10-08T12:45:38.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.795+0000 7ff4d659c700 1 -- 172.21.15.45:0/4150168945 learned_addr learned my addr 172.21.15.45:0/4150168945 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:38.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.795+0000 7ff4d759e700 1 --2- 172.21.15.45:0/4150168945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4d815c320 0x7ff4d81e3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.795+0000 7ff4d6d9d700 1 --2- 172.21.15.45:0/4150168945 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff4d80724c0 0x7ff4d81f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.795+0000 7ff4d659c700 1 -- 172.21.15.45:0/4150168945 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff4d80724c0 msgr2=0x7ff4d81f33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.795+0000 7ff4d659c700 1 --2- 172.21.15.45:0/4150168945 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff4d80724c0 0x7ff4d81f33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.795+0000 7ff4d659c700 1 -- 172.21.15.45:0/4150168945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4d815c320 msgr2=0x7ff4d81e3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:38.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.795+0000 7ff4d659c700 1 --2- 172.21.15.45:0/4150168945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4d815c320 0x7ff4d81e3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:38.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.795+0000 7ff4d659c700 1 -- 172.21.15.45:0/4150168945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c0009520 con 0x7ff4d8158950 2023-10-08T12:45:38.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.795+0000 7ff4d659c700 1 --2- 172.21.15.45:0/4150168945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d8158950 0x7ff4d8155a20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0009810 tx=0x7ff4c0010840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:38.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.795+0000 7ff4cf7fe700 1 -- 172.21.15.45:0/4150168945 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0017400 con 0x7ff4d8158950 2023-10-08T12:45:38.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.795+0000 7ff4cf7fe700 1 -- 172.21.15.45:0/4150168945 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff4c0017670 con 0x7ff4d8158950 2023-10-08T12:45:38.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.796+0000 7ff4dd145700 1 -- 172.21.15.45:0/4150168945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d81f3a30 con 0x7ff4d8158950 2023-10-08T12:45:38.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.796+0000 7ff4cf7fe700 1 -- 172.21.15.45:0/4150168945 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0017a80 con 0x7ff4d8158950 2023-10-08T12:45:38.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.796+0000 7ff4dd145700 1 -- 172.21.15.45:0/4150168945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d81f3ff0 con 0x7ff4d8158950 2023-10-08T12:45:38.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.796+0000 7ff4dd145700 1 -- 172.21.15.45:0/4150168945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d804e4c0 con 0x7ff4d8158950 2023-10-08T12:45:38.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.797+0000 7ff4cf7fe700 1 -- 172.21.15.45:0/4150168945 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff4c0017be0 con 0x7ff4d8158950 2023-10-08T12:45:38.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.797+0000 7ff4cf7fe700 1 --2- 172.21.15.45:0/4150168945 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7ff4b806aed0 0x7ff4b806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:38.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.797+0000 7ff4cf7fe700 1 -- 172.21.15.45:0/4150168945 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4c008afc0 con 0x7ff4d8158950 2023-10-08T12:45:38.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.797+0000 7ff4d6d9d700 1 --2- 172.21.15.45:0/4150168945 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7ff4b806aed0 0x7ff4b806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:38.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.798+0000 7ff4d6d9d700 1 --2- 172.21.15.45:0/4150168945 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7ff4b806aed0 0x7ff4b806d390 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8005fd0 tx=0x7ff4c800a560 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:38.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.802+0000 7ff4cf7fe700 1 -- 172.21.15.45:0/4150168945 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff4c00bdca0 con 0x7ff4d8158950 2023-10-08T12:45:38.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:38.998+0000 7ff4dd145700 1 -- 172.21.15.45:0/4150168945 --> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff4d80ca950 con 0x7ff4b806aed0 2023-10-08T12:45:39.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.006+0000 7ff4cf7fe700 1 -- 172.21.15.45:0/4150168945 <== mgr.4105 v2:172.21.15.78:6832/3438117854 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264579 (secure 0 0 0) 0x7ff4c800a2d0 con 0x7ff4b806aed0 2023-10-08T12:45:39.009 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:39.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.008+0000 7ff4dd145700 1 -- 172.21.15.45:0/4150168945 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7ff4b806aed0 msgr2=0x7ff4b806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:39.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.008+0000 7ff4dd145700 1 --2- 172.21.15.45:0/4150168945 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7ff4b806aed0 0x7ff4b806d390 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8005fd0 tx=0x7ff4c800a560 comp rx=0 tx=0).stop 2023-10-08T12:45:39.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.008+0000 7ff4dd145700 1 -- 172.21.15.45:0/4150168945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d8158950 msgr2=0x7ff4d8155a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:39.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.008+0000 7ff4dd145700 1 --2- 172.21.15.45:0/4150168945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d8158950 0x7ff4d8155a20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0009810 tx=0x7ff4c0010840 comp rx=0 tx=0).stop 2023-10-08T12:45:39.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.008+0000 7ff4dd145700 1 -- 172.21.15.45:0/4150168945 shutdown_connections 2023-10-08T12:45:39.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.008+0000 7ff4dd145700 1 --2- 172.21.15.45:0/4150168945 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7ff4b806aed0 0x7ff4b806d390 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:39.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.008+0000 7ff4dd145700 1 --2- 172.21.15.45:0/4150168945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4d815c320 0x7ff4d81e3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:39.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.008+0000 7ff4dd145700 1 --2- 172.21.15.45:0/4150168945 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff4d80724c0 0x7ff4d81f33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:39.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.008+0000 7ff4dd145700 1 --2- 172.21.15.45:0/4150168945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d8158950 0x7ff4d8155a20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:39.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.008+0000 7ff4dd145700 1 -- 172.21.15.45:0/4150168945 >> 172.21.15.45:0/4150168945 conn(0x7ff4d80b0430 msgr2=0x7ff4d8157db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:39.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.008+0000 7ff4dd145700 1 -- 172.21.15.45:0/4150168945 shutdown_connections 2023-10-08T12:45:39.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.009+0000 7ff4dd145700 1 -- 172.21.15.45:0/4150168945 wait complete. 2023-10-08T12:45:39.013 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-08T12:45:39.021 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-08T12:45:37.130321+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219016,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755704,"statfs":{"total":773094113280,"available":772869840896,"internally_reserved":0,"allocated":2891776,"data_stored":1752740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.921502"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427435+0000","last_change":"2023-10-08T12:45:25.234814+0000","last_active":"2023-10-08T12:45:26.427435+0000","last_peered":"2023-10-08T12:45:26.427435+0000","last_clean":"2023-10-08T12:45:26.427435+0000","last_became_active":"2023-10-08T12:45:25.234312+0000","last_became_peered":"2023-10-08T12:45:25.234312+0000","last_unstale":"2023-10-08T12:45:26.427435+0000","last_undegraded":"2023-10-08T12:45:26.427435+0000","last_fullsized":"2023-10-08T12:45:26.427435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:04:40.256365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427240+0000","last_change":"2023-10-08T12:45:25.237535+0000","last_active":"2023-10-08T12:45:26.427240+0000","last_peered":"2023-10-08T12:45:26.427240+0000","last_clean":"2023-10-08T12:45:26.427240+0000","last_became_active":"2023-10-08T12:45:25.237106+0000","last_became_peered":"2023-10-08T12:45:25.237106+0000","last_unstale":"2023-10-08T12:45:26.427240+0000","last_undegraded":"2023-10-08T12:45:26.427240+0000","last_fullsized":"2023-10-08T12:45:26.427240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:04:54.376133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427308+0000","last_change":"2023-10-08T12:45:25.224344+0000","last_active":"2023-10-08T12:45:26.427308+0000","last_peered":"2023-10-08T12:45:26.427308+0000","last_clean":"2023-10-08T12:45:26.427308+0000","last_became_active":"2023-10-08T12:45:25.224047+0000","last_became_peered":"2023-10-08T12:45:25.224047+0000","last_unstale":"2023-10-08T12:45:26.427308+0000","last_undegraded":"2023-10-08T12:45:26.427308+0000","last_fullsized":"2023-10-08T12:45:26.427308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:41.055637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211657+0000","last_change":"2023-10-08T12:45:25.238941+0000","last_active":"2023-10-08T12:45:26.211657+0000","last_peered":"2023-10-08T12:45:26.211657+0000","last_clean":"2023-10-08T12:45:26.211657+0000","last_became_active":"2023-10-08T12:45:25.238025+0000","last_became_peered":"2023-10-08T12:45:25.238025+0000","last_unstale":"2023-10-08T12:45:26.211657+0000","last_undegraded":"2023-10-08T12:45:26.211657+0000","last_fullsized":"2023-10-08T12:45:26.211657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:49:50.098137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426928+0000","last_change":"2023-10-08T12:45:25.234488+0000","last_active":"2023-10-08T12:45:26.426928+0000","last_peered":"2023-10-08T12:45:26.426928+0000","last_clean":"2023-10-08T12:45:26.426928+0000","last_became_active":"2023-10-08T12:45:25.234222+0000","last_became_peered":"2023-10-08T12:45:25.234222+0000","last_unstale":"2023-10-08T12:45:26.426928+0000","last_undegraded":"2023-10-08T12:45:26.426928+0000","last_fullsized":"2023-10-08T12:45:26.426928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:15.909104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.210706+0000","last_change":"2023-10-08T12:45:25.239298+0000","last_active":"2023-10-08T12:45:26.210706+0000","last_peered":"2023-10-08T12:45:26.210706+0000","last_clean":"2023-10-08T12:45:26.210706+0000","last_became_active":"2023-10-08T12:45:25.238959+0000","last_became_peered":"2023-10-08T12:45:25.238959+0000","last_unstale":"2023-10-08T12:45:26.210706+0000","last_undegraded":"2023-10-08T12:45:26.210706+0000","last_fullsized":"2023-10-08T12:45:26.210706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:47:19.248207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426883+0000","last_change":"2023-10-08T12:45:25.237303+0000","last_active":"2023-10-08T12:45:26.426883+0000","last_peered":"2023-10-08T12:45:26.426883+0000","last_clean":"2023-10-08T12:45:26.426883+0000","last_became_active":"2023-10-08T12:45:25.237013+0000","last_became_peered":"2023-10-08T12:45:25.237013+0000","last_unstale":"2023-10-08T12:45:26.426883+0000","last_undegraded":"2023-10-08T12:45:26.426883+0000","last_fullsized":"2023-10-08T12:45:26.426883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:56:33.493223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426665+0000","last_change":"2023-10-08T12:45:25.232154+0000","last_active":"2023-10-08T12:45:26.426665+0000","last_peered":"2023-10-08T12:45:26.426665+0000","last_clean":"2023-10-08T12:45:26.426665+0000","last_became_active":"2023-10-08T12:45:25.231838+0000","last_became_peered":"2023-10-08T12:45:25.231838+0000","last_unstale":"2023-10-08T12:45:26.426665+0000","last_undegraded":"2023-10-08T12:45:26.426665+0000","last_fullsized":"2023-10-08T12:45:26.426665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:41.055637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427423+0000","last_change":"2023-10-08T12:45:25.235235+0000","last_active":"2023-10-08T12:45:26.427423+0000","last_peered":"2023-10-08T12:45:26.427423+0000","last_clean":"2023-10-08T12:45:26.427423+0000","last_became_active":"2023-10-08T12:45:25.234979+0000","last_became_peered":"2023-10-08T12:45:25.234979+0000","last_unstale":"2023-10-08T12:45:26.427423+0000","last_undegraded":"2023-10-08T12:45:26.427423+0000","last_fullsized":"2023-10-08T12:45:26.427423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:49:46.849372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427454+0000","last_change":"2023-10-08T12:45:25.231507+0000","last_active":"2023-10-08T12:45:26.427454+0000","last_peered":"2023-10-08T12:45:26.427454+0000","last_clean":"2023-10-08T12:45:26.427454+0000","last_became_active":"2023-10-08T12:45:25.231239+0000","last_became_peered":"2023-10-08T12:45:25.231239+0000","last_unstale":"2023-10-08T12:45:26.427454+0000","last_undegraded":"2023-10-08T12:45:26.427454+0000","last_fullsized":"2023-10-08T12:45:26.427454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:56:33.493223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427009+0000","last_change":"2023-10-08T12:45:25.233027+0000","last_active":"2023-10-08T12:45:26.427009+0000","last_peered":"2023-10-08T12:45:26.427009+0000","last_clean":"2023-10-08T12:45:26.427009+0000","last_became_active":"2023-10-08T12:45:25.232719+0000","last_became_peered":"2023-10-08T12:45:25.232719+0000","last_unstale":"2023-10-08T12:45:26.427009+0000","last_undegraded":"2023-10-08T12:45:26.427009+0000","last_fullsized":"2023-10-08T12:45:26.427009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:08:35.730146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211814+0000","last_change":"2023-10-08T12:45:25.233147+0000","last_active":"2023-10-08T12:45:26.211814+0000","last_peered":"2023-10-08T12:45:26.211814+0000","last_clean":"2023-10-08T12:45:26.211814+0000","last_became_active":"2023-10-08T12:45:25.232834+0000","last_became_peered":"2023-10-08T12:45:25.232834+0000","last_unstale":"2023-10-08T12:45:26.211814+0000","last_undegraded":"2023-10-08T12:45:26.211814+0000","last_fullsized":"2023-10-08T12:45:26.211814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:49:32.959621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427758+0000","last_change":"2023-10-08T12:45:25.232818+0000","last_active":"2023-10-08T12:45:26.427758+0000","last_peered":"2023-10-08T12:45:26.427758+0000","last_clean":"2023-10-08T12:45:26.427758+0000","last_became_active":"2023-10-08T12:45:25.232543+0000","last_became_peered":"2023-10-08T12:45:25.232543+0000","last_unstale":"2023-10-08T12:45:26.427758+0000","last_undegraded":"2023-10-08T12:45:26.427758+0000","last_fullsized":"2023-10-08T12:45:26.427758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:04:54.376133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427500+0000","last_change":"2023-10-08T12:45:25.220806+0000","last_active":"2023-10-08T12:45:26.427500+0000","last_peered":"2023-10-08T12:45:26.427500+0000","last_clean":"2023-10-08T12:45:26.427500+0000","last_became_active":"2023-10-08T12:45:25.220465+0000","last_became_peered":"2023-10-08T12:45:25.220465+0000","last_unstale":"2023-10-08T12:45:26.427500+0000","last_undegraded":"2023-10-08T12:45:26.427500+0000","last_fullsized":"2023-10-08T12:45:26.427500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:32:46.148901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426409+0000","last_change":"2023-10-08T12:45:25.221755+0000","last_active":"2023-10-08T12:45:26.426409+0000","last_peered":"2023-10-08T12:45:26.426409+0000","last_clean":"2023-10-08T12:45:26.426409+0000","last_became_active":"2023-10-08T12:45:25.221252+0000","last_became_peered":"2023-10-08T12:45:25.221252+0000","last_unstale":"2023-10-08T12:45:26.426409+0000","last_undegraded":"2023-10-08T12:45:26.426409+0000","last_fullsized":"2023-10-08T12:45:26.426409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:48.216433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.210444+0000","last_change":"2023-10-08T12:45:25.239140+0000","last_active":"2023-10-08T12:45:26.210444+0000","last_peered":"2023-10-08T12:45:26.210444+0000","last_clean":"2023-10-08T12:45:26.210444+0000","last_became_active":"2023-10-08T12:45:25.238448+0000","last_became_peered":"2023-10-08T12:45:25.238448+0000","last_unstale":"2023-10-08T12:45:26.210444+0000","last_undegraded":"2023-10-08T12:45:26.210444+0000","last_fullsized":"2023-10-08T12:45:26.210444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:08:35.730146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211858+0000","last_change":"2023-10-08T12:45:25.230732+0000","last_active":"2023-10-08T12:45:26.211858+0000","last_peered":"2023-10-08T12:45:26.211858+0000","last_clean":"2023-10-08T12:45:26.211858+0000","last_became_active":"2023-10-08T12:45:25.230446+0000","last_became_peered":"2023-10-08T12:45:25.230446+0000","last_unstale":"2023-10-08T12:45:26.211858+0000","last_undegraded":"2023-10-08T12:45:26.211858+0000","last_fullsized":"2023-10-08T12:45:26.211858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:49:46.849372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.209782+0000","last_change":"2023-10-08T12:45:25.233903+0000","last_active":"2023-10-08T12:45:26.209782+0000","last_peered":"2023-10-08T12:45:26.209782+0000","last_clean":"2023-10-08T12:45:26.209782+0000","last_became_active":"2023-10-08T12:45:25.233592+0000","last_became_peered":"2023-10-08T12:45:25.233592+0000","last_unstale":"2023-10-08T12:45:26.209782+0000","last_undegraded":"2023-10-08T12:45:26.209782+0000","last_fullsized":"2023-10-08T12:45:26.209782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:49:32.959621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426890+0000","last_change":"2023-10-08T12:45:25.227128+0000","last_active":"2023-10-08T12:45:26.426890+0000","last_peered":"2023-10-08T12:45:26.426890+0000","last_clean":"2023-10-08T12:45:26.426890+0000","last_became_active":"2023-10-08T12:45:25.226861+0000","last_became_peered":"2023-10-08T12:45:25.226861+0000","last_unstale":"2023-10-08T12:45:26.426890+0000","last_undegraded":"2023-10-08T12:45:26.426890+0000","last_fullsized":"2023-10-08T12:45:26.426890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:49:29.699634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.240615+0000","last_change":"2023-10-08T12:45:24.228061+0000","last_active":"2023-10-08T12:45:25.240615+0000","last_peered":"2023-10-08T12:45:25.240615+0000","last_clean":"2023-10-08T12:45:25.240615+0000","last_became_active":"2023-10-08T12:45:24.227725+0000","last_became_peered":"2023-10-08T12:45:24.227725+0000","last_unstale":"2023-10-08T12:45:25.240615+0000","last_undegraded":"2023-10-08T12:45:25.240615+0000","last_fullsized":"2023-10-08T12:45:25.240615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:23:14.697499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.428110+0000","last_change":"2023-10-08T12:45:25.233268+0000","last_active":"2023-10-08T12:45:26.428110+0000","last_peered":"2023-10-08T12:45:26.428110+0000","last_clean":"2023-10-08T12:45:26.428110+0000","last_became_active":"2023-10-08T12:45:25.232988+0000","last_became_peered":"2023-10-08T12:45:25.232988+0000","last_unstale":"2023-10-08T12:45:26.428110+0000","last_undegraded":"2023-10-08T12:45:26.428110+0000","last_fullsized":"2023-10-08T12:45:26.428110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:49:29.699634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.234965+0000","last_change":"2023-10-08T12:45:24.224322+0000","last_active":"2023-10-08T12:45:25.234965+0000","last_peered":"2023-10-08T12:45:25.234965+0000","last_clean":"2023-10-08T12:45:25.234965+0000","last_became_active":"2023-10-08T12:45:24.223973+0000","last_became_peered":"2023-10-08T12:45:24.223973+0000","last_unstale":"2023-10-08T12:45:25.234965+0000","last_undegraded":"2023-10-08T12:45:25.234965+0000","last_fullsized":"2023-10-08T12:45:25.234965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:48:34.401677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427286+0000","last_change":"2023-10-08T12:45:25.232327+0000","last_active":"2023-10-08T12:45:26.427286+0000","last_peered":"2023-10-08T12:45:26.427286+0000","last_clean":"2023-10-08T12:45:26.427286+0000","last_became_active":"2023-10-08T12:45:25.231896+0000","last_became_peered":"2023-10-08T12:45:25.231896+0000","last_unstale":"2023-10-08T12:45:26.427286+0000","last_undegraded":"2023-10-08T12:45:26.427286+0000","last_fullsized":"2023-10-08T12:45:26.427286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:48:35.406914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.234734+0000","last_change":"2023-10-08T12:45:24.228768+0000","last_active":"2023-10-08T12:45:25.234734+0000","last_peered":"2023-10-08T12:45:25.234734+0000","last_clean":"2023-10-08T12:45:25.234734+0000","last_became_active":"2023-10-08T12:45:24.228469+0000","last_became_peered":"2023-10-08T12:45:24.228469+0000","last_unstale":"2023-10-08T12:45:25.234734+0000","last_undegraded":"2023-10-08T12:45:25.234734+0000","last_fullsized":"2023-10-08T12:45:25.234734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:47.211196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211536+0000","last_change":"2023-10-08T12:45:25.233150+0000","last_active":"2023-10-08T12:45:26.211536+0000","last_peered":"2023-10-08T12:45:26.211536+0000","last_clean":"2023-10-08T12:45:26.211536+0000","last_became_active":"2023-10-08T12:45:25.231798+0000","last_became_peered":"2023-10-08T12:45:25.231798+0000","last_unstale":"2023-10-08T12:45:26.211536+0000","last_undegraded":"2023-10-08T12:45:26.211536+0000","last_fullsized":"2023-10-08T12:45:26.211536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:18:01.792375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.234600+0000","last_change":"2023-10-08T12:45:24.227667+0000","last_active":"2023-10-08T12:45:25.234600+0000","last_peered":"2023-10-08T12:45:25.234600+0000","last_clean":"2023-10-08T12:45:25.234600+0000","last_became_active":"2023-10-08T12:45:24.227346+0000","last_became_peered":"2023-10-08T12:45:24.227346+0000","last_unstale":"2023-10-08T12:45:25.234600+0000","last_undegraded":"2023-10-08T12:45:25.234600+0000","last_fullsized":"2023-10-08T12:45:25.234600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:01:09.066012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.210909+0000","last_change":"2023-10-08T12:45:25.231656+0000","last_active":"2023-10-08T12:45:26.210909+0000","last_peered":"2023-10-08T12:45:26.210909+0000","last_clean":"2023-10-08T12:45:26.210909+0000","last_became_active":"2023-10-08T12:45:25.231336+0000","last_became_peered":"2023-10-08T12:45:25.231336+0000","last_unstale":"2023-10-08T12:45:26.210909+0000","last_undegraded":"2023-10-08T12:45:26.210909+0000","last_fullsized":"2023-10-08T12:45:26.210909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:49:29.699634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.227889+0000","last_change":"2023-10-08T12:45:24.225874+0000","last_active":"2023-10-08T12:45:25.227889+0000","last_peered":"2023-10-08T12:45:25.227889+0000","last_clean":"2023-10-08T12:45:25.227889+0000","last_became_active":"2023-10-08T12:45:24.225568+0000","last_became_peered":"2023-10-08T12:45:24.225568+0000","last_unstale":"2023-10-08T12:45:25.227889+0000","last_undegraded":"2023-10-08T12:45:25.227889+0000","last_fullsized":"2023-10-08T12:45:25.227889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:44:03.829859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211248+0000","last_change":"2023-10-08T12:45:25.217589+0000","last_active":"2023-10-08T12:45:26.211248+0000","last_peered":"2023-10-08T12:45:26.211248+0000","last_clean":"2023-10-08T12:45:26.211248+0000","last_became_active":"2023-10-08T12:45:25.217318+0000","last_became_peered":"2023-10-08T12:45:25.217318+0000","last_unstale":"2023-10-08T12:45:26.211248+0000","last_undegraded":"2023-10-08T12:45:26.211248+0000","last_fullsized":"2023-10-08T12:45:26.211248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:41.446646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.233120+0000","last_change":"2023-10-08T12:45:24.221289+0000","last_active":"2023-10-08T12:45:25.233120+0000","last_peered":"2023-10-08T12:45:25.233120+0000","last_clean":"2023-10-08T12:45:25.233120+0000","last_became_active":"2023-10-08T12:45:24.220980+0000","last_became_peered":"2023-10-08T12:45:24.220980+0000","last_unstale":"2023-10-08T12:45:25.233120+0000","last_undegraded":"2023-10-08T12:45:25.233120+0000","last_fullsized":"2023-10-08T12:45:25.233120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:48:34.401677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427697+0000","last_change":"2023-10-08T12:45:25.215738+0000","last_active":"2023-10-08T12:45:26.427697+0000","last_peered":"2023-10-08T12:45:26.427697+0000","last_clean":"2023-10-08T12:45:26.427697+0000","last_became_active":"2023-10-08T12:45:25.215434+0000","last_became_peered":"2023-10-08T12:45:25.215434+0000","last_unstale":"2023-10-08T12:45:26.427697+0000","last_undegraded":"2023-10-08T12:45:26.427697+0000","last_fullsized":"2023-10-08T12:45:26.427697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:47:19.248207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.218954+0000","last_change":"2023-10-08T12:45:24.223766+0000","last_active":"2023-10-08T12:45:25.218954+0000","last_peered":"2023-10-08T12:45:25.218954+0000","last_clean":"2023-10-08T12:45:25.218954+0000","last_became_active":"2023-10-08T12:45:24.223463+0000","last_became_peered":"2023-10-08T12:45:24.223463+0000","last_unstale":"2023-10-08T12:45:25.218954+0000","last_undegraded":"2023-10-08T12:45:25.218954+0000","last_fullsized":"2023-10-08T12:45:25.218954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:38:47.162600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426854+0000","last_change":"2023-10-08T12:45:25.235554+0000","last_active":"2023-10-08T12:45:26.426854+0000","last_peered":"2023-10-08T12:45:26.426854+0000","last_clean":"2023-10-08T12:45:26.426854+0000","last_became_active":"2023-10-08T12:45:25.235272+0000","last_became_peered":"2023-10-08T12:45:25.235272+0000","last_unstale":"2023-10-08T12:45:26.426854+0000","last_undegraded":"2023-10-08T12:45:26.426854+0000","last_fullsized":"2023-10-08T12:45:26.426854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:32:46.148901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.226704+0000","last_change":"2023-10-08T12:45:24.219555+0000","last_active":"2023-10-08T12:45:25.226704+0000","last_peered":"2023-10-08T12:45:25.226704+0000","last_clean":"2023-10-08T12:45:25.226704+0000","last_became_active":"2023-10-08T12:45:24.219262+0000","last_became_peered":"2023-10-08T12:45:24.219262+0000","last_unstale":"2023-10-08T12:45:25.226704+0000","last_undegraded":"2023-10-08T12:45:25.226704+0000","last_fullsized":"2023-10-08T12:45:25.226704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:40.050400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427422+0000","last_change":"2023-10-08T12:45:25.227790+0000","last_active":"2023-10-08T12:45:26.427422+0000","last_peered":"2023-10-08T12:45:26.427422+0000","last_clean":"2023-10-08T12:45:26.427422+0000","last_became_active":"2023-10-08T12:45:25.227499+0000","last_became_peered":"2023-10-08T12:45:25.227499+0000","last_unstale":"2023-10-08T12:45:26.427422+0000","last_undegraded":"2023-10-08T12:45:26.427422+0000","last_fullsized":"2023-10-08T12:45:26.427422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:47:19.248207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.215553+0000","last_change":"2023-10-08T12:45:24.224004+0000","last_active":"2023-10-08T12:45:25.215553+0000","last_peered":"2023-10-08T12:45:25.215553+0000","last_clean":"2023-10-08T12:45:25.215553+0000","last_became_active":"2023-10-08T12:45:24.223726+0000","last_became_peered":"2023-10-08T12:45:24.223726+0000","last_unstale":"2023-10-08T12:45:25.215553+0000","last_undegraded":"2023-10-08T12:45:25.215553+0000","last_fullsized":"2023-10-08T12:45:25.215553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:15.178667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211144+0000","last_change":"2023-10-08T12:45:25.230677+0000","last_active":"2023-10-08T12:45:26.211144+0000","last_peered":"2023-10-08T12:45:26.211144+0000","last_clean":"2023-10-08T12:45:26.211144+0000","last_became_active":"2023-10-08T12:45:25.230414+0000","last_became_peered":"2023-10-08T12:45:25.230414+0000","last_unstale":"2023-10-08T12:45:26.211144+0000","last_undegraded":"2023-10-08T12:45:26.211144+0000","last_fullsized":"2023-10-08T12:45:26.211144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:32:02.258575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.227176+0000","last_change":"2023-10-08T12:45:24.226086+0000","last_active":"2023-10-08T12:45:25.227176+0000","last_peered":"2023-10-08T12:45:25.227176+0000","last_clean":"2023-10-08T12:45:25.227176+0000","last_became_active":"2023-10-08T12:45:24.225807+0000","last_became_peered":"2023-10-08T12:45:24.225807+0000","last_unstale":"2023-10-08T12:45:25.227176+0000","last_undegraded":"2023-10-08T12:45:25.227176+0000","last_fullsized":"2023-10-08T12:45:25.227176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:25.788386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427575+0000","last_change":"2023-10-08T12:45:25.233121+0000","last_active":"2023-10-08T12:45:26.427575+0000","last_peered":"2023-10-08T12:45:26.427575+0000","last_clean":"2023-10-08T12:45:26.427575+0000","last_became_active":"2023-10-08T12:45:25.232807+0000","last_became_peered":"2023-10-08T12:45:25.232807+0000","last_unstale":"2023-10-08T12:45:26.427575+0000","last_undegraded":"2023-10-08T12:45:26.427575+0000","last_fullsized":"2023-10-08T12:45:26.427575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:04:54.376133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.240194+0000","last_change":"2023-10-08T12:45:24.226329+0000","last_active":"2023-10-08T12:45:25.240194+0000","last_peered":"2023-10-08T12:45:25.240194+0000","last_clean":"2023-10-08T12:45:25.240194+0000","last_became_active":"2023-10-08T12:45:24.226056+0000","last_became_peered":"2023-10-08T12:45:24.226056+0000","last_unstale":"2023-10-08T12:45:25.240194+0000","last_undegraded":"2023-10-08T12:45:25.240194+0000","last_fullsized":"2023-10-08T12:45:25.240194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:48:34.401677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211648+0000","last_change":"2023-10-08T12:45:25.225089+0000","last_active":"2023-10-08T12:45:26.211648+0000","last_peered":"2023-10-08T12:45:26.211648+0000","last_clean":"2023-10-08T12:45:26.211648+0000","last_became_active":"2023-10-08T12:45:25.224125+0000","last_became_peered":"2023-10-08T12:45:25.224125+0000","last_unstale":"2023-10-08T12:45:26.211648+0000","last_undegraded":"2023-10-08T12:45:26.211648+0000","last_fullsized":"2023-10-08T12:45:26.211648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:16:14.249377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.243231+0000","last_change":"2023-10-08T12:45:24.222786+0000","last_active":"2023-10-08T12:45:25.243231+0000","last_peered":"2023-10-08T12:45:25.243231+0000","last_clean":"2023-10-08T12:45:25.243231+0000","last_became_active":"2023-10-08T12:45:24.222465+0000","last_became_peered":"2023-10-08T12:45:24.222465+0000","last_unstale":"2023-10-08T12:45:25.243231+0000","last_undegraded":"2023-10-08T12:45:25.243231+0000","last_fullsized":"2023-10-08T12:45:25.243231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:38:47.162600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427068+0000","last_change":"2023-10-08T12:45:25.224662+0000","last_active":"2023-10-08T12:45:26.427068+0000","last_peered":"2023-10-08T12:45:26.427068+0000","last_clean":"2023-10-08T12:45:26.427068+0000","last_became_active":"2023-10-08T12:45:25.224168+0000","last_became_peered":"2023-10-08T12:45:25.224168+0000","last_unstale":"2023-10-08T12:45:26.427068+0000","last_undegraded":"2023-10-08T12:45:26.427068+0000","last_fullsized":"2023-10-08T12:45:26.427068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:18:01.792375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.237395+0000","last_change":"2023-10-08T12:45:24.221225+0000","last_active":"2023-10-08T12:45:25.237395+0000","last_peered":"2023-10-08T12:45:25.237395+0000","last_clean":"2023-10-08T12:45:25.237395+0000","last_became_active":"2023-10-08T12:45:24.220465+0000","last_became_peered":"2023-10-08T12:45:24.220465+0000","last_unstale":"2023-10-08T12:45:25.237395+0000","last_undegraded":"2023-10-08T12:45:25.237395+0000","last_fullsized":"2023-10-08T12:45:25.237395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:40.441409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426979+0000","last_change":"2023-10-08T12:45:25.223301+0000","last_active":"2023-10-08T12:45:26.426979+0000","last_peered":"2023-10-08T12:45:26.426979+0000","last_clean":"2023-10-08T12:45:26.426979+0000","last_became_active":"2023-10-08T12:45:25.223017+0000","last_became_peered":"2023-10-08T12:45:25.223017+0000","last_unstale":"2023-10-08T12:45:26.426979+0000","last_undegraded":"2023-10-08T12:45:26.426979+0000","last_fullsized":"2023-10-08T12:45:26.426979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:38:48.167837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.227386+0000","last_change":"2023-10-08T12:45:24.223071+0000","last_active":"2023-10-08T12:45:25.227386+0000","last_peered":"2023-10-08T12:45:25.227386+0000","last_clean":"2023-10-08T12:45:25.227386+0000","last_became_active":"2023-10-08T12:45:24.222681+0000","last_became_peered":"2023-10-08T12:45:24.222681+0000","last_unstale":"2023-10-08T12:45:25.227386+0000","last_undegraded":"2023-10-08T12:45:25.227386+0000","last_fullsized":"2023-10-08T12:45:25.227386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:32:45.143664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426987+0000","last_change":"2023-10-08T12:45:25.235762+0000","last_active":"2023-10-08T12:45:26.426987+0000","last_peered":"2023-10-08T12:45:26.426987+0000","last_clean":"2023-10-08T12:45:26.426987+0000","last_became_active":"2023-10-08T12:45:25.235232+0000","last_became_peered":"2023-10-08T12:45:25.235232+0000","last_unstale":"2023-10-08T12:45:26.426987+0000","last_undegraded":"2023-10-08T12:45:26.426987+0000","last_fullsized":"2023-10-08T12:45:26.426987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:33:43.081367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.215694+0000","last_change":"2023-10-08T12:45:24.220892+0000","last_active":"2023-10-08T12:45:25.215694+0000","last_peered":"2023-10-08T12:45:25.215694+0000","last_clean":"2023-10-08T12:45:25.215694+0000","last_became_active":"2023-10-08T12:45:24.220573+0000","last_became_peered":"2023-10-08T12:45:24.220573+0000","last_unstale":"2023-10-08T12:45:25.215694+0000","last_undegraded":"2023-10-08T12:45:25.215694+0000","last_fullsized":"2023-10-08T12:45:25.215694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:40.441409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426430+0000","last_change":"2023-10-08T12:45:25.239496+0000","last_active":"2023-10-08T12:45:26.426430+0000","last_peered":"2023-10-08T12:45:26.426430+0000","last_clean":"2023-10-08T12:45:26.426430+0000","last_became_active":"2023-10-08T12:45:25.239106+0000","last_became_peered":"2023-10-08T12:45:25.239106+0000","last_unstale":"2023-10-08T12:45:26.426430+0000","last_undegraded":"2023-10-08T12:45:26.426430+0000","last_fullsized":"2023-10-08T12:45:26.426430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:48.216433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.241993+0000","last_change":"2023-10-08T12:45:24.225777+0000","last_active":"2023-10-08T12:45:25.241993+0000","last_peered":"2023-10-08T12:45:25.241993+0000","last_clean":"2023-10-08T12:45:25.241993+0000","last_became_active":"2023-10-08T12:45:24.225472+0000","last_became_peered":"2023-10-08T12:45:24.225472+0000","last_unstale":"2023-10-08T12:45:25.241993+0000","last_undegraded":"2023-10-08T12:45:25.241993+0000","last_fullsized":"2023-10-08T12:45:25.241993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:23:14.697499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427263+0000","last_change":"2023-10-08T12:45:25.235732+0000","last_active":"2023-10-08T12:45:26.427263+0000","last_peered":"2023-10-08T12:45:26.427263+0000","last_clean":"2023-10-08T12:45:26.427263+0000","last_became_active":"2023-10-08T12:45:25.235444+0000","last_became_peered":"2023-10-08T12:45:25.235444+0000","last_unstale":"2023-10-08T12:45:26.427263+0000","last_undegraded":"2023-10-08T12:45:26.427263+0000","last_fullsized":"2023-10-08T12:45:26.427263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:48.280304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.237752+0000","last_change":"2023-10-08T12:45:24.222110+0000","last_active":"2023-10-08T12:45:25.237752+0000","last_peered":"2023-10-08T12:45:25.237752+0000","last_clean":"2023-10-08T12:45:25.237752+0000","last_became_active":"2023-10-08T12:45:24.221768+0000","last_became_peered":"2023-10-08T12:45:24.221768+0000","last_unstale":"2023-10-08T12:45:25.237752+0000","last_undegraded":"2023-10-08T12:45:25.237752+0000","last_fullsized":"2023-10-08T12:45:25.237752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:23:14.697499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427029+0000","last_change":"2023-10-08T12:45:25.222582+0000","last_active":"2023-10-08T12:45:26.427029+0000","last_peered":"2023-10-08T12:45:26.427029+0000","last_clean":"2023-10-08T12:45:26.427029+0000","last_became_active":"2023-10-08T12:45:25.222312+0000","last_became_peered":"2023-10-08T12:45:25.222312+0000","last_unstale":"2023-10-08T12:45:26.427029+0000","last_undegraded":"2023-10-08T12:45:26.427029+0000","last_fullsized":"2023-10-08T12:45:26.427029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:32:02.258575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.212828+0000","last_change":"2023-10-08T12:45:24.225910+0000","last_active":"2023-10-08T12:45:25.212828+0000","last_peered":"2023-10-08T12:45:25.212828+0000","last_clean":"2023-10-08T12:45:25.212828+0000","last_became_active":"2023-10-08T12:45:24.225590+0000","last_became_peered":"2023-10-08T12:45:24.225590+0000","last_unstale":"2023-10-08T12:45:25.212828+0000","last_undegraded":"2023-10-08T12:45:25.212828+0000","last_fullsized":"2023-10-08T12:45:25.212828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:40.050400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211014+0000","last_change":"2023-10-08T12:45:25.238269+0000","last_active":"2023-10-08T12:45:26.211014+0000","last_peered":"2023-10-08T12:45:26.211014+0000","last_clean":"2023-10-08T12:45:26.211014+0000","last_became_active":"2023-10-08T12:45:25.237899+0000","last_became_peered":"2023-10-08T12:45:25.237899+0000","last_unstale":"2023-10-08T12:45:26.211014+0000","last_undegraded":"2023-10-08T12:45:26.211014+0000","last_fullsized":"2023-10-08T12:45:26.211014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:15.909104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.227253+0000","last_change":"2023-10-08T12:45:24.226194+0000","last_active":"2023-10-08T12:45:25.227253+0000","last_peered":"2023-10-08T12:45:25.227253+0000","last_clean":"2023-10-08T12:45:25.227253+0000","last_became_active":"2023-10-08T12:45:24.225901+0000","last_became_peered":"2023-10-08T12:45:24.225901+0000","last_unstale":"2023-10-08T12:45:25.227253+0000","last_undegraded":"2023-10-08T12:45:25.227253+0000","last_fullsized":"2023-10-08T12:45:25.227253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:47.211196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211763+0000","last_change":"2023-10-08T12:45:25.234627+0000","last_active":"2023-10-08T12:45:26.211763+0000","last_peered":"2023-10-08T12:45:26.211763+0000","last_clean":"2023-10-08T12:45:26.211763+0000","last_became_active":"2023-10-08T12:45:25.234323+0000","last_became_peered":"2023-10-08T12:45:25.234323+0000","last_unstale":"2023-10-08T12:45:26.211763+0000","last_undegraded":"2023-10-08T12:45:26.211763+0000","last_fullsized":"2023-10-08T12:45:26.211763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:56:56.850111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426376+0000","last_change":"2023-10-08T12:45:25.224549+0000","last_active":"2023-10-08T12:45:26.426376+0000","last_peered":"2023-10-08T12:45:26.426376+0000","last_clean":"2023-10-08T12:45:26.426376+0000","last_became_active":"2023-10-08T12:45:25.223606+0000","last_became_peered":"2023-10-08T12:45:25.223606+0000","last_unstale":"2023-10-08T12:45:26.426376+0000","last_undegraded":"2023-10-08T12:45:26.426376+0000","last_fullsized":"2023-10-08T12:45:26.426376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:26.793623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.218337+0000","last_change":"2023-10-08T12:45:24.216886+0000","last_active":"2023-10-08T12:45:25.218337+0000","last_peered":"2023-10-08T12:45:25.218337+0000","last_clean":"2023-10-08T12:45:25.218337+0000","last_became_active":"2023-10-08T12:45:24.216435+0000","last_became_peered":"2023-10-08T12:45:24.216435+0000","last_unstale":"2023-10-08T12:45:25.218337+0000","last_undegraded":"2023-10-08T12:45:25.218337+0000","last_fullsized":"2023-10-08T12:45:25.218337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:16:13.244140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427721+0000","last_change":"2023-10-08T12:45:25.234200+0000","last_active":"2023-10-08T12:45:26.427721+0000","last_peered":"2023-10-08T12:45:26.427721+0000","last_clean":"2023-10-08T12:45:26.427721+0000","last_became_active":"2023-10-08T12:45:25.233861+0000","last_became_peered":"2023-10-08T12:45:25.233861+0000","last_unstale":"2023-10-08T12:45:26.427721+0000","last_undegraded":"2023-10-08T12:45:26.427721+0000","last_fullsized":"2023-10-08T12:45:26.427721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:08:35.730146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.226650+0000","last_change":"2023-10-08T12:45:24.218750+0000","last_active":"2023-10-08T12:45:25.226650+0000","last_peered":"2023-10-08T12:45:25.226650+0000","last_clean":"2023-10-08T12:45:25.226650+0000","last_became_active":"2023-10-08T12:45:24.218402+0000","last_became_peered":"2023-10-08T12:45:24.218402+0000","last_unstale":"2023-10-08T12:45:25.226650+0000","last_undegraded":"2023-10-08T12:45:25.226650+0000","last_fullsized":"2023-10-08T12:45:25.226650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:48:34.401677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.215229+0000","last_change":"2023-10-08T12:45:21.094571+0000","last_active":"2023-10-08T12:45:25.215229+0000","last_peered":"2023-10-08T12:45:25.215229+0000","last_clean":"2023-10-08T12:45:25.215229+0000","last_became_active":"2023-10-08T12:45:21.093551+0000","last_became_peered":"2023-10-08T12:45:21.093551+0000","last_unstale":"2023-10-08T12:45:25.215229+0000","last_undegraded":"2023-10-08T12:45:25.215229+0000","last_fullsized":"2023-10-08T12:45:25.215229+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:19.842786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:19.842786+0000","last_clean_scrub_stamp":"2023-10-08T12:45:19.842786+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:25.041743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426946+0000","last_change":"2023-10-08T12:45:25.215819+0000","last_active":"2023-10-08T12:45:26.426946+0000","last_peered":"2023-10-08T12:45:26.426946+0000","last_clean":"2023-10-08T12:45:26.426946+0000","last_became_active":"2023-10-08T12:45:25.215352+0000","last_became_peered":"2023-10-08T12:45:25.215352+0000","last_unstale":"2023-10-08T12:45:26.426946+0000","last_undegraded":"2023-10-08T12:45:26.426946+0000","last_fullsized":"2023-10-08T12:45:26.426946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:26.793623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.215346+0000","last_change":"2023-10-08T12:45:24.229708+0000","last_active":"2023-10-08T12:45:25.215346+0000","last_peered":"2023-10-08T12:45:25.215346+0000","last_clean":"2023-10-08T12:45:25.215346+0000","last_became_active":"2023-10-08T12:45:24.229494+0000","last_became_peered":"2023-10-08T12:45:24.229494+0000","last_unstale":"2023-10-08T12:45:25.215346+0000","last_undegraded":"2023-10-08T12:45:25.215346+0000","last_fullsized":"2023-10-08T12:45:25.215346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:16:13.244140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.217629+0000","last_change":"2023-10-08T12:45:24.229122+0000","last_active":"2023-10-08T12:45:25.217629+0000","last_peered":"2023-10-08T12:45:25.217629+0000","last_clean":"2023-10-08T12:45:25.217629+0000","last_became_active":"2023-10-08T12:45:24.228838+0000","last_became_peered":"2023-10-08T12:45:24.228838+0000","last_unstale":"2023-10-08T12:45:25.217629+0000","last_undegraded":"2023-10-08T12:45:25.217629+0000","last_fullsized":"2023-10-08T12:45:25.217629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:25.788386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427195+0000","last_change":"2023-10-08T12:45:25.224118+0000","last_active":"2023-10-08T12:45:26.427195+0000","last_peered":"2023-10-08T12:45:26.427195+0000","last_clean":"2023-10-08T12:45:26.427195+0000","last_became_active":"2023-10-08T12:45:25.223850+0000","last_became_peered":"2023-10-08T12:45:25.223850+0000","last_unstale":"2023-10-08T12:45:26.427195+0000","last_undegraded":"2023-10-08T12:45:26.427195+0000","last_fullsized":"2023-10-08T12:45:26.427195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:08:35.730146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427043+0000","last_change":"2023-10-08T12:45:24.226993+0000","last_active":"2023-10-08T12:45:26.427043+0000","last_peered":"2023-10-08T12:45:26.427043+0000","last_clean":"2023-10-08T12:45:26.427043+0000","last_became_active":"2023-10-08T12:45:24.226721+0000","last_became_peered":"2023-10-08T12:45:24.226721+0000","last_unstale":"2023-10-08T12:45:26.427043+0000","last_undegraded":"2023-10-08T12:45:26.427043+0000","last_fullsized":"2023-10-08T12:45:26.427043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:38:47.162600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.428284+0000","last_change":"2023-10-08T12:45:25.224548+0000","last_active":"2023-10-08T12:45:26.428284+0000","last_peered":"2023-10-08T12:45:26.428284+0000","last_clean":"2023-10-08T12:45:26.428284+0000","last_became_active":"2023-10-08T12:45:25.224094+0000","last_became_peered":"2023-10-08T12:45:25.224094+0000","last_unstale":"2023-10-08T12:45:26.428284+0000","last_undegraded":"2023-10-08T12:45:26.428284+0000","last_fullsized":"2023-10-08T12:45:26.428284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:33:43.081367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.236382+0000","last_change":"2023-10-08T12:45:24.229198+0000","last_active":"2023-10-08T12:45:25.236382+0000","last_peered":"2023-10-08T12:45:25.236382+0000","last_clean":"2023-10-08T12:45:25.236382+0000","last_became_active":"2023-10-08T12:45:24.228922+0000","last_became_peered":"2023-10-08T12:45:24.228922+0000","last_unstale":"2023-10-08T12:45:25.236382+0000","last_undegraded":"2023-10-08T12:45:25.236382+0000","last_fullsized":"2023-10-08T12:45:25.236382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:23:14.697499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426950+0000","last_change":"2023-10-08T12:45:25.220801+0000","last_active":"2023-10-08T12:45:26.426950+0000","last_peered":"2023-10-08T12:45:26.426950+0000","last_clean":"2023-10-08T12:45:26.426950+0000","last_became_active":"2023-10-08T12:45:25.220473+0000","last_became_peered":"2023-10-08T12:45:25.220473+0000","last_unstale":"2023-10-08T12:45:26.426950+0000","last_undegraded":"2023-10-08T12:45:26.426950+0000","last_fullsized":"2023-10-08T12:45:26.426950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:01:10.071249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.215157+0000","last_change":"2023-10-08T12:45:24.228202+0000","last_active":"2023-10-08T12:45:25.215157+0000","last_peered":"2023-10-08T12:45:25.215157+0000","last_clean":"2023-10-08T12:45:25.215157+0000","last_became_active":"2023-10-08T12:45:24.227988+0000","last_became_peered":"2023-10-08T12:45:24.227988+0000","last_unstale":"2023-10-08T12:45:25.215157+0000","last_undegraded":"2023-10-08T12:45:25.215157+0000","last_fullsized":"2023-10-08T12:45:25.215157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:40.441409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211154+0000","last_change":"2023-10-08T12:45:25.227542+0000","last_active":"2023-10-08T12:45:26.211154+0000","last_peered":"2023-10-08T12:45:26.211154+0000","last_clean":"2023-10-08T12:45:26.211154+0000","last_became_active":"2023-10-08T12:45:25.227279+0000","last_became_peered":"2023-10-08T12:45:25.227279+0000","last_unstale":"2023-10-08T12:45:26.211154+0000","last_undegraded":"2023-10-08T12:45:26.211154+0000","last_fullsized":"2023-10-08T12:45:26.211154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:16.183904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.211960+0000","last_change":"2023-10-08T12:45:24.228028+0000","last_active":"2023-10-08T12:45:25.211960+0000","last_peered":"2023-10-08T12:45:25.211960+0000","last_clean":"2023-10-08T12:45:25.211960+0000","last_became_active":"2023-10-08T12:45:24.227739+0000","last_became_peered":"2023-10-08T12:45:24.227739+0000","last_unstale":"2023-10-08T12:45:25.211960+0000","last_undegraded":"2023-10-08T12:45:25.211960+0000","last_fullsized":"2023-10-08T12:45:25.211960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:49:31.954384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426680+0000","last_change":"2023-10-08T12:45:25.236177+0000","last_active":"2023-10-08T12:45:26.426680+0000","last_peered":"2023-10-08T12:45:26.426680+0000","last_clean":"2023-10-08T12:45:26.426680+0000","last_became_active":"2023-10-08T12:45:25.235890+0000","last_became_peered":"2023-10-08T12:45:25.235890+0000","last_unstale":"2023-10-08T12:45:26.426680+0000","last_undegraded":"2023-10-08T12:45:26.426680+0000","last_fullsized":"2023-10-08T12:45:26.426680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:26.793623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.211878+0000","last_change":"2023-10-08T12:45:24.222491+0000","last_active":"2023-10-08T12:45:25.211878+0000","last_peered":"2023-10-08T12:45:25.211878+0000","last_clean":"2023-10-08T12:45:25.211878+0000","last_became_active":"2023-10-08T12:45:24.222266+0000","last_became_peered":"2023-10-08T12:45:24.222266+0000","last_unstale":"2023-10-08T12:45:25.211878+0000","last_undegraded":"2023-10-08T12:45:25.211878+0000","last_fullsized":"2023-10-08T12:45:25.211878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:56:55.844874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427967+0000","last_change":"2023-10-08T12:45:25.234548+0000","last_active":"2023-10-08T12:45:26.427967+0000","last_peered":"2023-10-08T12:45:26.427967+0000","last_clean":"2023-10-08T12:45:26.427967+0000","last_became_active":"2023-10-08T12:45:25.234277+0000","last_became_peered":"2023-10-08T12:45:25.234277+0000","last_unstale":"2023-10-08T12:45:26.427967+0000","last_undegraded":"2023-10-08T12:45:26.427967+0000","last_fullsized":"2023-10-08T12:45:26.427967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:56:33.493223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.235588+0000","last_change":"2023-10-08T12:45:24.227674+0000","last_active":"2023-10-08T12:45:25.235588+0000","last_peered":"2023-10-08T12:45:25.235588+0000","last_clean":"2023-10-08T12:45:25.235588+0000","last_became_active":"2023-10-08T12:45:24.227376+0000","last_became_peered":"2023-10-08T12:45:24.227376+0000","last_unstale":"2023-10-08T12:45:25.235588+0000","last_undegraded":"2023-10-08T12:45:25.235588+0000","last_fullsized":"2023-10-08T12:45:25.235588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:04:53.370896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427083+0000","last_change":"2023-10-08T12:45:25.228511+0000","last_active":"2023-10-08T12:45:26.427083+0000","last_peered":"2023-10-08T12:45:26.427083+0000","last_clean":"2023-10-08T12:45:26.427083+0000","last_became_active":"2023-10-08T12:45:25.227866+0000","last_became_peered":"2023-10-08T12:45:25.227866+0000","last_unstale":"2023-10-08T12:45:26.427083+0000","last_undegraded":"2023-10-08T12:45:26.427083+0000","last_fullsized":"2023-10-08T12:45:26.427083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:04:54.376133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.218171+0000","last_change":"2023-10-08T12:45:24.215676+0000","last_active":"2023-10-08T12:45:25.218171+0000","last_peered":"2023-10-08T12:45:25.218171+0000","last_clean":"2023-10-08T12:45:25.218171+0000","last_became_active":"2023-10-08T12:45:24.215332+0000","last_became_peered":"2023-10-08T12:45:24.215332+0000","last_unstale":"2023-10-08T12:45:25.218171+0000","last_undegraded":"2023-10-08T12:45:25.218171+0000","last_fullsized":"2023-10-08T12:45:25.218171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:40.441409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427302+0000","last_change":"2023-10-08T12:45:25.235593+0000","last_active":"2023-10-08T12:45:26.427302+0000","last_peered":"2023-10-08T12:45:26.427302+0000","last_clean":"2023-10-08T12:45:26.427302+0000","last_became_active":"2023-10-08T12:45:25.234710+0000","last_became_peered":"2023-10-08T12:45:25.234710+0000","last_unstale":"2023-10-08T12:45:26.427302+0000","last_undegraded":"2023-10-08T12:45:26.427302+0000","last_fullsized":"2023-10-08T12:45:26.427302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:49:50.098137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.240294+0000","last_change":"2023-10-08T12:45:24.220654+0000","last_active":"2023-10-08T12:45:25.240294+0000","last_peered":"2023-10-08T12:45:25.240294+0000","last_clean":"2023-10-08T12:45:25.240294+0000","last_became_active":"2023-10-08T12:45:24.220367+0000","last_became_peered":"2023-10-08T12:45:24.220367+0000","last_unstale":"2023-10-08T12:45:25.240294+0000","last_undegraded":"2023-10-08T12:45:25.240294+0000","last_fullsized":"2023-10-08T12:45:25.240294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:44:03.829859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211649+0000","last_change":"2023-10-08T12:45:25.239597+0000","last_active":"2023-10-08T12:45:26.211649+0000","last_peered":"2023-10-08T12:45:26.211649+0000","last_clean":"2023-10-08T12:45:26.211649+0000","last_became_active":"2023-10-08T12:45:25.238424+0000","last_became_peered":"2023-10-08T12:45:25.238424+0000","last_unstale":"2023-10-08T12:45:26.211649+0000","last_undegraded":"2023-10-08T12:45:26.211649+0000","last_fullsized":"2023-10-08T12:45:26.211649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:48.280304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.237785+0000","last_change":"2023-10-08T12:45:24.216389+0000","last_active":"2023-10-08T12:45:25.237785+0000","last_peered":"2023-10-08T12:45:25.237785+0000","last_clean":"2023-10-08T12:45:25.237785+0000","last_became_active":"2023-10-08T12:45:24.216111+0000","last_became_peered":"2023-10-08T12:45:24.216111+0000","last_unstale":"2023-10-08T12:45:25.237785+0000","last_undegraded":"2023-10-08T12:45:25.237785+0000","last_fullsized":"2023-10-08T12:45:25.237785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:15.178667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427542+0000","last_change":"2023-10-08T12:45:25.236292+0000","last_active":"2023-10-08T12:45:26.427542+0000","last_peered":"2023-10-08T12:45:26.427542+0000","last_clean":"2023-10-08T12:45:26.427542+0000","last_became_active":"2023-10-08T12:45:25.235946+0000","last_became_peered":"2023-10-08T12:45:25.235946+0000","last_unstale":"2023-10-08T12:45:26.427542+0000","last_undegraded":"2023-10-08T12:45:26.427542+0000","last_fullsized":"2023-10-08T12:45:26.427542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:49:50.149459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426418+0000","last_change":"2023-10-08T12:45:25.239059+0000","last_active":"2023-10-08T12:45:26.426418+0000","last_peered":"2023-10-08T12:45:26.426418+0000","last_clean":"2023-10-08T12:45:26.426418+0000","last_became_active":"2023-10-08T12:45:25.238760+0000","last_became_peered":"2023-10-08T12:45:25.238760+0000","last_unstale":"2023-10-08T12:45:26.426418+0000","last_undegraded":"2023-10-08T12:45:26.426418+0000","last_fullsized":"2023-10-08T12:45:26.426418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:26.793623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.209670+0000","last_change":"2023-10-08T12:45:25.231384+0000","last_active":"2023-10-08T12:45:26.209670+0000","last_peered":"2023-10-08T12:45:26.209670+0000","last_clean":"2023-10-08T12:45:26.209670+0000","last_became_active":"2023-10-08T12:45:25.231107+0000","last_became_peered":"2023-10-08T12:45:25.231107+0000","last_unstale":"2023-10-08T12:45:26.209670+0000","last_undegraded":"2023-10-08T12:45:26.209670+0000","last_fullsized":"2023-10-08T12:45:26.209670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:56:56.850111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211086+0000","last_change":"2023-10-08T12:45:25.240154+0000","last_active":"2023-10-08T12:45:26.211086+0000","last_peered":"2023-10-08T12:45:26.211086+0000","last_clean":"2023-10-08T12:45:26.211086+0000","last_became_active":"2023-10-08T12:45:25.239707+0000","last_became_peered":"2023-10-08T12:45:25.239707+0000","last_unstale":"2023-10-08T12:45:26.211086+0000","last_undegraded":"2023-10-08T12:45:26.211086+0000","last_fullsized":"2023-10-08T12:45:26.211086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:33:43.081367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427580+0000","last_change":"2023-10-08T12:45:25.226125+0000","last_active":"2023-10-08T12:45:26.427580+0000","last_peered":"2023-10-08T12:45:26.427580+0000","last_clean":"2023-10-08T12:45:26.427580+0000","last_became_active":"2023-10-08T12:45:25.225857+0000","last_became_peered":"2023-10-08T12:45:25.225857+0000","last_unstale":"2023-10-08T12:45:26.427580+0000","last_undegraded":"2023-10-08T12:45:26.427580+0000","last_fullsized":"2023-10-08T12:45:26.427580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:08:35.730146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427934+0000","last_change":"2023-10-08T12:45:25.233903+0000","last_active":"2023-10-08T12:45:26.427934+0000","last_peered":"2023-10-08T12:45:26.427934+0000","last_clean":"2023-10-08T12:45:26.427934+0000","last_became_active":"2023-10-08T12:45:25.233623+0000","last_became_peered":"2023-10-08T12:45:25.233623+0000","last_unstale":"2023-10-08T12:45:26.427934+0000","last_undegraded":"2023-10-08T12:45:26.427934+0000","last_fullsized":"2023-10-08T12:45:26.427934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:47:19.248207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427126+0000","last_change":"2023-10-08T12:45:25.226278+0000","last_active":"2023-10-08T12:45:26.427126+0000","last_peered":"2023-10-08T12:45:26.427126+0000","last_clean":"2023-10-08T12:45:26.427126+0000","last_became_active":"2023-10-08T12:45:25.225029+0000","last_became_peered":"2023-10-08T12:45:25.225029+0000","last_unstale":"2023-10-08T12:45:26.427126+0000","last_undegraded":"2023-10-08T12:45:26.427126+0000","last_fullsized":"2023-10-08T12:45:26.427126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:32:46.148901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427244+0000","last_change":"2023-10-08T12:45:25.237094+0000","last_active":"2023-10-08T12:45:26.427244+0000","last_peered":"2023-10-08T12:45:26.427244+0000","last_clean":"2023-10-08T12:45:26.427244+0000","last_became_active":"2023-10-08T12:45:25.236619+0000","last_became_peered":"2023-10-08T12:45:25.236619+0000","last_unstale":"2023-10-08T12:45:26.427244+0000","last_undegraded":"2023-10-08T12:45:26.427244+0000","last_fullsized":"2023-10-08T12:45:26.427244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:47:19.248207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.428124+0000","last_change":"2023-10-08T12:45:25.224087+0000","last_active":"2023-10-08T12:45:26.428124+0000","last_peered":"2023-10-08T12:45:26.428124+0000","last_clean":"2023-10-08T12:45:26.428124+0000","last_became_active":"2023-10-08T12:45:25.223774+0000","last_became_peered":"2023-10-08T12:45:25.223774+0000","last_unstale":"2023-10-08T12:45:26.428124+0000","last_undegraded":"2023-10-08T12:45:26.428124+0000","last_fullsized":"2023-10-08T12:45:26.428124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:15.909104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.210640+0000","last_change":"2023-10-08T12:45:25.238966+0000","last_active":"2023-10-08T12:45:26.210640+0000","last_peered":"2023-10-08T12:45:26.210640+0000","last_clean":"2023-10-08T12:45:26.210640+0000","last_became_active":"2023-10-08T12:45:25.238579+0000","last_became_peered":"2023-10-08T12:45:25.238579+0000","last_unstale":"2023-10-08T12:45:26.210640+0000","last_undegraded":"2023-10-08T12:45:26.210640+0000","last_fullsized":"2023-10-08T12:45:26.210640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:04:54.376133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426808+0000","last_change":"2023-10-08T12:45:25.227703+0000","last_active":"2023-10-08T12:45:26.426808+0000","last_peered":"2023-10-08T12:45:26.426808+0000","last_clean":"2023-10-08T12:45:26.426808+0000","last_became_active":"2023-10-08T12:45:25.227400+0000","last_became_peered":"2023-10-08T12:45:25.227400+0000","last_unstale":"2023-10-08T12:45:26.426808+0000","last_undegraded":"2023-10-08T12:45:26.426808+0000","last_fullsized":"2023-10-08T12:45:26.426808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:48.216433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.210891+0000","last_change":"2023-10-08T12:45:25.231956+0000","last_active":"2023-10-08T12:45:26.210891+0000","last_peered":"2023-10-08T12:45:26.210891+0000","last_clean":"2023-10-08T12:45:26.210891+0000","last_became_active":"2023-10-08T12:45:25.231669+0000","last_became_peered":"2023-10-08T12:45:25.231669+0000","last_unstale":"2023-10-08T12:45:26.210891+0000","last_undegraded":"2023-10-08T12:45:26.210891+0000","last_fullsized":"2023-10-08T12:45:26.210891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:56:33.493223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427412+0000","last_change":"2023-10-08T12:45:25.228975+0000","last_active":"2023-10-08T12:45:26.427412+0000","last_peered":"2023-10-08T12:45:26.427412+0000","last_clean":"2023-10-08T12:45:26.427412+0000","last_became_active":"2023-10-08T12:45:25.224678+0000","last_became_peered":"2023-10-08T12:45:25.224678+0000","last_unstale":"2023-10-08T12:45:26.427412+0000","last_undegraded":"2023-10-08T12:45:26.427412+0000","last_fullsized":"2023-10-08T12:45:26.427412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:48.216433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426772+0000","last_change":"2023-10-08T12:45:25.234967+0000","last_active":"2023-10-08T12:45:26.426772+0000","last_peered":"2023-10-08T12:45:26.426772+0000","last_clean":"2023-10-08T12:45:26.426772+0000","last_became_active":"2023-10-08T12:45:25.234563+0000","last_became_peered":"2023-10-08T12:45:25.234563+0000","last_unstale":"2023-10-08T12:45:26.426772+0000","last_undegraded":"2023-10-08T12:45:26.426772+0000","last_fullsized":"2023-10-08T12:45:26.426772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:32:46.148901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:45:39.027 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T12:45:39.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.188+0000 7fc2e2553700 1 -- 172.21.15.45:0/2237605298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2dc0b5020 msgr2=0x7fc2dc0b54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:39.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.188+0000 7fc2e2553700 1 --2- 172.21.15.45:0/2237605298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2dc0b5020 0x7fc2dc0b54b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc2d400b0a0 tx=0x7fc2d400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:45:39.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.189+0000 7fc2e2553700 1 -- 172.21.15.45:0/2237605298 shutdown_connections 2023-10-08T12:45:39.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.189+0000 7fc2e2553700 1 --2- 172.21.15.45:0/2237605298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2dc0b5020 0x7fc2dc0b54b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:39.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.189+0000 7fc2e2553700 1 --2- 172.21.15.45:0/2237605298 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc2dc0cc990 0x7fc2dc0d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:39.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.189+0000 7fc2e2553700 1 -- 172.21.15.45:0/2237605298 >> 172.21.15.45:0/2237605298 conn(0x7fc2dc071940 msgr2=0x7fc2dc071d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:39.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.189+0000 7fc2e2553700 1 -- 172.21.15.45:0/2237605298 shutdown_connections 2023-10-08T12:45:39.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.189+0000 7fc2e2553700 1 -- 172.21.15.45:0/2237605298 wait complete. 2023-10-08T12:45:39.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.190+0000 7fc2e2553700 1 Processor -- start 2023-10-08T12:45:39.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.190+0000 7fc2e2553700 1 -- start start 2023-10-08T12:45:39.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.191+0000 7fc2e2553700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc2dc0b5020 0x7fc2dc1f1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:39.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.191+0000 7fc2e2553700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2dc0cc990 0x7fc2dc159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:39.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.191+0000 7fc2e2553700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2dc0ccd70 0x7fc2dc0a8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:39.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.191+0000 7fc2e2553700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc15b670 con 0x7fc2dc0cc990 2023-10-08T12:45:39.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.191+0000 7fc2e2553700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc15aa60 con 0x7fc2dc0ccd70 2023-10-08T12:45:39.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.191+0000 7fc2e2553700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc15ad40 con 0x7fc2dc0b5020 2023-10-08T12:45:39.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.191+0000 7fc2db7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2dc0cc990 0x7fc2dc159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:39.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.191+0000 7fc2db7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2dc0cc990 0x7fc2dc159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35424/0 (socket says 172.21.15.45:35424) 2023-10-08T12:45:39.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.191+0000 7fc2db7fe700 1 -- 172.21.15.45:0/1780145404 learned_addr learned my addr 172.21.15.45:0/1780145404 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:39.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.191+0000 7fc2dbfff700 1 --2- 172.21.15.45:0/1780145404 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc2dc0b5020 0x7fc2dc1f1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:39.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.191+0000 7fc2e0af0700 1 --2- 172.21.15.45:0/1780145404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2dc0ccd70 0x7fc2dc0a8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:39.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.191+0000 7fc2db7fe700 1 -- 172.21.15.45:0/1780145404 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc2dc0b5020 msgr2=0x7fc2dc1f1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:39.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.191+0000 7fc2db7fe700 1 --2- 172.21.15.45:0/1780145404 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc2dc0b5020 0x7fc2dc1f1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:39.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.191+0000 7fc2db7fe700 1 -- 172.21.15.45:0/1780145404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2dc0ccd70 msgr2=0x7fc2dc0a8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:39.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.191+0000 7fc2db7fe700 1 --2- 172.21.15.45:0/1780145404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2dc0ccd70 0x7fc2dc0a8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:39.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.191+0000 7fc2db7fe700 1 -- 172.21.15.45:0/1780145404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d4009d00 con 0x7fc2dc0cc990 2023-10-08T12:45:39.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.191+0000 7fc2e0af0700 1 --2- 172.21.15.45:0/1780145404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2dc0ccd70 0x7fc2dc0a8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:45:39.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.191+0000 7fc2db7fe700 1 --2- 172.21.15.45:0/1780145404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2dc0cc990 0x7fc2dc159fa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc2c400c430 tx=0x7fc2c400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:39.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.191+0000 7fc2d8ff9700 1 -- 172.21.15.45:0/1780145404 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c40052d0 con 0x7fc2dc0cc990 2023-10-08T12:45:39.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.191+0000 7fc2d8ff9700 1 -- 172.21.15.45:0/1780145404 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc2c4005540 con 0x7fc2dc0cc990 2023-10-08T12:45:39.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.191+0000 7fc2e2553700 1 -- 172.21.15.45:0/1780145404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2dc15b020 con 0x7fc2dc0cc990 2023-10-08T12:45:39.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.191+0000 7fc2d8ff9700 1 -- 172.21.15.45:0/1780145404 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4006aa0 con 0x7fc2dc0cc990 2023-10-08T12:45:39.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.192+0000 7fc2e2553700 1 -- 172.21.15.45:0/1780145404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2dc14bca0 con 0x7fc2dc0cc990 2023-10-08T12:45:39.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.192+0000 7fc2e2553700 1 -- 172.21.15.45:0/1780145404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2dc15b820 con 0x7fc2dc0cc990 2023-10-08T12:45:39.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.193+0000 7fc2d8ff9700 1 -- 172.21.15.45:0/1780145404 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc2c4003680 con 0x7fc2dc0cc990 2023-10-08T12:45:39.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.193+0000 7fc2d8ff9700 1 --2- 172.21.15.45:0/1780145404 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc2bc06aed0 0x7fc2bc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:39.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.194+0000 7fc2d8ff9700 1 -- 172.21.15.45:0/1780145404 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2c4088a40 con 0x7fc2dc0cc990 2023-10-08T12:45:39.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.194+0000 7fc2dbfff700 1 --2- 172.21.15.45:0/1780145404 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc2bc06aed0 0x7fc2bc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:39.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.194+0000 7fc2dbfff700 1 --2- 172.21.15.45:0/1780145404 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc2bc06aed0 0x7fc2bc06d390 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc009bf0 tx=0x7fc2cc009260 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:39.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.198+0000 7fc2d8ff9700 1 -- 172.21.15.45:0/1780145404 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc2dc15b820 con 0x7fc2dc0cc990 2023-10-08T12:45:39.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.397+0000 7fc2e2553700 1 -- 172.21.15.45:0/1780145404 --> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc2dc0cd1f0 con 0x7fc2bc06aed0 2023-10-08T12:45:39.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.405+0000 7fc2d8ff9700 1 -- 172.21.15.45:0/1780145404 <== mgr.4105 v2:172.21.15.78:6832/3438117854 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264579 (secure 0 0 0) 0x7fc2cc016070 con 0x7fc2bc06aed0 2023-10-08T12:45:39.408 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:39.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.408+0000 7fc2e2553700 1 -- 172.21.15.45:0/1780145404 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc2bc06aed0 msgr2=0x7fc2bc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:39.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.408+0000 7fc2e2553700 1 --2- 172.21.15.45:0/1780145404 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc2bc06aed0 0x7fc2bc06d390 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc009bf0 tx=0x7fc2cc009260 comp rx=0 tx=0).stop 2023-10-08T12:45:39.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.408+0000 7fc2e2553700 1 -- 172.21.15.45:0/1780145404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2dc0cc990 msgr2=0x7fc2dc159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:39.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.408+0000 7fc2e2553700 1 --2- 172.21.15.45:0/1780145404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2dc0cc990 0x7fc2dc159fa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc2c400c430 tx=0x7fc2c400c7f0 comp rx=0 tx=0).stop 2023-10-08T12:45:39.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.408+0000 7fc2e2553700 1 -- 172.21.15.45:0/1780145404 shutdown_connections 2023-10-08T12:45:39.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.408+0000 7fc2e2553700 1 --2- 172.21.15.45:0/1780145404 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc2bc06aed0 0x7fc2bc06d390 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:39.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.408+0000 7fc2e2553700 1 --2- 172.21.15.45:0/1780145404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2dc0ccd70 0x7fc2dc0a8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:39.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.408+0000 7fc2e2553700 1 --2- 172.21.15.45:0/1780145404 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc2dc0b5020 0x7fc2dc1f1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:39.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.408+0000 7fc2e2553700 1 --2- 172.21.15.45:0/1780145404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2dc0cc990 0x7fc2dc159fa0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:39.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.408+0000 7fc2e2553700 1 -- 172.21.15.45:0/1780145404 >> 172.21.15.45:0/1780145404 conn(0x7fc2dc071940 msgr2=0x7fc2dc0b3420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:39.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.408+0000 7fc2e2553700 1 -- 172.21.15.45:0/1780145404 shutdown_connections 2023-10-08T12:45:39.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.408+0000 7fc2e2553700 1 -- 172.21.15.45:0/1780145404 wait complete. 2023-10-08T12:45:39.412 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-08T12:45:39.421 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-08T12:45:39.130856+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219016,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755704,"statfs":{"total":773094113280,"available":772869840896,"internally_reserved":0,"allocated":2891776,"data_stored":1752740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003308"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427435+0000","last_change":"2023-10-08T12:45:25.234814+0000","last_active":"2023-10-08T12:45:26.427435+0000","last_peered":"2023-10-08T12:45:26.427435+0000","last_clean":"2023-10-08T12:45:26.427435+0000","last_became_active":"2023-10-08T12:45:25.234312+0000","last_became_peered":"2023-10-08T12:45:25.234312+0000","last_unstale":"2023-10-08T12:45:26.427435+0000","last_undegraded":"2023-10-08T12:45:26.427435+0000","last_fullsized":"2023-10-08T12:45:26.427435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:04:40.256365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427240+0000","last_change":"2023-10-08T12:45:25.237535+0000","last_active":"2023-10-08T12:45:26.427240+0000","last_peered":"2023-10-08T12:45:26.427240+0000","last_clean":"2023-10-08T12:45:26.427240+0000","last_became_active":"2023-10-08T12:45:25.237106+0000","last_became_peered":"2023-10-08T12:45:25.237106+0000","last_unstale":"2023-10-08T12:45:26.427240+0000","last_undegraded":"2023-10-08T12:45:26.427240+0000","last_fullsized":"2023-10-08T12:45:26.427240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:04:54.376133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427308+0000","last_change":"2023-10-08T12:45:25.224344+0000","last_active":"2023-10-08T12:45:26.427308+0000","last_peered":"2023-10-08T12:45:26.427308+0000","last_clean":"2023-10-08T12:45:26.427308+0000","last_became_active":"2023-10-08T12:45:25.224047+0000","last_became_peered":"2023-10-08T12:45:25.224047+0000","last_unstale":"2023-10-08T12:45:26.427308+0000","last_undegraded":"2023-10-08T12:45:26.427308+0000","last_fullsized":"2023-10-08T12:45:26.427308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:41.055637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211657+0000","last_change":"2023-10-08T12:45:25.238941+0000","last_active":"2023-10-08T12:45:26.211657+0000","last_peered":"2023-10-08T12:45:26.211657+0000","last_clean":"2023-10-08T12:45:26.211657+0000","last_became_active":"2023-10-08T12:45:25.238025+0000","last_became_peered":"2023-10-08T12:45:25.238025+0000","last_unstale":"2023-10-08T12:45:26.211657+0000","last_undegraded":"2023-10-08T12:45:26.211657+0000","last_fullsized":"2023-10-08T12:45:26.211657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:49:50.098137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426928+0000","last_change":"2023-10-08T12:45:25.234488+0000","last_active":"2023-10-08T12:45:26.426928+0000","last_peered":"2023-10-08T12:45:26.426928+0000","last_clean":"2023-10-08T12:45:26.426928+0000","last_became_active":"2023-10-08T12:45:25.234222+0000","last_became_peered":"2023-10-08T12:45:25.234222+0000","last_unstale":"2023-10-08T12:45:26.426928+0000","last_undegraded":"2023-10-08T12:45:26.426928+0000","last_fullsized":"2023-10-08T12:45:26.426928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:15.909104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.210706+0000","last_change":"2023-10-08T12:45:25.239298+0000","last_active":"2023-10-08T12:45:26.210706+0000","last_peered":"2023-10-08T12:45:26.210706+0000","last_clean":"2023-10-08T12:45:26.210706+0000","last_became_active":"2023-10-08T12:45:25.238959+0000","last_became_peered":"2023-10-08T12:45:25.238959+0000","last_unstale":"2023-10-08T12:45:26.210706+0000","last_undegraded":"2023-10-08T12:45:26.210706+0000","last_fullsized":"2023-10-08T12:45:26.210706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:47:19.248207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426883+0000","last_change":"2023-10-08T12:45:25.237303+0000","last_active":"2023-10-08T12:45:26.426883+0000","last_peered":"2023-10-08T12:45:26.426883+0000","last_clean":"2023-10-08T12:45:26.426883+0000","last_became_active":"2023-10-08T12:45:25.237013+0000","last_became_peered":"2023-10-08T12:45:25.237013+0000","last_unstale":"2023-10-08T12:45:26.426883+0000","last_undegraded":"2023-10-08T12:45:26.426883+0000","last_fullsized":"2023-10-08T12:45:26.426883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:56:33.493223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426665+0000","last_change":"2023-10-08T12:45:25.232154+0000","last_active":"2023-10-08T12:45:26.426665+0000","last_peered":"2023-10-08T12:45:26.426665+0000","last_clean":"2023-10-08T12:45:26.426665+0000","last_became_active":"2023-10-08T12:45:25.231838+0000","last_became_peered":"2023-10-08T12:45:25.231838+0000","last_unstale":"2023-10-08T12:45:26.426665+0000","last_undegraded":"2023-10-08T12:45:26.426665+0000","last_fullsized":"2023-10-08T12:45:26.426665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:41.055637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427423+0000","last_change":"2023-10-08T12:45:25.235235+0000","last_active":"2023-10-08T12:45:26.427423+0000","last_peered":"2023-10-08T12:45:26.427423+0000","last_clean":"2023-10-08T12:45:26.427423+0000","last_became_active":"2023-10-08T12:45:25.234979+0000","last_became_peered":"2023-10-08T12:45:25.234979+0000","last_unstale":"2023-10-08T12:45:26.427423+0000","last_undegraded":"2023-10-08T12:45:26.427423+0000","last_fullsized":"2023-10-08T12:45:26.427423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:49:46.849372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427454+0000","last_change":"2023-10-08T12:45:25.231507+0000","last_active":"2023-10-08T12:45:26.427454+0000","last_peered":"2023-10-08T12:45:26.427454+0000","last_clean":"2023-10-08T12:45:26.427454+0000","last_became_active":"2023-10-08T12:45:25.231239+0000","last_became_peered":"2023-10-08T12:45:25.231239+0000","last_unstale":"2023-10-08T12:45:26.427454+0000","last_undegraded":"2023-10-08T12:45:26.427454+0000","last_fullsized":"2023-10-08T12:45:26.427454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:56:33.493223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427009+0000","last_change":"2023-10-08T12:45:25.233027+0000","last_active":"2023-10-08T12:45:26.427009+0000","last_peered":"2023-10-08T12:45:26.427009+0000","last_clean":"2023-10-08T12:45:26.427009+0000","last_became_active":"2023-10-08T12:45:25.232719+0000","last_became_peered":"2023-10-08T12:45:25.232719+0000","last_unstale":"2023-10-08T12:45:26.427009+0000","last_undegraded":"2023-10-08T12:45:26.427009+0000","last_fullsized":"2023-10-08T12:45:26.427009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:08:35.730146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211814+0000","last_change":"2023-10-08T12:45:25.233147+0000","last_active":"2023-10-08T12:45:26.211814+0000","last_peered":"2023-10-08T12:45:26.211814+0000","last_clean":"2023-10-08T12:45:26.211814+0000","last_became_active":"2023-10-08T12:45:25.232834+0000","last_became_peered":"2023-10-08T12:45:25.232834+0000","last_unstale":"2023-10-08T12:45:26.211814+0000","last_undegraded":"2023-10-08T12:45:26.211814+0000","last_fullsized":"2023-10-08T12:45:26.211814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:49:32.959621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427758+0000","last_change":"2023-10-08T12:45:25.232818+0000","last_active":"2023-10-08T12:45:26.427758+0000","last_peered":"2023-10-08T12:45:26.427758+0000","last_clean":"2023-10-08T12:45:26.427758+0000","last_became_active":"2023-10-08T12:45:25.232543+0000","last_became_peered":"2023-10-08T12:45:25.232543+0000","last_unstale":"2023-10-08T12:45:26.427758+0000","last_undegraded":"2023-10-08T12:45:26.427758+0000","last_fullsized":"2023-10-08T12:45:26.427758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:04:54.376133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427500+0000","last_change":"2023-10-08T12:45:25.220806+0000","last_active":"2023-10-08T12:45:26.427500+0000","last_peered":"2023-10-08T12:45:26.427500+0000","last_clean":"2023-10-08T12:45:26.427500+0000","last_became_active":"2023-10-08T12:45:25.220465+0000","last_became_peered":"2023-10-08T12:45:25.220465+0000","last_unstale":"2023-10-08T12:45:26.427500+0000","last_undegraded":"2023-10-08T12:45:26.427500+0000","last_fullsized":"2023-10-08T12:45:26.427500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:32:46.148901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426409+0000","last_change":"2023-10-08T12:45:25.221755+0000","last_active":"2023-10-08T12:45:26.426409+0000","last_peered":"2023-10-08T12:45:26.426409+0000","last_clean":"2023-10-08T12:45:26.426409+0000","last_became_active":"2023-10-08T12:45:25.221252+0000","last_became_peered":"2023-10-08T12:45:25.221252+0000","last_unstale":"2023-10-08T12:45:26.426409+0000","last_undegraded":"2023-10-08T12:45:26.426409+0000","last_fullsized":"2023-10-08T12:45:26.426409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:48.216433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.210444+0000","last_change":"2023-10-08T12:45:25.239140+0000","last_active":"2023-10-08T12:45:26.210444+0000","last_peered":"2023-10-08T12:45:26.210444+0000","last_clean":"2023-10-08T12:45:26.210444+0000","last_became_active":"2023-10-08T12:45:25.238448+0000","last_became_peered":"2023-10-08T12:45:25.238448+0000","last_unstale":"2023-10-08T12:45:26.210444+0000","last_undegraded":"2023-10-08T12:45:26.210444+0000","last_fullsized":"2023-10-08T12:45:26.210444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:08:35.730146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211858+0000","last_change":"2023-10-08T12:45:25.230732+0000","last_active":"2023-10-08T12:45:26.211858+0000","last_peered":"2023-10-08T12:45:26.211858+0000","last_clean":"2023-10-08T12:45:26.211858+0000","last_became_active":"2023-10-08T12:45:25.230446+0000","last_became_peered":"2023-10-08T12:45:25.230446+0000","last_unstale":"2023-10-08T12:45:26.211858+0000","last_undegraded":"2023-10-08T12:45:26.211858+0000","last_fullsized":"2023-10-08T12:45:26.211858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:49:46.849372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.209782+0000","last_change":"2023-10-08T12:45:25.233903+0000","last_active":"2023-10-08T12:45:26.209782+0000","last_peered":"2023-10-08T12:45:26.209782+0000","last_clean":"2023-10-08T12:45:26.209782+0000","last_became_active":"2023-10-08T12:45:25.233592+0000","last_became_peered":"2023-10-08T12:45:25.233592+0000","last_unstale":"2023-10-08T12:45:26.209782+0000","last_undegraded":"2023-10-08T12:45:26.209782+0000","last_fullsized":"2023-10-08T12:45:26.209782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:49:32.959621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426890+0000","last_change":"2023-10-08T12:45:25.227128+0000","last_active":"2023-10-08T12:45:26.426890+0000","last_peered":"2023-10-08T12:45:26.426890+0000","last_clean":"2023-10-08T12:45:26.426890+0000","last_became_active":"2023-10-08T12:45:25.226861+0000","last_became_peered":"2023-10-08T12:45:25.226861+0000","last_unstale":"2023-10-08T12:45:26.426890+0000","last_undegraded":"2023-10-08T12:45:26.426890+0000","last_fullsized":"2023-10-08T12:45:26.426890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:49:29.699634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.240615+0000","last_change":"2023-10-08T12:45:24.228061+0000","last_active":"2023-10-08T12:45:25.240615+0000","last_peered":"2023-10-08T12:45:25.240615+0000","last_clean":"2023-10-08T12:45:25.240615+0000","last_became_active":"2023-10-08T12:45:24.227725+0000","last_became_peered":"2023-10-08T12:45:24.227725+0000","last_unstale":"2023-10-08T12:45:25.240615+0000","last_undegraded":"2023-10-08T12:45:25.240615+0000","last_fullsized":"2023-10-08T12:45:25.240615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:23:14.697499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.428110+0000","last_change":"2023-10-08T12:45:25.233268+0000","last_active":"2023-10-08T12:45:26.428110+0000","last_peered":"2023-10-08T12:45:26.428110+0000","last_clean":"2023-10-08T12:45:26.428110+0000","last_became_active":"2023-10-08T12:45:25.232988+0000","last_became_peered":"2023-10-08T12:45:25.232988+0000","last_unstale":"2023-10-08T12:45:26.428110+0000","last_undegraded":"2023-10-08T12:45:26.428110+0000","last_fullsized":"2023-10-08T12:45:26.428110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:49:29.699634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.234965+0000","last_change":"2023-10-08T12:45:24.224322+0000","last_active":"2023-10-08T12:45:25.234965+0000","last_peered":"2023-10-08T12:45:25.234965+0000","last_clean":"2023-10-08T12:45:25.234965+0000","last_became_active":"2023-10-08T12:45:24.223973+0000","last_became_peered":"2023-10-08T12:45:24.223973+0000","last_unstale":"2023-10-08T12:45:25.234965+0000","last_undegraded":"2023-10-08T12:45:25.234965+0000","last_fullsized":"2023-10-08T12:45:25.234965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:48:34.401677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427286+0000","last_change":"2023-10-08T12:45:25.232327+0000","last_active":"2023-10-08T12:45:26.427286+0000","last_peered":"2023-10-08T12:45:26.427286+0000","last_clean":"2023-10-08T12:45:26.427286+0000","last_became_active":"2023-10-08T12:45:25.231896+0000","last_became_peered":"2023-10-08T12:45:25.231896+0000","last_unstale":"2023-10-08T12:45:26.427286+0000","last_undegraded":"2023-10-08T12:45:26.427286+0000","last_fullsized":"2023-10-08T12:45:26.427286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:48:35.406914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.234734+0000","last_change":"2023-10-08T12:45:24.228768+0000","last_active":"2023-10-08T12:45:25.234734+0000","last_peered":"2023-10-08T12:45:25.234734+0000","last_clean":"2023-10-08T12:45:25.234734+0000","last_became_active":"2023-10-08T12:45:24.228469+0000","last_became_peered":"2023-10-08T12:45:24.228469+0000","last_unstale":"2023-10-08T12:45:25.234734+0000","last_undegraded":"2023-10-08T12:45:25.234734+0000","last_fullsized":"2023-10-08T12:45:25.234734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:47.211196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211536+0000","last_change":"2023-10-08T12:45:25.233150+0000","last_active":"2023-10-08T12:45:26.211536+0000","last_peered":"2023-10-08T12:45:26.211536+0000","last_clean":"2023-10-08T12:45:26.211536+0000","last_became_active":"2023-10-08T12:45:25.231798+0000","last_became_peered":"2023-10-08T12:45:25.231798+0000","last_unstale":"2023-10-08T12:45:26.211536+0000","last_undegraded":"2023-10-08T12:45:26.211536+0000","last_fullsized":"2023-10-08T12:45:26.211536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:18:01.792375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.234600+0000","last_change":"2023-10-08T12:45:24.227667+0000","last_active":"2023-10-08T12:45:25.234600+0000","last_peered":"2023-10-08T12:45:25.234600+0000","last_clean":"2023-10-08T12:45:25.234600+0000","last_became_active":"2023-10-08T12:45:24.227346+0000","last_became_peered":"2023-10-08T12:45:24.227346+0000","last_unstale":"2023-10-08T12:45:25.234600+0000","last_undegraded":"2023-10-08T12:45:25.234600+0000","last_fullsized":"2023-10-08T12:45:25.234600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:01:09.066012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.210909+0000","last_change":"2023-10-08T12:45:25.231656+0000","last_active":"2023-10-08T12:45:26.210909+0000","last_peered":"2023-10-08T12:45:26.210909+0000","last_clean":"2023-10-08T12:45:26.210909+0000","last_became_active":"2023-10-08T12:45:25.231336+0000","last_became_peered":"2023-10-08T12:45:25.231336+0000","last_unstale":"2023-10-08T12:45:26.210909+0000","last_undegraded":"2023-10-08T12:45:26.210909+0000","last_fullsized":"2023-10-08T12:45:26.210909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:49:29.699634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.227889+0000","last_change":"2023-10-08T12:45:24.225874+0000","last_active":"2023-10-08T12:45:25.227889+0000","last_peered":"2023-10-08T12:45:25.227889+0000","last_clean":"2023-10-08T12:45:25.227889+0000","last_became_active":"2023-10-08T12:45:24.225568+0000","last_became_peered":"2023-10-08T12:45:24.225568+0000","last_unstale":"2023-10-08T12:45:25.227889+0000","last_undegraded":"2023-10-08T12:45:25.227889+0000","last_fullsized":"2023-10-08T12:45:25.227889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:44:03.829859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211248+0000","last_change":"2023-10-08T12:45:25.217589+0000","last_active":"2023-10-08T12:45:26.211248+0000","last_peered":"2023-10-08T12:45:26.211248+0000","last_clean":"2023-10-08T12:45:26.211248+0000","last_became_active":"2023-10-08T12:45:25.217318+0000","last_became_peered":"2023-10-08T12:45:25.217318+0000","last_unstale":"2023-10-08T12:45:26.211248+0000","last_undegraded":"2023-10-08T12:45:26.211248+0000","last_fullsized":"2023-10-08T12:45:26.211248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:41.446646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.233120+0000","last_change":"2023-10-08T12:45:24.221289+0000","last_active":"2023-10-08T12:45:25.233120+0000","last_peered":"2023-10-08T12:45:25.233120+0000","last_clean":"2023-10-08T12:45:25.233120+0000","last_became_active":"2023-10-08T12:45:24.220980+0000","last_became_peered":"2023-10-08T12:45:24.220980+0000","last_unstale":"2023-10-08T12:45:25.233120+0000","last_undegraded":"2023-10-08T12:45:25.233120+0000","last_fullsized":"2023-10-08T12:45:25.233120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:48:34.401677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427697+0000","last_change":"2023-10-08T12:45:25.215738+0000","last_active":"2023-10-08T12:45:26.427697+0000","last_peered":"2023-10-08T12:45:26.427697+0000","last_clean":"2023-10-08T12:45:26.427697+0000","last_became_active":"2023-10-08T12:45:25.215434+0000","last_became_peered":"2023-10-08T12:45:25.215434+0000","last_unstale":"2023-10-08T12:45:26.427697+0000","last_undegraded":"2023-10-08T12:45:26.427697+0000","last_fullsized":"2023-10-08T12:45:26.427697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:47:19.248207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.218954+0000","last_change":"2023-10-08T12:45:24.223766+0000","last_active":"2023-10-08T12:45:25.218954+0000","last_peered":"2023-10-08T12:45:25.218954+0000","last_clean":"2023-10-08T12:45:25.218954+0000","last_became_active":"2023-10-08T12:45:24.223463+0000","last_became_peered":"2023-10-08T12:45:24.223463+0000","last_unstale":"2023-10-08T12:45:25.218954+0000","last_undegraded":"2023-10-08T12:45:25.218954+0000","last_fullsized":"2023-10-08T12:45:25.218954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:38:47.162600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426854+0000","last_change":"2023-10-08T12:45:25.235554+0000","last_active":"2023-10-08T12:45:26.426854+0000","last_peered":"2023-10-08T12:45:26.426854+0000","last_clean":"2023-10-08T12:45:26.426854+0000","last_became_active":"2023-10-08T12:45:25.235272+0000","last_became_peered":"2023-10-08T12:45:25.235272+0000","last_unstale":"2023-10-08T12:45:26.426854+0000","last_undegraded":"2023-10-08T12:45:26.426854+0000","last_fullsized":"2023-10-08T12:45:26.426854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:32:46.148901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.226704+0000","last_change":"2023-10-08T12:45:24.219555+0000","last_active":"2023-10-08T12:45:25.226704+0000","last_peered":"2023-10-08T12:45:25.226704+0000","last_clean":"2023-10-08T12:45:25.226704+0000","last_became_active":"2023-10-08T12:45:24.219262+0000","last_became_peered":"2023-10-08T12:45:24.219262+0000","last_unstale":"2023-10-08T12:45:25.226704+0000","last_undegraded":"2023-10-08T12:45:25.226704+0000","last_fullsized":"2023-10-08T12:45:25.226704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:40.050400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427422+0000","last_change":"2023-10-08T12:45:25.227790+0000","last_active":"2023-10-08T12:45:26.427422+0000","last_peered":"2023-10-08T12:45:26.427422+0000","last_clean":"2023-10-08T12:45:26.427422+0000","last_became_active":"2023-10-08T12:45:25.227499+0000","last_became_peered":"2023-10-08T12:45:25.227499+0000","last_unstale":"2023-10-08T12:45:26.427422+0000","last_undegraded":"2023-10-08T12:45:26.427422+0000","last_fullsized":"2023-10-08T12:45:26.427422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:47:19.248207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.215553+0000","last_change":"2023-10-08T12:45:24.224004+0000","last_active":"2023-10-08T12:45:25.215553+0000","last_peered":"2023-10-08T12:45:25.215553+0000","last_clean":"2023-10-08T12:45:25.215553+0000","last_became_active":"2023-10-08T12:45:24.223726+0000","last_became_peered":"2023-10-08T12:45:24.223726+0000","last_unstale":"2023-10-08T12:45:25.215553+0000","last_undegraded":"2023-10-08T12:45:25.215553+0000","last_fullsized":"2023-10-08T12:45:25.215553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:15.178667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211144+0000","last_change":"2023-10-08T12:45:25.230677+0000","last_active":"2023-10-08T12:45:26.211144+0000","last_peered":"2023-10-08T12:45:26.211144+0000","last_clean":"2023-10-08T12:45:26.211144+0000","last_became_active":"2023-10-08T12:45:25.230414+0000","last_became_peered":"2023-10-08T12:45:25.230414+0000","last_unstale":"2023-10-08T12:45:26.211144+0000","last_undegraded":"2023-10-08T12:45:26.211144+0000","last_fullsized":"2023-10-08T12:45:26.211144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:32:02.258575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.227176+0000","last_change":"2023-10-08T12:45:24.226086+0000","last_active":"2023-10-08T12:45:25.227176+0000","last_peered":"2023-10-08T12:45:25.227176+0000","last_clean":"2023-10-08T12:45:25.227176+0000","last_became_active":"2023-10-08T12:45:24.225807+0000","last_became_peered":"2023-10-08T12:45:24.225807+0000","last_unstale":"2023-10-08T12:45:25.227176+0000","last_undegraded":"2023-10-08T12:45:25.227176+0000","last_fullsized":"2023-10-08T12:45:25.227176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:25.788386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427575+0000","last_change":"2023-10-08T12:45:25.233121+0000","last_active":"2023-10-08T12:45:26.427575+0000","last_peered":"2023-10-08T12:45:26.427575+0000","last_clean":"2023-10-08T12:45:26.427575+0000","last_became_active":"2023-10-08T12:45:25.232807+0000","last_became_peered":"2023-10-08T12:45:25.232807+0000","last_unstale":"2023-10-08T12:45:26.427575+0000","last_undegraded":"2023-10-08T12:45:26.427575+0000","last_fullsized":"2023-10-08T12:45:26.427575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:04:54.376133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.240194+0000","last_change":"2023-10-08T12:45:24.226329+0000","last_active":"2023-10-08T12:45:25.240194+0000","last_peered":"2023-10-08T12:45:25.240194+0000","last_clean":"2023-10-08T12:45:25.240194+0000","last_became_active":"2023-10-08T12:45:24.226056+0000","last_became_peered":"2023-10-08T12:45:24.226056+0000","last_unstale":"2023-10-08T12:45:25.240194+0000","last_undegraded":"2023-10-08T12:45:25.240194+0000","last_fullsized":"2023-10-08T12:45:25.240194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:48:34.401677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211648+0000","last_change":"2023-10-08T12:45:25.225089+0000","last_active":"2023-10-08T12:45:26.211648+0000","last_peered":"2023-10-08T12:45:26.211648+0000","last_clean":"2023-10-08T12:45:26.211648+0000","last_became_active":"2023-10-08T12:45:25.224125+0000","last_became_peered":"2023-10-08T12:45:25.224125+0000","last_unstale":"2023-10-08T12:45:26.211648+0000","last_undegraded":"2023-10-08T12:45:26.211648+0000","last_fullsized":"2023-10-08T12:45:26.211648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:16:14.249377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.243231+0000","last_change":"2023-10-08T12:45:24.222786+0000","last_active":"2023-10-08T12:45:25.243231+0000","last_peered":"2023-10-08T12:45:25.243231+0000","last_clean":"2023-10-08T12:45:25.243231+0000","last_became_active":"2023-10-08T12:45:24.222465+0000","last_became_peered":"2023-10-08T12:45:24.222465+0000","last_unstale":"2023-10-08T12:45:25.243231+0000","last_undegraded":"2023-10-08T12:45:25.243231+0000","last_fullsized":"2023-10-08T12:45:25.243231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:38:47.162600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427068+0000","last_change":"2023-10-08T12:45:25.224662+0000","last_active":"2023-10-08T12:45:26.427068+0000","last_peered":"2023-10-08T12:45:26.427068+0000","last_clean":"2023-10-08T12:45:26.427068+0000","last_became_active":"2023-10-08T12:45:25.224168+0000","last_became_peered":"2023-10-08T12:45:25.224168+0000","last_unstale":"2023-10-08T12:45:26.427068+0000","last_undegraded":"2023-10-08T12:45:26.427068+0000","last_fullsized":"2023-10-08T12:45:26.427068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:18:01.792375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.237395+0000","last_change":"2023-10-08T12:45:24.221225+0000","last_active":"2023-10-08T12:45:25.237395+0000","last_peered":"2023-10-08T12:45:25.237395+0000","last_clean":"2023-10-08T12:45:25.237395+0000","last_became_active":"2023-10-08T12:45:24.220465+0000","last_became_peered":"2023-10-08T12:45:24.220465+0000","last_unstale":"2023-10-08T12:45:25.237395+0000","last_undegraded":"2023-10-08T12:45:25.237395+0000","last_fullsized":"2023-10-08T12:45:25.237395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:40.441409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426979+0000","last_change":"2023-10-08T12:45:25.223301+0000","last_active":"2023-10-08T12:45:26.426979+0000","last_peered":"2023-10-08T12:45:26.426979+0000","last_clean":"2023-10-08T12:45:26.426979+0000","last_became_active":"2023-10-08T12:45:25.223017+0000","last_became_peered":"2023-10-08T12:45:25.223017+0000","last_unstale":"2023-10-08T12:45:26.426979+0000","last_undegraded":"2023-10-08T12:45:26.426979+0000","last_fullsized":"2023-10-08T12:45:26.426979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:38:48.167837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.227386+0000","last_change":"2023-10-08T12:45:24.223071+0000","last_active":"2023-10-08T12:45:25.227386+0000","last_peered":"2023-10-08T12:45:25.227386+0000","last_clean":"2023-10-08T12:45:25.227386+0000","last_became_active":"2023-10-08T12:45:24.222681+0000","last_became_peered":"2023-10-08T12:45:24.222681+0000","last_unstale":"2023-10-08T12:45:25.227386+0000","last_undegraded":"2023-10-08T12:45:25.227386+0000","last_fullsized":"2023-10-08T12:45:25.227386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:32:45.143664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426987+0000","last_change":"2023-10-08T12:45:25.235762+0000","last_active":"2023-10-08T12:45:26.426987+0000","last_peered":"2023-10-08T12:45:26.426987+0000","last_clean":"2023-10-08T12:45:26.426987+0000","last_became_active":"2023-10-08T12:45:25.235232+0000","last_became_peered":"2023-10-08T12:45:25.235232+0000","last_unstale":"2023-10-08T12:45:26.426987+0000","last_undegraded":"2023-10-08T12:45:26.426987+0000","last_fullsized":"2023-10-08T12:45:26.426987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:33:43.081367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.215694+0000","last_change":"2023-10-08T12:45:24.220892+0000","last_active":"2023-10-08T12:45:25.215694+0000","last_peered":"2023-10-08T12:45:25.215694+0000","last_clean":"2023-10-08T12:45:25.215694+0000","last_became_active":"2023-10-08T12:45:24.220573+0000","last_became_peered":"2023-10-08T12:45:24.220573+0000","last_unstale":"2023-10-08T12:45:25.215694+0000","last_undegraded":"2023-10-08T12:45:25.215694+0000","last_fullsized":"2023-10-08T12:45:25.215694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:40.441409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426430+0000","last_change":"2023-10-08T12:45:25.239496+0000","last_active":"2023-10-08T12:45:26.426430+0000","last_peered":"2023-10-08T12:45:26.426430+0000","last_clean":"2023-10-08T12:45:26.426430+0000","last_became_active":"2023-10-08T12:45:25.239106+0000","last_became_peered":"2023-10-08T12:45:25.239106+0000","last_unstale":"2023-10-08T12:45:26.426430+0000","last_undegraded":"2023-10-08T12:45:26.426430+0000","last_fullsized":"2023-10-08T12:45:26.426430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:48.216433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.241993+0000","last_change":"2023-10-08T12:45:24.225777+0000","last_active":"2023-10-08T12:45:25.241993+0000","last_peered":"2023-10-08T12:45:25.241993+0000","last_clean":"2023-10-08T12:45:25.241993+0000","last_became_active":"2023-10-08T12:45:24.225472+0000","last_became_peered":"2023-10-08T12:45:24.225472+0000","last_unstale":"2023-10-08T12:45:25.241993+0000","last_undegraded":"2023-10-08T12:45:25.241993+0000","last_fullsized":"2023-10-08T12:45:25.241993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:23:14.697499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427263+0000","last_change":"2023-10-08T12:45:25.235732+0000","last_active":"2023-10-08T12:45:26.427263+0000","last_peered":"2023-10-08T12:45:26.427263+0000","last_clean":"2023-10-08T12:45:26.427263+0000","last_became_active":"2023-10-08T12:45:25.235444+0000","last_became_peered":"2023-10-08T12:45:25.235444+0000","last_unstale":"2023-10-08T12:45:26.427263+0000","last_undegraded":"2023-10-08T12:45:26.427263+0000","last_fullsized":"2023-10-08T12:45:26.427263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:48.280304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.237752+0000","last_change":"2023-10-08T12:45:24.222110+0000","last_active":"2023-10-08T12:45:25.237752+0000","last_peered":"2023-10-08T12:45:25.237752+0000","last_clean":"2023-10-08T12:45:25.237752+0000","last_became_active":"2023-10-08T12:45:24.221768+0000","last_became_peered":"2023-10-08T12:45:24.221768+0000","last_unstale":"2023-10-08T12:45:25.237752+0000","last_undegraded":"2023-10-08T12:45:25.237752+0000","last_fullsized":"2023-10-08T12:45:25.237752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:23:14.697499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427029+0000","last_change":"2023-10-08T12:45:25.222582+0000","last_active":"2023-10-08T12:45:26.427029+0000","last_peered":"2023-10-08T12:45:26.427029+0000","last_clean":"2023-10-08T12:45:26.427029+0000","last_became_active":"2023-10-08T12:45:25.222312+0000","last_became_peered":"2023-10-08T12:45:25.222312+0000","last_unstale":"2023-10-08T12:45:26.427029+0000","last_undegraded":"2023-10-08T12:45:26.427029+0000","last_fullsized":"2023-10-08T12:45:26.427029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:32:02.258575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.212828+0000","last_change":"2023-10-08T12:45:24.225910+0000","last_active":"2023-10-08T12:45:25.212828+0000","last_peered":"2023-10-08T12:45:25.212828+0000","last_clean":"2023-10-08T12:45:25.212828+0000","last_became_active":"2023-10-08T12:45:24.225590+0000","last_became_peered":"2023-10-08T12:45:24.225590+0000","last_unstale":"2023-10-08T12:45:25.212828+0000","last_undegraded":"2023-10-08T12:45:25.212828+0000","last_fullsized":"2023-10-08T12:45:25.212828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:40.050400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211014+0000","last_change":"2023-10-08T12:45:25.238269+0000","last_active":"2023-10-08T12:45:26.211014+0000","last_peered":"2023-10-08T12:45:26.211014+0000","last_clean":"2023-10-08T12:45:26.211014+0000","last_became_active":"2023-10-08T12:45:25.237899+0000","last_became_peered":"2023-10-08T12:45:25.237899+0000","last_unstale":"2023-10-08T12:45:26.211014+0000","last_undegraded":"2023-10-08T12:45:26.211014+0000","last_fullsized":"2023-10-08T12:45:26.211014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:15.909104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.227253+0000","last_change":"2023-10-08T12:45:24.226194+0000","last_active":"2023-10-08T12:45:25.227253+0000","last_peered":"2023-10-08T12:45:25.227253+0000","last_clean":"2023-10-08T12:45:25.227253+0000","last_became_active":"2023-10-08T12:45:24.225901+0000","last_became_peered":"2023-10-08T12:45:24.225901+0000","last_unstale":"2023-10-08T12:45:25.227253+0000","last_undegraded":"2023-10-08T12:45:25.227253+0000","last_fullsized":"2023-10-08T12:45:25.227253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:47.211196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211763+0000","last_change":"2023-10-08T12:45:25.234627+0000","last_active":"2023-10-08T12:45:26.211763+0000","last_peered":"2023-10-08T12:45:26.211763+0000","last_clean":"2023-10-08T12:45:26.211763+0000","last_became_active":"2023-10-08T12:45:25.234323+0000","last_became_peered":"2023-10-08T12:45:25.234323+0000","last_unstale":"2023-10-08T12:45:26.211763+0000","last_undegraded":"2023-10-08T12:45:26.211763+0000","last_fullsized":"2023-10-08T12:45:26.211763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:56:56.850111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426376+0000","last_change":"2023-10-08T12:45:25.224549+0000","last_active":"2023-10-08T12:45:26.426376+0000","last_peered":"2023-10-08T12:45:26.426376+0000","last_clean":"2023-10-08T12:45:26.426376+0000","last_became_active":"2023-10-08T12:45:25.223606+0000","last_became_peered":"2023-10-08T12:45:25.223606+0000","last_unstale":"2023-10-08T12:45:26.426376+0000","last_undegraded":"2023-10-08T12:45:26.426376+0000","last_fullsized":"2023-10-08T12:45:26.426376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:26.793623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.218337+0000","last_change":"2023-10-08T12:45:24.216886+0000","last_active":"2023-10-08T12:45:25.218337+0000","last_peered":"2023-10-08T12:45:25.218337+0000","last_clean":"2023-10-08T12:45:25.218337+0000","last_became_active":"2023-10-08T12:45:24.216435+0000","last_became_peered":"2023-10-08T12:45:24.216435+0000","last_unstale":"2023-10-08T12:45:25.218337+0000","last_undegraded":"2023-10-08T12:45:25.218337+0000","last_fullsized":"2023-10-08T12:45:25.218337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:16:13.244140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427721+0000","last_change":"2023-10-08T12:45:25.234200+0000","last_active":"2023-10-08T12:45:26.427721+0000","last_peered":"2023-10-08T12:45:26.427721+0000","last_clean":"2023-10-08T12:45:26.427721+0000","last_became_active":"2023-10-08T12:45:25.233861+0000","last_became_peered":"2023-10-08T12:45:25.233861+0000","last_unstale":"2023-10-08T12:45:26.427721+0000","last_undegraded":"2023-10-08T12:45:26.427721+0000","last_fullsized":"2023-10-08T12:45:26.427721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:08:35.730146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.226650+0000","last_change":"2023-10-08T12:45:24.218750+0000","last_active":"2023-10-08T12:45:25.226650+0000","last_peered":"2023-10-08T12:45:25.226650+0000","last_clean":"2023-10-08T12:45:25.226650+0000","last_became_active":"2023-10-08T12:45:24.218402+0000","last_became_peered":"2023-10-08T12:45:24.218402+0000","last_unstale":"2023-10-08T12:45:25.226650+0000","last_undegraded":"2023-10-08T12:45:25.226650+0000","last_fullsized":"2023-10-08T12:45:25.226650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:48:34.401677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.215229+0000","last_change":"2023-10-08T12:45:21.094571+0000","last_active":"2023-10-08T12:45:25.215229+0000","last_peered":"2023-10-08T12:45:25.215229+0000","last_clean":"2023-10-08T12:45:25.215229+0000","last_became_active":"2023-10-08T12:45:21.093551+0000","last_became_peered":"2023-10-08T12:45:21.093551+0000","last_unstale":"2023-10-08T12:45:25.215229+0000","last_undegraded":"2023-10-08T12:45:25.215229+0000","last_fullsized":"2023-10-08T12:45:25.215229+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:19.842786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:19.842786+0000","last_clean_scrub_stamp":"2023-10-08T12:45:19.842786+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:25.041743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426946+0000","last_change":"2023-10-08T12:45:25.215819+0000","last_active":"2023-10-08T12:45:26.426946+0000","last_peered":"2023-10-08T12:45:26.426946+0000","last_clean":"2023-10-08T12:45:26.426946+0000","last_became_active":"2023-10-08T12:45:25.215352+0000","last_became_peered":"2023-10-08T12:45:25.215352+0000","last_unstale":"2023-10-08T12:45:26.426946+0000","last_undegraded":"2023-10-08T12:45:26.426946+0000","last_fullsized":"2023-10-08T12:45:26.426946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:26.793623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.215346+0000","last_change":"2023-10-08T12:45:24.229708+0000","last_active":"2023-10-08T12:45:25.215346+0000","last_peered":"2023-10-08T12:45:25.215346+0000","last_clean":"2023-10-08T12:45:25.215346+0000","last_became_active":"2023-10-08T12:45:24.229494+0000","last_became_peered":"2023-10-08T12:45:24.229494+0000","last_unstale":"2023-10-08T12:45:25.215346+0000","last_undegraded":"2023-10-08T12:45:25.215346+0000","last_fullsized":"2023-10-08T12:45:25.215346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:16:13.244140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.217629+0000","last_change":"2023-10-08T12:45:24.229122+0000","last_active":"2023-10-08T12:45:25.217629+0000","last_peered":"2023-10-08T12:45:25.217629+0000","last_clean":"2023-10-08T12:45:25.217629+0000","last_became_active":"2023-10-08T12:45:24.228838+0000","last_became_peered":"2023-10-08T12:45:24.228838+0000","last_unstale":"2023-10-08T12:45:25.217629+0000","last_undegraded":"2023-10-08T12:45:25.217629+0000","last_fullsized":"2023-10-08T12:45:25.217629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:25.788386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427195+0000","last_change":"2023-10-08T12:45:25.224118+0000","last_active":"2023-10-08T12:45:26.427195+0000","last_peered":"2023-10-08T12:45:26.427195+0000","last_clean":"2023-10-08T12:45:26.427195+0000","last_became_active":"2023-10-08T12:45:25.223850+0000","last_became_peered":"2023-10-08T12:45:25.223850+0000","last_unstale":"2023-10-08T12:45:26.427195+0000","last_undegraded":"2023-10-08T12:45:26.427195+0000","last_fullsized":"2023-10-08T12:45:26.427195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:08:35.730146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427043+0000","last_change":"2023-10-08T12:45:24.226993+0000","last_active":"2023-10-08T12:45:26.427043+0000","last_peered":"2023-10-08T12:45:26.427043+0000","last_clean":"2023-10-08T12:45:26.427043+0000","last_became_active":"2023-10-08T12:45:24.226721+0000","last_became_peered":"2023-10-08T12:45:24.226721+0000","last_unstale":"2023-10-08T12:45:26.427043+0000","last_undegraded":"2023-10-08T12:45:26.427043+0000","last_fullsized":"2023-10-08T12:45:26.427043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:38:47.162600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.428284+0000","last_change":"2023-10-08T12:45:25.224548+0000","last_active":"2023-10-08T12:45:26.428284+0000","last_peered":"2023-10-08T12:45:26.428284+0000","last_clean":"2023-10-08T12:45:26.428284+0000","last_became_active":"2023-10-08T12:45:25.224094+0000","last_became_peered":"2023-10-08T12:45:25.224094+0000","last_unstale":"2023-10-08T12:45:26.428284+0000","last_undegraded":"2023-10-08T12:45:26.428284+0000","last_fullsized":"2023-10-08T12:45:26.428284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:33:43.081367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.236382+0000","last_change":"2023-10-08T12:45:24.229198+0000","last_active":"2023-10-08T12:45:25.236382+0000","last_peered":"2023-10-08T12:45:25.236382+0000","last_clean":"2023-10-08T12:45:25.236382+0000","last_became_active":"2023-10-08T12:45:24.228922+0000","last_became_peered":"2023-10-08T12:45:24.228922+0000","last_unstale":"2023-10-08T12:45:25.236382+0000","last_undegraded":"2023-10-08T12:45:25.236382+0000","last_fullsized":"2023-10-08T12:45:25.236382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:23:14.697499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426950+0000","last_change":"2023-10-08T12:45:25.220801+0000","last_active":"2023-10-08T12:45:26.426950+0000","last_peered":"2023-10-08T12:45:26.426950+0000","last_clean":"2023-10-08T12:45:26.426950+0000","last_became_active":"2023-10-08T12:45:25.220473+0000","last_became_peered":"2023-10-08T12:45:25.220473+0000","last_unstale":"2023-10-08T12:45:26.426950+0000","last_undegraded":"2023-10-08T12:45:26.426950+0000","last_fullsized":"2023-10-08T12:45:26.426950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:01:10.071249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.215157+0000","last_change":"2023-10-08T12:45:24.228202+0000","last_active":"2023-10-08T12:45:25.215157+0000","last_peered":"2023-10-08T12:45:25.215157+0000","last_clean":"2023-10-08T12:45:25.215157+0000","last_became_active":"2023-10-08T12:45:24.227988+0000","last_became_peered":"2023-10-08T12:45:24.227988+0000","last_unstale":"2023-10-08T12:45:25.215157+0000","last_undegraded":"2023-10-08T12:45:25.215157+0000","last_fullsized":"2023-10-08T12:45:25.215157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:40.441409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211154+0000","last_change":"2023-10-08T12:45:25.227542+0000","last_active":"2023-10-08T12:45:26.211154+0000","last_peered":"2023-10-08T12:45:26.211154+0000","last_clean":"2023-10-08T12:45:26.211154+0000","last_became_active":"2023-10-08T12:45:25.227279+0000","last_became_peered":"2023-10-08T12:45:25.227279+0000","last_unstale":"2023-10-08T12:45:26.211154+0000","last_undegraded":"2023-10-08T12:45:26.211154+0000","last_fullsized":"2023-10-08T12:45:26.211154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:16.183904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.211960+0000","last_change":"2023-10-08T12:45:24.228028+0000","last_active":"2023-10-08T12:45:25.211960+0000","last_peered":"2023-10-08T12:45:25.211960+0000","last_clean":"2023-10-08T12:45:25.211960+0000","last_became_active":"2023-10-08T12:45:24.227739+0000","last_became_peered":"2023-10-08T12:45:24.227739+0000","last_unstale":"2023-10-08T12:45:25.211960+0000","last_undegraded":"2023-10-08T12:45:25.211960+0000","last_fullsized":"2023-10-08T12:45:25.211960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:49:31.954384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426680+0000","last_change":"2023-10-08T12:45:25.236177+0000","last_active":"2023-10-08T12:45:26.426680+0000","last_peered":"2023-10-08T12:45:26.426680+0000","last_clean":"2023-10-08T12:45:26.426680+0000","last_became_active":"2023-10-08T12:45:25.235890+0000","last_became_peered":"2023-10-08T12:45:25.235890+0000","last_unstale":"2023-10-08T12:45:26.426680+0000","last_undegraded":"2023-10-08T12:45:26.426680+0000","last_fullsized":"2023-10-08T12:45:26.426680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:26.793623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.211878+0000","last_change":"2023-10-08T12:45:24.222491+0000","last_active":"2023-10-08T12:45:25.211878+0000","last_peered":"2023-10-08T12:45:25.211878+0000","last_clean":"2023-10-08T12:45:25.211878+0000","last_became_active":"2023-10-08T12:45:24.222266+0000","last_became_peered":"2023-10-08T12:45:24.222266+0000","last_unstale":"2023-10-08T12:45:25.211878+0000","last_undegraded":"2023-10-08T12:45:25.211878+0000","last_fullsized":"2023-10-08T12:45:25.211878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:56:55.844874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427967+0000","last_change":"2023-10-08T12:45:25.234548+0000","last_active":"2023-10-08T12:45:26.427967+0000","last_peered":"2023-10-08T12:45:26.427967+0000","last_clean":"2023-10-08T12:45:26.427967+0000","last_became_active":"2023-10-08T12:45:25.234277+0000","last_became_peered":"2023-10-08T12:45:25.234277+0000","last_unstale":"2023-10-08T12:45:26.427967+0000","last_undegraded":"2023-10-08T12:45:26.427967+0000","last_fullsized":"2023-10-08T12:45:26.427967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:56:33.493223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.235588+0000","last_change":"2023-10-08T12:45:24.227674+0000","last_active":"2023-10-08T12:45:25.235588+0000","last_peered":"2023-10-08T12:45:25.235588+0000","last_clean":"2023-10-08T12:45:25.235588+0000","last_became_active":"2023-10-08T12:45:24.227376+0000","last_became_peered":"2023-10-08T12:45:24.227376+0000","last_unstale":"2023-10-08T12:45:25.235588+0000","last_undegraded":"2023-10-08T12:45:25.235588+0000","last_fullsized":"2023-10-08T12:45:25.235588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:04:53.370896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427083+0000","last_change":"2023-10-08T12:45:25.228511+0000","last_active":"2023-10-08T12:45:26.427083+0000","last_peered":"2023-10-08T12:45:26.427083+0000","last_clean":"2023-10-08T12:45:26.427083+0000","last_became_active":"2023-10-08T12:45:25.227866+0000","last_became_peered":"2023-10-08T12:45:25.227866+0000","last_unstale":"2023-10-08T12:45:26.427083+0000","last_undegraded":"2023-10-08T12:45:26.427083+0000","last_fullsized":"2023-10-08T12:45:26.427083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:04:54.376133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.218171+0000","last_change":"2023-10-08T12:45:24.215676+0000","last_active":"2023-10-08T12:45:25.218171+0000","last_peered":"2023-10-08T12:45:25.218171+0000","last_clean":"2023-10-08T12:45:25.218171+0000","last_became_active":"2023-10-08T12:45:24.215332+0000","last_became_peered":"2023-10-08T12:45:24.215332+0000","last_unstale":"2023-10-08T12:45:25.218171+0000","last_undegraded":"2023-10-08T12:45:25.218171+0000","last_fullsized":"2023-10-08T12:45:25.218171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:40.441409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427302+0000","last_change":"2023-10-08T12:45:25.235593+0000","last_active":"2023-10-08T12:45:26.427302+0000","last_peered":"2023-10-08T12:45:26.427302+0000","last_clean":"2023-10-08T12:45:26.427302+0000","last_became_active":"2023-10-08T12:45:25.234710+0000","last_became_peered":"2023-10-08T12:45:25.234710+0000","last_unstale":"2023-10-08T12:45:26.427302+0000","last_undegraded":"2023-10-08T12:45:26.427302+0000","last_fullsized":"2023-10-08T12:45:26.427302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:49:50.098137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.240294+0000","last_change":"2023-10-08T12:45:24.220654+0000","last_active":"2023-10-08T12:45:25.240294+0000","last_peered":"2023-10-08T12:45:25.240294+0000","last_clean":"2023-10-08T12:45:25.240294+0000","last_became_active":"2023-10-08T12:45:24.220367+0000","last_became_peered":"2023-10-08T12:45:24.220367+0000","last_unstale":"2023-10-08T12:45:25.240294+0000","last_undegraded":"2023-10-08T12:45:25.240294+0000","last_fullsized":"2023-10-08T12:45:25.240294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:44:03.829859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211649+0000","last_change":"2023-10-08T12:45:25.239597+0000","last_active":"2023-10-08T12:45:26.211649+0000","last_peered":"2023-10-08T12:45:26.211649+0000","last_clean":"2023-10-08T12:45:26.211649+0000","last_became_active":"2023-10-08T12:45:25.238424+0000","last_became_peered":"2023-10-08T12:45:25.238424+0000","last_unstale":"2023-10-08T12:45:26.211649+0000","last_undegraded":"2023-10-08T12:45:26.211649+0000","last_fullsized":"2023-10-08T12:45:26.211649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:48.280304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:45:25.237785+0000","last_change":"2023-10-08T12:45:24.216389+0000","last_active":"2023-10-08T12:45:25.237785+0000","last_peered":"2023-10-08T12:45:25.237785+0000","last_clean":"2023-10-08T12:45:25.237785+0000","last_became_active":"2023-10-08T12:45:24.216111+0000","last_became_peered":"2023-10-08T12:45:24.216111+0000","last_unstale":"2023-10-08T12:45:25.237785+0000","last_undegraded":"2023-10-08T12:45:25.237785+0000","last_fullsized":"2023-10-08T12:45:25.237785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:23.194597+0000","last_clean_scrub_stamp":"2023-10-08T12:45:23.194597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:15.178667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427542+0000","last_change":"2023-10-08T12:45:25.236292+0000","last_active":"2023-10-08T12:45:26.427542+0000","last_peered":"2023-10-08T12:45:26.427542+0000","last_clean":"2023-10-08T12:45:26.427542+0000","last_became_active":"2023-10-08T12:45:25.235946+0000","last_became_peered":"2023-10-08T12:45:25.235946+0000","last_unstale":"2023-10-08T12:45:26.427542+0000","last_undegraded":"2023-10-08T12:45:26.427542+0000","last_fullsized":"2023-10-08T12:45:26.427542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:49:50.149459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426418+0000","last_change":"2023-10-08T12:45:25.239059+0000","last_active":"2023-10-08T12:45:26.426418+0000","last_peered":"2023-10-08T12:45:26.426418+0000","last_clean":"2023-10-08T12:45:26.426418+0000","last_became_active":"2023-10-08T12:45:25.238760+0000","last_became_peered":"2023-10-08T12:45:25.238760+0000","last_unstale":"2023-10-08T12:45:26.426418+0000","last_undegraded":"2023-10-08T12:45:26.426418+0000","last_fullsized":"2023-10-08T12:45:26.426418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:26.793623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.209670+0000","last_change":"2023-10-08T12:45:25.231384+0000","last_active":"2023-10-08T12:45:26.209670+0000","last_peered":"2023-10-08T12:45:26.209670+0000","last_clean":"2023-10-08T12:45:26.209670+0000","last_became_active":"2023-10-08T12:45:25.231107+0000","last_became_peered":"2023-10-08T12:45:25.231107+0000","last_unstale":"2023-10-08T12:45:26.209670+0000","last_undegraded":"2023-10-08T12:45:26.209670+0000","last_fullsized":"2023-10-08T12:45:26.209670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:56:56.850111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.211086+0000","last_change":"2023-10-08T12:45:25.240154+0000","last_active":"2023-10-08T12:45:26.211086+0000","last_peered":"2023-10-08T12:45:26.211086+0000","last_clean":"2023-10-08T12:45:26.211086+0000","last_became_active":"2023-10-08T12:45:25.239707+0000","last_became_peered":"2023-10-08T12:45:25.239707+0000","last_unstale":"2023-10-08T12:45:26.211086+0000","last_undegraded":"2023-10-08T12:45:26.211086+0000","last_fullsized":"2023-10-08T12:45:26.211086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:33:43.081367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427580+0000","last_change":"2023-10-08T12:45:25.226125+0000","last_active":"2023-10-08T12:45:26.427580+0000","last_peered":"2023-10-08T12:45:26.427580+0000","last_clean":"2023-10-08T12:45:26.427580+0000","last_became_active":"2023-10-08T12:45:25.225857+0000","last_became_peered":"2023-10-08T12:45:25.225857+0000","last_unstale":"2023-10-08T12:45:26.427580+0000","last_undegraded":"2023-10-08T12:45:26.427580+0000","last_fullsized":"2023-10-08T12:45:26.427580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:08:35.730146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427934+0000","last_change":"2023-10-08T12:45:25.233903+0000","last_active":"2023-10-08T12:45:26.427934+0000","last_peered":"2023-10-08T12:45:26.427934+0000","last_clean":"2023-10-08T12:45:26.427934+0000","last_became_active":"2023-10-08T12:45:25.233623+0000","last_became_peered":"2023-10-08T12:45:25.233623+0000","last_unstale":"2023-10-08T12:45:26.427934+0000","last_undegraded":"2023-10-08T12:45:26.427934+0000","last_fullsized":"2023-10-08T12:45:26.427934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:47:19.248207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427126+0000","last_change":"2023-10-08T12:45:25.226278+0000","last_active":"2023-10-08T12:45:26.427126+0000","last_peered":"2023-10-08T12:45:26.427126+0000","last_clean":"2023-10-08T12:45:26.427126+0000","last_became_active":"2023-10-08T12:45:25.225029+0000","last_became_peered":"2023-10-08T12:45:25.225029+0000","last_unstale":"2023-10-08T12:45:26.427126+0000","last_undegraded":"2023-10-08T12:45:26.427126+0000","last_fullsized":"2023-10-08T12:45:26.427126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:32:46.148901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427244+0000","last_change":"2023-10-08T12:45:25.237094+0000","last_active":"2023-10-08T12:45:26.427244+0000","last_peered":"2023-10-08T12:45:26.427244+0000","last_clean":"2023-10-08T12:45:26.427244+0000","last_became_active":"2023-10-08T12:45:25.236619+0000","last_became_peered":"2023-10-08T12:45:25.236619+0000","last_unstale":"2023-10-08T12:45:26.427244+0000","last_undegraded":"2023-10-08T12:45:26.427244+0000","last_fullsized":"2023-10-08T12:45:26.427244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:47:19.248207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.428124+0000","last_change":"2023-10-08T12:45:25.224087+0000","last_active":"2023-10-08T12:45:26.428124+0000","last_peered":"2023-10-08T12:45:26.428124+0000","last_clean":"2023-10-08T12:45:26.428124+0000","last_became_active":"2023-10-08T12:45:25.223774+0000","last_became_peered":"2023-10-08T12:45:25.223774+0000","last_unstale":"2023-10-08T12:45:26.428124+0000","last_undegraded":"2023-10-08T12:45:26.428124+0000","last_fullsized":"2023-10-08T12:45:26.428124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:15.909104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.210640+0000","last_change":"2023-10-08T12:45:25.238966+0000","last_active":"2023-10-08T12:45:26.210640+0000","last_peered":"2023-10-08T12:45:26.210640+0000","last_clean":"2023-10-08T12:45:26.210640+0000","last_became_active":"2023-10-08T12:45:25.238579+0000","last_became_peered":"2023-10-08T12:45:25.238579+0000","last_unstale":"2023-10-08T12:45:26.210640+0000","last_undegraded":"2023-10-08T12:45:26.210640+0000","last_fullsized":"2023-10-08T12:45:26.210640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:04:54.376133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426808+0000","last_change":"2023-10-08T12:45:25.227703+0000","last_active":"2023-10-08T12:45:26.426808+0000","last_peered":"2023-10-08T12:45:26.426808+0000","last_clean":"2023-10-08T12:45:26.426808+0000","last_became_active":"2023-10-08T12:45:25.227400+0000","last_became_peered":"2023-10-08T12:45:25.227400+0000","last_unstale":"2023-10-08T12:45:26.426808+0000","last_undegraded":"2023-10-08T12:45:26.426808+0000","last_fullsized":"2023-10-08T12:45:26.426808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:48.216433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.210891+0000","last_change":"2023-10-08T12:45:25.231956+0000","last_active":"2023-10-08T12:45:26.210891+0000","last_peered":"2023-10-08T12:45:26.210891+0000","last_clean":"2023-10-08T12:45:26.210891+0000","last_became_active":"2023-10-08T12:45:25.231669+0000","last_became_peered":"2023-10-08T12:45:25.231669+0000","last_unstale":"2023-10-08T12:45:26.210891+0000","last_undegraded":"2023-10-08T12:45:26.210891+0000","last_fullsized":"2023-10-08T12:45:26.210891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:56:33.493223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.427412+0000","last_change":"2023-10-08T12:45:25.228975+0000","last_active":"2023-10-08T12:45:26.427412+0000","last_peered":"2023-10-08T12:45:26.427412+0000","last_clean":"2023-10-08T12:45:26.427412+0000","last_became_active":"2023-10-08T12:45:25.224678+0000","last_became_peered":"2023-10-08T12:45:25.224678+0000","last_unstale":"2023-10-08T12:45:26.427412+0000","last_undegraded":"2023-10-08T12:45:26.427412+0000","last_fullsized":"2023-10-08T12:45:26.427412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:48.216433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:45:26.426772+0000","last_change":"2023-10-08T12:45:25.234967+0000","last_active":"2023-10-08T12:45:26.426772+0000","last_peered":"2023-10-08T12:45:26.426772+0000","last_clean":"2023-10-08T12:45:26.426772+0000","last_became_active":"2023-10-08T12:45:25.234563+0000","last_became_peered":"2023-10-08T12:45:25.234563+0000","last_unstale":"2023-10-08T12:45:26.426772+0000","last_undegraded":"2023-10-08T12:45:26.426772+0000","last_fullsized":"2023-10-08T12:45:26.426772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:24.199834+0000","last_clean_scrub_stamp":"2023-10-08T12:45:24.199834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:32:46.148901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:45:39.426 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-08T12:45:39.427 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-08T12:45:39.427 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-08T12:45:39.427 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-08T12:45:39.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.588+0000 7f676c62e700 1 -- 172.21.15.45:0/506404872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6750004850 msgr2=0x7f6750004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:39.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.588+0000 7f676c62e700 1 --2- 172.21.15.45:0/506404872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6750004850 0x7f6750004cd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6760001050 tx=0x7f6750005880 comp rx=0 tx=0).stop 2023-10-08T12:45:39.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.588+0000 7f676c62e700 1 -- 172.21.15.45:0/506404872 shutdown_connections 2023-10-08T12:45:39.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.588+0000 7f676c62e700 1 --2- 172.21.15.45:0/506404872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6750004850 0x7f6750004cd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:39.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.588+0000 7f676c62e700 1 -- 172.21.15.45:0/506404872 >> 172.21.15.45:0/506404872 conn(0x7f67640afb60 msgr2=0x7f67640aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:39.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.588+0000 7f676c62e700 1 -- 172.21.15.45:0/506404872 shutdown_connections 2023-10-08T12:45:39.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.588+0000 7f676c62e700 1 -- 172.21.15.45:0/506404872 wait complete. 2023-10-08T12:45:39.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.589+0000 7f676c62e700 1 Processor -- start 2023-10-08T12:45:39.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.589+0000 7f676c62e700 1 -- start start 2023-10-08T12:45:39.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.590+0000 7f676c62e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6750004850 0x7f67640c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:39.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.590+0000 7f676c62e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f676415af70 0x7f67640c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:39.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.590+0000 7f676c62e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f676414a670 0x7f676414aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:39.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.590+0000 7f676c62e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67641f03a0 con 0x7f676414a670 2023-10-08T12:45:39.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.590+0000 7f676c62e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676415b750 con 0x7f6750004850 2023-10-08T12:45:39.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.590+0000 7f676c62e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f676415ba30 con 0x7f676415af70 2023-10-08T12:45:39.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.590+0000 7f676abcb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f676414a670 0x7f676414aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:39.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.590+0000 7f676abcb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f676414a670 0x7f676414aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35446/0 (socket says 172.21.15.45:35446) 2023-10-08T12:45:39.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.590+0000 7f676abcb700 1 -- 172.21.15.45:0/4155515356 learned_addr learned my addr 172.21.15.45:0/4155515356 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:39.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.590+0000 7f676a3ca700 1 --2- 172.21.15.45:0/4155515356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6750004850 0x7f67640c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:39.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.590+0000 7f6769bc9700 1 --2- 172.21.15.45:0/4155515356 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f676415af70 0x7f67640c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:39.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.590+0000 7f676abcb700 1 -- 172.21.15.45:0/4155515356 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f676415af70 msgr2=0x7f67640c1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:39.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.590+0000 7f676abcb700 1 --2- 172.21.15.45:0/4155515356 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f676415af70 0x7f67640c1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:39.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.590+0000 7f676abcb700 1 -- 172.21.15.45:0/4155515356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6750004850 msgr2=0x7f67640c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:39.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.590+0000 7f676abcb700 1 --2- 172.21.15.45:0/4155515356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6750004850 0x7f67640c3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:39.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.590+0000 7f676abcb700 1 -- 172.21.15.45:0/4155515356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f676415bd10 con 0x7f676414a670 2023-10-08T12:45:39.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.590+0000 7f6769bc9700 1 --2- 172.21.15.45:0/4155515356 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f676415af70 0x7f67640c1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:39.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.591+0000 7f676abcb700 1 --2- 172.21.15.45:0/4155515356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f676414a670 0x7f676414aaf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f67640b0790 tx=0x7f675c007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:39.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.591+0000 7f675affd700 1 -- 172.21.15.45:0/4155515356 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c00e070 con 0x7f676414a670 2023-10-08T12:45:39.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.591+0000 7f675affd700 1 -- 172.21.15.45:0/4155515356 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f675c00f040 con 0x7f676414a670 2023-10-08T12:45:39.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.591+0000 7f676c62e700 1 -- 172.21.15.45:0/4155515356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f676415bff0 con 0x7f676414a670 2023-10-08T12:45:39.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.591+0000 7f675affd700 1 -- 172.21.15.45:0/4155515356 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c0108c0 con 0x7f676414a670 2023-10-08T12:45:39.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.591+0000 7f676c62e700 1 -- 172.21.15.45:0/4155515356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f676415b3f0 con 0x7f676414a670 2023-10-08T12:45:39.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.592+0000 7f676c62e700 1 -- 172.21.15.45:0/4155515356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67640674a0 con 0x7f676414a670 2023-10-08T12:45:39.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.592+0000 7f675affd700 1 -- 172.21.15.45:0/4155515356 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f675c010a20 con 0x7f676414a670 2023-10-08T12:45:39.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.593+0000 7f675affd700 1 --2- 172.21.15.45:0/4155515356 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f674806af00 0x7f674806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:39.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.593+0000 7f675affd700 1 -- 172.21.15.45:0/4155515356 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f675c089d70 con 0x7f676414a670 2023-10-08T12:45:39.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.593+0000 7f676a3ca700 1 --2- 172.21.15.45:0/4155515356 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f674806af00 0x7f674806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:39.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.593+0000 7f676a3ca700 1 --2- 172.21.15.45:0/4155515356 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f674806af00 0x7f674806d3c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6754006fd0 tx=0x7f6754006cd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:39.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.597+0000 7f675affd700 1 -- 172.21.15.45:0/4155515356 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f675c054cf0 con 0x7f676414a670 2023-10-08T12:45:39.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.842+0000 7f676c62e700 1 -- 172.21.15.45:0/4155515356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f676415c510 con 0x7f676414a670 2023-10-08T12:45:39.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.842+0000 7f675affd700 1 -- 172.21.15.45:0/4155515356 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f676415c510 con 0x7f676414a670 2023-10-08T12:45:39.843 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:39.843 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-08T12:45:39.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.844+0000 7f676c62e700 1 -- 172.21.15.45:0/4155515356 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f674806af00 msgr2=0x7f674806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:39.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.844+0000 7f676c62e700 1 --2- 172.21.15.45:0/4155515356 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f674806af00 0x7f674806d3c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6754006fd0 tx=0x7f6754006cd0 comp rx=0 tx=0).stop 2023-10-08T12:45:39.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.844+0000 7f676c62e700 1 -- 172.21.15.45:0/4155515356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f676414a670 msgr2=0x7f676414aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:39.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.844+0000 7f676c62e700 1 --2- 172.21.15.45:0/4155515356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f676414a670 0x7f676414aaf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f67640b0790 tx=0x7f675c007ec0 comp rx=0 tx=0).stop 2023-10-08T12:45:39.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.844+0000 7f676c62e700 1 -- 172.21.15.45:0/4155515356 shutdown_connections 2023-10-08T12:45:39.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.844+0000 7f676c62e700 1 --2- 172.21.15.45:0/4155515356 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f674806af00 0x7f674806d3c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:39.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.844+0000 7f676c62e700 1 --2- 172.21.15.45:0/4155515356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f676414a670 0x7f676414aaf0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:39.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.844+0000 7f676c62e700 1 --2- 172.21.15.45:0/4155515356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6750004850 0x7f67640c3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:39.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.844+0000 7f676c62e700 1 --2- 172.21.15.45:0/4155515356 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f676415af70 0x7f67640c1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:39.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.844+0000 7f676c62e700 1 -- 172.21.15.45:0/4155515356 >> 172.21.15.45:0/4155515356 conn(0x7f67640afb60 msgr2=0x7f67640b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:39.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.844+0000 7f676c62e700 1 -- 172.21.15.45:0/4155515356 shutdown_connections 2023-10-08T12:45:39.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.844+0000 7f676c62e700 1 -- 172.21.15.45:0/4155515356 wait complete. 2023-10-08T12:45:39.857 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-08T12:45:39.858 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:45:39.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.983+0000 7f530fba2700 1 -- 172.21.15.45:0/539526595 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5308158950 msgr2=0x7f53080cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:39.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.983+0000 7f530fba2700 1 --2- 172.21.15.45:0/539526595 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5308158950 0x7f53080cdf60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f530806d490 tx=0x7f5304009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:39.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.983+0000 7f530fba2700 1 -- 172.21.15.45:0/539526595 shutdown_connections 2023-10-08T12:45:39.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.983+0000 7f530fba2700 1 --2- 172.21.15.45:0/539526595 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f53080724c0 0x7f53080c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:39.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.983+0000 7f530fba2700 1 --2- 172.21.15.45:0/539526595 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5308158950 0x7f53080cdf60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:39.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.983+0000 7f530fba2700 1 --2- 172.21.15.45:0/539526595 >> v2:172.21.15.78:3300/0 conn(0x7f530815c320 0x7f5308071f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:39.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.983+0000 7f530fba2700 1 -- 172.21.15.45:0/539526595 >> 172.21.15.45:0/539526595 conn(0x7f53080b0430 msgr2=0x7f53080b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:39.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.983+0000 7f530fba2700 1 -- 172.21.15.45:0/539526595 shutdown_connections 2023-10-08T12:45:39.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.983+0000 7f530fba2700 1 -- 172.21.15.45:0/539526595 wait complete. 2023-10-08T12:45:39.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.984+0000 7f530fba2700 1 Processor -- start 2023-10-08T12:45:39.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.984+0000 7f530fba2700 1 -- start start 2023-10-08T12:45:39.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.985+0000 7f530fba2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53080724c0 0x7f53080aa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:39.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.985+0000 7f530fba2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5308158950 0x7f53081f1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:39.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.985+0000 7f530fba2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f530815c320 0x7f53080cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:39.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.985+0000 7f530fba2700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53080ae8d0 con 0x7f5308158950 2023-10-08T12:45:39.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.985+0000 7f530fba2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53080ad320 con 0x7f53080724c0 2023-10-08T12:45:39.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.985+0000 7f530fba2700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53081f1e70 con 0x7f530815c320 2023-10-08T12:45:39.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.985+0000 7f530d13d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5308158950 0x7f53081f1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:39.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.985+0000 7f530d13d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5308158950 0x7f53081f1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35456/0 (socket says 172.21.15.45:35456) 2023-10-08T12:45:39.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.985+0000 7f530d13d700 1 -- 172.21.15.45:0/196947837 learned_addr learned my addr 172.21.15.45:0/196947837 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:39.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.985+0000 7f530d93e700 1 --2- 172.21.15.45:0/196947837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53080724c0 0x7f53080aa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:39.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.985+0000 7f530e13f700 1 --2- 172.21.15.45:0/196947837 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f530815c320 0x7f53080cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:39.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.985+0000 7f530d13d700 1 -- 172.21.15.45:0/196947837 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f530815c320 msgr2=0x7f53080cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:39.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.985+0000 7f530d13d700 1 --2- 172.21.15.45:0/196947837 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f530815c320 0x7f53080cb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:39.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.985+0000 7f530d13d700 1 -- 172.21.15.45:0/196947837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53080724c0 msgr2=0x7f53080aa8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:39.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.985+0000 7f530d13d700 1 --2- 172.21.15.45:0/196947837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53080724c0 0x7f53080aa8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:39.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.985+0000 7f530d13d700 1 -- 172.21.15.45:0/196947837 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53040095f0 con 0x7f5308158950 2023-10-08T12:45:39.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.985+0000 7f530d93e700 1 --2- 172.21.15.45:0/196947837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53080724c0 0x7f53080aa8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:39.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.985+0000 7f530d13d700 1 --2- 172.21.15.45:0/196947837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5308158950 0x7f53081f1930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f52fc00d950 tx=0x7f52fc00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:39.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.986+0000 7f52fa7fc700 1 -- 172.21.15.45:0/196947837 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc009930 con 0x7f5308158950 2023-10-08T12:45:39.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.986+0000 7f52fa7fc700 1 -- 172.21.15.45:0/196947837 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f52fc009b80 con 0x7f5308158950 2023-10-08T12:45:39.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.986+0000 7f530fba2700 1 -- 172.21.15.45:0/196947837 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53080aaf30 con 0x7f5308158950 2023-10-08T12:45:39.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.986+0000 7f52fa7fc700 1 -- 172.21.15.45:0/196947837 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc010460 con 0x7f5308158950 2023-10-08T12:45:39.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.986+0000 7f530fba2700 1 -- 172.21.15.45:0/196947837 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53080ae210 con 0x7f5308158950 2023-10-08T12:45:39.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.987+0000 7f530fba2700 1 -- 172.21.15.45:0/196947837 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53080aea10 con 0x7f5308158950 2023-10-08T12:45:39.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.987+0000 7f52fa7fc700 1 -- 172.21.15.45:0/196947837 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f52fc0105c0 con 0x7f5308158950 2023-10-08T12:45:39.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.987+0000 7f52fa7fc700 1 --2- 172.21.15.45:0/196947837 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f52ec06af00 0x7f52ec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:39.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.987+0000 7f52fa7fc700 1 -- 172.21.15.45:0/196947837 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52fc0898f0 con 0x7f5308158950 2023-10-08T12:45:39.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.988+0000 7f530d93e700 1 --2- 172.21.15.45:0/196947837 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f52ec06af00 0x7f52ec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:39.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.988+0000 7f530d93e700 1 --2- 172.21.15.45:0/196947837 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f52ec06af00 0x7f52ec06d3c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f53040098e0 tx=0x7f53040047c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:39.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:39.992+0000 7f52fa7fc700 1 -- 172.21.15.45:0/196947837 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f53080aea10 con 0x7f5308158950 2023-10-08T12:45:40.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.192+0000 7f530fba2700 1 -- 172.21.15.45:0/196947837 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53080aea10 con 0x7f5308158950 2023-10-08T12:45:40.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.194+0000 7f52fa7fc700 1 -- 172.21.15.45:0/196947837 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f53080aea10 con 0x7f5308158950 2023-10-08T12:45:40.195 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:40.195 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:45:26.206424+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:45:19.183651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:45:22.277383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:45:23.606639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.412453+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.351925+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.428025+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.437246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.441119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.388608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.415524+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.401835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:45:40.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.196+0000 7f530fba2700 1 -- 172.21.15.45:0/196947837 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f52ec06af00 msgr2=0x7f52ec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.196+0000 7f530fba2700 1 --2- 172.21.15.45:0/196947837 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f52ec06af00 0x7f52ec06d3c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f53040098e0 tx=0x7f53040047c0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.196+0000 7f530fba2700 1 -- 172.21.15.45:0/196947837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5308158950 msgr2=0x7f53081f1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.196+0000 7f530fba2700 1 --2- 172.21.15.45:0/196947837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5308158950 0x7f53081f1930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f52fc00d950 tx=0x7f52fc00dd10 comp rx=0 tx=0).stop 2023-10-08T12:45:40.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.196+0000 7f530fba2700 1 -- 172.21.15.45:0/196947837 shutdown_connections 2023-10-08T12:45:40.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.196+0000 7f530fba2700 1 --2- 172.21.15.45:0/196947837 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f52ec06af00 0x7f52ec06d3c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.196+0000 7f530fba2700 1 --2- 172.21.15.45:0/196947837 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f530815c320 0x7f53080cb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.196+0000 7f530fba2700 1 --2- 172.21.15.45:0/196947837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53080724c0 0x7f53080aa8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.196+0000 7f530fba2700 1 --2- 172.21.15.45:0/196947837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5308158950 0x7f53081f1930 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.196+0000 7f530fba2700 1 -- 172.21.15.45:0/196947837 >> 172.21.15.45:0/196947837 conn(0x7f53080b0430 msgr2=0x7f53080ceae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.196+0000 7f530fba2700 1 -- 172.21.15.45:0/196947837 shutdown_connections 2023-10-08T12:45:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.196+0000 7f530fba2700 1 -- 172.21.15.45:0/196947837 wait complete. 2023-10-08T12:45:40.209 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:45:19.183651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:45:22.277383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:45:23.606639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:45:40.210 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:45:40.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.340+0000 7fa90a8dd700 1 -- 172.21.15.45:0/504268981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8f0004d90 msgr2=0x7fa8f0005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.340+0000 7fa90a8dd700 1 --2- 172.21.15.45:0/504268981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8f0004d90 0x7fa8f0005210 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa9040cc110 tx=0x7fa8f0005880 comp rx=0 tx=0).stop 2023-10-08T12:45:40.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.340+0000 7fa908e7a700 1 -- 172.21.15.45:0/504268981 reap_dead start 2023-10-08T12:45:40.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.340+0000 7fa90a8dd700 1 -- 172.21.15.45:0/504268981 shutdown_connections 2023-10-08T12:45:40.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.340+0000 7fa90a8dd700 1 -- 172.21.15.45:0/504268981 >> 172.21.15.45:0/504268981 conn(0x7fa904097a20 msgr2=0x7fa9040ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:40.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.340+0000 7fa90a8dd700 1 -- 172.21.15.45:0/504268981 shutdown_connections 2023-10-08T12:45:40.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.340+0000 7fa90a8dd700 1 -- 172.21.15.45:0/504268981 wait complete. 2023-10-08T12:45:40.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.341+0000 7fa90a8dd700 1 Processor -- start 2023-10-08T12:45:40.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.341+0000 7fa90a8dd700 1 -- start start 2023-10-08T12:45:40.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.342+0000 7fa90a8dd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8f0004d90 0x7fa904156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.342+0000 7fa90a8dd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa904098470 0x7fa904145080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.342+0000 7fa90a8dd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa90415aa00 0x7fa90415aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.342+0000 7fa90a8dd700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90415b3f0 con 0x7fa904098470 2023-10-08T12:45:40.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.342+0000 7fa90a8dd700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9040c8ad0 con 0x7fa8f0004d90 2023-10-08T12:45:40.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.342+0000 7fa90a8dd700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa904142710 con 0x7fa90415aa00 2023-10-08T12:45:40.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.342+0000 7fa9037fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa904098470 0x7fa904145080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.342+0000 7fa9037fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa904098470 0x7fa904145080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35474/0 (socket says 172.21.15.45:35474) 2023-10-08T12:45:40.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.342+0000 7fa9037fe700 1 -- 172.21.15.45:0/2326668564 learned_addr learned my addr 172.21.15.45:0/2326668564 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:40.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.342+0000 7fa903fff700 1 --2- 172.21.15.45:0/2326668564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8f0004d90 0x7fa904156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.342+0000 7fa908e7a700 1 --2- 172.21.15.45:0/2326668564 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa90415aa00 0x7fa90415aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.342+0000 7fa9037fe700 1 -- 172.21.15.45:0/2326668564 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa90415aa00 msgr2=0x7fa90415aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.342+0000 7fa9037fe700 1 --2- 172.21.15.45:0/2326668564 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa90415aa00 0x7fa90415aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.342+0000 7fa9037fe700 1 -- 172.21.15.45:0/2326668564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8f0004d90 msgr2=0x7fa904156510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.342+0000 7fa9037fe700 1 --2- 172.21.15.45:0/2326668564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8f0004d90 0x7fa904156510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.342+0000 7fa9037fe700 1 -- 172.21.15.45:0/2326668564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa904156a50 con 0x7fa904098470 2023-10-08T12:45:40.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.342+0000 7fa908e7a700 1 --2- 172.21.15.45:0/2326668564 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa90415aa00 0x7fa90415aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:40.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.342+0000 7fa903fff700 1 --2- 172.21.15.45:0/2326668564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8f0004d90 0x7fa904156510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:40.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.342+0000 7fa9037fe700 1 --2- 172.21.15.45:0/2326668564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa904098470 0x7fa904145080 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec006660 tx=0x7fa8ec006740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:40.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.343+0000 7fa900ff9700 1 -- 172.21.15.45:0/2326668564 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec011840 con 0x7fa904098470 2023-10-08T12:45:40.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.343+0000 7fa900ff9700 1 -- 172.21.15.45:0/2326668564 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa8ec0119c0 con 0x7fa904098470 2023-10-08T12:45:40.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.343+0000 7fa900ff9700 1 -- 172.21.15.45:0/2326668564 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec011dd0 con 0x7fa904098470 2023-10-08T12:45:40.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.343+0000 7fa90a8dd700 1 -- 172.21.15.45:0/2326668564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9041455c0 con 0x7fa904098470 2023-10-08T12:45:40.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.343+0000 7fa90a8dd700 1 -- 172.21.15.45:0/2326668564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9040c5d20 con 0x7fa904098470 2023-10-08T12:45:40.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.344+0000 7fa90a8dd700 1 -- 172.21.15.45:0/2326668564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa904066850 con 0x7fa904098470 2023-10-08T12:45:40.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.344+0000 7fa900ff9700 1 -- 172.21.15.45:0/2326668564 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa8ec0103c0 con 0x7fa904098470 2023-10-08T12:45:40.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.345+0000 7fa900ff9700 1 --2- 172.21.15.45:0/2326668564 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa8e406af00 0x7fa8e406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.345+0000 7fa900ff9700 1 -- 172.21.15.45:0/2326668564 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8ec08a6e0 con 0x7fa904098470 2023-10-08T12:45:40.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.345+0000 7fa903fff700 1 --2- 172.21.15.45:0/2326668564 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa8e406af00 0x7fa8e406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.345+0000 7fa903fff700 1 --2- 172.21.15.45:0/2326668564 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa8e406af00 0x7fa8e406d3c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4006fd0 tx=0x7fa8f4006bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:40.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.349+0000 7fa900ff9700 1 -- 172.21.15.45:0/2326668564 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa8ec055700 con 0x7fa904098470 2023-10-08T12:45:40.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.549+0000 7fa90a8dd700 1 -- 172.21.15.45:0/2326668564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa904142850 con 0x7fa904098470 2023-10-08T12:45:40.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.550+0000 7fa900ff9700 1 -- 172.21.15.45:0/2326668564 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa8ec015070 con 0x7fa904098470 2023-10-08T12:45:40.551 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-08T12:45:40.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.552+0000 7fa90a8dd700 1 -- 172.21.15.45:0/2326668564 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa8e406af00 msgr2=0x7fa8e406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.552+0000 7fa90a8dd700 1 --2- 172.21.15.45:0/2326668564 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa8e406af00 0x7fa8e406d3c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4006fd0 tx=0x7fa8f4006bc0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.552+0000 7fa90a8dd700 1 -- 172.21.15.45:0/2326668564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa904098470 msgr2=0x7fa904145080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.552+0000 7fa90a8dd700 1 --2- 172.21.15.45:0/2326668564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa904098470 0x7fa904145080 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec006660 tx=0x7fa8ec006740 comp rx=0 tx=0).stop 2023-10-08T12:45:40.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.552+0000 7fa90a8dd700 1 -- 172.21.15.45:0/2326668564 shutdown_connections 2023-10-08T12:45:40.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.552+0000 7fa90a8dd700 1 --2- 172.21.15.45:0/2326668564 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa8e406af00 0x7fa8e406d3c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.552+0000 7fa90a8dd700 1 --2- 172.21.15.45:0/2326668564 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa90415aa00 0x7fa90415aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.552+0000 7fa90a8dd700 1 --2- 172.21.15.45:0/2326668564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8f0004d90 0x7fa904156510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.552+0000 7fa90a8dd700 1 --2- 172.21.15.45:0/2326668564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa904098470 0x7fa904145080 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.552+0000 7fa90a8dd700 1 -- 172.21.15.45:0/2326668564 >> 172.21.15.45:0/2326668564 conn(0x7fa904097a20 msgr2=0x7fa90406ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:40.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.552+0000 7fa90a8dd700 1 -- 172.21.15.45:0/2326668564 shutdown_connections 2023-10-08T12:45:40.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.552+0000 7fa90a8dd700 1 -- 172.21.15.45:0/2326668564 wait complete. 2023-10-08T12:45:40.565 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:45:40.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.694+0000 7f536d39a700 1 -- 172.21.15.45:0/374954248 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f536815bbf0 msgr2=0x7f53680d14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.694+0000 7f536d39a700 1 --2- 172.21.15.45:0/374954248 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f536815bbf0 0x7f53680d14c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f535c0098c0 tx=0x7f535c009bd0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.694+0000 7f536d39a700 1 -- 172.21.15.45:0/374954248 shutdown_connections 2023-10-08T12:45:40.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.694+0000 7f536d39a700 1 --2- 172.21.15.45:0/374954248 >> v2:172.21.15.78:3300/0 conn(0x7f53680ccde0 0x7f53680cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.694+0000 7f536d39a700 1 --2- 172.21.15.45:0/374954248 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f536815bbf0 0x7f53680d14c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.694+0000 7f536d39a700 1 -- 172.21.15.45:0/374954248 >> 172.21.15.45:0/374954248 conn(0x7f5368071940 msgr2=0x7f5368071d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:40.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.694+0000 7f536d39a700 1 -- 172.21.15.45:0/374954248 shutdown_connections 2023-10-08T12:45:40.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.694+0000 7f536d39a700 1 -- 172.21.15.45:0/374954248 wait complete. 2023-10-08T12:45:40.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.695+0000 7f536d39a700 1 Processor -- start 2023-10-08T12:45:40.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.695+0000 7f536d39a700 1 -- start start 2023-10-08T12:45:40.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.696+0000 7f536d39a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53680ccde0 0x7f5368159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.696+0000 7f536d39a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f53680cee20 0x7f5368156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.696+0000 7f536d39a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f536815bbf0 0x7f5368071d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.696+0000 7f536d39a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53680b24d0 con 0x7f53680ccde0 2023-10-08T12:45:40.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.696+0000 7f536d39a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5368159b70 con 0x7f536815bbf0 2023-10-08T12:45:40.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.696+0000 7f536d39a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53680caca0 con 0x7f53680cee20 2023-10-08T12:45:40.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.696+0000 7f5366ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53680ccde0 0x7f5368159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.696+0000 7f5366ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53680ccde0 0x7f5368159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35486/0 (socket says 172.21.15.45:35486) 2023-10-08T12:45:40.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.696+0000 7f5366ffd700 1 -- 172.21.15.45:0/3892063238 learned_addr learned my addr 172.21.15.45:0/3892063238 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:40.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.696+0000 7f53677fe700 1 --2- 172.21.15.45:0/3892063238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f536815bbf0 0x7f5368071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.696+0000 7f53667fc700 1 --2- 172.21.15.45:0/3892063238 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f53680cee20 0x7f5368156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.696+0000 7f5366ffd700 1 -- 172.21.15.45:0/3892063238 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f53680cee20 msgr2=0x7f5368156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.696+0000 7f5366ffd700 1 --2- 172.21.15.45:0/3892063238 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f53680cee20 0x7f5368156000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.696+0000 7f5366ffd700 1 -- 172.21.15.45:0/3892063238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f536815bbf0 msgr2=0x7f5368071d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.696+0000 7f5366ffd700 1 --2- 172.21.15.45:0/3892063238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f536815bbf0 0x7f5368071d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.696+0000 7f5366ffd700 1 -- 172.21.15.45:0/3892063238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535c009520 con 0x7f53680ccde0 2023-10-08T12:45:40.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.697+0000 7f5366ffd700 1 --2- 172.21.15.45:0/3892063238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53680ccde0 0x7f5368159630 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f535c009230 tx=0x7f535c00f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:40.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.697+0000 7f534f7fe700 1 -- 172.21.15.45:0/3892063238 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c00fb10 con 0x7f53680ccde0 2023-10-08T12:45:40.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.697+0000 7f534f7fe700 1 -- 172.21.15.45:0/3892063238 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f535c00fd80 con 0x7f53680ccde0 2023-10-08T12:45:40.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.697+0000 7f534f7fe700 1 -- 172.21.15.45:0/3892063238 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c020670 con 0x7f53680ccde0 2023-10-08T12:45:40.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.697+0000 7f536d39a700 1 -- 172.21.15.45:0/3892063238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5368156540 con 0x7f53680ccde0 2023-10-08T12:45:40.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.697+0000 7f536d39a700 1 -- 172.21.15.45:0/3892063238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53680cb1d0 con 0x7f53680ccde0 2023-10-08T12:45:40.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.698+0000 7f536d39a700 1 -- 172.21.15.45:0/3892063238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5368066850 con 0x7f53680ccde0 2023-10-08T12:45:40.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.698+0000 7f534f7fe700 1 -- 172.21.15.45:0/3892063238 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f535c017400 con 0x7f53680ccde0 2023-10-08T12:45:40.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.699+0000 7f534f7fe700 1 --2- 172.21.15.45:0/3892063238 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f535406aed0 0x7f535406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:40.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.699+0000 7f534f7fe700 1 -- 172.21.15.45:0/3892063238 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f535c08a680 con 0x7f53680ccde0 2023-10-08T12:45:40.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.699+0000 7f53667fc700 1 --2- 172.21.15.45:0/3892063238 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f535406aed0 0x7f535406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:40.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.699+0000 7f53667fc700 1 --2- 172.21.15.45:0/3892063238 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f535406aed0 0x7f535406d390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f53681f5100 tx=0x7f5358007f40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:40.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.703+0000 7f534f7fe700 1 -- 172.21.15.45:0/3892063238 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f535c0557c0 con 0x7f53680ccde0 2023-10-08T12:45:40.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.901+0000 7f536d39a700 1 -- 172.21.15.45:0/3892063238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f53680c7ff0 con 0x7f53680ccde0 2023-10-08T12:45:40.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.901+0000 7f534f7fe700 1 -- 172.21.15.45:0/3892063238 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f535c058de0 con 0x7f53680ccde0 2023-10-08T12:45:40.902 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-08T12:45:40.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.903+0000 7f536d39a700 1 -- 172.21.15.45:0/3892063238 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f535406aed0 msgr2=0x7f535406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.903+0000 7f536d39a700 1 --2- 172.21.15.45:0/3892063238 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f535406aed0 0x7f535406d390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f53681f5100 tx=0x7f5358007f40 comp rx=0 tx=0).stop 2023-10-08T12:45:40.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.903+0000 7f536d39a700 1 -- 172.21.15.45:0/3892063238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53680ccde0 msgr2=0x7f5368159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:40.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.903+0000 7f536d39a700 1 --2- 172.21.15.45:0/3892063238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53680ccde0 0x7f5368159630 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f535c009230 tx=0x7f535c00f710 comp rx=0 tx=0).stop 2023-10-08T12:45:40.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.903+0000 7f536d39a700 1 -- 172.21.15.45:0/3892063238 shutdown_connections 2023-10-08T12:45:40.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.903+0000 7f536d39a700 1 --2- 172.21.15.45:0/3892063238 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f535406aed0 0x7f535406d390 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.903+0000 7f536d39a700 1 --2- 172.21.15.45:0/3892063238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f536815bbf0 0x7f5368071d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.903+0000 7f536d39a700 1 --2- 172.21.15.45:0/3892063238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53680ccde0 0x7f5368159630 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.903+0000 7f536d39a700 1 --2- 172.21.15.45:0/3892063238 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f53680cee20 0x7f5368156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:40.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.903+0000 7f536d39a700 1 -- 172.21.15.45:0/3892063238 >> 172.21.15.45:0/3892063238 conn(0x7f5368071940 msgr2=0x7f536815d960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:40.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.903+0000 7f536d39a700 1 -- 172.21.15.45:0/3892063238 shutdown_connections 2023-10-08T12:45:40.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:40.903+0000 7f536d39a700 1 -- 172.21.15.45:0/3892063238 wait complete. 2023-10-08T12:45:40.916 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:45:41.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.046+0000 7f7b7157a700 1 -- 172.21.15.45:0/2452294947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b54003a00 msgr2=0x7f7b54003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:41.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.046+0000 7f7b7157a700 1 --2- 172.21.15.45:0/2452294947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b54003a00 0x7f7b54003e20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00c310 tx=0x7f7b54005880 comp rx=0 tx=0).stop 2023-10-08T12:45:41.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.046+0000 7f7b6b7fe700 1 -- 172.21.15.45:0/2452294947 reap_dead start 2023-10-08T12:45:41.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.046+0000 7f7b7157a700 1 -- 172.21.15.45:0/2452294947 shutdown_connections 2023-10-08T12:45:41.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.046+0000 7f7b7157a700 1 -- 172.21.15.45:0/2452294947 >> 172.21.15.45:0/2452294947 conn(0x7f7b6c071940 msgr2=0x7f7b6c071d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:41.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.046+0000 7f7b7157a700 1 -- 172.21.15.45:0/2452294947 shutdown_connections 2023-10-08T12:45:41.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.046+0000 7f7b7157a700 1 -- 172.21.15.45:0/2452294947 wait complete. 2023-10-08T12:45:41.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.048+0000 7f7b7157a700 1 Processor -- start 2023-10-08T12:45:41.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.048+0000 7f7b7157a700 1 -- start start 2023-10-08T12:45:41.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.048+0000 7f7b7157a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b54003a00 0x7f7b6c1f54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:41.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.049+0000 7f7b7157a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7b6c0b1360 0x7f7b6c1f1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:41.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.049+0000 7f7b7157a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b6c144220 0x7f7b6c0b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:41.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.049+0000 7f7b7157a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c0c6c60 con 0x7f7b6c144220 2023-10-08T12:45:41.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.049+0000 7f7b7157a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c1f5cf0 con 0x7f7b54003a00 2023-10-08T12:45:41.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.049+0000 7f7b7157a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c1f5fd0 con 0x7f7b6c0b1360 2023-10-08T12:45:41.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.049+0000 7f7b6b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b6c144220 0x7f7b6c0b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:41.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.049+0000 7f7b6b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b6c144220 0x7f7b6c0b61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35510/0 (socket says 172.21.15.45:35510) 2023-10-08T12:45:41.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.049+0000 7f7b6b7fe700 1 -- 172.21.15.45:0/501498396 learned_addr learned my addr 172.21.15.45:0/501498396 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:41.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.049+0000 7f7b6affd700 1 --2- 172.21.15.45:0/501498396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b54003a00 0x7f7b6c1f54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:41.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.049+0000 7f7b6a7fc700 1 --2- 172.21.15.45:0/501498396 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7b6c0b1360 0x7f7b6c1f1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:41.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.049+0000 7f7b6b7fe700 1 -- 172.21.15.45:0/501498396 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7b6c0b1360 msgr2=0x7f7b6c1f1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:41.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.049+0000 7f7b6b7fe700 1 --2- 172.21.15.45:0/501498396 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7b6c0b1360 0x7f7b6c1f1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.049+0000 7f7b6b7fe700 1 -- 172.21.15.45:0/501498396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b54003a00 msgr2=0x7f7b6c1f54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:41.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.049+0000 7f7b6b7fe700 1 --2- 172.21.15.45:0/501498396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b54003a00 0x7f7b6c1f54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.049+0000 7f7b6b7fe700 1 -- 172.21.15.45:0/501498396 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b6c1f62b0 con 0x7f7b6c144220 2023-10-08T12:45:41.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.049+0000 7f7b6a7fc700 1 --2- 172.21.15.45:0/501498396 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7b6c0b1360 0x7f7b6c1f1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:41.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.049+0000 7f7b6b7fe700 1 --2- 172.21.15.45:0/501498396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b6c144220 0x7f7b6c0b61d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c072670 tx=0x7f7b6400f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:41.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.049+0000 7f7b537fe700 1 -- 172.21.15.45:0/501498396 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b64019070 con 0x7f7b6c144220 2023-10-08T12:45:41.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.049+0000 7f7b537fe700 1 -- 172.21.15.45:0/501498396 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7b6400f040 con 0x7f7b6c144220 2023-10-08T12:45:41.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.049+0000 7f7b7157a700 1 -- 172.21.15.45:0/501498396 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b6c1f5a00 con 0x7f7b6c144220 2023-10-08T12:45:41.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.049+0000 7f7b537fe700 1 -- 172.21.15.45:0/501498396 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6400e040 con 0x7f7b6c144220 2023-10-08T12:45:41.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.049+0000 7f7b7157a700 1 -- 172.21.15.45:0/501498396 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b6c0c6780 con 0x7f7b6c144220 2023-10-08T12:45:41.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.050+0000 7f7b7157a700 1 -- 172.21.15.45:0/501498396 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b6c0c6da0 con 0x7f7b6c144220 2023-10-08T12:45:41.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.051+0000 7f7b537fe700 1 -- 172.21.15.45:0/501498396 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7b64003a00 con 0x7f7b6c144220 2023-10-08T12:45:41.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.051+0000 7f7b537fe700 1 --2- 172.21.15.45:0/501498396 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f7b5806aed0 0x7f7b5806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:41.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.051+0000 7f7b537fe700 1 -- 172.21.15.45:0/501498396 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b64089210 con 0x7f7b6c144220 2023-10-08T12:45:41.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.051+0000 7f7b6affd700 1 --2- 172.21.15.45:0/501498396 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f7b5806aed0 0x7f7b5806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:41.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.052+0000 7f7b6affd700 1 --2- 172.21.15.45:0/501498396 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f7b5806aed0 0x7f7b5806d390 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c001050 tx=0x7f7b5c001a00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:41.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.056+0000 7f7b537fe700 1 -- 172.21.15.45:0/501498396 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7b6c0c6da0 con 0x7f7b6c144220 2023-10-08T12:45:41.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.259+0000 7f7b7157a700 1 -- 172.21.15.45:0/501498396 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7b6c0c6da0 con 0x7f7b6c144220 2023-10-08T12:45:41.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.259+0000 7f7b537fe700 1 -- 172.21.15.45:0/501498396 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7b6c0c6da0 con 0x7f7b6c144220 2023-10-08T12:45:41.260 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-08T12:45:41.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.261+0000 7f7b7157a700 1 -- 172.21.15.45:0/501498396 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f7b5806aed0 msgr2=0x7f7b5806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:41.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.261+0000 7f7b7157a700 1 --2- 172.21.15.45:0/501498396 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f7b5806aed0 0x7f7b5806d390 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c001050 tx=0x7f7b5c001a00 comp rx=0 tx=0).stop 2023-10-08T12:45:41.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.261+0000 7f7b7157a700 1 -- 172.21.15.45:0/501498396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b6c144220 msgr2=0x7f7b6c0b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:41.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.261+0000 7f7b7157a700 1 --2- 172.21.15.45:0/501498396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b6c144220 0x7f7b6c0b61d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c072670 tx=0x7f7b6400f490 comp rx=0 tx=0).stop 2023-10-08T12:45:41.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.261+0000 7f7b7157a700 1 -- 172.21.15.45:0/501498396 shutdown_connections 2023-10-08T12:45:41.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.261+0000 7f7b7157a700 1 --2- 172.21.15.45:0/501498396 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f7b5806aed0 0x7f7b5806d390 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.261+0000 7f7b7157a700 1 --2- 172.21.15.45:0/501498396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b6c144220 0x7f7b6c0b61d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.261+0000 7f7b7157a700 1 --2- 172.21.15.45:0/501498396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b54003a00 0x7f7b6c1f54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.261+0000 7f7b7157a700 1 --2- 172.21.15.45:0/501498396 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7b6c0b1360 0x7f7b6c1f1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.261+0000 7f7b7157a700 1 -- 172.21.15.45:0/501498396 >> 172.21.15.45:0/501498396 conn(0x7f7b6c071940 msgr2=0x7f7b6c0cc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:41.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.261+0000 7f7b7157a700 1 -- 172.21.15.45:0/501498396 shutdown_connections 2023-10-08T12:45:41.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.262+0000 7f7b7157a700 1 -- 172.21.15.45:0/501498396 wait complete. 2023-10-08T12:45:41.274 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:45:41.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.401+0000 7f8cbfaaf700 1 -- 172.21.15.45:0/3216109036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ca4003a00 msgr2=0x7f8ca4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:41.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.401+0000 7f8cbfaaf700 1 --2- 172.21.15.45:0/3216109036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ca4003a00 0x7f8ca4003e20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8cac009be0 tx=0x7f8ca4005880 comp rx=0 tx=0).stop 2023-10-08T12:45:41.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.401+0000 7f8cbe04c700 1 -- 172.21.15.45:0/3216109036 reap_dead start 2023-10-08T12:45:41.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.401+0000 7f8cbfaaf700 1 -- 172.21.15.45:0/3216109036 shutdown_connections 2023-10-08T12:45:41.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.401+0000 7f8cbfaaf700 1 -- 172.21.15.45:0/3216109036 >> 172.21.15.45:0/3216109036 conn(0x7f8cb80b0430 msgr2=0x7f8cb80b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:41.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.401+0000 7f8cbfaaf700 1 -- 172.21.15.45:0/3216109036 shutdown_connections 2023-10-08T12:45:41.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.401+0000 7f8cbfaaf700 1 -- 172.21.15.45:0/3216109036 wait complete. 2023-10-08T12:45:41.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.402+0000 7f8cbfaaf700 1 Processor -- start 2023-10-08T12:45:41.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.403+0000 7f8cbfaaf700 1 -- start start 2023-10-08T12:45:41.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.403+0000 7f8cbfaaf700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8ca4003a00 0x7f8cb814cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:41.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.403+0000 7f8cbfaaf700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cb80aac90 0x7f8cb80acc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:41.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.403+0000 7f8cbfaaf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cb80ad160 0x7f8cb8158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:41.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.403+0000 7f8cbfaaf700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb80ab120 con 0x7f8cb80aac90 2023-10-08T12:45:41.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.403+0000 7f8cbfaaf700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb80ab400 con 0x7f8cb80ad160 2023-10-08T12:45:41.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.403+0000 7f8cbfaaf700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb80ab6e0 con 0x7f8ca4003a00 2023-10-08T12:45:41.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.403+0000 7f8cbd04a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cb80aac90 0x7f8cb80acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:41.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.403+0000 7f8cbd04a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cb80aac90 0x7f8cb80acc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35528/0 (socket says 172.21.15.45:35528) 2023-10-08T12:45:41.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.403+0000 7f8cbd04a700 1 -- 172.21.15.45:0/2301888721 learned_addr learned my addr 172.21.15.45:0/2301888721 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:41.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.403+0000 7f8cbd84b700 1 --2- 172.21.15.45:0/2301888721 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8ca4003a00 0x7f8cb814cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:41.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.403+0000 7f8cbe04c700 1 --2- 172.21.15.45:0/2301888721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cb80ad160 0x7f8cb8158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:41.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.404+0000 7f8cbd04a700 1 -- 172.21.15.45:0/2301888721 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8ca4003a00 msgr2=0x7f8cb814cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:41.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.404+0000 7f8cbd04a700 1 --2- 172.21.15.45:0/2301888721 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8ca4003a00 0x7f8cb814cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.404+0000 7f8cbd04a700 1 -- 172.21.15.45:0/2301888721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cb80ad160 msgr2=0x7f8cb8158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:41.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.404+0000 7f8cbd04a700 1 --2- 172.21.15.45:0/2301888721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cb80ad160 0x7f8cb8158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.404+0000 7f8cbd04a700 1 -- 172.21.15.45:0/2301888721 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb80ab9c0 con 0x7f8cb80aac90 2023-10-08T12:45:41.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.404+0000 7f8cbe04c700 1 --2- 172.21.15.45:0/2301888721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cb80ad160 0x7f8cb8158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:41.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.404+0000 7f8cbd84b700 1 --2- 172.21.15.45:0/2301888721 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8ca4003a00 0x7f8cb814cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:41.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.404+0000 7f8cbd04a700 1 --2- 172.21.15.45:0/2301888721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cb80aac90 0x7f8cb80acc20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8cb400e650 tx=0x7f8cb400ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:41.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.404+0000 7f8caa7fc700 1 -- 172.21.15.45:0/2301888721 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb4010890 con 0x7f8cb80aac90 2023-10-08T12:45:41.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.404+0000 7f8caa7fc700 1 -- 172.21.15.45:0/2301888721 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8cb4010ae0 con 0x7f8cb80aac90 2023-10-08T12:45:41.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.404+0000 7f8cbfaaf700 1 -- 172.21.15.45:0/2301888721 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb80abca0 con 0x7f8cb80aac90 2023-10-08T12:45:41.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.404+0000 7f8caa7fc700 1 -- 172.21.15.45:0/2301888721 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb4011460 con 0x7f8cb80aac90 2023-10-08T12:45:41.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.404+0000 7f8cbfaaf700 1 -- 172.21.15.45:0/2301888721 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb80ac1c0 con 0x7f8cb80aac90 2023-10-08T12:45:41.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.405+0000 7f8cbfaaf700 1 -- 172.21.15.45:0/2301888721 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb80abec0 con 0x7f8cb80aac90 2023-10-08T12:45:41.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.405+0000 7f8caa7fc700 1 -- 172.21.15.45:0/2301888721 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8cb40115c0 con 0x7f8cb80aac90 2023-10-08T12:45:41.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.406+0000 7f8caa7fc700 1 --2- 172.21.15.45:0/2301888721 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f8c9c06aed0 0x7f8c9c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:41.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.406+0000 7f8caa7fc700 1 -- 172.21.15.45:0/2301888721 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8cb4089d00 con 0x7f8cb80aac90 2023-10-08T12:45:41.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.406+0000 7f8cbd84b700 1 --2- 172.21.15.45:0/2301888721 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f8c9c06aed0 0x7f8c9c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:41.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.407+0000 7f8cbd84b700 1 --2- 172.21.15.45:0/2301888721 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f8c9c06aed0 0x7f8c9c06d390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8cac009be0 tx=0x7f8cac004750 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:41.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.410+0000 7f8caa7fc700 1 -- 172.21.15.45:0/2301888721 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8cb4054db0 con 0x7f8cb80aac90 2023-10-08T12:45:41.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.655+0000 7f8cbfaaf700 1 -- 172.21.15.45:0/2301888721 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8cb815c7f0 con 0x7f8cb80aac90 2023-10-08T12:45:41.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.655+0000 7f8caa7fc700 1 -- 172.21.15.45:0/2301888721 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7f8cb401f090 con 0x7f8cb80aac90 2023-10-08T12:45:41.656 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:41.656 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4332,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3352988594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3352988594},{"type":"v1","addr":"172.21.15.45:6834","nonce":3352988594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4335,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/448033669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":448033669},{"type":"v1","addr":"172.21.15.45:6835","nonce":448033669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4347,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2935302656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":2935302656},{"type":"v1","addr":"172.21.15.78:6837","nonce":2935302656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T12:45:24.623822+0000","modified":"2023-10-08T12:45:27.649794+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4372},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4372":{"gid":4372,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6836/2145831865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2145831865},{"type":"v1","addr":"172.21.15.78:6836","nonce":2145831865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:45:41.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.657+0000 7f8cbfaaf700 1 -- 172.21.15.45:0/2301888721 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f8c9c06aed0 msgr2=0x7f8c9c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:41.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.657+0000 7f8cbfaaf700 1 --2- 172.21.15.45:0/2301888721 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f8c9c06aed0 0x7f8c9c06d390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8cac009be0 tx=0x7f8cac004750 comp rx=0 tx=0).stop 2023-10-08T12:45:41.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.657+0000 7f8cbfaaf700 1 -- 172.21.15.45:0/2301888721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cb80aac90 msgr2=0x7f8cb80acc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:41.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.657+0000 7f8cbfaaf700 1 --2- 172.21.15.45:0/2301888721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cb80aac90 0x7f8cb80acc20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8cb400e650 tx=0x7f8cb400ea10 comp rx=0 tx=0).stop 2023-10-08T12:45:41.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.657+0000 7f8cbfaaf700 1 -- 172.21.15.45:0/2301888721 shutdown_connections 2023-10-08T12:45:41.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.657+0000 7f8cbfaaf700 1 --2- 172.21.15.45:0/2301888721 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f8c9c06aed0 0x7f8c9c06d390 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.657+0000 7f8cbfaaf700 1 --2- 172.21.15.45:0/2301888721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cb80ad160 0x7f8cb8158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.657+0000 7f8cbfaaf700 1 --2- 172.21.15.45:0/2301888721 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8ca4003a00 0x7f8cb814cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.657+0000 7f8cbfaaf700 1 --2- 172.21.15.45:0/2301888721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cb80aac90 0x7f8cb80acc20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.657+0000 7f8cbfaaf700 1 -- 172.21.15.45:0/2301888721 >> 172.21.15.45:0/2301888721 conn(0x7f8cb80b0430 msgr2=0x7f8cb80af7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:41.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.657+0000 7f8cbfaaf700 1 -- 172.21.15.45:0/2301888721 shutdown_connections 2023-10-08T12:45:41.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.657+0000 7f8cbfaaf700 1 -- 172.21.15.45:0/2301888721 wait complete. 2023-10-08T12:45:41.660 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-10-08T12:45:41.670 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:45:41.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.796+0000 7fb9b69cf700 1 -- 172.21.15.45:0/2102336960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9b00c1680 msgr2=0x7fb9b00c8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:41.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.796+0000 7fb9b69cf700 1 --2- 172.21.15.45:0/2102336960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9b00c1680 0x7fb9b00c8d50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4005fd0 tx=0x7fb9a4009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:41.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.796+0000 7fb9b69cf700 1 -- 172.21.15.45:0/2102336960 shutdown_connections 2023-10-08T12:45:41.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.796+0000 7fb9b69cf700 1 --2- 172.21.15.45:0/2102336960 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb9b006b320 0x7fb9b006d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.796+0000 7fb9b69cf700 1 --2- 172.21.15.45:0/2102336960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9b00c1680 0x7fb9b00c8d50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.796+0000 7fb9b69cf700 1 -- 172.21.15.45:0/2102336960 >> 172.21.15.45:0/2102336960 conn(0x7fb9b00afae0 msgr2=0x7fb9b00afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:41.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.796+0000 7fb9b69cf700 1 -- 172.21.15.45:0/2102336960 shutdown_connections 2023-10-08T12:45:41.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.796+0000 7fb9b69cf700 1 -- 172.21.15.45:0/2102336960 wait complete. 2023-10-08T12:45:41.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.797+0000 7fb9b69cf700 1 Processor -- start 2023-10-08T12:45:41.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.797+0000 7fb9b69cf700 1 -- start start 2023-10-08T12:45:41.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.798+0000 7fb9b69cf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9b006b320 0x7fb9b0155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:41.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.798+0000 7fb9b69cf700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb9b00c1680 0x7fb9b01578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:41.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.798+0000 7fb9b69cf700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9b015cf90 0x7fb9b0157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:41.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.798+0000 7fb9b69cf700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b01eee60 con 0x7fb9b015cf90 2023-10-08T12:45:41.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.798+0000 7fb9b69cf700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b0158cd0 con 0x7fb9b006b320 2023-10-08T12:45:41.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.798+0000 7fb9b69cf700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b0158fb0 con 0x7fb9b00c1680 2023-10-08T12:45:41.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.798+0000 7fb9b4f6c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9b015cf90 0x7fb9b0157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.798+0000 7fb9b4f6c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9b015cf90 0x7fb9b0157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35544/0 (socket says 172.21.15.45:35544) 2023-10-08T12:45:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.798+0000 7fb9b4f6c700 1 -- 172.21.15.45:0/4211270707 learned_addr learned my addr 172.21.15.45:0/4211270707 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.798+0000 7fb9affff700 1 --2- 172.21.15.45:0/4211270707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9b006b320 0x7fb9b0155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.798+0000 7fb9af7fe700 1 --2- 172.21.15.45:0/4211270707 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb9b00c1680 0x7fb9b01578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.798+0000 7fb9b4f6c700 1 -- 172.21.15.45:0/4211270707 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb9b00c1680 msgr2=0x7fb9b01578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.798+0000 7fb9b4f6c700 1 --2- 172.21.15.45:0/4211270707 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb9b00c1680 0x7fb9b01578e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.798+0000 7fb9b4f6c700 1 -- 172.21.15.45:0/4211270707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9b006b320 msgr2=0x7fb9b0155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.798+0000 7fb9b4f6c700 1 --2- 172.21.15.45:0/4211270707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9b006b320 0x7fb9b0155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.798+0000 7fb9b4f6c700 1 -- 172.21.15.45:0/4211270707 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a40095f0 con 0x7fb9b015cf90 2023-10-08T12:45:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.798+0000 7fb9affff700 1 --2- 172.21.15.45:0/4211270707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9b006b320 0x7fb9b0155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:45:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.799+0000 7fb9b4f6c700 1 --2- 172.21.15.45:0/4211270707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9b015cf90 0x7fb9b0157e20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb9a800ada0 tx=0x7fb9a800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.799+0000 7fb9acff9700 1 -- 172.21.15.45:0/4211270707 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a800f070 con 0x7fb9b015cf90 2023-10-08T12:45:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.799+0000 7fb9acff9700 1 -- 172.21.15.45:0/4211270707 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb9a8007e60 con 0x7fb9b015cf90 2023-10-08T12:45:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.799+0000 7fb9b69cf700 1 -- 172.21.15.45:0/4211270707 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b00c27e0 con 0x7fb9b015cf90 2023-10-08T12:45:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.799+0000 7fb9acff9700 1 -- 172.21.15.45:0/4211270707 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a8004df0 con 0x7fb9b015cf90 2023-10-08T12:45:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.799+0000 7fb9b69cf700 1 -- 172.21.15.45:0/4211270707 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b00c24b0 con 0x7fb9b015cf90 2023-10-08T12:45:41.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.800+0000 7fb9b69cf700 1 -- 172.21.15.45:0/4211270707 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b00674a0 con 0x7fb9b015cf90 2023-10-08T12:45:41.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.800+0000 7fb9acff9700 1 -- 172.21.15.45:0/4211270707 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb9a800c980 con 0x7fb9b015cf90 2023-10-08T12:45:41.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.801+0000 7fb9acff9700 1 --2- 172.21.15.45:0/4211270707 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb99c06aed0 0x7fb99c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:41.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.801+0000 7fb9acff9700 1 -- 172.21.15.45:0/4211270707 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9a8089360 con 0x7fb9b015cf90 2023-10-08T12:45:41.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.801+0000 7fb9affff700 1 --2- 172.21.15.45:0/4211270707 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb99c06aed0 0x7fb99c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:41.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.801+0000 7fb9affff700 1 --2- 172.21.15.45:0/4211270707 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb99c06aed0 0x7fb99c06d390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0006fd0 tx=0x7fb9a0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:41.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:41.805+0000 7fb9acff9700 1 -- 172.21.15.45:0/4211270707 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb9a80544a0 con 0x7fb9b015cf90 2023-10-08T12:45:42.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.004+0000 7fb9b69cf700 1 -- 172.21.15.45:0/4211270707 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9b00c2a20 con 0x7fb9b015cf90 2023-10-08T12:45:42.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.005+0000 7fb9acff9700 1 -- 172.21.15.45:0/4211270707 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7fb9b00c2a20 con 0x7fb9b015cf90 2023-10-08T12:45:42.006 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:42.007 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:45:26.206424+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:45:19.183651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:45:22.277383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:45:23.606639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.412453+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.351925+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.428025+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.437246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.441119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.388608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.415524+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.401835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:45:42.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.007+0000 7fb9b69cf700 1 -- 172.21.15.45:0/4211270707 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb99c06aed0 msgr2=0x7fb99c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.007+0000 7fb9b69cf700 1 --2- 172.21.15.45:0/4211270707 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb99c06aed0 0x7fb99c06d390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0006fd0 tx=0x7fb9a0008040 comp rx=0 tx=0).stop 2023-10-08T12:45:42.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.007+0000 7fb9b69cf700 1 -- 172.21.15.45:0/4211270707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9b015cf90 msgr2=0x7fb9b0157e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.007+0000 7fb9b69cf700 1 --2- 172.21.15.45:0/4211270707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9b015cf90 0x7fb9b0157e20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb9a800ada0 tx=0x7fb9a800c330 comp rx=0 tx=0).stop 2023-10-08T12:45:42.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.008+0000 7fb9b69cf700 1 -- 172.21.15.45:0/4211270707 shutdown_connections 2023-10-08T12:45:42.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.008+0000 7fb9b69cf700 1 --2- 172.21.15.45:0/4211270707 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb99c06aed0 0x7fb99c06d390 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.008+0000 7fb9b69cf700 1 --2- 172.21.15.45:0/4211270707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9b015cf90 0x7fb9b0157e20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.008+0000 7fb9b69cf700 1 --2- 172.21.15.45:0/4211270707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9b006b320 0x7fb9b0155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.008+0000 7fb9b69cf700 1 --2- 172.21.15.45:0/4211270707 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb9b00c1680 0x7fb9b01578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.008+0000 7fb9b69cf700 1 -- 172.21.15.45:0/4211270707 >> 172.21.15.45:0/4211270707 conn(0x7fb9b00afae0 msgr2=0x7fb9b009c350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:42.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.008+0000 7fb9b69cf700 1 -- 172.21.15.45:0/4211270707 shutdown_connections 2023-10-08T12:45:42.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.008+0000 7fb9b69cf700 1 -- 172.21.15.45:0/4211270707 wait complete. 2023-10-08T12:45:42.021 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:45:19.183651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:45:22.277383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:45:23.606639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:45:42.021 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:45:42.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.151+0000 7f9ebbc9c700 1 -- 172.21.15.45:0/2284024184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eb40cafc0 msgr2=0x7f9eb40cb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.151+0000 7f9ebbc9c700 1 --2- 172.21.15.45:0/2284024184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eb40cafc0 0x7f9eb40cb3d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40729f0 tx=0x7f9eac00b380 comp rx=0 tx=0).stop 2023-10-08T12:45:42.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.151+0000 7f9ebbc9c700 1 -- 172.21.15.45:0/2284024184 shutdown_connections 2023-10-08T12:45:42.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.151+0000 7f9ebbc9c700 1 --2- 172.21.15.45:0/2284024184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eb40cafc0 0x7f9eb40cb3d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.151+0000 7f9ebbc9c700 1 --2- 172.21.15.45:0/2284024184 >> v2:172.21.15.78:3300/0 conn(0x7f9eb415d0c0 0x7f9eb4097a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.151+0000 7f9ebbc9c700 1 -- 172.21.15.45:0/2284024184 >> 172.21.15.45:0/2284024184 conn(0x7f9eb40b1290 msgr2=0x7f9eb40b16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:42.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.151+0000 7f9ebbc9c700 1 -- 172.21.15.45:0/2284024184 shutdown_connections 2023-10-08T12:45:42.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.151+0000 7f9ebbc9c700 1 -- 172.21.15.45:0/2284024184 wait complete. 2023-10-08T12:45:42.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.153+0000 7f9ebbc9c700 1 Processor -- start 2023-10-08T12:45:42.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.153+0000 7f9ebbc9c700 1 -- start start 2023-10-08T12:45:42.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.154+0000 7f9ebbc9c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9eb40b06d0 0x7f9eb40b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.154+0000 7f9ebbc9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eb40cafc0 0x7f9eb406f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.154+0000 7f9ebbc9c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9eb415d0c0 0x7f9eb406fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.154+0000 7f9ebbc9c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb40b4a80 con 0x7f9eb40cafc0 2023-10-08T12:45:42.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.154+0000 7f9ebbc9c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb40b3e00 con 0x7f9eb40b06d0 2023-10-08T12:45:42.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.154+0000 7f9ebbc9c700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb40b40e0 con 0x7f9eb415d0c0 2023-10-08T12:45:42.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.154+0000 7f9eb9237700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eb40cafc0 0x7f9eb406f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.154+0000 7f9eb9237700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eb40cafc0 0x7f9eb406f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35556/0 (socket says 172.21.15.45:35556) 2023-10-08T12:45:42.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.154+0000 7f9eb9237700 1 -- 172.21.15.45:0/2930438368 learned_addr learned my addr 172.21.15.45:0/2930438368 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:42.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.154+0000 7f9eb9a38700 1 --2- 172.21.15.45:0/2930438368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9eb40b06d0 0x7f9eb40b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.154+0000 7f9eba239700 1 --2- 172.21.15.45:0/2930438368 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9eb415d0c0 0x7f9eb406fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.154+0000 7f9eb9237700 1 -- 172.21.15.45:0/2930438368 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9eb415d0c0 msgr2=0x7f9eb406fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.154+0000 7f9eb9237700 1 --2- 172.21.15.45:0/2930438368 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9eb415d0c0 0x7f9eb406fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.154+0000 7f9eb9237700 1 -- 172.21.15.45:0/2930438368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9eb40b06d0 msgr2=0x7f9eb40b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.154+0000 7f9eb9237700 1 --2- 172.21.15.45:0/2930438368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9eb40b06d0 0x7f9eb40b33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.154+0000 7f9eb9237700 1 -- 172.21.15.45:0/2930438368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac009d00 con 0x7f9eb40cafc0 2023-10-08T12:45:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.154+0000 7f9eba239700 1 --2- 172.21.15.45:0/2930438368 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9eb415d0c0 0x7f9eb406fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.154+0000 7f9eb9237700 1 --2- 172.21.15.45:0/2930438368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eb40cafc0 0x7f9eb406f5e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9ea400c4d0 tx=0x7f9ea400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.154+0000 7f9eaa7fc700 1 -- 172.21.15.45:0/2930438368 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4011790 con 0x7f9eb40cafc0 2023-10-08T12:45:42.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.154+0000 7f9eaa7fc700 1 -- 172.21.15.45:0/2930438368 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9ea40119e0 con 0x7f9eb40cafc0 2023-10-08T12:45:42.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.154+0000 7f9ebbc9c700 1 -- 172.21.15.45:0/2930438368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eb40b43c0 con 0x7f9eb40cafc0 2023-10-08T12:45:42.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.154+0000 7f9eaa7fc700 1 -- 172.21.15.45:0/2930438368 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4011df0 con 0x7f9eb40cafc0 2023-10-08T12:45:42.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.155+0000 7f9ebbc9c700 1 -- 172.21.15.45:0/2930438368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eb40b4ea0 con 0x7f9eb40cafc0 2023-10-08T12:45:42.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.155+0000 7f9ebbc9c700 1 -- 172.21.15.45:0/2930438368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eb40b5030 con 0x7f9eb40cafc0 2023-10-08T12:45:42.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.156+0000 7f9eaa7fc700 1 -- 172.21.15.45:0/2930438368 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9ea4026430 con 0x7f9eb40cafc0 2023-10-08T12:45:42.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.157+0000 7f9eaa7fc700 1 --2- 172.21.15.45:0/2930438368 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f9e9806aed0 0x7f9e9806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.157+0000 7f9eaa7fc700 1 -- 172.21.15.45:0/2930438368 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ea408a010 con 0x7f9eb40cafc0 2023-10-08T12:45:42.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.157+0000 7f9eb9a38700 1 --2- 172.21.15.45:0/2930438368 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f9e9806aed0 0x7f9e9806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.157+0000 7f9eb9a38700 1 --2- 172.21.15.45:0/2930438368 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f9e9806aed0 0x7f9e9806d390 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0005950 tx=0x7f9eb0005f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:42.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.161+0000 7f9eaa7fc700 1 -- 172.21.15.45:0/2930438368 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9ea4055230 con 0x7f9eb40cafc0 2023-10-08T12:45:42.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.361+0000 7f9ebbc9c700 1 -- 172.21.15.45:0/2930438368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9eb4066850 con 0x7f9eb40cafc0 2023-10-08T12:45:42.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.362+0000 7f9eaa7fc700 1 -- 172.21.15.45:0/2930438368 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9ea4058850 con 0x7f9eb40cafc0 2023-10-08T12:45:42.363 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-08T12:45:42.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.364+0000 7f9ebbc9c700 1 -- 172.21.15.45:0/2930438368 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f9e9806aed0 msgr2=0x7f9e9806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.364+0000 7f9ebbc9c700 1 --2- 172.21.15.45:0/2930438368 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f9e9806aed0 0x7f9e9806d390 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0005950 tx=0x7f9eb0005f90 comp rx=0 tx=0).stop 2023-10-08T12:45:42.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.364+0000 7f9ebbc9c700 1 -- 172.21.15.45:0/2930438368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eb40cafc0 msgr2=0x7f9eb406f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.364+0000 7f9ebbc9c700 1 --2- 172.21.15.45:0/2930438368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eb40cafc0 0x7f9eb406f5e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9ea400c4d0 tx=0x7f9ea400c7e0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.364+0000 7f9ebbc9c700 1 -- 172.21.15.45:0/2930438368 shutdown_connections 2023-10-08T12:45:42.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.364+0000 7f9ebbc9c700 1 --2- 172.21.15.45:0/2930438368 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f9e9806aed0 0x7f9e9806d390 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.364+0000 7f9ebbc9c700 1 --2- 172.21.15.45:0/2930438368 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9eb415d0c0 0x7f9eb406fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.364+0000 7f9ebbc9c700 1 --2- 172.21.15.45:0/2930438368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9eb40b06d0 0x7f9eb40b33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.364+0000 7f9ebbc9c700 1 --2- 172.21.15.45:0/2930438368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eb40cafc0 0x7f9eb406f5e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.364+0000 7f9ebbc9c700 1 -- 172.21.15.45:0/2930438368 >> 172.21.15.45:0/2930438368 conn(0x7f9eb40b1290 msgr2=0x7f9eb415a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:42.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.364+0000 7f9ebbc9c700 1 -- 172.21.15.45:0/2930438368 shutdown_connections 2023-10-08T12:45:42.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.364+0000 7f9ebbc9c700 1 -- 172.21.15.45:0/2930438368 wait complete. 2023-10-08T12:45:42.377 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:45:42.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.506+0000 7fab2aec9700 1 -- 172.21.15.45:0/3098539901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab240cb560 msgr2=0x7fab240b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.506+0000 7fab2aec9700 1 --2- 172.21.15.45:0/3098539901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab240cb560 0x7fab240b20e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fab240981b0 tx=0x7fab1c00b330 comp rx=0 tx=0).stop 2023-10-08T12:45:42.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.506+0000 7fab2aec9700 1 -- 172.21.15.45:0/3098539901 shutdown_connections 2023-10-08T12:45:42.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.506+0000 7fab2aec9700 1 --2- 172.21.15.45:0/3098539901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab240cb560 0x7fab240b20e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.506+0000 7fab2aec9700 1 --2- 172.21.15.45:0/3098539901 >> v2:172.21.15.78:3300/0 conn(0x7fab240c9c00 0x7fab240cb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.506+0000 7fab2aec9700 1 -- 172.21.15.45:0/3098539901 >> 172.21.15.45:0/3098539901 conn(0x7fab24097a20 msgr2=0x7fab240ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:42.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.506+0000 7fab2aec9700 1 -- 172.21.15.45:0/3098539901 shutdown_connections 2023-10-08T12:45:42.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.506+0000 7fab2aec9700 1 -- 172.21.15.45:0/3098539901 wait complete. 2023-10-08T12:45:42.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.507+0000 7fab2aec9700 1 Processor -- start 2023-10-08T12:45:42.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.507+0000 7fab2aec9700 1 -- start start 2023-10-08T12:45:42.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.508+0000 7fab2aec9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab240c9c00 0x7fab241f1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.508+0000 7fab2aec9700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fab240cb560 0x7fab2406a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.508+0000 7fab2aec9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab2415c0d0 0x7fab2406a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.508+0000 7fab2aec9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab241f1f40 con 0x7fab240c9c00 2023-10-08T12:45:42.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.508+0000 7fab2aec9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2406d880 con 0x7fab2415c0d0 2023-10-08T12:45:42.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.508+0000 7fab2aec9700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab2406db20 con 0x7fab240cb560 2023-10-08T12:45:42.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.508+0000 7fab28c65700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab240c9c00 0x7fab241f1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.508+0000 7fab28c65700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab240c9c00 0x7fab241f1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35568/0 (socket says 172.21.15.45:35568) 2023-10-08T12:45:42.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.508+0000 7fab28c65700 1 -- 172.21.15.45:0/3154319770 learned_addr learned my addr 172.21.15.45:0/3154319770 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:42.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.508+0000 7fab29466700 1 --2- 172.21.15.45:0/3154319770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab2415c0d0 0x7fab2406a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.509+0000 7fab23fff700 1 --2- 172.21.15.45:0/3154319770 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fab240cb560 0x7fab2406a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.509+0000 7fab28c65700 1 -- 172.21.15.45:0/3154319770 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fab240cb560 msgr2=0x7fab2406a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.509+0000 7fab28c65700 1 --2- 172.21.15.45:0/3154319770 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fab240cb560 0x7fab2406a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.509+0000 7fab28c65700 1 -- 172.21.15.45:0/3154319770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab2415c0d0 msgr2=0x7fab2406a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.509+0000 7fab28c65700 1 --2- 172.21.15.45:0/3154319770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab2415c0d0 0x7fab2406a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.509+0000 7fab28c65700 1 -- 172.21.15.45:0/3154319770 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1c009c40 con 0x7fab240c9c00 2023-10-08T12:45:42.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.509+0000 7fab23fff700 1 --2- 172.21.15.45:0/3154319770 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fab240cb560 0x7fab2406a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:45:42.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.509+0000 7fab29466700 1 --2- 172.21.15.45:0/3154319770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab2415c0d0 0x7fab2406a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:42.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.509+0000 7fab28c65700 1 --2- 172.21.15.45:0/3154319770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab240c9c00 0x7fab241f1a00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fab1800c4d0 tx=0x7fab1800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:42.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.509+0000 7fab217fa700 1 -- 172.21.15.45:0/3154319770 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab18005230 con 0x7fab240c9c00 2023-10-08T12:45:42.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.509+0000 7fab217fa700 1 -- 172.21.15.45:0/3154319770 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fab18005480 con 0x7fab240c9c00 2023-10-08T12:45:42.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.509+0000 7fab2aec9700 1 -- 172.21.15.45:0/3154319770 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab2406de00 con 0x7fab240c9c00 2023-10-08T12:45:42.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.509+0000 7fab217fa700 1 -- 172.21.15.45:0/3154319770 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab18004990 con 0x7fab240c9c00 2023-10-08T12:45:42.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.509+0000 7fab2aec9700 1 -- 172.21.15.45:0/3154319770 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab2406e3c0 con 0x7fab240c9c00 2023-10-08T12:45:42.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.510+0000 7fab2aec9700 1 -- 172.21.15.45:0/3154319770 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab24066850 con 0x7fab240c9c00 2023-10-08T12:45:42.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.510+0000 7fab217fa700 1 -- 172.21.15.45:0/3154319770 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fab18004af0 con 0x7fab240c9c00 2023-10-08T12:45:42.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.511+0000 7fab217fa700 1 --2- 172.21.15.45:0/3154319770 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fab0806aed0 0x7fab0806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.511+0000 7fab217fa700 1 -- 172.21.15.45:0/3154319770 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab18088cf0 con 0x7fab240c9c00 2023-10-08T12:45:42.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.511+0000 7fab23fff700 1 --2- 172.21.15.45:0/3154319770 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fab0806aed0 0x7fab0806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.511+0000 7fab23fff700 1 --2- 172.21.15.45:0/3154319770 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fab0806aed0 0x7fab0806d390 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fab10005e10 tx=0x7fab10005d20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:42.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.515+0000 7fab217fa700 1 -- 172.21.15.45:0/3154319770 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fab1808d070 con 0x7fab240c9c00 2023-10-08T12:45:42.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.716+0000 7fab2aec9700 1 -- 172.21.15.45:0/3154319770 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fab240afa30 con 0x7fab240c9c00 2023-10-08T12:45:42.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.716+0000 7fab217fa700 1 -- 172.21.15.45:0/3154319770 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fab180170a0 con 0x7fab240c9c00 2023-10-08T12:45:42.717 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-08T12:45:42.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.718+0000 7fab2aec9700 1 -- 172.21.15.45:0/3154319770 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fab0806aed0 msgr2=0x7fab0806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.718+0000 7fab2aec9700 1 --2- 172.21.15.45:0/3154319770 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fab0806aed0 0x7fab0806d390 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fab10005e10 tx=0x7fab10005d20 comp rx=0 tx=0).stop 2023-10-08T12:45:42.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.718+0000 7fab2aec9700 1 -- 172.21.15.45:0/3154319770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab240c9c00 msgr2=0x7fab241f1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.718+0000 7fab2aec9700 1 --2- 172.21.15.45:0/3154319770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab240c9c00 0x7fab241f1a00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fab1800c4d0 tx=0x7fab1800c890 comp rx=0 tx=0).stop 2023-10-08T12:45:42.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.718+0000 7fab2aec9700 1 -- 172.21.15.45:0/3154319770 shutdown_connections 2023-10-08T12:45:42.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.718+0000 7fab2aec9700 1 --2- 172.21.15.45:0/3154319770 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fab0806aed0 0x7fab0806d390 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.718+0000 7fab2aec9700 1 --2- 172.21.15.45:0/3154319770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab2415c0d0 0x7fab2406a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.718+0000 7fab2aec9700 1 --2- 172.21.15.45:0/3154319770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab240c9c00 0x7fab241f1a00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.718+0000 7fab2aec9700 1 --2- 172.21.15.45:0/3154319770 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fab240cb560 0x7fab2406a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.718+0000 7fab2aec9700 1 -- 172.21.15.45:0/3154319770 >> 172.21.15.45:0/3154319770 conn(0x7fab24097a20 msgr2=0x7fab240cee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:42.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.718+0000 7fab2aec9700 1 -- 172.21.15.45:0/3154319770 shutdown_connections 2023-10-08T12:45:42.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.718+0000 7fab2aec9700 1 -- 172.21.15.45:0/3154319770 wait complete. 2023-10-08T12:45:42.731 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:45:42.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.860+0000 7f8f89cfc700 1 -- 172.21.15.45:0/102390706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f840cb730 msgr2=0x7f8f840b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.860+0000 7f8f89cfc700 1 --2- 172.21.15.45:0/102390706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f840cb730 0x7f8f840b20e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c009fd0 tx=0x7f8f7c00b380 comp rx=0 tx=0).stop 2023-10-08T12:45:42.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.860+0000 7f8f89cfc700 1 -- 172.21.15.45:0/102390706 shutdown_connections 2023-10-08T12:45:42.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.860+0000 7f8f89cfc700 1 --2- 172.21.15.45:0/102390706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f840cb730 0x7f8f840b20e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.860+0000 7f8f89cfc700 1 --2- 172.21.15.45:0/102390706 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f8415c0d0 0x7f8f840c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.860+0000 7f8f89cfc700 1 -- 172.21.15.45:0/102390706 >> 172.21.15.45:0/102390706 conn(0x7f8f84097a20 msgr2=0x7f8f840ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:42.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.860+0000 7f8f89cfc700 1 -- 172.21.15.45:0/102390706 shutdown_connections 2023-10-08T12:45:42.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.860+0000 7f8f89cfc700 1 -- 172.21.15.45:0/102390706 wait complete. 2023-10-08T12:45:42.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.861+0000 7f8f89cfc700 1 Processor -- start 2023-10-08T12:45:42.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.861+0000 7f8f89cfc700 1 -- start start 2023-10-08T12:45:42.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.862+0000 7f8f89cfc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f840cb730 0x7f8f840c4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.862+0000 7f8f89cfc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f840cf000 0x7f8f840c7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.862+0000 7f8f89cfc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8415c0d0 0x7f8f840c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.862+0000 7f8f89cfc700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f840c3d00 con 0x7f8f840cb730 2023-10-08T12:45:42.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.862+0000 7f8f89cfc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f840c4190 con 0x7f8f8415c0d0 2023-10-08T12:45:42.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.862+0000 7f8f89cfc700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f840c30f0 con 0x7f8f840cf000 2023-10-08T12:45:42.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.862+0000 7f8f837fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f840cb730 0x7f8f840c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.862+0000 7f8f837fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f840cb730 0x7f8f840c4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35582/0 (socket says 172.21.15.45:35582) 2023-10-08T12:45:42.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.862+0000 7f8f837fe700 1 -- 172.21.15.45:0/3524668360 learned_addr learned my addr 172.21.15.45:0/3524668360 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:42.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.862+0000 7f8f83fff700 1 --2- 172.21.15.45:0/3524668360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8415c0d0 0x7f8f840c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.862+0000 7f8f82ffd700 1 --2- 172.21.15.45:0/3524668360 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f840cf000 0x7f8f840c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.862+0000 7f8f837fe700 1 -- 172.21.15.45:0/3524668360 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f840cf000 msgr2=0x7f8f840c7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.862+0000 7f8f837fe700 1 --2- 172.21.15.45:0/3524668360 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f840cf000 0x7f8f840c7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.862+0000 7f8f837fe700 1 -- 172.21.15.45:0/3524668360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8415c0d0 msgr2=0x7f8f840c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:42.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.862+0000 7f8f837fe700 1 --2- 172.21.15.45:0/3524668360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8415c0d0 0x7f8f840c7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:42.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.862+0000 7f8f837fe700 1 -- 172.21.15.45:0/3524668360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f7c009d00 con 0x7f8f840cb730 2023-10-08T12:45:42.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.862+0000 7f8f83fff700 1 --2- 172.21.15.45:0/3524668360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8415c0d0 0x7f8f840c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:45:42.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.862+0000 7f8f82ffd700 1 --2- 172.21.15.45:0/3524668360 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f840cf000 0x7f8f840c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:45:42.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.863+0000 7f8f837fe700 1 --2- 172.21.15.45:0/3524668360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f840cb730 0x7f8f840c4590 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400ea20 tx=0x7f8f7400ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:42.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.863+0000 7f8f6bfff700 1 -- 172.21.15.45:0/3524668360 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f74009610 con 0x7f8f840cb730 2023-10-08T12:45:42.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.863+0000 7f8f6bfff700 1 -- 172.21.15.45:0/3524668360 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8f7400ccc0 con 0x7f8f840cb730 2023-10-08T12:45:42.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.863+0000 7f8f89cfc700 1 -- 172.21.15.45:0/3524668360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f840c33d0 con 0x7f8f840cb730 2023-10-08T12:45:42.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.863+0000 7f8f6bfff700 1 -- 172.21.15.45:0/3524668360 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f74010690 con 0x7f8f840cb730 2023-10-08T12:45:42.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.863+0000 7f8f89cfc700 1 -- 172.21.15.45:0/3524668360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f840c3990 con 0x7f8f840cb730 2023-10-08T12:45:42.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.864+0000 7f8f89cfc700 1 -- 172.21.15.45:0/3524668360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f840c3b50 con 0x7f8f840cb730 2023-10-08T12:45:42.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.864+0000 7f8f6bfff700 1 -- 172.21.15.45:0/3524668360 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8f740107f0 con 0x7f8f840cb730 2023-10-08T12:45:42.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.864+0000 7f8f6bfff700 1 --2- 172.21.15.45:0/3524668360 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f8f7006aed0 0x7f8f7006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:42.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.865+0000 7f8f6bfff700 1 -- 172.21.15.45:0/3524668360 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f74014070 con 0x7f8f840cb730 2023-10-08T12:45:42.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.865+0000 7f8f82ffd700 1 --2- 172.21.15.45:0/3524668360 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f8f7006aed0 0x7f8f7006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:42.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.865+0000 7f8f82ffd700 1 --2- 172.21.15.45:0/3524668360 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f8f7006aed0 0x7f8f7006d390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8f840b34d0 tx=0x7f8f78009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:42.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:42.869+0000 7f8f6bfff700 1 -- 172.21.15.45:0/3524668360 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8f74051ca0 con 0x7f8f840cb730 2023-10-08T12:45:43.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.068+0000 7f8f89cfc700 1 -- 172.21.15.45:0/3524668360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8f840c3fe0 con 0x7f8f840cb730 2023-10-08T12:45:43.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.068+0000 7f8f6bfff700 1 -- 172.21.15.45:0/3524668360 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8f74055010 con 0x7f8f840cb730 2023-10-08T12:45:43.069 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-08T12:45:43.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.071+0000 7f8f89cfc700 1 -- 172.21.15.45:0/3524668360 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f8f7006aed0 msgr2=0x7f8f7006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:43.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.071+0000 7f8f89cfc700 1 --2- 172.21.15.45:0/3524668360 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f8f7006aed0 0x7f8f7006d390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8f840b34d0 tx=0x7f8f78009040 comp rx=0 tx=0).stop 2023-10-08T12:45:43.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.071+0000 7f8f89cfc700 1 -- 172.21.15.45:0/3524668360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f840cb730 msgr2=0x7f8f840c4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:43.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.071+0000 7f8f89cfc700 1 --2- 172.21.15.45:0/3524668360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f840cb730 0x7f8f840c4590 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400ea20 tx=0x7f8f7400ede0 comp rx=0 tx=0).stop 2023-10-08T12:45:43.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.071+0000 7f8f89cfc700 1 -- 172.21.15.45:0/3524668360 shutdown_connections 2023-10-08T12:45:43.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.071+0000 7f8f89cfc700 1 --2- 172.21.15.45:0/3524668360 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f8f7006aed0 0x7f8f7006d390 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:43.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.071+0000 7f8f89cfc700 1 --2- 172.21.15.45:0/3524668360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8415c0d0 0x7f8f840c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:43.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.071+0000 7f8f89cfc700 1 --2- 172.21.15.45:0/3524668360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f840cb730 0x7f8f840c4590 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:43.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.071+0000 7f8f89cfc700 1 --2- 172.21.15.45:0/3524668360 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f840cf000 0x7f8f840c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:43.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.071+0000 7f8f89cfc700 1 -- 172.21.15.45:0/3524668360 >> 172.21.15.45:0/3524668360 conn(0x7f8f84097a20 msgr2=0x7f8f840cb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:43.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.071+0000 7f8f89cfc700 1 -- 172.21.15.45:0/3524668360 shutdown_connections 2023-10-08T12:45:43.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.071+0000 7f8f89cfc700 1 -- 172.21.15.45:0/3524668360 wait complete. 2023-10-08T12:45:43.084 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:45:43.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.209+0000 7fa0b42ff700 1 -- 172.21.15.45:0/2139058450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0ac0cdf60 msgr2=0x7fa0ac15c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:43.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.209+0000 7fa0b42ff700 1 --2- 172.21.15.45:0/2139058450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0ac0cdf60 0x7fa0ac15c320 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac071850 tx=0x7fa09c009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:43.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.209+0000 7fa0b42ff700 1 -- 172.21.15.45:0/2139058450 shutdown_connections 2023-10-08T12:45:43.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.209+0000 7fa0b42ff700 1 --2- 172.21.15.45:0/2139058450 >> v2:172.21.15.78:3300/0 conn(0x7fa0ac0c9ff0 0x7fa0ac0ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:43.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.209+0000 7fa0b42ff700 1 --2- 172.21.15.45:0/2139058450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0ac0cdf60 0x7fa0ac15c320 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:43.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.209+0000 7fa0b42ff700 1 -- 172.21.15.45:0/2139058450 >> 172.21.15.45:0/2139058450 conn(0x7fa0ac0b0430 msgr2=0x7fa0ac0b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:43.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.209+0000 7fa0b42ff700 1 -- 172.21.15.45:0/2139058450 shutdown_connections 2023-10-08T12:45:43.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.209+0000 7fa0b42ff700 1 -- 172.21.15.45:0/2139058450 wait complete. 2023-10-08T12:45:43.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.210+0000 7fa0b42ff700 1 Processor -- start 2023-10-08T12:45:43.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.210+0000 7fa0b42ff700 1 -- start start 2023-10-08T12:45:43.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.211+0000 7fa0b42ff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0ac0c9ff0 0x7fa0ac154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:43.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.211+0000 7fa0b42ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0ac0cdf60 0x7fa0ac0c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:43.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.211+0000 7fa0b42ff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0ac158950 0x7fa0ac0c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:43.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.211+0000 7fa0b42ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac155880 con 0x7fa0ac0cdf60 2023-10-08T12:45:43.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.211+0000 7fa0b42ff700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac0c68a0 con 0x7fa0ac0c9ff0 2023-10-08T12:45:43.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.211+0000 7fa0b42ff700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac154c70 con 0x7fa0ac158950 2023-10-08T12:45:43.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.211+0000 7fa0b189a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0ac0cdf60 0x7fa0ac0c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:43.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.211+0000 7fa0b189a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0ac0cdf60 0x7fa0ac0c84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35598/0 (socket says 172.21.15.45:35598) 2023-10-08T12:45:43.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.211+0000 7fa0b189a700 1 -- 172.21.15.45:0/794906969 learned_addr learned my addr 172.21.15.45:0/794906969 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:43.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.211+0000 7fa0b209b700 1 --2- 172.21.15.45:0/794906969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0ac0c9ff0 0x7fa0ac154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:43.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.211+0000 7fa0b289c700 1 --2- 172.21.15.45:0/794906969 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0ac158950 0x7fa0ac0c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:43.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.211+0000 7fa0b189a700 1 -- 172.21.15.45:0/794906969 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0ac158950 msgr2=0x7fa0ac0c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:43.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.211+0000 7fa0b189a700 1 --2- 172.21.15.45:0/794906969 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0ac158950 0x7fa0ac0c6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:43.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.211+0000 7fa0b189a700 1 -- 172.21.15.45:0/794906969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0ac0c9ff0 msgr2=0x7fa0ac154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:43.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.211+0000 7fa0b189a700 1 --2- 172.21.15.45:0/794906969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0ac0c9ff0 0x7fa0ac154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:43.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.211+0000 7fa0b189a700 1 -- 172.21.15.45:0/794906969 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09c0095f0 con 0x7fa0ac0cdf60 2023-10-08T12:45:43.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.211+0000 7fa0b289c700 1 --2- 172.21.15.45:0/794906969 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0ac158950 0x7fa0ac0c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:43.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.211+0000 7fa0b189a700 1 --2- 172.21.15.45:0/794906969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0ac0cdf60 0x7fa0ac0c84e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa09c005fd0 tx=0x7fa09c004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:43.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.212+0000 7fa0a2ffd700 1 -- 172.21.15.45:0/794906969 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c01d070 con 0x7fa0ac0cdf60 2023-10-08T12:45:43.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.212+0000 7fa0a2ffd700 1 -- 172.21.15.45:0/794906969 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa09c00b7b0 con 0x7fa0ac0cdf60 2023-10-08T12:45:43.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.212+0000 7fa0b42ff700 1 -- 172.21.15.45:0/794906969 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0ac154f50 con 0x7fa0ac0cdf60 2023-10-08T12:45:43.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.212+0000 7fa0a2ffd700 1 -- 172.21.15.45:0/794906969 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c0045f0 con 0x7fa0ac0cdf60 2023-10-08T12:45:43.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.212+0000 7fa0b42ff700 1 -- 172.21.15.45:0/794906969 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0ac155510 con 0x7fa0ac0cdf60 2023-10-08T12:45:43.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.213+0000 7fa0b42ff700 1 -- 172.21.15.45:0/794906969 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0ac1556d0 con 0x7fa0ac0cdf60 2023-10-08T12:45:43.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.213+0000 7fa0a2ffd700 1 -- 172.21.15.45:0/794906969 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa09c00bbc0 con 0x7fa0ac0cdf60 2023-10-08T12:45:43.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.213+0000 7fa0a2ffd700 1 --2- 172.21.15.45:0/794906969 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa09006aed0 0x7fa09006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:43.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.214+0000 7fa0a2ffd700 1 -- 172.21.15.45:0/794906969 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa09c08ad20 con 0x7fa0ac0cdf60 2023-10-08T12:45:43.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.214+0000 7fa0b209b700 1 --2- 172.21.15.45:0/794906969 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa09006aed0 0x7fa09006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:43.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.214+0000 7fa0b209b700 1 --2- 172.21.15.45:0/794906969 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa09006aed0 0x7fa09006d390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8007fd0 tx=0x7fa0a8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:43.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.218+0000 7fa0a2ffd700 1 -- 172.21.15.45:0/794906969 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa09c055f00 con 0x7fa0ac0cdf60 2023-10-08T12:45:43.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.463+0000 7fa0b42ff700 1 -- 172.21.15.45:0/794906969 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0ac04e4c0 con 0x7fa0ac0cdf60 2023-10-08T12:45:43.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.464+0000 7fa0a2ffd700 1 -- 172.21.15.45:0/794906969 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7fa09c059520 con 0x7fa0ac0cdf60 2023-10-08T12:45:43.465 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:43.465 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4332,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3352988594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3352988594},{"type":"v1","addr":"172.21.15.45:6834","nonce":3352988594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4335,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/448033669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":448033669},{"type":"v1","addr":"172.21.15.45:6835","nonce":448033669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4347,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2935302656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":2935302656},{"type":"v1","addr":"172.21.15.78:6837","nonce":2935302656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T12:45:24.623822+0000","modified":"2023-10-08T12:45:27.649794+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4372},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4372":{"gid":4372,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6836/2145831865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2145831865},{"type":"v1","addr":"172.21.15.78:6836","nonce":2145831865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:45:43.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.466+0000 7fa0b42ff700 1 -- 172.21.15.45:0/794906969 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa09006aed0 msgr2=0x7fa09006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:43.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.466+0000 7fa0b42ff700 1 --2- 172.21.15.45:0/794906969 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa09006aed0 0x7fa09006d390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8007fd0 tx=0x7fa0a8009040 comp rx=0 tx=0).stop 2023-10-08T12:45:43.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.466+0000 7fa0b42ff700 1 -- 172.21.15.45:0/794906969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0ac0cdf60 msgr2=0x7fa0ac0c84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:43.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.466+0000 7fa0b42ff700 1 --2- 172.21.15.45:0/794906969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0ac0cdf60 0x7fa0ac0c84e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa09c005fd0 tx=0x7fa09c004260 comp rx=0 tx=0).stop 2023-10-08T12:45:43.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.466+0000 7fa0b42ff700 1 -- 172.21.15.45:0/794906969 shutdown_connections 2023-10-08T12:45:43.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.466+0000 7fa0b42ff700 1 --2- 172.21.15.45:0/794906969 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa09006aed0 0x7fa09006d390 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:43.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.466+0000 7fa0b42ff700 1 --2- 172.21.15.45:0/794906969 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0ac158950 0x7fa0ac0c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:43.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.466+0000 7fa0b42ff700 1 --2- 172.21.15.45:0/794906969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0ac0c9ff0 0x7fa0ac154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:43.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.466+0000 7fa0b42ff700 1 --2- 172.21.15.45:0/794906969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0ac0cdf60 0x7fa0ac0c84e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:43.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.466+0000 7fa0b42ff700 1 -- 172.21.15.45:0/794906969 >> 172.21.15.45:0/794906969 conn(0x7fa0ac0b0430 msgr2=0x7fa0ac0b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:43.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.466+0000 7fa0b42ff700 1 -- 172.21.15.45:0/794906969 shutdown_connections 2023-10-08T12:45:43.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.466+0000 7fa0b42ff700 1 -- 172.21.15.45:0/794906969 wait complete. 2023-10-08T12:45:43.468 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-10-08T12:45:43.479 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:45:43.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.604+0000 7efde4110700 1 -- 172.21.15.45:0/3273830394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efddc15c320 msgr2=0x7efddc071f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:43.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.604+0000 7efde4110700 1 --2- 172.21.15.45:0/3273830394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efddc15c320 0x7efddc071f80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efdd8005fd0 tx=0x7efdd8009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:43.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.604+0000 7efde4110700 1 -- 172.21.15.45:0/3273830394 shutdown_connections 2023-10-08T12:45:43.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.604+0000 7efde4110700 1 --2- 172.21.15.45:0/3273830394 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efddc158950 0x7efddc0cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:43.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.604+0000 7efde4110700 1 --2- 172.21.15.45:0/3273830394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efddc15c320 0x7efddc071f80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:43.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.604+0000 7efde4110700 1 -- 172.21.15.45:0/3273830394 >> 172.21.15.45:0/3273830394 conn(0x7efddc0b0430 msgr2=0x7efddc0b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:43.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.604+0000 7efde4110700 1 -- 172.21.15.45:0/3273830394 shutdown_connections 2023-10-08T12:45:43.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.604+0000 7efde4110700 1 -- 172.21.15.45:0/3273830394 wait complete. 2023-10-08T12:45:43.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.605+0000 7efde4110700 1 Processor -- start 2023-10-08T12:45:43.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.605+0000 7efde4110700 1 -- start start 2023-10-08T12:45:43.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.606+0000 7efde4110700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efddc0724c0 0x7efddc1f1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:43.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.606+0000 7efde4110700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efddc158950 0x7efddc0add00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:43.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.606+0000 7efde4110700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efddc15c320 0x7efddc0ae240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:43.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.606+0000 7efde4110700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efddc1f2060 con 0x7efddc158950 2023-10-08T12:45:43.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.606+0000 7efde4110700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efddc0c7f40 con 0x7efddc15c320 2023-10-08T12:45:43.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.606+0000 7efde4110700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efddc0c8220 con 0x7efddc0724c0 2023-10-08T12:45:43.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.606+0000 7efde16ab700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efddc158950 0x7efddc0add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:43.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.606+0000 7efde16ab700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efddc158950 0x7efddc0add00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35612/0 (socket says 172.21.15.45:35612) 2023-10-08T12:45:43.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.606+0000 7efde16ab700 1 -- 172.21.15.45:0/1343079223 learned_addr learned my addr 172.21.15.45:0/1343079223 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:43.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.607+0000 7efde1eac700 1 --2- 172.21.15.45:0/1343079223 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efddc0724c0 0x7efddc1f1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:43.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.607+0000 7efde26ad700 1 --2- 172.21.15.45:0/1343079223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efddc15c320 0x7efddc0ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:43.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.607+0000 7efde16ab700 1 -- 172.21.15.45:0/1343079223 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efddc0724c0 msgr2=0x7efddc1f1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:43.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.607+0000 7efde16ab700 1 --2- 172.21.15.45:0/1343079223 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efddc0724c0 0x7efddc1f1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:43.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.607+0000 7efde16ab700 1 -- 172.21.15.45:0/1343079223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efddc15c320 msgr2=0x7efddc0ae240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:43.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.607+0000 7efde16ab700 1 --2- 172.21.15.45:0/1343079223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efddc15c320 0x7efddc0ae240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:43.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.607+0000 7efde16ab700 1 -- 172.21.15.45:0/1343079223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd80095f0 con 0x7efddc158950 2023-10-08T12:45:43.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.607+0000 7efde1eac700 1 --2- 172.21.15.45:0/1343079223 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efddc0724c0 0x7efddc1f1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:45:43.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.607+0000 7efde26ad700 1 --2- 172.21.15.45:0/1343079223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efddc15c320 0x7efddc0ae240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:45:43.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.607+0000 7efde16ab700 1 --2- 172.21.15.45:0/1343079223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efddc158950 0x7efddc0add00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efddc070420 tx=0x7efdd800bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:43.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.607+0000 7efdd27fc700 1 -- 172.21.15.45:0/1343079223 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd801c070 con 0x7efddc158950 2023-10-08T12:45:43.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.607+0000 7efdd27fc700 1 -- 172.21.15.45:0/1343079223 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7efdd8003910 con 0x7efddc158950 2023-10-08T12:45:43.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.607+0000 7efdd27fc700 1 -- 172.21.15.45:0/1343079223 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd8003d00 con 0x7efddc158950 2023-10-08T12:45:43.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.607+0000 7efde4110700 1 -- 172.21.15.45:0/1343079223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efddc0c8500 con 0x7efddc158950 2023-10-08T12:45:43.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.607+0000 7efde4110700 1 -- 172.21.15.45:0/1343079223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efddc0c8ac0 con 0x7efddc158950 2023-10-08T12:45:43.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.608+0000 7efde4110700 1 -- 172.21.15.45:0/1343079223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efddc0c5690 con 0x7efddc158950 2023-10-08T12:45:43.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.609+0000 7efdd27fc700 1 -- 172.21.15.45:0/1343079223 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efdd8004830 con 0x7efddc158950 2023-10-08T12:45:43.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.609+0000 7efdd27fc700 1 --2- 172.21.15.45:0/1343079223 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7efdc006aed0 0x7efdc006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:43.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.609+0000 7efdd27fc700 1 -- 172.21.15.45:0/1343079223 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efdd808b020 con 0x7efddc158950 2023-10-08T12:45:43.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.610+0000 7efde1eac700 1 --2- 172.21.15.45:0/1343079223 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7efdc006aed0 0x7efdc006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:43.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.610+0000 7efde1eac700 1 --2- 172.21.15.45:0/1343079223 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7efdc006aed0 0x7efdc006d390 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efdcc005fd0 tx=0x7efdcc005e20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:43.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.613+0000 7efdd27fc700 1 -- 172.21.15.45:0/1343079223 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efdd8056140 con 0x7efddc158950 2023-10-08T12:45:43.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.816+0000 7efde4110700 1 -- 172.21.15.45:0/1343079223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efddc04e4c0 con 0x7efddc158950 2023-10-08T12:45:43.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.817+0000 7efdd27fc700 1 -- 172.21.15.45:0/1343079223 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7efdd8003e60 con 0x7efddc158950 2023-10-08T12:45:43.818 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:43.819 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:45:26.206424+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:45:19.183651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:45:22.277383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:45:23.606639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.412453+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.351925+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.428025+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.437246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.441119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.388608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.415524+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.401835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:45:43.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.819+0000 7efde4110700 1 -- 172.21.15.45:0/1343079223 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7efdc006aed0 msgr2=0x7efdc006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:43.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.819+0000 7efde4110700 1 --2- 172.21.15.45:0/1343079223 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7efdc006aed0 0x7efdc006d390 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efdcc005fd0 tx=0x7efdcc005e20 comp rx=0 tx=0).stop 2023-10-08T12:45:43.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.819+0000 7efde4110700 1 -- 172.21.15.45:0/1343079223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efddc158950 msgr2=0x7efddc0add00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:43.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.819+0000 7efde4110700 1 --2- 172.21.15.45:0/1343079223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efddc158950 0x7efddc0add00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efddc070420 tx=0x7efdd800bec0 comp rx=0 tx=0).stop 2023-10-08T12:45:43.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.819+0000 7efde4110700 1 -- 172.21.15.45:0/1343079223 shutdown_connections 2023-10-08T12:45:43.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.820+0000 7efde4110700 1 --2- 172.21.15.45:0/1343079223 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7efdc006aed0 0x7efdc006d390 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:43.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.820+0000 7efde4110700 1 --2- 172.21.15.45:0/1343079223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efddc15c320 0x7efddc0ae240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:43.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.820+0000 7efde4110700 1 --2- 172.21.15.45:0/1343079223 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efddc0724c0 0x7efddc1f1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:43.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.820+0000 7efde4110700 1 --2- 172.21.15.45:0/1343079223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efddc158950 0x7efddc0add00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:43.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.820+0000 7efde4110700 1 -- 172.21.15.45:0/1343079223 >> 172.21.15.45:0/1343079223 conn(0x7efddc0b0430 msgr2=0x7efddc157e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:43.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.820+0000 7efde4110700 1 -- 172.21.15.45:0/1343079223 shutdown_connections 2023-10-08T12:45:43.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.820+0000 7efde4110700 1 -- 172.21.15.45:0/1343079223 wait complete. 2023-10-08T12:45:43.833 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:45:43.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.959+0000 7f8262065700 1 -- 172.21.15.45:0/2053923482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8244003a00 msgr2=0x7f8244003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:43.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.959+0000 7f8262065700 1 --2- 172.21.15.45:0/2053923482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8244003a00 0x7f8244003e20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f824c00c310 tx=0x7f8244005880 comp rx=0 tx=0).stop 2023-10-08T12:45:43.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.959+0000 7f8262065700 1 -- 172.21.15.45:0/2053923482 shutdown_connections 2023-10-08T12:45:43.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.959+0000 7f8262065700 1 --2- 172.21.15.45:0/2053923482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8244003a00 0x7f8244003e20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:43.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.959+0000 7f8262065700 1 -- 172.21.15.45:0/2053923482 >> 172.21.15.45:0/2053923482 conn(0x7f825c0cf750 msgr2=0x7f825c0cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:43.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.959+0000 7f8262065700 1 -- 172.21.15.45:0/2053923482 shutdown_connections 2023-10-08T12:45:43.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.959+0000 7f8262065700 1 -- 172.21.15.45:0/2053923482 wait complete. 2023-10-08T12:45:43.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.961+0000 7f8262065700 1 Processor -- start 2023-10-08T12:45:43.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.961+0000 7f8262065700 1 -- start start 2023-10-08T12:45:43.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.962+0000 7f8262065700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8244003a00 0x7f825c1f4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:43.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.962+0000 7f8262065700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f825c0c8a70 0x7f825c153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:43.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.962+0000 7f8262065700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f825c0c8ef0 0x7f825c154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:43.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.962+0000 7f8262065700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c1545d0 con 0x7f825c0c8a70 2023-10-08T12:45:43.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.962+0000 7f8262065700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c1548b0 con 0x7f8244003a00 2023-10-08T12:45:43.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.962+0000 7f8262065700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f825c154b90 con 0x7f825c0c8ef0 2023-10-08T12:45:43.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.962+0000 7f825affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f825c0c8a70 0x7f825c153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:43.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.962+0000 7f825affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f825c0c8a70 0x7f825c153b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35632/0 (socket says 172.21.15.45:35632) 2023-10-08T12:45:43.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.962+0000 7f825affd700 1 -- 172.21.15.45:0/3918086725 learned_addr learned my addr 172.21.15.45:0/3918086725 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:43.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.962+0000 7f825b7fe700 1 --2- 172.21.15.45:0/3918086725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8244003a00 0x7f825c1f4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:43.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.962+0000 7f825bfff700 1 --2- 172.21.15.45:0/3918086725 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f825c0c8ef0 0x7f825c154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:43.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.962+0000 7f825affd700 1 -- 172.21.15.45:0/3918086725 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f825c0c8ef0 msgr2=0x7f825c154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:43.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.962+0000 7f825affd700 1 --2- 172.21.15.45:0/3918086725 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f825c0c8ef0 0x7f825c154090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:43.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.962+0000 7f825affd700 1 -- 172.21.15.45:0/3918086725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8244003a00 msgr2=0x7f825c1f4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:43.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.962+0000 7f825affd700 1 --2- 172.21.15.45:0/3918086725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8244003a00 0x7f825c1f4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:43.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.962+0000 7f825affd700 1 -- 172.21.15.45:0/3918086725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f825c154e70 con 0x7f825c0c8a70 2023-10-08T12:45:43.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.963+0000 7f825affd700 1 --2- 172.21.15.45:0/3918086725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f825c0c8a70 0x7f825c153b50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8250003f50 tx=0x7f82500015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:43.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.963+0000 7f8243fff700 1 -- 172.21.15.45:0/3918086725 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8250011430 con 0x7f825c0c8a70 2023-10-08T12:45:43.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.963+0000 7f8243fff700 1 -- 172.21.15.45:0/3918086725 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8250011590 con 0x7f825c0c8a70 2023-10-08T12:45:43.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.963+0000 7f8262065700 1 -- 172.21.15.45:0/3918086725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f825c155150 con 0x7f825c0c8a70 2023-10-08T12:45:43.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.963+0000 7f8243fff700 1 -- 172.21.15.45:0/3918086725 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8250011980 con 0x7f825c0c8a70 2023-10-08T12:45:43.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.963+0000 7f8262065700 1 -- 172.21.15.45:0/3918086725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f825c1f4970 con 0x7f825c0c8a70 2023-10-08T12:45:43.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.964+0000 7f8262065700 1 -- 172.21.15.45:0/3918086725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f825c06f640 con 0x7f825c0c8a70 2023-10-08T12:45:43.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.964+0000 7f8243fff700 1 -- 172.21.15.45:0/3918086725 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8250011ae0 con 0x7f825c0c8a70 2023-10-08T12:45:43.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.965+0000 7f8243fff700 1 --2- 172.21.15.45:0/3918086725 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f824806aed0 0x7f824806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:43.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.965+0000 7f8243fff700 1 -- 172.21.15.45:0/3918086725 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f825008a340 con 0x7f825c0c8a70 2023-10-08T12:45:43.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.965+0000 7f825b7fe700 1 --2- 172.21.15.45:0/3918086725 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f824806aed0 0x7f824806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:43.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.965+0000 7f825b7fe700 1 --2- 172.21.15.45:0/3918086725 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f824806aed0 0x7f824806d390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f824c000c00 tx=0x7f824c00f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:43.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:43.969+0000 7f8243fff700 1 -- 172.21.15.45:0/3918086725 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f82500553e0 con 0x7f825c0c8a70 2023-10-08T12:45:44.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.214+0000 7f8262065700 1 -- 172.21.15.45:0/3918086725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f825c04e4c0 con 0x7f825c0c8a70 2023-10-08T12:45:44.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.215+0000 7f8243fff700 1 -- 172.21.15.45:0/3918086725 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7f8250015020 con 0x7f825c0c8a70 2023-10-08T12:45:44.216 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:44.216 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4332,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3352988594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3352988594},{"type":"v1","addr":"172.21.15.45:6834","nonce":3352988594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4335,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/448033669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":448033669},{"type":"v1","addr":"172.21.15.45:6835","nonce":448033669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4347,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2935302656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":2935302656},{"type":"v1","addr":"172.21.15.78:6837","nonce":2935302656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T12:45:24.623822+0000","modified":"2023-10-08T12:45:27.649794+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4372},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4372":{"gid":4372,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6836/2145831865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2145831865},{"type":"v1","addr":"172.21.15.78:6836","nonce":2145831865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:45:44.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.217+0000 7f8262065700 1 -- 172.21.15.45:0/3918086725 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f824806aed0 msgr2=0x7f824806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:44.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.217+0000 7f8262065700 1 --2- 172.21.15.45:0/3918086725 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f824806aed0 0x7f824806d390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f824c000c00 tx=0x7f824c00f000 comp rx=0 tx=0).stop 2023-10-08T12:45:44.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.217+0000 7f8262065700 1 -- 172.21.15.45:0/3918086725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f825c0c8a70 msgr2=0x7f825c153b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:44.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.217+0000 7f8262065700 1 --2- 172.21.15.45:0/3918086725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f825c0c8a70 0x7f825c153b50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8250003f50 tx=0x7f82500015f0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.217+0000 7f8262065700 1 -- 172.21.15.45:0/3918086725 shutdown_connections 2023-10-08T12:45:44.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.217+0000 7f8262065700 1 --2- 172.21.15.45:0/3918086725 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f824806aed0 0x7f824806d390 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.217+0000 7f8262065700 1 --2- 172.21.15.45:0/3918086725 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f825c0c8ef0 0x7f825c154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.217+0000 7f8262065700 1 --2- 172.21.15.45:0/3918086725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8244003a00 0x7f825c1f4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.217+0000 7f8262065700 1 --2- 172.21.15.45:0/3918086725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f825c0c8a70 0x7f825c153b50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.217+0000 7f8262065700 1 -- 172.21.15.45:0/3918086725 >> 172.21.15.45:0/3918086725 conn(0x7f825c0cf750 msgr2=0x7f825c158c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:44.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.217+0000 7f8262065700 1 -- 172.21.15.45:0/3918086725 shutdown_connections 2023-10-08T12:45:44.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.217+0000 7f8262065700 1 -- 172.21.15.45:0/3918086725 wait complete. 2023-10-08T12:45:44.219 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-10-08T12:45:44.632 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T12:45:24.623822+0000', 'modified': '2023-10-08T12:45:27.649794+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4372}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4372': {'gid': 4372, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6836/2145831865', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6834', 'nonce': 2145831865}, {'type': 'v1', 'addr': '172.21.15.78:6836', 'nonce': 2145831865}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-08T12:45:44.633 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T12:45:44.633 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-08T12:45:44.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.765+0000 7f3ededdd700 1 -- 172.21.15.45:0/3373660106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ed8158950 msgr2=0x7f3ed80cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:44.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.765+0000 7f3ededdd700 1 --2- 172.21.15.45:0/3373660106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ed8158950 0x7f3ed80cdf60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0098c0 tx=0x7f3ecc009bd0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.765+0000 7f3ededdd700 1 -- 172.21.15.45:0/3373660106 shutdown_connections 2023-10-08T12:45:44.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.765+0000 7f3ededdd700 1 --2- 172.21.15.45:0/3373660106 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3ed80c9ff0 0x7f3ed80ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.765+0000 7f3ededdd700 1 --2- 172.21.15.45:0/3373660106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ed8158950 0x7f3ed80cdf60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.765+0000 7f3ededdd700 1 -- 172.21.15.45:0/3373660106 >> 172.21.15.45:0/3373660106 conn(0x7f3ed80b0430 msgr2=0x7f3ed80b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:44.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.765+0000 7f3ededdd700 1 -- 172.21.15.45:0/3373660106 shutdown_connections 2023-10-08T12:45:44.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.765+0000 7f3ededdd700 1 -- 172.21.15.45:0/3373660106 wait complete. 2023-10-08T12:45:44.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.766+0000 7f3ededdd700 1 Processor -- start 2023-10-08T12:45:44.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.766+0000 7f3ededdd700 1 -- start start 2023-10-08T12:45:44.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.767+0000 7f3ededdd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ed80c9ff0 0x7f3ed814ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:44.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.767+0000 7f3ededdd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ed8158950 0x7f3ed815ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:44.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.767+0000 7f3ededdd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3ed815c320 0x7f3ed80c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:44.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.767+0000 7f3ededdd700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed814b290 con 0x7f3ed8158950 2023-10-08T12:45:44.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.767+0000 7f3ededdd700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed81f0160 con 0x7f3ed80c9ff0 2023-10-08T12:45:44.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.767+0000 7f3ededdd700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed81f0440 con 0x7f3ed815c320 2023-10-08T12:45:44.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.767+0000 7f3ed7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ed8158950 0x7f3ed815ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:44.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.767+0000 7f3ed7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ed8158950 0x7f3ed815ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35646/0 (socket says 172.21.15.45:35646) 2023-10-08T12:45:44.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.767+0000 7f3ed7fff700 1 -- 172.21.15.45:0/126704567 learned_addr learned my addr 172.21.15.45:0/126704567 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:44.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.767+0000 7f3edd37a700 1 --2- 172.21.15.45:0/126704567 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3ed815c320 0x7f3ed80c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:44.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.767+0000 7f3edcb79700 1 --2- 172.21.15.45:0/126704567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ed80c9ff0 0x7f3ed814ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:44.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.767+0000 7f3ed7fff700 1 -- 172.21.15.45:0/126704567 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3ed815c320 msgr2=0x7f3ed80c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:44.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.767+0000 7f3ed7fff700 1 --2- 172.21.15.45:0/126704567 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3ed815c320 0x7f3ed80c7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.767+0000 7f3ed7fff700 1 -- 172.21.15.45:0/126704567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ed80c9ff0 msgr2=0x7f3ed814ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:44.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.767+0000 7f3ed7fff700 1 --2- 172.21.15.45:0/126704567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ed80c9ff0 0x7f3ed814ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.767+0000 7f3ed7fff700 1 -- 172.21.15.45:0/126704567 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc009520 con 0x7f3ed8158950 2023-10-08T12:45:44.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.767+0000 7f3edd37a700 1 --2- 172.21.15.45:0/126704567 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3ed815c320 0x7f3ed80c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:45:44.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.767+0000 7f3edcb79700 1 --2- 172.21.15.45:0/126704567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ed80c9ff0 0x7f3ed814ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:45:44.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.768+0000 7f3ed7fff700 1 --2- 172.21.15.45:0/126704567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ed8158950 0x7f3ed815ac80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3ec400c450 tx=0x7f3ec400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:44.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.768+0000 7f3ed57fa700 1 -- 172.21.15.45:0/126704567 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4011790 con 0x7f3ed8158950 2023-10-08T12:45:44.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.768+0000 7f3ed57fa700 1 -- 172.21.15.45:0/126704567 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3ec40119e0 con 0x7f3ed8158950 2023-10-08T12:45:44.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.768+0000 7f3ededdd700 1 -- 172.21.15.45:0/126704567 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed81f0720 con 0x7f3ed8158950 2023-10-08T12:45:44.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.768+0000 7f3ed57fa700 1 -- 172.21.15.45:0/126704567 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4011dd0 con 0x7f3ed8158950 2023-10-08T12:45:44.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.768+0000 7f3ededdd700 1 -- 172.21.15.45:0/126704567 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed81f0ce0 con 0x7f3ed8158950 2023-10-08T12:45:44.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.769+0000 7f3ed57fa700 1 -- 172.21.15.45:0/126704567 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3ec401c460 con 0x7f3ed8158950 2023-10-08T12:45:44.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.770+0000 7f3ed57fa700 1 --2- 172.21.15.45:0/126704567 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3ebc06aed0 0x7f3ebc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:44.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.770+0000 7f3ed57fa700 1 -- 172.21.15.45:0/126704567 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ec4089510 con 0x7f3ed8158950 2023-10-08T12:45:44.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.770+0000 7f3edcb79700 1 --2- 172.21.15.45:0/126704567 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3ebc06aed0 0x7f3ebc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:44.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.770+0000 7f3edcb79700 1 --2- 172.21.15.45:0/126704567 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3ebc06aed0 0x7f3ebc06d390 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc009230 tx=0x7f3ecc0047c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:44.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.772+0000 7f3eeafc6b80 1 Processor -- start 2023-10-08T12:45:44.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.772+0000 7f3eeafc6b80 1 -- start start 2023-10-08T12:45:44.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.773+0000 7f3eeafc6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641d375f150 0x5641d375f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:44.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.773+0000 7f3eeafc6b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641d377beb0 0x5641d3734cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:44.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.773+0000 7f3eeafc6b80 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x5641d37324e0 0x5641d37351f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:44.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.773+0000 7f3eeafc6b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641d369c410 con 0x5641d377beb0 2023-10-08T12:45:44.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.773+0000 7f3eeafc6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641d368dbd0 con 0x5641d375f150 2023-10-08T12:45:44.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.773+0000 7f3eeafc6b80 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641d368b4f0 con 0x5641d37324e0 2023-10-08T12:45:44.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.773+0000 7f3ed7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641d377beb0 0x5641d3734cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:44.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.773+0000 7f3ed7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641d377beb0 0x5641d3734cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35654/0 (socket says 172.21.15.45:35654) 2023-10-08T12:45:44.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.773+0000 7f3ed7fff700 1 -- 172.21.15.45:0/753026443 learned_addr learned my addr 172.21.15.45:0/753026443 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:44.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.773+0000 7f3edcb79700 1 --2- 172.21.15.45:0/753026443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641d375f150 0x5641d375f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:44.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.773+0000 7f3edd37a700 1 --2- 172.21.15.45:0/753026443 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x5641d37324e0 0x5641d37351f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:44.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.773+0000 7f3ed7fff700 1 -- 172.21.15.45:0/753026443 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x5641d37324e0 msgr2=0x5641d37351f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:44.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.773+0000 7f3ed7fff700 1 --2- 172.21.15.45:0/753026443 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x5641d37324e0 0x5641d37351f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.773+0000 7f3ed7fff700 1 -- 172.21.15.45:0/753026443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641d375f150 msgr2=0x5641d375f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:44.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.773+0000 7f3ed7fff700 1 --2- 172.21.15.45:0/753026443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641d375f150 0x5641d375f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.773+0000 7f3ed7fff700 1 -- 172.21.15.45:0/753026443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641d36e9950 con 0x5641d377beb0 2023-10-08T12:45:44.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.773+0000 7f3edd37a700 1 --2- 172.21.15.45:0/753026443 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x5641d37324e0 0x5641d37351f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:44.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.773+0000 7f3ed7fff700 1 --2- 172.21.15.45:0/753026443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641d377beb0 0x5641d3734cb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4005770 tx=0x7f3ec4057d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520a1cbd63a2a207 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:44.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.773+0000 7f3ec27fc700 1 -- 172.21.15.45:0/753026443 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec405c460 con 0x5641d377beb0 2023-10-08T12:45:44.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.773+0000 7f3ec27fc700 1 -- 172.21.15.45:0/753026443 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3ec4060610 con 0x5641d377beb0 2023-10-08T12:45:44.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.773+0000 7f3ec27fc700 1 -- 172.21.15.45:0/753026443 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec405c170 con 0x5641d377beb0 2023-10-08T12:45:44.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.774+0000 7f3eeafc6b80 1 -- 172.21.15.45:0/753026443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641d377beb0 msgr2=0x5641d3734cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:44.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.774+0000 7f3eeafc6b80 1 --2- 172.21.15.45:0/753026443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641d377beb0 0x5641d3734cb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4005770 tx=0x7f3ec4057d60 comp rx=0 tx=0).stop 2023-10-08T12:45:44.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.774+0000 7f3eeafc6b80 1 -- 172.21.15.45:0/753026443 shutdown_connections 2023-10-08T12:45:44.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.774+0000 7f3eeafc6b80 1 --2- 172.21.15.45:0/753026443 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x5641d37324e0 0x5641d37351f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.774+0000 7f3eeafc6b80 1 --2- 172.21.15.45:0/753026443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641d375f150 0x5641d375f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.774+0000 7f3eeafc6b80 1 --2- 172.21.15.45:0/753026443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641d377beb0 0x5641d3734cb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.774+0000 7f3eeafc6b80 1 -- 172.21.15.45:0/753026443 >> 172.21.15.45:0/753026443 conn(0x5641d36a8210 msgr2=0x5641d3779f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:44.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.774+0000 7f3eeafc6b80 1 -- 172.21.15.45:0/753026443 shutdown_connections 2023-10-08T12:45:44.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.774+0000 7f3eeafc6b80 1 -- 172.21.15.45:0/753026443 wait complete. 2023-10-08T12:45:44.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.775+0000 7f3eeafc6b80 1 -- start start 2023-10-08T12:45:44.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.775+0000 7f3eeafc6b80 1 Processor -- start 2023-10-08T12:45:44.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.776+0000 7f3eeafc6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641d37324e0 0x5641d3788fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:44.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.776+0000 7f3eeafc6b80 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x5641d375f150 0x5641d378cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:44.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.776+0000 7f3eeafc6b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641d377beb0 0x5641d372ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:44.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.776+0000 7f3eeafc6b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641d3686de0 con 0x5641d377beb0 2023-10-08T12:45:44.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.776+0000 7f3eeafc6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641d36236c0 con 0x5641d37324e0 2023-10-08T12:45:44.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.776+0000 7f3eeafc6b80 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641d3623360 con 0x5641d375f150 2023-10-08T12:45:44.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.776+0000 7f3eeafc6b80 10 client.0 _ll_register_callbacks cb 0x5641d34807b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:45:44.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.776+0000 7f3edd37a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641d377beb0 0x5641d372ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:44.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.776+0000 7f3edcb79700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641d37324e0 0x5641d3788fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:44.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.776+0000 7f3edd37a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641d377beb0 0x5641d372ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35662/0 (socket says 172.21.15.45:35662) 2023-10-08T12:45:44.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.776+0000 7f3edd37a700 1 -- 172.21.15.45:0/3233939257 learned_addr learned my addr 172.21.15.45:0/3233939257 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:44.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.776+0000 7f3ed7fff700 1 --2- 172.21.15.45:0/3233939257 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x5641d375f150 0x5641d378cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:44.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.776+0000 7f3edd37a700 1 -- 172.21.15.45:0/3233939257 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x5641d375f150 msgr2=0x5641d378cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:44.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.776+0000 7f3edd37a700 1 --2- 172.21.15.45:0/3233939257 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x5641d375f150 0x5641d378cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.776+0000 7f3edd37a700 1 -- 172.21.15.45:0/3233939257 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641d37324e0 msgr2=0x5641d3788fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:44.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.776+0000 7f3edd37a700 1 --2- 172.21.15.45:0/3233939257 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641d37324e0 0x5641d3788fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.776+0000 7f3edd37a700 1 -- 172.21.15.45:0/3233939257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed81f0ce0 con 0x5641d377beb0 2023-10-08T12:45:44.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.776+0000 7f3edd37a700 1 --2- 172.21.15.45:0/3233939257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641d377beb0 0x5641d372ddf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00078f0 tx=0x7f3ed0007c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3f270f473e58021 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:44.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.776+0000 7f3eb77fe700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-10-08T12:45:44.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.776+0000 7f3eb77fe700 1 -- 172.21.15.45:0/3233939257 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed00155f0 con 0x5641d377beb0 2023-10-08T12:45:44.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.776+0000 7f3eb77fe700 1 -- 172.21.15.45:0/3233939257 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ed0015750 con 0x5641d377beb0 2023-10-08T12:45:44.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.776+0000 7f3eeafc6b80 1 -- 172.21.15.45:0/3233939257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5641d3727170 con 0x5641d377beb0 2023-10-08T12:45:44.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.776+0000 7f3eb77fe700 1 -- 172.21.15.45:0/3233939257 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ed0015910 con 0x5641d377beb0 2023-10-08T12:45:44.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.776+0000 7f3eeafc6b80 10 client.4728 fetch_fsmap learned FSMap version 8 2023-10-08T12:45:44.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.776+0000 7f3eeafc6b80 1 -- 172.21.15.45:0/3233939257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5641d34b1d90 con 0x5641d377beb0 2023-10-08T12:45:44.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.777+0000 7f3eb77fe700 1 -- 172.21.15.45:0/3233939257 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x5641d3727170 con 0x5641d377beb0 2023-10-08T12:45:44.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.777+0000 7f3eb77fe700 1 -- 172.21.15.45:0/3233939257 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3ed0015b60 con 0x5641d377beb0 2023-10-08T12:45:44.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.777+0000 7f3eeafc6b80 10 client.4728 fetch_fsmap finished waiting for FSMap version 8 2023-10-08T12:45:44.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.777+0000 7f3eeafc6b80 10 client.4728 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-08T12:45:44.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.777+0000 7f3eeafc6b80 20 client.4728 populate_metadata read hostname 'smithi045' 2023-10-08T12:45:44.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.777+0000 7f3eeafc6b80 1 --2- 172.21.15.45:0/3233939257 >> [v2:172.21.15.78:6834/2145831865,v1:172.21.15.78:6836/2145831865] conn(0x5641d3762740 0x5641d37642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:44.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.777+0000 7f3eeafc6b80 4 client.4728 mds_command: new command op to 4372 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:45:44.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.777+0000 7f3eeafc6b80 1 -- 172.21.15.45:0/3233939257 --> [v2:172.21.15.78:6834/2145831865,v1:172.21.15.78:6836/2145831865] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5641d367fdc0 con 0x5641d3762740 2023-10-08T12:45:44.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.777+0000 7f3edcb79700 1 --2- 172.21.15.45:0/3233939257 >> [v2:172.21.15.78:6834/2145831865,v1:172.21.15.78:6836/2145831865] conn(0x5641d3762740 0x5641d37642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:44.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.777+0000 7f3eb77fe700 10 client.4728 ms_handle_connect on v2:172.21.15.78:6834/2145831865 2023-10-08T12:45:44.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.777+0000 7f3edcb79700 1 --2- 172.21.15.45:0/3233939257 >> [v2:172.21.15.78:6834/2145831865,v1:172.21.15.78:6836/2145831865] conn(0x5641d3762740 0x5641d37642e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5aeaa37c597d5b58 server_cookie=fa8ae75e80900ff2 in_seq=0 out_seq=0 2023-10-08T12:45:44.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.778+0000 7f3eb77fe700 1 -- 172.21.15.45:0/3233939257 <== mds.0 v2:172.21.15.78:6834/2145831865 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5641d367fdc0 con 0x5641d3762740 2023-10-08T12:45:44.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.778+0000 7f3eb77fe700 10 client.4728 handle_command_reply: tid=0 2023-10-08T12:45:44.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.778+0000 7f3eeafc6b80 1 client.4728 shutdown 2023-10-08T12:45:44.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.778+0000 7f3eeafc6b80 1 -- 172.21.15.45:0/3233939257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641d377beb0 msgr2=0x5641d372ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:44.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.778+0000 7f3eeafc6b80 1 --2- 172.21.15.45:0/3233939257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641d377beb0 0x5641d372ddf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00078f0 tx=0x7f3ed0007c00 comp rx=0 tx=0).stop 2023-10-08T12:45:44.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.778+0000 7f3eeafc6b80 1 -- 172.21.15.45:0/3233939257 shutdown_connections 2023-10-08T12:45:44.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.778+0000 7f3eeafc6b80 1 --2- 172.21.15.45:0/3233939257 >> [v2:172.21.15.78:6834/2145831865,v1:172.21.15.78:6836/2145831865] conn(0x5641d3762740 0x5641d37642e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.778+0000 7f3eeafc6b80 1 --2- 172.21.15.45:0/3233939257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641d377beb0 0x5641d372ddf0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.778+0000 7f3eeafc6b80 1 --2- 172.21.15.45:0/3233939257 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641d37324e0 0x5641d3788fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.778+0000 7f3eb77fe700 0 client.4728 ms_handle_reset on v2:172.21.15.78:6834/2145831865 2023-10-08T12:45:44.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.778+0000 7f3eeafc6b80 1 --2- 172.21.15.45:0/3233939257 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x5641d375f150 0x5641d378cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.779+0000 7f3eeafc6b80 1 -- 172.21.15.45:0/3233939257 >> 172.21.15.45:0/3233939257 conn(0x5641d36a8210 msgr2=0x5641d3778cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:44.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.779+0000 7f3eeafc6b80 1 -- 172.21.15.45:0/3233939257 shutdown_connections 2023-10-08T12:45:44.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.779+0000 7f3eeafc6b80 1 -- 172.21.15.45:0/3233939257 wait complete. 2023-10-08T12:45:44.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.779+0000 7f3eeafc6b80 20 client.4728 trim_cache size 0 max 16384 2023-10-08T12:45:44.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.796+0000 7f3eeafc6b80 1 Processor -- start 2023-10-08T12:45:44.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.796+0000 7f3eeafc6b80 1 -- start start 2023-10-08T12:45:44.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.797+0000 7f3eeafc6b80 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x5641d37324e0 0x5641d372ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:44.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.797+0000 7f3eeafc6b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641d375f150 0x5641d3778510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:44.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.797+0000 7f3eeafc6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641d3762740 0x5641d37d79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:44.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.797+0000 7f3eeafc6b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641d35078d0 con 0x5641d375f150 2023-10-08T12:45:44.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.797+0000 7f3eeafc6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641d375f530 con 0x5641d3762740 2023-10-08T12:45:44.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.797+0000 7f3eeafc6b80 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641d379bfd0 con 0x5641d37324e0 2023-10-08T12:45:44.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.797+0000 7f3ed7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641d375f150 0x5641d3778510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:44.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.797+0000 7f3ed7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641d375f150 0x5641d3778510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35668/0 (socket says 172.21.15.45:35668) 2023-10-08T12:45:44.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.797+0000 7f3ed7fff700 1 -- 172.21.15.45:0/380936752 learned_addr learned my addr 172.21.15.45:0/380936752 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:44.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.797+0000 7f3edcb79700 1 --2- 172.21.15.45:0/380936752 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x5641d37324e0 0x5641d372ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:44.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.797+0000 7f3edd37a700 1 --2- 172.21.15.45:0/380936752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641d3762740 0x5641d37d79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:44.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.797+0000 7f3ed7fff700 1 -- 172.21.15.45:0/380936752 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x5641d37324e0 msgr2=0x5641d372ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:44.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.797+0000 7f3ed7fff700 1 --2- 172.21.15.45:0/380936752 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x5641d37324e0 0x5641d372ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.797+0000 7f3ed7fff700 1 -- 172.21.15.45:0/380936752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641d3762740 msgr2=0x5641d37d79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:44.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.797+0000 7f3ed7fff700 1 --2- 172.21.15.45:0/380936752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641d3762740 0x5641d37d79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.797+0000 7f3ed7fff700 1 -- 172.21.15.45:0/380936752 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641d349ac10 con 0x5641d375f150 2023-10-08T12:45:44.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.798+0000 7f3ed7fff700 1 --2- 172.21.15.45:0/380936752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641d375f150 0x5641d3778510 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4001300 tx=0x7f3ec4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6dd76b78fcf665 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:44.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.798+0000 7f3ec2ffd700 1 -- 172.21.15.45:0/380936752 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec405c460 con 0x5641d375f150 2023-10-08T12:45:44.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.798+0000 7f3ec2ffd700 1 -- 172.21.15.45:0/380936752 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3ec40566b0 con 0x5641d375f150 2023-10-08T12:45:44.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.798+0000 7f3ec2ffd700 1 -- 172.21.15.45:0/380936752 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4058570 con 0x5641d375f150 2023-10-08T12:45:44.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.798+0000 7f3eeafc6b80 1 -- 172.21.15.45:0/380936752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641d375f150 msgr2=0x5641d3778510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:44.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.798+0000 7f3eeafc6b80 1 --2- 172.21.15.45:0/380936752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641d375f150 0x5641d3778510 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4001300 tx=0x7f3ec4000ed0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.798+0000 7f3eeafc6b80 1 -- 172.21.15.45:0/380936752 shutdown_connections 2023-10-08T12:45:44.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.798+0000 7f3eeafc6b80 1 --2- 172.21.15.45:0/380936752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641d3762740 0x5641d37d79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.798+0000 7f3eeafc6b80 1 --2- 172.21.15.45:0/380936752 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x5641d37324e0 0x5641d372ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.798+0000 7f3eeafc6b80 1 --2- 172.21.15.45:0/380936752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641d375f150 0x5641d3778510 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.798+0000 7f3eeafc6b80 1 -- 172.21.15.45:0/380936752 >> 172.21.15.45:0/380936752 conn(0x5641d36a8210 msgr2=0x5641d3762b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:44.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.798+0000 7f3eeafc6b80 1 -- 172.21.15.45:0/380936752 shutdown_connections 2023-10-08T12:45:44.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.798+0000 7f3eeafc6b80 1 -- 172.21.15.45:0/380936752 wait complete. 2023-10-08T12:45:44.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.799+0000 7f3eeafc6b80 1 -- start start 2023-10-08T12:45:44.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.799+0000 7f3eeafc6b80 1 Processor -- start 2023-10-08T12:45:44.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.800+0000 7f3eeafc6b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641d37324e0 0x5641d37c0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:44.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.800+0000 7f3eeafc6b80 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x5641d375f150 0x5641d375da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:44.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.800+0000 7f3eeafc6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641d3762740 0x5641d375dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:44.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.800+0000 7f3eeafc6b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641d3764f30 con 0x5641d37324e0 2023-10-08T12:45:44.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.800+0000 7f3eeafc6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641d374e7d0 con 0x5641d3762740 2023-10-08T12:45:44.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.800+0000 7f3eeafc6b80 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641d3764060 con 0x5641d375f150 2023-10-08T12:45:44.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.800+0000 7f3eeafc6b80 10 client.0 _ll_register_callbacks cb 0x7f3ed0009ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:45:44.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.800+0000 7f3edcb79700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641d37324e0 0x5641d37c0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:44.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.800+0000 7f3edcb79700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641d37324e0 0x5641d37c0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35672/0 (socket says 172.21.15.45:35672) 2023-10-08T12:45:44.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.800+0000 7f3edcb79700 1 -- 172.21.15.45:0/3692982155 learned_addr learned my addr 172.21.15.45:0/3692982155 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:44.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.800+0000 7f3ed7fff700 1 --2- 172.21.15.45:0/3692982155 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x5641d375f150 0x5641d375da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:44.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.800+0000 7f3edd37a700 1 --2- 172.21.15.45:0/3692982155 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641d3762740 0x5641d375dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:44.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.800+0000 7f3edcb79700 1 -- 172.21.15.45:0/3692982155 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x5641d375f150 msgr2=0x5641d375da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:44.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.800+0000 7f3edcb79700 1 --2- 172.21.15.45:0/3692982155 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x5641d375f150 0x5641d375da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.800+0000 7f3edcb79700 1 -- 172.21.15.45:0/3692982155 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641d3762740 msgr2=0x5641d375dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:44.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.800+0000 7f3edcb79700 1 --2- 172.21.15.45:0/3692982155 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641d3762740 0x5641d375dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.800+0000 7f3edcb79700 1 -- 172.21.15.45:0/3692982155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5641d36e9950 con 0x5641d37324e0 2023-10-08T12:45:44.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.800+0000 7f3edcb79700 1 --2- 172.21.15.45:0/3692982155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641d37324e0 0x5641d37c0160 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8070420 tx=0x7f3ecc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316e7ebc54cbcdfe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:44.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.800+0000 7f3eb77fe700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-10-08T12:45:44.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.801+0000 7f3eb77fe700 1 -- 172.21.15.45:0/3692982155 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc028040 con 0x5641d37324e0 2023-10-08T12:45:44.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.801+0000 7f3eeafc6b80 1 -- 172.21.15.45:0/3692982155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3ec4060610 con 0x5641d37324e0 2023-10-08T12:45:44.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.801+0000 7f3eb77fe700 1 -- 172.21.15.45:0/3692982155 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ecc033560 con 0x5641d37324e0 2023-10-08T12:45:44.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.801+0000 7f3eb77fe700 1 -- 172.21.15.45:0/3692982155 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ecc01c070 con 0x5641d37324e0 2023-10-08T12:45:44.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.801+0000 7f3eeafc6b80 10 client.4734 fetch_fsmap learned FSMap version 8 2023-10-08T12:45:44.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.801+0000 7f3eeafc6b80 1 -- 172.21.15.45:0/3692982155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5641d34d8200 con 0x5641d37324e0 2023-10-08T12:45:44.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.801+0000 7f3eb77fe700 1 -- 172.21.15.45:0/3692982155 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3ec4060610 con 0x5641d37324e0 2023-10-08T12:45:44.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.801+0000 7f3eb77fe700 1 -- 172.21.15.45:0/3692982155 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3ecc033ae0 con 0x5641d37324e0 2023-10-08T12:45:44.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.801+0000 7f3eeafc6b80 10 client.4734 fetch_fsmap finished waiting for FSMap version 8 2023-10-08T12:45:44.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.801+0000 7f3eeafc6b80 10 client.4734 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-08T12:45:44.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.801+0000 7f3eeafc6b80 20 client.4734 populate_metadata read hostname 'smithi045' 2023-10-08T12:45:44.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.802+0000 7f3eeafc6b80 1 --2- 172.21.15.45:0/3692982155 >> [v2:172.21.15.78:6834/2145831865,v1:172.21.15.78:6836/2145831865] conn(0x5641d377beb0 0x5641d3778b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:44.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.802+0000 7f3eeafc6b80 4 client.4734 mds_command: new command op to 4372 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T12:45:44.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.802+0000 7f3eeafc6b80 1 -- 172.21.15.45:0/3692982155 --> [v2:172.21.15.78:6834/2145831865,v1:172.21.15.78:6836/2145831865] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5641d367fae0 con 0x5641d377beb0 2023-10-08T12:45:44.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.802+0000 7f3ed7fff700 1 --2- 172.21.15.45:0/3692982155 >> [v2:172.21.15.78:6834/2145831865,v1:172.21.15.78:6836/2145831865] conn(0x5641d377beb0 0x5641d3778b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:44.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.802+0000 7f3eb77fe700 10 client.4734 ms_handle_connect on v2:172.21.15.78:6834/2145831865 2023-10-08T12:45:44.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.802+0000 7f3ed7fff700 1 --2- 172.21.15.45:0/3692982155 >> [v2:172.21.15.78:6834/2145831865,v1:172.21.15.78:6836/2145831865] conn(0x5641d377beb0 0x5641d3778b70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5311fa0fb629d46f server_cookie=99010635c07bd619 in_seq=0 out_seq=0 2023-10-08T12:45:44.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.802+0000 7f3eb77fe700 1 -- 172.21.15.45:0/3692982155 <== mds.0 v2:172.21.15.78:6834/2145831865 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5641d367fae0 con 0x5641d377beb0 2023-10-08T12:45:44.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.802+0000 7f3eb77fe700 10 client.4734 handle_command_reply: tid=0 2023-10-08T12:45:44.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.802+0000 7f3eeafc6b80 1 client.4734 shutdown 2023-10-08T12:45:44.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.802+0000 7f3eeafc6b80 1 -- 172.21.15.45:0/3692982155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641d37324e0 msgr2=0x5641d37c0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:44.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.802+0000 7f3eeafc6b80 1 --2- 172.21.15.45:0/3692982155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641d37324e0 0x5641d37c0160 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8070420 tx=0x7f3ecc009260 comp rx=0 tx=0).stop 2023-10-08T12:45:44.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.802+0000 7f3eeafc6b80 1 -- 172.21.15.45:0/3692982155 shutdown_connections 2023-10-08T12:45:44.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.802+0000 7f3eeafc6b80 1 --2- 172.21.15.45:0/3692982155 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641d3762740 0x5641d375dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.802+0000 7f3eeafc6b80 1 --2- 172.21.15.45:0/3692982155 >> [v2:172.21.15.78:6834/2145831865,v1:172.21.15.78:6836/2145831865] conn(0x5641d377beb0 0x5641d3778b70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.802+0000 7f3eeafc6b80 1 --2- 172.21.15.45:0/3692982155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641d37324e0 0x5641d37c0160 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.802+0000 7f3eb77fe700 0 client.4734 ms_handle_reset on v2:172.21.15.78:6834/2145831865 2023-10-08T12:45:44.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.802+0000 7f3eeafc6b80 1 --2- 172.21.15.45:0/3692982155 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x5641d375f150 0x5641d375da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.802+0000 7f3eeafc6b80 1 -- 172.21.15.45:0/3692982155 >> 172.21.15.45:0/3692982155 conn(0x5641d36a8210 msgr2=0x5641d37d68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:44.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.803+0000 7f3eeafc6b80 1 -- 172.21.15.45:0/3692982155 shutdown_connections 2023-10-08T12:45:44.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.803+0000 7f3eeafc6b80 1 -- 172.21.15.45:0/3692982155 wait complete. 2023-10-08T12:45:44.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.803+0000 7f3eeafc6b80 20 client.4734 trim_cache size 0 max 16384 2023-10-08T12:45:44.810 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-08T12:45:44.810 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "3c5c3516-8181-4382-8205-f21bea7ad4b3", 2023-10-08T12:45:44.811 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-10-08T12:45:44.811 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4372, 2023-10-08T12:45:44.811 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-10-08T12:45:44.811 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-10-08T12:45:44.811 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-10-08T12:45:44.811 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 19.596090522000001, 2023-10-08T12:45:44.811 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 8, 2023-10-08T12:45:44.811 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 20, 2023-10-08T12:45:44.811 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 20, 2023-10-08T12:45:44.811 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 25.028718120000001 2023-10-08T12:45:44.811 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-08T12:45:44.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.803+0000 7f3ededdd700 1 -- 172.21.15.45:0/126704567 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3ebc06aed0 msgr2=0x7f3ebc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:44.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.803+0000 7f3ededdd700 1 --2- 172.21.15.45:0/126704567 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3ebc06aed0 0x7f3ebc06d390 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc009230 tx=0x7f3ecc0047c0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.803+0000 7f3ededdd700 1 -- 172.21.15.45:0/126704567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ed8158950 msgr2=0x7f3ed815ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:44.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.803+0000 7f3ededdd700 1 --2- 172.21.15.45:0/126704567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ed8158950 0x7f3ed815ac80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3ec400c450 tx=0x7f3ec400c810 comp rx=0 tx=0).stop 2023-10-08T12:45:44.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.803+0000 7f3ededdd700 1 -- 172.21.15.45:0/126704567 shutdown_connections 2023-10-08T12:45:44.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.803+0000 7f3ededdd700 1 --2- 172.21.15.45:0/126704567 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3ebc06aed0 0x7f3ebc06d390 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.803+0000 7f3ededdd700 1 --2- 172.21.15.45:0/126704567 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3ed815c320 0x7f3ed80c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.803+0000 7f3ededdd700 1 --2- 172.21.15.45:0/126704567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ed80c9ff0 0x7f3ed814ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.803+0000 7f3ededdd700 1 --2- 172.21.15.45:0/126704567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ed8158950 0x7f3ed815ac80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:44.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.803+0000 7f3ededdd700 1 -- 172.21.15.45:0/126704567 >> 172.21.15.45:0/126704567 conn(0x7f3ed80b0430 msgr2=0x7f3ed8157ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:44.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.803+0000 7f3ededdd700 1 -- 172.21.15.45:0/126704567 shutdown_connections 2023-10-08T12:45:44.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:44.803+0000 7f3ededdd700 1 -- 172.21.15.45:0/126704567 wait complete. 2023-10-08T12:45:44.816 INFO:teuthology.run_tasks:Running task kclient... 2023-10-08T12:45:44.838 INFO:tasks.kclient:Mounting kernel clients... 2023-10-08T12:45:44.839 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-08T12:45:44.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:44.839 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-10-08T12:45:44.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:44.857 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2023-10-08T12:45:44.927 INFO:teuthology.orchestra.run.smithi045.stderr:Cannot find device "ceph-brx" 2023-10-08T12:45:44.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:45:44.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:44.929 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-10-08T12:45:44.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:44.986 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2023-10-08T12:45:45.055 INFO:teuthology.orchestra.run.smithi045.stderr:Cannot find device "ceph-brx" 2023-10-08T12:45:45.056 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:45:45.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:45.056 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-10-08T12:45:45.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:45.078 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2023-10-08T12:45:45.153 INFO:teuthology.orchestra.run.smithi078.stderr:Cannot find device "ceph-brx" 2023-10-08T12:45:45.155 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:45:45.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:45.155 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-10-08T12:45:45.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:45.216 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2023-10-08T12:45:45.289 INFO:teuthology.orchestra.run.smithi078.stderr:Cannot find device "ceph-brx" 2023-10-08T12:45:45.291 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:45:45.291 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-10-08T12:45:45.291 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-08T12:45:45.292 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T12:45:45.292 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T12:45:45.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.420+0000 7fe72e579700 1 -- 172.21.15.45:0/649282337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7280cb910 msgr2=0x7fe72815ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:45.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.420+0000 7fe72e579700 1 --2- 172.21.15.45:0/649282337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7280cb910 0x7fe72815ab90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe720009f60 tx=0x7fe720009f90 comp rx=0 tx=0).stop 2023-10-08T12:45:45.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.420+0000 7fe72e579700 1 -- 172.21.15.45:0/649282337 shutdown_connections 2023-10-08T12:45:45.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.420+0000 7fe72e579700 1 --2- 172.21.15.45:0/649282337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7280cb910 0x7fe72815ab90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:45.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.420+0000 7fe72e579700 1 --2- 172.21.15.45:0/649282337 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7280cb490 0x7fe72815a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:45.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.420+0000 7fe72e579700 1 -- 172.21.15.45:0/649282337 >> 172.21.15.45:0/649282337 conn(0x7fe72806a210 msgr2=0x7fe72806a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:45.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.420+0000 7fe72e579700 1 -- 172.21.15.45:0/649282337 shutdown_connections 2023-10-08T12:45:45.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.420+0000 7fe72e579700 1 -- 172.21.15.45:0/649282337 wait complete. 2023-10-08T12:45:45.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.421+0000 7fe72e579700 1 Processor -- start 2023-10-08T12:45:45.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.422+0000 7fe72e579700 1 -- start start 2023-10-08T12:45:45.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.422+0000 7fe72e579700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7280b2b30 0x7fe7281efd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:45.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.422+0000 7fe72e579700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7280cb490 0x7fe7281e1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:45.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.422+0000 7fe72e579700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7280cb910 0x7fe72813e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:45.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.422+0000 7fe72e579700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72813ad90 con 0x7fe7280cb490 2023-10-08T12:45:45.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.422+0000 7fe72e579700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7281f02a0 con 0x7fe7280cb910 2023-10-08T12:45:45.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.422+0000 7fe72e579700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7281e30e0 con 0x7fe7280b2b30 2023-10-08T12:45:45.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.422+0000 7fe7277fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7280cb490 0x7fe7281e1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:45.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.422+0000 7fe7277fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7280cb490 0x7fe7281e1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35688/0 (socket says 172.21.15.45:35688) 2023-10-08T12:45:45.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.422+0000 7fe7277fe700 1 -- 172.21.15.45:0/1907772766 learned_addr learned my addr 172.21.15.45:0/1907772766 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:45.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.423+0000 7fe727fff700 1 --2- 172.21.15.45:0/1907772766 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7280b2b30 0x7fe7281efd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:45.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.423+0000 7fe72cb16700 1 --2- 172.21.15.45:0/1907772766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7280cb910 0x7fe72813e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:45.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.423+0000 7fe7277fe700 1 -- 172.21.15.45:0/1907772766 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7280b2b30 msgr2=0x7fe7281efd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:45.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.423+0000 7fe7277fe700 1 --2- 172.21.15.45:0/1907772766 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7280b2b30 0x7fe7281efd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:45.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.423+0000 7fe7277fe700 1 -- 172.21.15.45:0/1907772766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7280cb910 msgr2=0x7fe72813e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:45.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.423+0000 7fe7277fe700 1 --2- 172.21.15.45:0/1907772766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7280cb910 0x7fe72813e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:45.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.423+0000 7fe7277fe700 1 -- 172.21.15.45:0/1907772766 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe720009c40 con 0x7fe7280cb490 2023-10-08T12:45:45.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.423+0000 7fe72cb16700 1 --2- 172.21.15.45:0/1907772766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7280cb910 0x7fe72813e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:45.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.423+0000 7fe7277fe700 1 --2- 172.21.15.45:0/1907772766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7280cb490 0x7fe7281e1a50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe71000c970 tx=0x7fe71000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:45.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.423+0000 7fe724ff9700 1 -- 172.21.15.45:0/1907772766 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe710007aa0 con 0x7fe7280cb490 2023-10-08T12:45:45.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.423+0000 7fe724ff9700 1 -- 172.21.15.45:0/1907772766 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe710007d10 con 0x7fe7280cb490 2023-10-08T12:45:45.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.423+0000 7fe72e579700 1 -- 172.21.15.45:0/1907772766 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7281e1f90 con 0x7fe7280cb490 2023-10-08T12:45:45.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.423+0000 7fe724ff9700 1 -- 172.21.15.45:0/1907772766 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe710004a90 con 0x7fe7280cb490 2023-10-08T12:45:45.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.423+0000 7fe72e579700 1 -- 172.21.15.45:0/1907772766 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe72813a3f0 con 0x7fe7280cb490 2023-10-08T12:45:45.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.424+0000 7fe72e579700 1 -- 172.21.15.45:0/1907772766 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe72813aed0 con 0x7fe7280cb490 2023-10-08T12:45:45.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.424+0000 7fe724ff9700 1 -- 172.21.15.45:0/1907772766 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe71000f450 con 0x7fe7280cb490 2023-10-08T12:45:45.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.425+0000 7fe724ff9700 1 --2- 172.21.15.45:0/1907772766 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe70806aed0 0x7fe70806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:45.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.425+0000 7fe724ff9700 1 -- 172.21.15.45:0/1907772766 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe710013070 con 0x7fe7280cb490 2023-10-08T12:45:45.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.425+0000 7fe727fff700 1 --2- 172.21.15.45:0/1907772766 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe70806aed0 0x7fe70806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:45.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.426+0000 7fe727fff700 1 --2- 172.21.15.45:0/1907772766 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe70806aed0 0x7fe70806d390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe718004740 tx=0x7fe718009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:45.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.430+0000 7fe724ff9700 1 -- 172.21.15.45:0/1907772766 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe72813aed0 con 0x7fe7280cb490 2023-10-08T12:45:45.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.675+0000 7fe72e579700 1 -- 172.21.15.45:0/1907772766 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe72813aed0 con 0x7fe7280cb490 2023-10-08T12:45:45.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.676+0000 7fe724ff9700 1 -- 172.21.15.45:0/1907772766 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe72813aed0 con 0x7fe7280cb490 2023-10-08T12:45:45.677 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T12:45:45.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.678+0000 7fe72e579700 1 -- 172.21.15.45:0/1907772766 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe70806aed0 msgr2=0x7fe70806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:45.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.678+0000 7fe72e579700 1 --2- 172.21.15.45:0/1907772766 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe70806aed0 0x7fe70806d390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe718004740 tx=0x7fe718009040 comp rx=0 tx=0).stop 2023-10-08T12:45:45.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.678+0000 7fe72e579700 1 -- 172.21.15.45:0/1907772766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7280cb490 msgr2=0x7fe7281e1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:45.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.678+0000 7fe72e579700 1 --2- 172.21.15.45:0/1907772766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7280cb490 0x7fe7281e1a50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe71000c970 tx=0x7fe71000cd30 comp rx=0 tx=0).stop 2023-10-08T12:45:45.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.678+0000 7fe72e579700 1 -- 172.21.15.45:0/1907772766 shutdown_connections 2023-10-08T12:45:45.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.678+0000 7fe72e579700 1 --2- 172.21.15.45:0/1907772766 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe70806aed0 0x7fe70806d390 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:45.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.678+0000 7fe72e579700 1 --2- 172.21.15.45:0/1907772766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7280cb910 0x7fe72813e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:45.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.678+0000 7fe72e579700 1 --2- 172.21.15.45:0/1907772766 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7280b2b30 0x7fe7281efd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:45.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.678+0000 7fe72e579700 1 --2- 172.21.15.45:0/1907772766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7280cb490 0x7fe7281e1a50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:45.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.678+0000 7fe72e579700 1 -- 172.21.15.45:0/1907772766 >> 172.21.15.45:0/1907772766 conn(0x7fe72806a210 msgr2=0x7fe728141800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:45.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.678+0000 7fe72e579700 1 -- 172.21.15.45:0/1907772766 shutdown_connections 2023-10-08T12:45:45.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:45.678+0000 7fe72e579700 1 -- 172.21.15.45:0/1907772766 wait complete. 2023-10-08T12:45:45.691 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T12:45:45.691 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T12:45:45.691 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-10-08T12:45:45.691 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T12:45:45.691 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T12:45:45.691 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T12:45:45.691 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T12:45:45.691 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T12:45:45.691 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T12:45:45.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:45.692 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-10-08T12:45:45.709 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T12:45:45.709 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T12:45:45.709 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T12:45:45.709 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:45.709 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-10-08T12:45:45.709 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:45.709 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T12:45:45.710 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-10-08T12:45:45.710 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T12:45:45.710 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-10-08T12:45:45.710 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T12:45:45.710 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-10-08T12:45:45.710 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T12:45:45.710 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42353sec preferred_lft 42353sec 2023-10-08T12:45:45.710 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-10-08T12:45:45.710 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:45.710 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T12:45:45.710 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-10-08T12:45:45.711 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-08T12:45:45.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:45.711 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-10-08T12:45:45.711 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-10-08T12:45:45.711 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add name ceph-brx type bridge 2023-10-08T12:45:45.711 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr flush dev ceph-brx 2023-10-08T12:45:45.711 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set ceph-brx up 2023-10-08T12:45:45.711 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-08T12:45:45.712 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-10-08T12:45:45.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:45.951 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T12:45:45.981 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-10-08T12:45:45.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:45.983 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-10-08T12:45:46.066 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-10-08T12:45:46.066 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T12:45:46.066 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T12:45:46.066 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T12:45:46.066 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T12:45:46.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:46.067 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-10-08T12:45:46.067 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-10-08T12:45:46.067 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T12:45:46.067 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T12:45:46.067 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T12:45:46.067 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-10-08T12:45:46.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:46.307 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-10-08T12:45:46.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:46.324 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list-id 2023-10-08T12:45:46.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:46.382 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-10-08T12:45:46.382 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-10-08T12:45:46.382 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T12:45:46.382 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-08T12:45:46.382 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-10-08T12:45:46.477 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-08T12:45:46.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:46.477 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-10-08T12:45:46.477 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-10-08T12:45:46.477 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-08T12:45:46.478 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-08T12:45:46.478 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-08T12:45:46.478 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-08T12:45:46.478 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-08T12:45:46.478 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-10-08T12:45:46.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:46.801 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-10-08T12:45:46.801 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-10-08T12:45:46.801 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-10-08T12:45:46.801 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set dev brx.0 master ceph-brx 2023-10-08T12:45:46.801 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-10-08T12:45:46.904 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T12:45:46.904 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T12:45:46.927 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T12:45:46.927 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T12:45:46.928 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T12:45:46.985 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T12:45:46.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:46.985 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T12:45:47.081 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T12:45:47.082 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T12:45:47.195 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T12:45:47.196 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T12:45:47.196 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.78:3300,172.21.15.78:3301" 2023-10-08T12:45:47.196 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with new device syntax: 0@3c5c3516-8181-4382-8205-f21bea7ad4b3.cephfs=/ 2023-10-08T12:45:47.196 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.45:3300/172.21.15.78:3300/172.21.15.78:3301" will pass to kernel 2023-10-08T12:45:47.196 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T12:45:47.196 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T12:45:47.196 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T12:45:47.272 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T12:45:47.273 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T12:45:47.273 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.78:3300,172.21.15.78:3301" 2023-10-08T12:45:47.273 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with new device syntax: 0@3c5c3516-8181-4382-8205-f21bea7ad4b3.cephfs=/ 2023-10-08T12:45:47.273 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.45:3300/172.21.15.78:3300/172.21.15.78:3301" will pass to kernel 2023-10-08T12:45:47.273 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T12:45:47.273 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T12:45:47.273 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T12:45:47.273 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:6789,172.21.15.78:6789,172.21.15.78:6790" 2023-10-08T12:45:47.273 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.45:6789,172.21.15.78:6789,172.21.15.78:6790:/ 2023-10-08T12:45:47.273 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=3c5c3516-8181-4382-8205-f21bea7ad4b3" will pass to kernel 2023-10-08T12:45:47.275 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T12:45:47.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:47.275 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T12:45:47.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:47.304 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T12:45:47.391 INFO:teuthology.orchestra.run.smithi045.stdout:client4738 2023-10-08T12:45:47.392 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:45:47.392 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T12:45:47.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:47.409 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T12:45:47.496 INFO:teuthology.orchestra.run.smithi045.stdout:client4738 2023-10-08T12:45:47.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:47.496 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T12:45:47.544 INFO:teuthology.orchestra.run.smithi045.stdout:client4738 2023-10-08T12:45:47.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:47.545 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/3c5c3516-8181-4382-8205-f21bea7ad4b3.client4738/status') 2023-10-08T12:45:47.599 INFO:teuthology.orchestra.run.smithi045.stdout:instance: client.4738 (3)172.21.15.45:0/2705040542 2023-10-08T12:45:47.599 INFO:teuthology.orchestra.run.smithi045.stdout:blocklisted: false 2023-10-08T12:45:47.599 INFO:teuthology.orchestra.run.smithi045.stderr:0+1 records in 2023-10-08T12:45:47.599 INFO:teuthology.orchestra.run.smithi045.stderr:0+1 records out 2023-10-08T12:45:47.599 INFO:teuthology.orchestra.run.smithi045.stderr:70 bytes copied, 2.551e-05 s, 2.7 MB/s 2023-10-08T12:45:47.600 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-10-08T12:45:47.601 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-08T12:45:47.601 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-08T12:45:47.601 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T12:45:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.727+0000 7f5ac0d89700 1 -- 172.21.15.45:0/781294241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5abc1420a0 msgr2=0x7f5abc0b3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.727+0000 7f5ac0d89700 1 --2- 172.21.15.45:0/781294241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5abc1420a0 0x7f5abc0b3400 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5aac005fd0 tx=0x7f5aac009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.727+0000 7f5ac0d89700 1 -- 172.21.15.45:0/781294241 shutdown_connections 2023-10-08T12:45:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.727+0000 7f5ac0d89700 1 --2- 172.21.15.45:0/781294241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5abc1420a0 0x7f5abc0b3400 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.727+0000 7f5ac0d89700 1 --2- 172.21.15.45:0/781294241 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5abc0cc880 0x7f5abc0b1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:47.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.727+0000 7f5ac0d89700 1 -- 172.21.15.45:0/781294241 >> 172.21.15.45:0/781294241 conn(0x7f5abc06a210 msgr2=0x7f5abc06a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:47.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.727+0000 7f5ac0d89700 1 -- 172.21.15.45:0/781294241 shutdown_connections 2023-10-08T12:45:47.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.727+0000 7f5ac0d89700 1 -- 172.21.15.45:0/781294241 wait complete. 2023-10-08T12:45:47.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.729+0000 7f5ac0d89700 1 Processor -- start 2023-10-08T12:45:47.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.729+0000 7f5ac0d89700 1 -- start start 2023-10-08T12:45:47.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.729+0000 7f5ac0d89700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5abc06c820 0x7f5abc1581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:47.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.729+0000 7f5ac0d89700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5abc0cc880 0x7f5abc1374f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:47.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.729+0000 7f5ac0d89700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5abc1420a0 0x7f5abc13b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:47.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.729+0000 7f5ac0d89700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc158700 con 0x7f5abc06c820 2023-10-08T12:45:47.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.729+0000 7f5ac0d89700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc13a100 con 0x7f5abc1420a0 2023-10-08T12:45:47.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.729+0000 7f5ac0d89700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc13a3e0 con 0x7f5abc0cc880 2023-10-08T12:45:47.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.729+0000 7f5aba59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5abc06c820 0x7f5abc1581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:47.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.729+0000 7f5aba59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5abc06c820 0x7f5abc1581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35704/0 (socket says 172.21.15.45:35704) 2023-10-08T12:45:47.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.729+0000 7f5aba59c700 1 -- 172.21.15.45:0/3589279721 learned_addr learned my addr 172.21.15.45:0/3589279721 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:47.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.730+0000 7f5abad9d700 1 --2- 172.21.15.45:0/3589279721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5abc1420a0 0x7f5abc13b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:47.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.730+0000 7f5ab9d9b700 1 --2- 172.21.15.45:0/3589279721 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5abc0cc880 0x7f5abc1374f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:47.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.730+0000 7f5aba59c700 1 -- 172.21.15.45:0/3589279721 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5abc0cc880 msgr2=0x7f5abc1374f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:47.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.730+0000 7f5aba59c700 1 --2- 172.21.15.45:0/3589279721 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5abc0cc880 0x7f5abc1374f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:47.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.730+0000 7f5aba59c700 1 -- 172.21.15.45:0/3589279721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5abc1420a0 msgr2=0x7f5abc13b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:47.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.730+0000 7f5aba59c700 1 --2- 172.21.15.45:0/3589279721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5abc1420a0 0x7f5abc13b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:47.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.730+0000 7f5aba59c700 1 -- 172.21.15.45:0/3589279721 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aac0095f0 con 0x7f5abc06c820 2023-10-08T12:45:47.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.730+0000 7f5abad9d700 1 --2- 172.21.15.45:0/3589279721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5abc1420a0 0x7f5abc13b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:47.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.730+0000 7f5ab9d9b700 1 --2- 172.21.15.45:0/3589279721 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5abc0cc880 0x7f5abc1374f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:47.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.730+0000 7f5aba59c700 1 --2- 172.21.15.45:0/3589279721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5abc06c820 0x7f5abc1581c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5aac000c00 tx=0x7f5aac004b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:47.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.730+0000 7f5aaaffd700 1 -- 172.21.15.45:0/3589279721 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aac01c070 con 0x7f5abc06c820 2023-10-08T12:45:47.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.730+0000 7f5aaaffd700 1 -- 172.21.15.45:0/3589279721 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5aac004320 con 0x7f5abc06c820 2023-10-08T12:45:47.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.730+0000 7f5ac0d89700 1 -- 172.21.15.45:0/3589279721 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5abc13a6c0 con 0x7f5abc06c820 2023-10-08T12:45:47.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.730+0000 7f5aaaffd700 1 -- 172.21.15.45:0/3589279721 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aac003680 con 0x7f5abc06c820 2023-10-08T12:45:47.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.730+0000 7f5ac0d89700 1 -- 172.21.15.45:0/3589279721 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5abc13ac80 con 0x7f5abc06c820 2023-10-08T12:45:47.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.731+0000 7f5ac0d89700 1 -- 172.21.15.45:0/3589279721 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5abc04e4c0 con 0x7f5abc06c820 2023-10-08T12:45:47.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.732+0000 7f5aaaffd700 1 -- 172.21.15.45:0/3589279721 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5aac0037e0 con 0x7f5abc06c820 2023-10-08T12:45:47.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.732+0000 7f5aaaffd700 1 --2- 172.21.15.45:0/3589279721 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f5a9c06aed0 0x7f5a9c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:47.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.732+0000 7f5aaaffd700 1 -- 172.21.15.45:0/3589279721 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5aac08a900 con 0x7f5abc06c820 2023-10-08T12:45:47.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.732+0000 7f5ab9d9b700 1 --2- 172.21.15.45:0/3589279721 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f5a9c06aed0 0x7f5a9c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:47.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.733+0000 7f5ab9d9b700 1 --2- 172.21.15.45:0/3589279721 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f5a9c06aed0 0x7f5a9c06d390 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0b23d0 tx=0x7f5ab0005f50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:47.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.737+0000 7f5aaaffd700 1 -- 172.21.15.45:0/3589279721 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5aac0559c0 con 0x7f5abc06c820 2023-10-08T12:45:47.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.981+0000 7f5ac0d89700 1 -- 172.21.15.45:0/3589279721 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5abc0aca80 con 0x7f5abc06c820 2023-10-08T12:45:47.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.981+0000 7f5aaaffd700 1 -- 172.21.15.45:0/3589279721 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5aac058fe0 con 0x7f5abc06c820 2023-10-08T12:45:47.982 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T12:45:47.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.984+0000 7f5ac0d89700 1 -- 172.21.15.45:0/3589279721 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f5a9c06aed0 msgr2=0x7f5a9c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:47.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.984+0000 7f5ac0d89700 1 --2- 172.21.15.45:0/3589279721 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f5a9c06aed0 0x7f5a9c06d390 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0b23d0 tx=0x7f5ab0005f50 comp rx=0 tx=0).stop 2023-10-08T12:45:47.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.984+0000 7f5ac0d89700 1 -- 172.21.15.45:0/3589279721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5abc06c820 msgr2=0x7f5abc1581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:47.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.984+0000 7f5ac0d89700 1 --2- 172.21.15.45:0/3589279721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5abc06c820 0x7f5abc1581c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5aac000c00 tx=0x7f5aac004b10 comp rx=0 tx=0).stop 2023-10-08T12:45:47.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.984+0000 7f5ac0d89700 1 -- 172.21.15.45:0/3589279721 shutdown_connections 2023-10-08T12:45:47.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.984+0000 7f5ac0d89700 1 --2- 172.21.15.45:0/3589279721 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f5a9c06aed0 0x7f5a9c06d390 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:47.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.984+0000 7f5ac0d89700 1 --2- 172.21.15.45:0/3589279721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5abc1420a0 0x7f5abc13b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:47.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.984+0000 7f5ac0d89700 1 --2- 172.21.15.45:0/3589279721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5abc06c820 0x7f5abc1581c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:47.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.984+0000 7f5ac0d89700 1 --2- 172.21.15.45:0/3589279721 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5abc0cc880 0x7f5abc1374f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:47.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.984+0000 7f5ac0d89700 1 -- 172.21.15.45:0/3589279721 >> 172.21.15.45:0/3589279721 conn(0x7f5abc06a210 msgr2=0x7f5abc0ad500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:47.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.984+0000 7f5ac0d89700 1 -- 172.21.15.45:0/3589279721 shutdown_connections 2023-10-08T12:45:47.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:47.984+0000 7f5ac0d89700 1 -- 172.21.15.45:0/3589279721 wait complete. 2023-10-08T12:45:47.997 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T12:45:47.997 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T12:45:47.997 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-10-08T12:45:47.997 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-08T12:45:47.997 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-08T12:45:47.997 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T12:45:47.997 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T12:45:47.998 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T12:45:47.998 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-08T12:45:47.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:47.998 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-10-08T12:45:48.015 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T12:45:48.015 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T12:45:48.015 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T12:45:48.016 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:48.016 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-10-08T12:45:48.016 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:48.016 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T12:45:48.016 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-10-08T12:45:48.016 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T12:45:48.016 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-10-08T12:45:48.016 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T12:45:48.016 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-10-08T12:45:48.016 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T12:45:48.016 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42351sec preferred_lft 42351sec 2023-10-08T12:45:48.016 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-10-08T12:45:48.017 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:48.017 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T12:45:48.017 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-10-08T12:45:48.017 INFO:teuthology.orchestra.run.smithi045.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T12:45:48.017 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether e6:29:a4:72:20:8b brd ff:ff:ff:ff:ff:ff 2023-10-08T12:45:48.017 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T12:45:48.017 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:48.017 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::50f2:2cff:fed6:8f10/64 scope link 2023-10-08T12:45:48.017 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:48.017 INFO:teuthology.orchestra.run.smithi045.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T12:45:48.017 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether e6:29:a4:72:20:8b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T12:45:48.018 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::e429:a4ff:fe72:208b/64 scope link tentative 2023-10-08T12:45:48.018 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:48.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:48.018 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T12:45:48.081 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-10-08T12:45:48.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:48.083 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-10-08T12:45:48.142 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-10-08T12:45:48.142 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T12:45:48.142 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T12:45:48.142 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T12:45:48.142 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T12:45:48.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:48.143 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-10-08T12:45:48.143 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-10-08T12:45:48.143 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T12:45:48.143 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T12:45:48.143 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T12:45:48.143 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-10-08T12:45:48.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:48.251 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-10-08T12:45:48.269 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T12:45:48.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:48.269 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list-id 2023-10-08T12:45:48.325 INFO:teuthology.orchestra.run.smithi045.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-08T12:45:48.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:48.326 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-10-08T12:45:48.326 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-10-08T12:45:48.326 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T12:45:48.326 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-08T12:45:48.326 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-10-08T12:45:48.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:48.421 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-08T12:45:48.458 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T12:45:48.459 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T12:45:48.459 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T12:45:48.459 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:48.459 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-10-08T12:45:48.459 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:48.459 INFO:teuthology.orchestra.run.smithi045.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T12:45:48.459 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether da:57:4a:1d:08:f9 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-08T12:45:48.459 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-08T12:45:48.459 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:48.459 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::d857:4aff:fe1d:8f9/64 scope link tentative 2023-10-08T12:45:48.460 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:48.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:48.470 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-08T12:45:48.552 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T12:45:48.552 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T12:45:48.552 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T12:45:48.552 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:48.552 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-10-08T12:45:48.552 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:48.553 INFO:teuthology.orchestra.run.smithi045.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T12:45:48.553 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether da:57:4a:1d:08:f9 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-08T12:45:48.553 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-08T12:45:48.553 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:48.553 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::d857:4aff:fe1d:8f9/64 scope link 2023-10-08T12:45:48.553 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:48.565 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-08T12:45:48.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:48.565 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-10-08T12:45:48.565 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-10-08T12:45:48.565 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-08T12:45:48.565 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-08T12:45:48.565 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-08T12:45:48.565 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-08T12:45:48.566 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-08T12:45:48.566 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-10-08T12:45:48.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:48.828 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-10-08T12:45:48.828 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-10-08T12:45:48.829 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.1 up 2023-10-08T12:45:48.829 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set dev brx.1 master ceph-brx 2023-10-08T12:45:48.829 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-10-08T12:45:48.947 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T12:45:48.948 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-08T12:45:48.971 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-08T12:45:48.971 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T12:45:48.971 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-08T12:45:49.027 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-10-08T12:45:49.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:49.028 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T12:45:49.114 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T12:45:49.114 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T12:45:49.145 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T12:45:49.146 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T12:45:49.146 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.78:3300,172.21.15.78:3301" 2023-10-08T12:45:49.146 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with new device syntax: 2@3c5c3516-8181-4382-8205-f21bea7ad4b3.cephfs=/ 2023-10-08T12:45:49.146 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.45:3300/172.21.15.78:3300/172.21.15.78:3301" will pass to kernel 2023-10-08T12:45:49.146 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T12:45:49.146 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T12:45:49.146 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T12:45:49.219 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T12:45:49.219 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T12:45:49.219 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.78:3300,172.21.15.78:3301" 2023-10-08T12:45:49.220 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with new device syntax: 2@3c5c3516-8181-4382-8205-f21bea7ad4b3.cephfs=/ 2023-10-08T12:45:49.220 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.45:3300/172.21.15.78:3300/172.21.15.78:3301" will pass to kernel 2023-10-08T12:45:49.220 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T12:45:49.220 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T12:45:49.220 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T12:45:49.220 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:6789,172.21.15.78:6789,172.21.15.78:6790" 2023-10-08T12:45:49.221 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.45:6789,172.21.15.78:6789,172.21.15.78:6790:/ 2023-10-08T12:45:49.221 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,key=2,mds_namespace=cephfs,fsid=3c5c3516-8181-4382-8205-f21bea7ad4b3" will pass to kernel 2023-10-08T12:45:49.222 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T12:45:49.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:49.223 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-08T12:45:49.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:49.251 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T12:45:49.324 INFO:teuthology.orchestra.run.smithi045.stdout:client4565 2023-10-08T12:45:49.325 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:45:49.325 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T12:45:49.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:49.383 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T12:45:49.457 INFO:teuthology.orchestra.run.smithi045.stdout:client4565 2023-10-08T12:45:49.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:49.457 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T12:45:49.529 INFO:teuthology.orchestra.run.smithi045.stdout:client4565 2023-10-08T12:45:49.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:49.530 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/3c5c3516-8181-4382-8205-f21bea7ad4b3.client4565/status') 2023-10-08T12:45:49.611 INFO:teuthology.orchestra.run.smithi045.stdout:instance: client.4565 (3)172.21.15.45:0/1215253860 2023-10-08T12:45:49.611 INFO:teuthology.orchestra.run.smithi045.stdout:blocklisted: false 2023-10-08T12:45:49.611 INFO:teuthology.orchestra.run.smithi045.stderr:0+1 records in 2023-10-08T12:45:49.611 INFO:teuthology.orchestra.run.smithi045.stderr:0+1 records out 2023-10-08T12:45:49.611 INFO:teuthology.orchestra.run.smithi045.stderr:70 bytes copied, 2.4471e-05 s, 2.9 MB/s 2023-10-08T12:45:49.612 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-10-08T12:45:49.612 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-08T12:45:49.612 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T12:45:49.612 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T12:45:49.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.780+0000 7f878e55c700 1 -- 172.21.15.45:0/1460280434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87880cdf60 msgr2=0x7f878815c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:49.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.780+0000 7f878e55c700 1 --2- 172.21.15.45:0/1460280434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87880cdf60 0x7f878815c320 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f877c005fd0 tx=0x7f877c009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:49.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.780+0000 7f878e55c700 1 -- 172.21.15.45:0/1460280434 shutdown_connections 2023-10-08T12:45:49.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.780+0000 7f878e55c700 1 --2- 172.21.15.45:0/1460280434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87880cdf60 0x7f878815c320 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:49.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.780+0000 7f878e55c700 1 -- 172.21.15.45:0/1460280434 >> 172.21.15.45:0/1460280434 conn(0x7f87880b0430 msgr2=0x7f87880b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:49.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.780+0000 7f878e55c700 1 -- 172.21.15.45:0/1460280434 shutdown_connections 2023-10-08T12:45:49.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.780+0000 7f878e55c700 1 -- 172.21.15.45:0/1460280434 wait complete. 2023-10-08T12:45:49.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.781+0000 7f878e55c700 1 Processor -- start 2023-10-08T12:45:49.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.781+0000 7f878e55c700 1 -- start start 2023-10-08T12:45:49.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.782+0000 7f878e55c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87880c9ff0 0x7f87881ef840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:49.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.782+0000 7f878e55c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87880cdf60 0x7f8788154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:49.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.782+0000 7f878e55c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8788158950 0x7f87881553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:49.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.782+0000 7f878e55c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87881e4e60 con 0x7f87880cdf60 2023-10-08T12:45:49.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.782+0000 7f878e55c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87880a6490 con 0x7f87880c9ff0 2023-10-08T12:45:49.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.782+0000 7f878e55c700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87881e2950 con 0x7f8788158950 2023-10-08T12:45:49.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.782+0000 7f87877fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87880cdf60 0x7f8788154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:49.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.782+0000 7f87877fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87880cdf60 0x7f8788154e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35734/0 (socket says 172.21.15.45:35734) 2023-10-08T12:45:49.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.782+0000 7f87877fe700 1 -- 172.21.15.45:0/679597636 learned_addr learned my addr 172.21.15.45:0/679597636 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:49.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.782+0000 7f87877fe700 1 -- 172.21.15.45:0/679597636 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8788158950 msgr2=0x7f87881553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:49.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.782+0000 7f8787fff700 1 --2- 172.21.15.45:0/679597636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87880c9ff0 0x7f87881ef840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:49.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.782+0000 7f878caf9700 1 --2- 172.21.15.45:0/679597636 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8788158950 0x7f87881553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:49.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.782+0000 7f87877fe700 1 --2- 172.21.15.45:0/679597636 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8788158950 0x7f87881553c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:49.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.782+0000 7f87877fe700 1 -- 172.21.15.45:0/679597636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87880c9ff0 msgr2=0x7f87881ef840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:49.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.782+0000 7f87877fe700 1 --2- 172.21.15.45:0/679597636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87880c9ff0 0x7f87881ef840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:49.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.782+0000 7f87877fe700 1 -- 172.21.15.45:0/679597636 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877c0095f0 con 0x7f87880cdf60 2023-10-08T12:45:49.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.782+0000 7f8787fff700 1 --2- 172.21.15.45:0/679597636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87880c9ff0 0x7f87881ef840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:45:49.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.782+0000 7f87877fe700 1 --2- 172.21.15.45:0/679597636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87880cdf60 0x7f8788154e80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f877c00b540 tx=0x7f877c004b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:49.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.783+0000 7f8784ff9700 1 -- 172.21.15.45:0/679597636 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c01d070 con 0x7f87880cdf60 2023-10-08T12:45:49.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.783+0000 7f8784ff9700 1 -- 172.21.15.45:0/679597636 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f877c004020 con 0x7f87880cdf60 2023-10-08T12:45:49.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.783+0000 7f878e55c700 1 -- 172.21.15.45:0/679597636 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87880c7550 con 0x7f87880cdf60 2023-10-08T12:45:49.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.783+0000 7f8784ff9700 1 -- 172.21.15.45:0/679597636 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c004430 con 0x7f87880cdf60 2023-10-08T12:45:49.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.783+0000 7f878e55c700 1 -- 172.21.15.45:0/679597636 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87881e25e0 con 0x7f87880cdf60 2023-10-08T12:45:49.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.783+0000 7f878e55c700 1 -- 172.21.15.45:0/679597636 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f878804e4c0 con 0x7f87880cdf60 2023-10-08T12:45:49.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.784+0000 7f8784ff9700 1 -- 172.21.15.45:0/679597636 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f877c005100 con 0x7f87880cdf60 2023-10-08T12:45:49.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.784+0000 7f8784ff9700 1 --2- 172.21.15.45:0/679597636 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f877406aed0 0x7f877406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:49.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.784+0000 7f8784ff9700 1 -- 172.21.15.45:0/679597636 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f877c08a9d0 con 0x7f87880cdf60 2023-10-08T12:45:49.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.785+0000 7f8787fff700 1 --2- 172.21.15.45:0/679597636 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f877406aed0 0x7f877406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:49.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.785+0000 7f8787fff700 1 --2- 172.21.15.45:0/679597636 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f877406aed0 0x7f877406d390 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8778006fd0 tx=0x7f8778008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:49.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:49.789+0000 7f8784ff9700 1 -- 172.21.15.45:0/679597636 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f877c055c30 con 0x7f87880cdf60 2023-10-08T12:45:50.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:50.033+0000 7f878e55c700 1 -- 172.21.15.45:0/679597636 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f87881e2a90 con 0x7f87880cdf60 2023-10-08T12:45:50.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:50.033+0000 7f8784ff9700 1 -- 172.21.15.45:0/679597636 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f877c059250 con 0x7f87880cdf60 2023-10-08T12:45:50.034 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T12:45:50.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:50.035+0000 7f878e55c700 1 -- 172.21.15.45:0/679597636 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f877406aed0 msgr2=0x7f877406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:50.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:50.035+0000 7f878e55c700 1 --2- 172.21.15.45:0/679597636 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f877406aed0 0x7f877406d390 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8778006fd0 tx=0x7f8778008040 comp rx=0 tx=0).stop 2023-10-08T12:45:50.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:50.035+0000 7f878e55c700 1 -- 172.21.15.45:0/679597636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87880cdf60 msgr2=0x7f8788154e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:50.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:50.035+0000 7f878e55c700 1 --2- 172.21.15.45:0/679597636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87880cdf60 0x7f8788154e80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f877c00b540 tx=0x7f877c004b10 comp rx=0 tx=0).stop 2023-10-08T12:45:50.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:50.035+0000 7f878e55c700 1 -- 172.21.15.45:0/679597636 shutdown_connections 2023-10-08T12:45:50.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:50.035+0000 7f878e55c700 1 --2- 172.21.15.45:0/679597636 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f877406aed0 0x7f877406d390 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:50.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:50.035+0000 7f878e55c700 1 --2- 172.21.15.45:0/679597636 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8788158950 0x7f87881553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:50.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:50.035+0000 7f878e55c700 1 --2- 172.21.15.45:0/679597636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87880c9ff0 0x7f87881ef840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:50.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:50.035+0000 7f878e55c700 1 --2- 172.21.15.45:0/679597636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87880cdf60 0x7f8788154e80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:50.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:50.035+0000 7f878e55c700 1 -- 172.21.15.45:0/679597636 >> 172.21.15.45:0/679597636 conn(0x7f87880b0430 msgr2=0x7f87880cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:50.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:50.036+0000 7f878e55c700 1 -- 172.21.15.45:0/679597636 shutdown_connections 2023-10-08T12:45:50.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:50.036+0000 7f878e55c700 1 -- 172.21.15.45:0/679597636 wait complete. 2023-10-08T12:45:50.048 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T12:45:50.049 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T12:45:50.049 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2023-10-08T12:45:50.049 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T12:45:50.049 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T12:45:50.049 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T12:45:50.049 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T12:45:50.049 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T12:45:50.050 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T12:45:50.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:50.050 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2023-10-08T12:45:50.073 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T12:45:50.073 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T12:45:50.073 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T12:45:50.073 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:50.073 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-10-08T12:45:50.073 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:50.073 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T12:45:50.073 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2023-10-08T12:45:50.073 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T12:45:50.074 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2023-10-08T12:45:50.074 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T12:45:50.074 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2023-10-08T12:45:50.074 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T12:45:50.074 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2023-10-08T12:45:50.074 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T12:45:50.074 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42367sec preferred_lft 42367sec 2023-10-08T12:45:50.074 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::7939:b45d:9ca8:9ae9/64 scope link noprefixroute 2023-10-08T12:45:50.074 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:50.075 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-08T12:45:50.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:50.075 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-10-08T12:45:50.075 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-10-08T12:45:50.075 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add name ceph-brx type bridge 2023-10-08T12:45:50.075 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr flush dev ceph-brx 2023-10-08T12:45:50.075 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set ceph-brx up 2023-10-08T12:45:50.075 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-08T12:45:50.075 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-10-08T12:45:50.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:50.253 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T12:45:50.287 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-10-08T12:45:50.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:50.289 DEBUG:teuthology.orchestra.run.smithi078:> route 2023-10-08T12:45:50.365 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2023-10-08T12:45:50.366 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T12:45:50.366 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T12:45:50.366 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T12:45:50.366 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T12:45:50.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:50.367 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-10-08T12:45:50.367 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-10-08T12:45:50.367 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T12:45:50.367 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T12:45:50.367 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T12:45:50.367 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-10-08T12:45:50.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:50.666 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-10-08T12:45:50.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:50.684 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list-id 2023-10-08T12:45:50.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:50.740 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-10-08T12:45:50.740 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-10-08T12:45:50.740 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T12:45:50.741 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-08T12:45:50.741 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-10-08T12:45:50.836 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-08T12:45:50.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:50.837 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-10-08T12:45:50.837 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-10-08T12:45:50.837 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-08T12:45:50.837 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-08T12:45:50.837 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-08T12:45:50.837 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-08T12:45:50.837 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-08T12:45:50.837 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-10-08T12:45:51.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:51.039 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-10-08T12:45:51.039 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-10-08T12:45:51.039 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2023-10-08T12:45:51.039 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set dev brx.0 master ceph-brx 2023-10-08T12:45:51.039 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-10-08T12:45:51.143 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T12:45:51.144 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T12:45:51.167 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T12:45:51.167 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T12:45:51.167 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T12:45:51.223 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-08T12:45:51.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:51.224 DEBUG:teuthology.orchestra.run.smithi078:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T12:45:51.322 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T12:45:51.322 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T12:45:51.448 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T12:45:51.448 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T12:45:51.448 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.78:3300,172.21.15.78:3301" 2023-10-08T12:45:51.448 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: trying mount with new device syntax: 1@3c5c3516-8181-4382-8205-f21bea7ad4b3.cephfs=/ 2023-10-08T12:45:51.448 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.45:3300/172.21.15.78:3300/172.21.15.78:3301" will pass to kernel 2023-10-08T12:45:51.448 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T12:45:51.448 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T12:45:51.448 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T12:45:51.481 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T12:45:51.481 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T12:45:51.481 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.78:3300,172.21.15.78:3301" 2023-10-08T12:45:51.482 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: trying mount with new device syntax: 1@3c5c3516-8181-4382-8205-f21bea7ad4b3.cephfs=/ 2023-10-08T12:45:51.482 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.45:3300/172.21.15.78:3300/172.21.15.78:3301" will pass to kernel 2023-10-08T12:45:51.482 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T12:45:51.482 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T12:45:51.482 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T12:45:51.482 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.45:6789,172.21.15.78:6789,172.21.15.78:6790" 2023-10-08T12:45:51.482 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.45:6789,172.21.15.78:6789,172.21.15.78:6790:/ 2023-10-08T12:45:51.482 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=3c5c3516-8181-4382-8205-f21bea7ad4b3" will pass to kernel 2023-10-08T12:45:51.485 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T12:45:51.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:51.486 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T12:45:51.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:51.518 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T12:45:51.589 INFO:teuthology.orchestra.run.smithi078.stdout:client4568 2023-10-08T12:45:51.589 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T12:45:51.590 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T12:45:51.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:51.646 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T12:45:51.717 INFO:teuthology.orchestra.run.smithi078.stdout:client4568 2023-10-08T12:45:51.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:51.718 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T12:45:51.789 INFO:teuthology.orchestra.run.smithi078.stdout:client4568 2023-10-08T12:45:51.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:51.790 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/3c5c3516-8181-4382-8205-f21bea7ad4b3.client4568/status') 2023-10-08T12:45:51.869 INFO:teuthology.orchestra.run.smithi078.stdout:instance: client.4568 (3)192.168.0.1:0/356772592 2023-10-08T12:45:51.869 INFO:teuthology.orchestra.run.smithi078.stdout:blocklisted: false 2023-10-08T12:45:51.869 INFO:teuthology.orchestra.run.smithi078.stderr:0+1 records in 2023-10-08T12:45:51.869 INFO:teuthology.orchestra.run.smithi078.stderr:0+1 records out 2023-10-08T12:45:51.869 INFO:teuthology.orchestra.run.smithi078.stderr:68 bytes copied, 2.0952e-05 s, 3.2 MB/s 2023-10-08T12:45:51.870 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-10-08T12:45:51.870 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-08T12:45:51.870 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-08T12:45:51.871 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T12:45:52.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.012+0000 7f532319e700 1 -- 172.21.15.45:0/3565266804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5308004cd0 msgr2=0x7f53080050d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:52.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.012+0000 7f532319e700 1 --2- 172.21.15.45:0/3565266804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5308004cd0 0x7f53080050d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5318009be0 tx=0x7f5308006990 comp rx=0 tx=0).stop 2023-10-08T12:45:52.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.012+0000 7f532299d700 1 -- 172.21.15.45:0/3565266804 reap_dead start 2023-10-08T12:45:52.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.012+0000 7f532319e700 1 -- 172.21.15.45:0/3565266804 shutdown_connections 2023-10-08T12:45:52.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.012+0000 7f532319e700 1 -- 172.21.15.45:0/3565266804 >> 172.21.15.45:0/3565266804 conn(0x7f531c0cd7b0 msgr2=0x7f531c0cdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:52.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.012+0000 7f532319e700 1 -- 172.21.15.45:0/3565266804 shutdown_connections 2023-10-08T12:45:52.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.012+0000 7f532319e700 1 -- 172.21.15.45:0/3565266804 wait complete. 2023-10-08T12:45:52.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.014+0000 7f532319e700 1 Processor -- start 2023-10-08T12:45:52.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.014+0000 7f532319e700 1 -- start start 2023-10-08T12:45:52.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.014+0000 7f532319e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5308004cd0 0x7f531c1560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:52.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.014+0000 7f532319e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f531c1588c0 0x7f531c15b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:52.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.015+0000 7f532319e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f531c1568c0 0x7f531c1e3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:52.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.015+0000 7f532319e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c0c44f0 con 0x7f531c1568c0 2023-10-08T12:45:52.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.015+0000 7f532319e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c156600 con 0x7f5308004cd0 2023-10-08T12:45:52.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.015+0000 7f532319e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531c0c5ca0 con 0x7f531c1588c0 2023-10-08T12:45:52.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.015+0000 7f532299d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f531c1568c0 0x7f531c1e3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:52.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.015+0000 7f532219c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5308004cd0 0x7f531c1560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:52.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.015+0000 7f532299d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f531c1568c0 0x7f531c1e3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35754/0 (socket says 172.21.15.45:35754) 2023-10-08T12:45:52.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.015+0000 7f532299d700 1 -- 172.21.15.45:0/2368317561 learned_addr learned my addr 172.21.15.45:0/2368317561 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:52.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.015+0000 7f532199b700 1 --2- 172.21.15.45:0/2368317561 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f531c1588c0 0x7f531c15b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:52.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.015+0000 7f532299d700 1 -- 172.21.15.45:0/2368317561 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f531c1588c0 msgr2=0x7f531c15b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:52.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.015+0000 7f532299d700 1 --2- 172.21.15.45:0/2368317561 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f531c1588c0 0x7f531c15b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:52.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.015+0000 7f532299d700 1 -- 172.21.15.45:0/2368317561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5308004cd0 msgr2=0x7f531c1560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:52.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.015+0000 7f532299d700 1 --2- 172.21.15.45:0/2368317561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5308004cd0 0x7f531c1560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:52.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.015+0000 7f532299d700 1 -- 172.21.15.45:0/2368317561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531c0c5f80 con 0x7f531c1568c0 2023-10-08T12:45:52.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.015+0000 7f532219c700 1 --2- 172.21.15.45:0/2368317561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5308004cd0 0x7f531c1560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:52.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.015+0000 7f532299d700 1 --2- 172.21.15.45:0/2368317561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f531c1568c0 0x7f531c1e3a70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f531c06e570 tx=0x7f5314006760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:52.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.015+0000 7f530effd700 1 -- 172.21.15.45:0/2368317561 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5314011960 con 0x7f531c1568c0 2023-10-08T12:45:52.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.015+0000 7f530effd700 1 -- 172.21.15.45:0/2368317561 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5314011ac0 con 0x7f531c1568c0 2023-10-08T12:45:52.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.015+0000 7f532319e700 1 -- 172.21.15.45:0/2368317561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f531c0c6260 con 0x7f531c1568c0 2023-10-08T12:45:52.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.015+0000 7f530effd700 1 -- 172.21.15.45:0/2368317561 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5314011ed0 con 0x7f531c1568c0 2023-10-08T12:45:52.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.015+0000 7f532319e700 1 -- 172.21.15.45:0/2368317561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f531c15b680 con 0x7f531c1568c0 2023-10-08T12:45:52.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.016+0000 7f532319e700 1 -- 172.21.15.45:0/2368317561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f531c0c6780 con 0x7f531c1568c0 2023-10-08T12:45:52.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.017+0000 7f530effd700 1 -- 172.21.15.45:0/2368317561 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5314013450 con 0x7f531c1568c0 2023-10-08T12:45:52.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.017+0000 7f530effd700 1 --2- 172.21.15.45:0/2368317561 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f530006aed0 0x7f530006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:52.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.017+0000 7f530effd700 1 -- 172.21.15.45:0/2368317561 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f531408c530 con 0x7f531c1568c0 2023-10-08T12:45:52.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.017+0000 7f532219c700 1 --2- 172.21.15.45:0/2368317561 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f530006aed0 0x7f530006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:52.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.018+0000 7f532219c700 1 --2- 172.21.15.45:0/2368317561 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f530006aed0 0x7f530006d390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5318009be0 tx=0x7f5318004750 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:52.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.022+0000 7f530effd700 1 -- 172.21.15.45:0/2368317561 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f531c0c6780 con 0x7f531c1568c0 2023-10-08T12:45:52.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.267+0000 7f532319e700 1 -- 172.21.15.45:0/2368317561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f531c0c6780 con 0x7f531c1568c0 2023-10-08T12:45:52.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.268+0000 7f530effd700 1 -- 172.21.15.45:0/2368317561 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f531c0c6780 con 0x7f531c1568c0 2023-10-08T12:45:52.268 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T12:45:52.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.270+0000 7f532319e700 1 -- 172.21.15.45:0/2368317561 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f530006aed0 msgr2=0x7f530006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:52.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.270+0000 7f532319e700 1 --2- 172.21.15.45:0/2368317561 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f530006aed0 0x7f530006d390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5318009be0 tx=0x7f5318004750 comp rx=0 tx=0).stop 2023-10-08T12:45:52.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.270+0000 7f532319e700 1 -- 172.21.15.45:0/2368317561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f531c1568c0 msgr2=0x7f531c1e3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:52.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.270+0000 7f532319e700 1 --2- 172.21.15.45:0/2368317561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f531c1568c0 0x7f531c1e3a70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f531c06e570 tx=0x7f5314006760 comp rx=0 tx=0).stop 2023-10-08T12:45:52.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.270+0000 7f532319e700 1 -- 172.21.15.45:0/2368317561 shutdown_connections 2023-10-08T12:45:52.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.270+0000 7f532319e700 1 --2- 172.21.15.45:0/2368317561 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f530006aed0 0x7f530006d390 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:52.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.270+0000 7f532319e700 1 --2- 172.21.15.45:0/2368317561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f531c1568c0 0x7f531c1e3a70 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:52.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.270+0000 7f532319e700 1 --2- 172.21.15.45:0/2368317561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5308004cd0 0x7f531c1560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:52.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.270+0000 7f532319e700 1 --2- 172.21.15.45:0/2368317561 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f531c1588c0 0x7f531c15b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:52.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.270+0000 7f532319e700 1 -- 172.21.15.45:0/2368317561 >> 172.21.15.45:0/2368317561 conn(0x7f531c0cd7b0 msgr2=0x7f531c0aa640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:52.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.270+0000 7f532319e700 1 -- 172.21.15.45:0/2368317561 shutdown_connections 2023-10-08T12:45:52.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:52.270+0000 7f532319e700 1 -- 172.21.15.45:0/2368317561 wait complete. 2023-10-08T12:45:52.285 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T12:45:52.285 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T12:45:52.286 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2023-10-08T12:45:52.286 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-08T12:45:52.286 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-08T12:45:52.286 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T12:45:52.286 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T12:45:52.286 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T12:45:52.286 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-08T12:45:52.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:52.286 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2023-10-08T12:45:52.303 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T12:45:52.303 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T12:45:52.303 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T12:45:52.303 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:52.304 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-10-08T12:45:52.304 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:52.304 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T12:45:52.304 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2023-10-08T12:45:52.304 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T12:45:52.304 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2023-10-08T12:45:52.304 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T12:45:52.304 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2023-10-08T12:45:52.304 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T12:45:52.304 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2023-10-08T12:45:52.304 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T12:45:52.304 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42365sec preferred_lft 42365sec 2023-10-08T12:45:52.305 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::7939:b45d:9ca8:9ae9/64 scope link noprefixroute 2023-10-08T12:45:52.305 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:52.305 INFO:teuthology.orchestra.run.smithi078.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T12:45:52.305 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether f6:fd:97:02:0f:77 brd ff:ff:ff:ff:ff:ff 2023-10-08T12:45:52.305 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T12:45:52.305 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:52.305 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::1c53:12ff:feca:2482/64 scope link 2023-10-08T12:45:52.305 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:52.305 INFO:teuthology.orchestra.run.smithi078.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T12:45:52.305 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether f6:fd:97:02:0f:77 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T12:45:52.305 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::f4fd:97ff:fe02:f77/64 scope link tentative 2023-10-08T12:45:52.306 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:52.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:52.307 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T12:45:52.369 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-10-08T12:45:52.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:52.370 DEBUG:teuthology.orchestra.run.smithi078:> route 2023-10-08T12:45:52.428 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2023-10-08T12:45:52.428 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T12:45:52.428 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T12:45:52.428 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T12:45:52.428 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T12:45:52.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:52.429 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-10-08T12:45:52.430 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-10-08T12:45:52.430 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T12:45:52.430 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T12:45:52.430 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T12:45:52.430 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-10-08T12:45:52.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:52.533 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-10-08T12:45:52.550 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T12:45:52.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:52.550 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list-id 2023-10-08T12:45:52.607 INFO:teuthology.orchestra.run.smithi078.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-08T12:45:52.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:52.607 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-10-08T12:45:52.607 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-10-08T12:45:52.607 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T12:45:52.607 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-08T12:45:52.607 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-10-08T12:45:52.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:52.700 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-08T12:45:52.735 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T12:45:52.735 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T12:45:52.736 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T12:45:52.736 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:52.736 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-10-08T12:45:52.736 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:52.736 INFO:teuthology.orchestra.run.smithi078.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T12:45:52.736 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether e2:72:f1:dd:b3:2a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-08T12:45:52.736 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-08T12:45:52.736 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:52.736 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::e072:f1ff:fedd:b32a/64 scope link 2023-10-08T12:45:52.736 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:52.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:52.748 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-08T12:45:52.829 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T12:45:52.829 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T12:45:52.830 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T12:45:52.830 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:52.830 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-10-08T12:45:52.830 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:52.830 INFO:teuthology.orchestra.run.smithi078.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T12:45:52.830 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether e2:72:f1:dd:b3:2a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-08T12:45:52.830 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-08T12:45:52.830 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:52.830 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::e072:f1ff:fedd:b32a/64 scope link 2023-10-08T12:45:52.830 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:45:52.840 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-08T12:45:52.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:52.841 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-10-08T12:45:52.841 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-10-08T12:45:52.841 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-08T12:45:52.841 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-08T12:45:52.841 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-08T12:45:52.841 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-08T12:45:52.841 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-08T12:45:52.841 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-10-08T12:45:53.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:53.092 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-10-08T12:45:53.092 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-10-08T12:45:53.092 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.1 up 2023-10-08T12:45:53.092 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set dev brx.1 master ceph-brx 2023-10-08T12:45:53.092 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-10-08T12:45:53.207 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T12:45:53.207 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-08T12:45:53.228 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-08T12:45:53.228 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T12:45:53.228 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-08T12:45:53.284 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-10-08T12:45:53.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:53.285 DEBUG:teuthology.orchestra.run.smithi078:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T12:45:53.369 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T12:45:53.369 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T12:45:53.392 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T12:45:53.392 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T12:45:53.393 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.78:3300,172.21.15.78:3301" 2023-10-08T12:45:53.393 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: trying mount with new device syntax: 3@3c5c3516-8181-4382-8205-f21bea7ad4b3.cephfs=/ 2023-10-08T12:45:53.393 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.45:3300/172.21.15.78:3300/172.21.15.78:3301" will pass to kernel 2023-10-08T12:45:53.393 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T12:45:53.393 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T12:45:53.393 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T12:45:53.421 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T12:45:53.421 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T12:45:53.422 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.78:3300,172.21.15.78:3301" 2023-10-08T12:45:53.422 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: trying mount with new device syntax: 3@3c5c3516-8181-4382-8205-f21bea7ad4b3.cephfs=/ 2023-10-08T12:45:53.422 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.45:3300/172.21.15.78:3300/172.21.15.78:3301" will pass to kernel 2023-10-08T12:45:53.422 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T12:45:53.422 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T12:45:53.422 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T12:45:53.422 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.45:6789,172.21.15.78:6789,172.21.15.78:6790" 2023-10-08T12:45:53.423 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.45:6789,172.21.15.78:6789,172.21.15.78:6790:/ 2023-10-08T12:45:53.423 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,key=3,mds_namespace=cephfs,fsid=3c5c3516-8181-4382-8205-f21bea7ad4b3" will pass to kernel 2023-10-08T12:45:53.425 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T12:45:53.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:53.425 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-08T12:45:53.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:53.460 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T12:45:53.532 INFO:teuthology.orchestra.run.smithi078.stdout:client4750 2023-10-08T12:45:53.532 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T12:45:53.532 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T12:45:53.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:53.589 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T12:45:53.660 INFO:teuthology.orchestra.run.smithi078.stdout:client4750 2023-10-08T12:45:53.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:53.661 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T12:45:53.731 INFO:teuthology.orchestra.run.smithi078.stdout:client4750 2023-10-08T12:45:53.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:45:53.732 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/3c5c3516-8181-4382-8205-f21bea7ad4b3.client4750/status') 2023-10-08T12:45:53.811 INFO:teuthology.orchestra.run.smithi078.stdout:instance: client.4750 (3)192.168.0.2:0/2385391504 2023-10-08T12:45:53.812 INFO:teuthology.orchestra.run.smithi078.stdout:blocklisted: false 2023-10-08T12:45:53.813 INFO:teuthology.orchestra.run.smithi078.stderr:0+1 records in 2023-10-08T12:45:53.813 INFO:teuthology.orchestra.run.smithi078.stderr:0+1 records out 2023-10-08T12:45:53.813 INFO:teuthology.orchestra.run.smithi078.stderr:69 bytes copied, 2.259e-05 s, 3.1 MB/s 2023-10-08T12:45:53.813 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-08T12:45:53.830 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:45:53.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.971+0000 7f245f02f700 1 -- 172.21.15.45:0/80943602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2458158950 msgr2=0x7f24580cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:53.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.971+0000 7f245f02f700 1 --2- 172.21.15.45:0/80943602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2458158950 0x7f24580cdf60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f245806d490 tx=0x7f244c009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:53.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.971+0000 7f245f02f700 1 -- 172.21.15.45:0/80943602 shutdown_connections 2023-10-08T12:45:53.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.971+0000 7f245f02f700 1 --2- 172.21.15.45:0/80943602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2458158950 0x7f24580cdf60 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:53.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.971+0000 7f245f02f700 1 --2- 172.21.15.45:0/80943602 >> v2:172.21.15.78:3300/0 conn(0x7f245815c320 0x7f2458071f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:53.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.971+0000 7f245f02f700 1 -- 172.21.15.45:0/80943602 >> 172.21.15.45:0/80943602 conn(0x7f24580b0430 msgr2=0x7f24580b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:53.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.971+0000 7f245f02f700 1 -- 172.21.15.45:0/80943602 shutdown_connections 2023-10-08T12:45:53.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.971+0000 7f245f02f700 1 -- 172.21.15.45:0/80943602 wait complete. 2023-10-08T12:45:53.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.973+0000 7f245f02f700 1 Processor -- start 2023-10-08T12:45:53.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.973+0000 7f245f02f700 1 -- start start 2023-10-08T12:45:53.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.973+0000 7f245f02f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24580724c0 0x7f24581ef5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:53.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.973+0000 7f245f02f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2458158950 0x7f24580c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:53.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.974+0000 7f245f02f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f245815c320 0x7f2458155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:53.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.974+0000 7f245f02f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245815aae0 con 0x7f24580724c0 2023-10-08T12:45:53.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.974+0000 7f245f02f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2458159ed0 con 0x7f245815c320 2023-10-08T12:45:53.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.974+0000 7f245f02f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245815a1b0 con 0x7f2458158950 2023-10-08T12:45:53.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.974+0000 7f245cdcb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24580724c0 0x7f24581ef5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:53.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.974+0000 7f245cdcb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24580724c0 0x7f24581ef5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35766/0 (socket says 172.21.15.45:35766) 2023-10-08T12:45:53.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.974+0000 7f245cdcb700 1 -- 172.21.15.45:0/1387204318 learned_addr learned my addr 172.21.15.45:0/1387204318 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:53.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.974+0000 7f2457fff700 1 --2- 172.21.15.45:0/1387204318 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2458158950 0x7f24580c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:53.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.974+0000 7f245d5cc700 1 --2- 172.21.15.45:0/1387204318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f245815c320 0x7f2458155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:53.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.974+0000 7f245cdcb700 1 -- 172.21.15.45:0/1387204318 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2458158950 msgr2=0x7f24580c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:53.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.974+0000 7f245cdcb700 1 --2- 172.21.15.45:0/1387204318 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2458158950 0x7f24580c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:53.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.974+0000 7f245cdcb700 1 -- 172.21.15.45:0/1387204318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f245815c320 msgr2=0x7f2458155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:53.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.974+0000 7f245cdcb700 1 --2- 172.21.15.45:0/1387204318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f245815c320 0x7f2458155e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:53.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.974+0000 7f245cdcb700 1 -- 172.21.15.45:0/1387204318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244c0095f0 con 0x7f24580724c0 2023-10-08T12:45:53.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.974+0000 7f245d5cc700 1 --2- 172.21.15.45:0/1387204318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f245815c320 0x7f2458155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:45:53.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.974+0000 7f245cdcb700 1 --2- 172.21.15.45:0/1387204318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24580724c0 0x7f24581ef5f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2458070420 tx=0x7f244c004b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:53.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.974+0000 7f24557fa700 1 -- 172.21.15.45:0/1387204318 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c01f070 con 0x7f24580724c0 2023-10-08T12:45:53.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.974+0000 7f24557fa700 1 -- 172.21.15.45:0/1387204318 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f244c01a930 con 0x7f24580724c0 2023-10-08T12:45:53.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.974+0000 7f24557fa700 1 -- 172.21.15.45:0/1387204318 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c01ad40 con 0x7f24580724c0 2023-10-08T12:45:53.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.974+0000 7f245f02f700 1 -- 172.21.15.45:0/1387204318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f245815a490 con 0x7f24580724c0 2023-10-08T12:45:53.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.975+0000 7f245f02f700 1 -- 172.21.15.45:0/1387204318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24580c8600 con 0x7f24580724c0 2023-10-08T12:45:53.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.975+0000 7f245f02f700 1 -- 172.21.15.45:0/1387204318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24580c8790 con 0x7f24580724c0 2023-10-08T12:45:53.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.976+0000 7f24557fa700 1 -- 172.21.15.45:0/1387204318 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f244c004df0 con 0x7f24580724c0 2023-10-08T12:45:53.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.976+0000 7f24557fa700 1 --2- 172.21.15.45:0/1387204318 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f243c06aed0 0x7f243c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:53.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.976+0000 7f24557fa700 1 -- 172.21.15.45:0/1387204318 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f244c08cd40 con 0x7f24580724c0 2023-10-08T12:45:53.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.977+0000 7f2457fff700 1 --2- 172.21.15.45:0/1387204318 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f243c06aed0 0x7f243c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:53.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.977+0000 7f2457fff700 1 --2- 172.21.15.45:0/1387204318 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f243c06aed0 0x7f243c06d390 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2444005fd0 tx=0x7f2444005d90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:53.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:53.981+0000 7f24557fa700 1 -- 172.21.15.45:0/1387204318 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f244c057e80 con 0x7f24580724c0 2023-10-08T12:45:54.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.181+0000 7f245f02f700 1 -- 172.21.15.45:0/1387204318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f245804e4c0 con 0x7f24580724c0 2023-10-08T12:45:54.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.182+0000 7f24557fa700 1 -- 172.21.15.45:0/1387204318 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f244c028070 con 0x7f24580724c0 2023-10-08T12:45:54.183 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:54.184 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:45:26.206424+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:45:19.183651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:45:22.277383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:45:23.606639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.412453+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.351925+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.428025+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.437246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.441119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.388608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.415524+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.401835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:45:54.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.184+0000 7f245f02f700 1 -- 172.21.15.45:0/1387204318 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f243c06aed0 msgr2=0x7f243c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:54.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.184+0000 7f245f02f700 1 --2- 172.21.15.45:0/1387204318 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f243c06aed0 0x7f243c06d390 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2444005fd0 tx=0x7f2444005d90 comp rx=0 tx=0).stop 2023-10-08T12:45:54.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.184+0000 7f245f02f700 1 -- 172.21.15.45:0/1387204318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24580724c0 msgr2=0x7f24581ef5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:54.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.184+0000 7f245f02f700 1 --2- 172.21.15.45:0/1387204318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24580724c0 0x7f24581ef5f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2458070420 tx=0x7f244c004b10 comp rx=0 tx=0).stop 2023-10-08T12:45:54.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.184+0000 7f245f02f700 1 -- 172.21.15.45:0/1387204318 shutdown_connections 2023-10-08T12:45:54.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.184+0000 7f245f02f700 1 --2- 172.21.15.45:0/1387204318 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f243c06aed0 0x7f243c06d390 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:54.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.184+0000 7f245f02f700 1 --2- 172.21.15.45:0/1387204318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f245815c320 0x7f2458155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:54.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.184+0000 7f245f02f700 1 --2- 172.21.15.45:0/1387204318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24580724c0 0x7f24581ef5f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:54.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.184+0000 7f245f02f700 1 --2- 172.21.15.45:0/1387204318 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2458158950 0x7f24580c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:54.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.184+0000 7f245f02f700 1 -- 172.21.15.45:0/1387204318 >> 172.21.15.45:0/1387204318 conn(0x7f24580b0430 msgr2=0x7f2458156d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:54.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.185+0000 7f245f02f700 1 -- 172.21.15.45:0/1387204318 shutdown_connections 2023-10-08T12:45:54.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.185+0000 7f245f02f700 1 -- 172.21.15.45:0/1387204318 wait complete. 2023-10-08T12:45:54.197 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:45:19.183651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:45:22.277383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:45:23.606639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:45:54.198 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:45:54.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.327+0000 7facc0284700 1 -- 172.21.15.45:0/1049648856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facb80cc820 msgr2=0x7facb80b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:54.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.327+0000 7facc0284700 1 --2- 172.21.15.45:0/1049648856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facb80cc820 0x7facb80b0510 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faca80098c0 tx=0x7faca8009bd0 comp rx=0 tx=0).stop 2023-10-08T12:45:54.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.328+0000 7facc0284700 1 -- 172.21.15.45:0/1049648856 shutdown_connections 2023-10-08T12:45:54.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.328+0000 7facc0284700 1 --2- 172.21.15.45:0/1049648856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facb80cc820 0x7facb80b0510 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:54.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.328+0000 7facc0284700 1 -- 172.21.15.45:0/1049648856 >> 172.21.15.45:0/1049648856 conn(0x7facb806b320 msgr2=0x7facb806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:54.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.328+0000 7facc0284700 1 -- 172.21.15.45:0/1049648856 shutdown_connections 2023-10-08T12:45:54.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.328+0000 7facc0284700 1 -- 172.21.15.45:0/1049648856 wait complete. 2023-10-08T12:45:54.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.329+0000 7facc0284700 1 Processor -- start 2023-10-08T12:45:54.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.329+0000 7facc0284700 1 -- start start 2023-10-08T12:45:54.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.329+0000 7facc0284700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facb80cc820 0x7facb81492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:54.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.329+0000 7facc0284700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7facb80cf520 0x7facb81575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:54.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.329+0000 7facc0284700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facb81586b0 0x7facb81498c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:54.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.329+0000 7facc0284700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb8161b80 con 0x7facb80cc820 2023-10-08T12:45:54.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.329+0000 7facc0284700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb815bd70 con 0x7facb81586b0 2023-10-08T12:45:54.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.329+0000 7facc0284700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb815b4d0 con 0x7facb80cf520 2023-10-08T12:45:54.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.330+0000 7facbe020700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facb80cc820 0x7facb81492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:54.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.330+0000 7facbe020700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facb80cc820 0x7facb81492c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35780/0 (socket says 172.21.15.45:35780) 2023-10-08T12:45:54.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.330+0000 7facbe020700 1 -- 172.21.15.45:0/588244551 learned_addr learned my addr 172.21.15.45:0/588244551 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:54.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.330+0000 7facbd81f700 1 --2- 172.21.15.45:0/588244551 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7facb80cf520 0x7facb81575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:54.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.330+0000 7facbe821700 1 --2- 172.21.15.45:0/588244551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facb81586b0 0x7facb81498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:54.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.330+0000 7facbe020700 1 -- 172.21.15.45:0/588244551 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7facb80cf520 msgr2=0x7facb81575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:54.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.330+0000 7facbe020700 1 --2- 172.21.15.45:0/588244551 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7facb80cf520 0x7facb81575e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:54.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.330+0000 7facbe020700 1 -- 172.21.15.45:0/588244551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facb81586b0 msgr2=0x7facb81498c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:54.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.330+0000 7facbe020700 1 --2- 172.21.15.45:0/588244551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facb81586b0 0x7facb81498c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:54.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.330+0000 7facbe020700 1 -- 172.21.15.45:0/588244551 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca8009520 con 0x7facb80cc820 2023-10-08T12:45:54.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.330+0000 7facbd81f700 1 --2- 172.21.15.45:0/588244551 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7facb80cf520 0x7facb81575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:54.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.330+0000 7facbe821700 1 --2- 172.21.15.45:0/588244551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facb81586b0 0x7facb81498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:45:54.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.330+0000 7facbe020700 1 --2- 172.21.15.45:0/588244551 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facb80cc820 0x7facb81492c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7facb400c450 tx=0x7facb400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:54.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.330+0000 7facaeffd700 1 -- 172.21.15.45:0/588244551 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb40052d0 con 0x7facb80cc820 2023-10-08T12:45:54.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.330+0000 7facaeffd700 1 -- 172.21.15.45:0/588244551 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7facb4005520 con 0x7facb80cc820 2023-10-08T12:45:54.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.330+0000 7facc0284700 1 -- 172.21.15.45:0/588244551 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb815b7b0 con 0x7facb80cc820 2023-10-08T12:45:54.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.330+0000 7facaeffd700 1 -- 172.21.15.45:0/588244551 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb40038e0 con 0x7facb80cc820 2023-10-08T12:45:54.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.330+0000 7facc0284700 1 -- 172.21.15.45:0/588244551 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb8157b20 con 0x7facb80cc820 2023-10-08T12:45:54.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.331+0000 7facc0284700 1 -- 172.21.15.45:0/588244551 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb815c140 con 0x7facb80cc820 2023-10-08T12:45:54.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.332+0000 7facaeffd700 1 -- 172.21.15.45:0/588244551 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7facb4003a40 con 0x7facb80cc820 2023-10-08T12:45:54.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.332+0000 7facaeffd700 1 --2- 172.21.15.45:0/588244551 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fac9c06aed0 0x7fac9c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:54.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.332+0000 7facaeffd700 1 -- 172.21.15.45:0/588244551 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7facb4088b70 con 0x7facb80cc820 2023-10-08T12:45:54.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.332+0000 7facbd81f700 1 --2- 172.21.15.45:0/588244551 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fac9c06aed0 0x7fac9c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:54.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.333+0000 7facbd81f700 1 --2- 172.21.15.45:0/588244551 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fac9c06aed0 0x7fac9c06d390 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7facb80ccc00 tx=0x7faca8019040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:54.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.337+0000 7facaeffd700 1 -- 172.21.15.45:0/588244551 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7facb4053cb0 con 0x7facb80cc820 2023-10-08T12:45:54.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.536+0000 7facc0284700 1 -- 172.21.15.45:0/588244551 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7facb8066850 con 0x7facb80cc820 2023-10-08T12:45:54.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.537+0000 7facaeffd700 1 -- 172.21.15.45:0/588244551 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7facb40572d0 con 0x7facb80cc820 2023-10-08T12:45:54.538 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-08T12:45:54.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.539+0000 7facc0284700 1 -- 172.21.15.45:0/588244551 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fac9c06aed0 msgr2=0x7fac9c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:54.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.539+0000 7facc0284700 1 --2- 172.21.15.45:0/588244551 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fac9c06aed0 0x7fac9c06d390 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7facb80ccc00 tx=0x7faca8019040 comp rx=0 tx=0).stop 2023-10-08T12:45:54.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.539+0000 7facc0284700 1 -- 172.21.15.45:0/588244551 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facb80cc820 msgr2=0x7facb81492c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:54.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.539+0000 7facc0284700 1 --2- 172.21.15.45:0/588244551 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facb80cc820 0x7facb81492c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7facb400c450 tx=0x7facb400c810 comp rx=0 tx=0).stop 2023-10-08T12:45:54.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.539+0000 7facc0284700 1 -- 172.21.15.45:0/588244551 shutdown_connections 2023-10-08T12:45:54.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.539+0000 7facc0284700 1 --2- 172.21.15.45:0/588244551 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fac9c06aed0 0x7fac9c06d390 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:54.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.539+0000 7facc0284700 1 --2- 172.21.15.45:0/588244551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facb81586b0 0x7facb81498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:54.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.539+0000 7facc0284700 1 --2- 172.21.15.45:0/588244551 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facb80cc820 0x7facb81492c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:54.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.539+0000 7facc0284700 1 --2- 172.21.15.45:0/588244551 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7facb80cf520 0x7facb81575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:54.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.539+0000 7facc0284700 1 -- 172.21.15.45:0/588244551 >> 172.21.15.45:0/588244551 conn(0x7facb806b320 msgr2=0x7facb8154e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:54.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.539+0000 7facc0284700 1 -- 172.21.15.45:0/588244551 shutdown_connections 2023-10-08T12:45:54.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.539+0000 7facc0284700 1 -- 172.21.15.45:0/588244551 wait complete. 2023-10-08T12:45:54.552 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:45:54.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.682+0000 7f4afebb4700 1 -- 172.21.15.45:0/1068042076 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ae8005210 msgr2=0x7f4ae800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:54.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.682+0000 7f4afebb4700 1 --2- 172.21.15.45:0/1068042076 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ae8005210 0x7f4ae800ba10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4af000c640 tx=0x7f4ae8005880 comp rx=0 tx=0).stop 2023-10-08T12:45:54.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.682+0000 7f4afebb4700 1 -- 172.21.15.45:0/1068042076 shutdown_connections 2023-10-08T12:45:54.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.682+0000 7f4afebb4700 1 --2- 172.21.15.45:0/1068042076 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ae8005210 0x7f4ae800ba10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:54.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.682+0000 7f4afebb4700 1 -- 172.21.15.45:0/1068042076 >> 172.21.15.45:0/1068042076 conn(0x7f4af80cddc0 msgr2=0x7f4af80ce1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:54.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.682+0000 7f4afebb4700 1 -- 172.21.15.45:0/1068042076 shutdown_connections 2023-10-08T12:45:54.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.682+0000 7f4afebb4700 1 -- 172.21.15.45:0/1068042076 wait complete. 2023-10-08T12:45:54.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.683+0000 7f4afebb4700 1 Processor -- start 2023-10-08T12:45:54.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.684+0000 7f4afebb4700 1 -- start start 2023-10-08T12:45:54.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.684+0000 7f4afebb4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ae8005210 0x7f4af8099f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:54.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.684+0000 7f4afebb4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4af8151af0 0x7f4af81f00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:54.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.684+0000 7f4afebb4700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4af81571f0 0x7f4af8155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:54.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.684+0000 7f4afebb4700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af809a750 con 0x7f4af8151af0 2023-10-08T12:45:54.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.684+0000 7f4afebb4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af81f0970 con 0x7f4ae8005210 2023-10-08T12:45:54.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.684+0000 7f4afebb4700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af81f0c50 con 0x7f4af81571f0 2023-10-08T12:45:54.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.685+0000 7f4af7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4af8151af0 0x7f4af81f00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:54.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.685+0000 7f4af7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4af8151af0 0x7f4af81f00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35802/0 (socket says 172.21.15.45:35802) 2023-10-08T12:45:54.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.685+0000 7f4af7fff700 1 -- 172.21.15.45:0/377539554 learned_addr learned my addr 172.21.15.45:0/377539554 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:54.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.685+0000 7f4afc950700 1 --2- 172.21.15.45:0/377539554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ae8005210 0x7f4af8099f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:54.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.685+0000 7f4afd151700 1 --2- 172.21.15.45:0/377539554 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4af81571f0 0x7f4af8155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:54.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.685+0000 7f4af7fff700 1 -- 172.21.15.45:0/377539554 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4af81571f0 msgr2=0x7f4af8155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:54.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.685+0000 7f4af7fff700 1 --2- 172.21.15.45:0/377539554 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4af81571f0 0x7f4af8155200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:54.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.685+0000 7f4af7fff700 1 -- 172.21.15.45:0/377539554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ae8005210 msgr2=0x7f4af8099f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:54.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.685+0000 7f4af7fff700 1 --2- 172.21.15.45:0/377539554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ae8005210 0x7f4af8099f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:54.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.685+0000 7f4af7fff700 1 -- 172.21.15.45:0/377539554 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af81f0f30 con 0x7f4af8151af0 2023-10-08T12:45:54.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.685+0000 7f4af7fff700 1 --2- 172.21.15.45:0/377539554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4af8151af0 0x7f4af81f00b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4003ea0 tx=0x7f4ae400b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:54.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.685+0000 7f4af57fa700 1 -- 172.21.15.45:0/377539554 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4011850 con 0x7f4af8151af0 2023-10-08T12:45:54.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.685+0000 7f4af57fa700 1 -- 172.21.15.45:0/377539554 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4ae40119b0 con 0x7f4af8151af0 2023-10-08T12:45:54.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.685+0000 7f4afebb4700 1 -- 172.21.15.45:0/377539554 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af809a9f0 con 0x7f4af8151af0 2023-10-08T12:45:54.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.685+0000 7f4af57fa700 1 -- 172.21.15.45:0/377539554 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4011d60 con 0x7f4af8151af0 2023-10-08T12:45:54.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.685+0000 7f4afebb4700 1 -- 172.21.15.45:0/377539554 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af8157680 con 0x7f4af8151af0 2023-10-08T12:45:54.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.686+0000 7f4afebb4700 1 -- 172.21.15.45:0/377539554 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af809ac30 con 0x7f4af8151af0 2023-10-08T12:45:54.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.687+0000 7f4af57fa700 1 -- 172.21.15.45:0/377539554 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4ae4017020 con 0x7f4af8151af0 2023-10-08T12:45:54.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.687+0000 7f4af57fa700 1 --2- 172.21.15.45:0/377539554 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4adc06af00 0x7f4adc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:54.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.687+0000 7f4af57fa700 1 -- 172.21.15.45:0/377539554 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ae408a1a0 con 0x7f4af8151af0 2023-10-08T12:45:54.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.687+0000 7f4afc950700 1 --2- 172.21.15.45:0/377539554 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4adc06af00 0x7f4adc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:54.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.688+0000 7f4afc950700 1 --2- 172.21.15.45:0/377539554 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4adc06af00 0x7f4adc06d3c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4af8099d50 tx=0x7f4aec006bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:54.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.692+0000 7f4af57fa700 1 -- 172.21.15.45:0/377539554 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4af809ac30 con 0x7f4af8151af0 2023-10-08T12:45:54.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.892+0000 7f4afebb4700 1 -- 172.21.15.45:0/377539554 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4af8067470 con 0x7f4af8151af0 2023-10-08T12:45:54.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.892+0000 7f4af57fa700 1 -- 172.21.15.45:0/377539554 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4ae4055250 con 0x7f4af8151af0 2023-10-08T12:45:54.893 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-08T12:45:54.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.894+0000 7f4afebb4700 1 -- 172.21.15.45:0/377539554 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4adc06af00 msgr2=0x7f4adc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:54.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.894+0000 7f4afebb4700 1 --2- 172.21.15.45:0/377539554 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4adc06af00 0x7f4adc06d3c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4af8099d50 tx=0x7f4aec006bc0 comp rx=0 tx=0).stop 2023-10-08T12:45:54.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.894+0000 7f4afebb4700 1 -- 172.21.15.45:0/377539554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4af8151af0 msgr2=0x7f4af81f00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:54.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.894+0000 7f4afebb4700 1 --2- 172.21.15.45:0/377539554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4af8151af0 0x7f4af81f00b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4003ea0 tx=0x7f4ae400b950 comp rx=0 tx=0).stop 2023-10-08T12:45:54.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.894+0000 7f4afebb4700 1 -- 172.21.15.45:0/377539554 shutdown_connections 2023-10-08T12:45:54.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.894+0000 7f4afebb4700 1 --2- 172.21.15.45:0/377539554 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4adc06af00 0x7f4adc06d3c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:54.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.894+0000 7f4afebb4700 1 --2- 172.21.15.45:0/377539554 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4af81571f0 0x7f4af8155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:54.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.894+0000 7f4afebb4700 1 --2- 172.21.15.45:0/377539554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ae8005210 0x7f4af8099f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:54.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.894+0000 7f4afebb4700 1 --2- 172.21.15.45:0/377539554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4af8151af0 0x7f4af81f00b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:54.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.894+0000 7f4afebb4700 1 -- 172.21.15.45:0/377539554 >> 172.21.15.45:0/377539554 conn(0x7f4af80cddc0 msgr2=0x7f4af80ad980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:54.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.895+0000 7f4afebb4700 1 -- 172.21.15.45:0/377539554 shutdown_connections 2023-10-08T12:45:54.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:54.895+0000 7f4afebb4700 1 -- 172.21.15.45:0/377539554 wait complete. 2023-10-08T12:45:54.908 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:45:55.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.037+0000 7fefd35ee700 1 -- 172.21.15.45:0/1729582811 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefb8004d90 msgr2=0x7fefb8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:55.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.038+0000 7fefd35ee700 1 --2- 172.21.15.45:0/1729582811 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefb8004d90 0x7fefb8005210 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fefc400e350 tx=0x7fefb8005880 comp rx=0 tx=0).stop 2023-10-08T12:45:55.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.038+0000 7fefd1b8b700 1 -- 172.21.15.45:0/1729582811 reap_dead start 2023-10-08T12:45:55.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.038+0000 7fefd35ee700 1 -- 172.21.15.45:0/1729582811 shutdown_connections 2023-10-08T12:45:55.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.038+0000 7fefd35ee700 1 -- 172.21.15.45:0/1729582811 >> 172.21.15.45:0/1729582811 conn(0x7fefcc088fb0 msgr2=0x7fefcc0893c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:55.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.038+0000 7fefd35ee700 1 -- 172.21.15.45:0/1729582811 shutdown_connections 2023-10-08T12:45:55.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.038+0000 7fefd35ee700 1 -- 172.21.15.45:0/1729582811 wait complete. 2023-10-08T12:45:55.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.039+0000 7fefd35ee700 1 Processor -- start 2023-10-08T12:45:55.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.039+0000 7fefd35ee700 1 -- start start 2023-10-08T12:45:55.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.040+0000 7fefd35ee700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fefcc0b4320 0x7fefcc15cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:55.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.040+0000 7fefd35ee700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefcc0c3210 0x7fefcc0b4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:55.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.040+0000 7fefd35ee700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefcc06c3a0 0x7fefcc06c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:55.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.040+0000 7fefd35ee700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc15adc0 con 0x7fefcc0c3210 2023-10-08T12:45:55.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.040+0000 7fefd35ee700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc0b4c40 con 0x7fefcc06c3a0 2023-10-08T12:45:55.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.040+0000 7fefd35ee700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc0c3960 con 0x7fefcc0b4320 2023-10-08T12:45:55.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.040+0000 7fefd0b89700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefcc0c3210 0x7fefcc0b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:55.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.040+0000 7fefd0b89700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefcc0c3210 0x7fefcc0b4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35822/0 (socket says 172.21.15.45:35822) 2023-10-08T12:45:55.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.040+0000 7fefd0b89700 1 -- 172.21.15.45:0/3463017184 learned_addr learned my addr 172.21.15.45:0/3463017184 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:55.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.040+0000 7fefd138a700 1 --2- 172.21.15.45:0/3463017184 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fefcc0b4320 0x7fefcc15cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:55.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.040+0000 7fefd1b8b700 1 --2- 172.21.15.45:0/3463017184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefcc06c3a0 0x7fefcc06c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:55.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.040+0000 7fefd0b89700 1 -- 172.21.15.45:0/3463017184 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fefcc0b4320 msgr2=0x7fefcc15cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:55.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.040+0000 7fefd0b89700 1 --2- 172.21.15.45:0/3463017184 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fefcc0b4320 0x7fefcc15cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:55.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.040+0000 7fefd0b89700 1 -- 172.21.15.45:0/3463017184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefcc06c3a0 msgr2=0x7fefcc06c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:55.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.040+0000 7fefd0b89700 1 --2- 172.21.15.45:0/3463017184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefcc06c3a0 0x7fefcc06c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:55.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.040+0000 7fefd0b89700 1 -- 172.21.15.45:0/3463017184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefcc0c3c40 con 0x7fefcc0c3210 2023-10-08T12:45:55.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.040+0000 7fefd0b89700 1 --2- 172.21.15.45:0/3463017184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefcc0c3210 0x7fefcc0b4700 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fefc8003fb0 tx=0x7fefc8001540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:55.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.040+0000 7fefc1ffb700 1 -- 172.21.15.45:0/3463017184 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc8006230 con 0x7fefcc0c3210 2023-10-08T12:45:55.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.040+0000 7fefc1ffb700 1 -- 172.21.15.45:0/3463017184 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fefc8011630 con 0x7fefcc0c3210 2023-10-08T12:45:55.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.040+0000 7fefd35ee700 1 -- 172.21.15.45:0/3463017184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefcc0c3f20 con 0x7fefcc0c3210 2023-10-08T12:45:55.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.040+0000 7fefc1ffb700 1 -- 172.21.15.45:0/3463017184 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc80119c0 con 0x7fefcc0c3210 2023-10-08T12:45:55.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.041+0000 7fefd35ee700 1 -- 172.21.15.45:0/3463017184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefcc0c4200 con 0x7fefcc0c3210 2023-10-08T12:45:55.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.042+0000 7fefd35ee700 1 -- 172.21.15.45:0/3463017184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefcc066850 con 0x7fefcc0c3210 2023-10-08T12:45:55.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.042+0000 7fefc1ffb700 1 -- 172.21.15.45:0/3463017184 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fefc8011b20 con 0x7fefcc0c3210 2023-10-08T12:45:55.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.042+0000 7fefc1ffb700 1 --2- 172.21.15.45:0/3463017184 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fefb006aed0 0x7fefb006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:55.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.042+0000 7fefc1ffb700 1 -- 172.21.15.45:0/3463017184 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fefc808a2d0 con 0x7fefcc0c3210 2023-10-08T12:45:55.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.043+0000 7fefd138a700 1 --2- 172.21.15.45:0/3463017184 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fefb006aed0 0x7fefb006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:55.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.043+0000 7fefd138a700 1 --2- 172.21.15.45:0/3463017184 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fefb006aed0 0x7fefb006d390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fefbc001e10 tx=0x7fefbc000fe0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:55.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.047+0000 7fefc1ffb700 1 -- 172.21.15.45:0/3463017184 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fefc8055410 con 0x7fefcc0c3210 2023-10-08T12:45:55.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.247+0000 7fefd35ee700 1 -- 172.21.15.45:0/3463017184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fefcc0b55a0 con 0x7fefcc0c3210 2023-10-08T12:45:55.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.247+0000 7fefc1ffb700 1 -- 172.21.15.45:0/3463017184 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fefc801f0a0 con 0x7fefcc0c3210 2023-10-08T12:45:55.248 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-08T12:45:55.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.249+0000 7fefd35ee700 1 -- 172.21.15.45:0/3463017184 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fefb006aed0 msgr2=0x7fefb006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:55.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.249+0000 7fefd35ee700 1 --2- 172.21.15.45:0/3463017184 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fefb006aed0 0x7fefb006d390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fefbc001e10 tx=0x7fefbc000fe0 comp rx=0 tx=0).stop 2023-10-08T12:45:55.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.249+0000 7fefd35ee700 1 -- 172.21.15.45:0/3463017184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefcc0c3210 msgr2=0x7fefcc0b4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:55.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.249+0000 7fefd35ee700 1 --2- 172.21.15.45:0/3463017184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefcc0c3210 0x7fefcc0b4700 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fefc8003fb0 tx=0x7fefc8001540 comp rx=0 tx=0).stop 2023-10-08T12:45:55.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.249+0000 7fefd35ee700 1 -- 172.21.15.45:0/3463017184 shutdown_connections 2023-10-08T12:45:55.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.249+0000 7fefd35ee700 1 --2- 172.21.15.45:0/3463017184 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fefb006aed0 0x7fefb006d390 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:55.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.249+0000 7fefd35ee700 1 --2- 172.21.15.45:0/3463017184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefcc06c3a0 0x7fefcc06c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:55.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.249+0000 7fefd35ee700 1 --2- 172.21.15.45:0/3463017184 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fefcc0b4320 0x7fefcc15cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:55.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.249+0000 7fefd35ee700 1 --2- 172.21.15.45:0/3463017184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefcc0c3210 0x7fefcc0b4700 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:55.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.249+0000 7fefd35ee700 1 -- 172.21.15.45:0/3463017184 >> 172.21.15.45:0/3463017184 conn(0x7fefcc088fb0 msgr2=0x7fefcc070110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:55.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.250+0000 7fefd35ee700 1 -- 172.21.15.45:0/3463017184 shutdown_connections 2023-10-08T12:45:55.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.250+0000 7fefd35ee700 1 -- 172.21.15.45:0/3463017184 wait complete. 2023-10-08T12:45:55.263 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:45:55.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.389+0000 7f2f43325700 1 -- 172.21.15.45:0/2885388662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f3c0cdf60 msgr2=0x7f2f3c15c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:55.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.389+0000 7f2f43325700 1 --2- 172.21.15.45:0/2885388662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f3c0cdf60 0x7f2f3c15c320 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2f300098c0 tx=0x7f2f30009bd0 comp rx=0 tx=0).stop 2023-10-08T12:45:55.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.389+0000 7f2f43325700 1 -- 172.21.15.45:0/2885388662 shutdown_connections 2023-10-08T12:45:55.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.389+0000 7f2f43325700 1 --2- 172.21.15.45:0/2885388662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f3c0cdf60 0x7f2f3c15c320 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:55.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.389+0000 7f2f43325700 1 -- 172.21.15.45:0/2885388662 >> 172.21.15.45:0/2885388662 conn(0x7f2f3c0b0430 msgr2=0x7f2f3c0b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:55.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.389+0000 7f2f43325700 1 -- 172.21.15.45:0/2885388662 shutdown_connections 2023-10-08T12:45:55.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.389+0000 7f2f43325700 1 -- 172.21.15.45:0/2885388662 wait complete. 2023-10-08T12:45:55.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.390+0000 7f2f43325700 1 Processor -- start 2023-10-08T12:45:55.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.390+0000 7f2f43325700 1 -- start start 2023-10-08T12:45:55.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.391+0000 7f2f43325700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2f3c0c9ff0 0x7f2f3c155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:55.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.391+0000 7f2f43325700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f3c0cdf60 0x7f2f3c1f2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:55.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.391+0000 7f2f43325700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f3c158950 0x7f2f3c1f3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:55.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.391+0000 7f2f43325700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3c0ad3a0 con 0x7f2f3c0cdf60 2023-10-08T12:45:55.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.391+0000 7f2f43325700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3c0ad0c0 con 0x7f2f3c158950 2023-10-08T12:45:55.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.391+0000 7f2f43325700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3c0aa9b0 con 0x7f2f3c0c9ff0 2023-10-08T12:45:55.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.391+0000 7f2f408c0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f3c0cdf60 0x7f2f3c1f2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:55.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.391+0000 7f2f408c0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f3c0cdf60 0x7f2f3c1f2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35834/0 (socket says 172.21.15.45:35834) 2023-10-08T12:45:55.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.391+0000 7f2f408c0700 1 -- 172.21.15.45:0/1113944174 learned_addr learned my addr 172.21.15.45:0/1113944174 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:55.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.391+0000 7f2f418c2700 1 --2- 172.21.15.45:0/1113944174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f3c158950 0x7f2f3c1f3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:55.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.391+0000 7f2f408c0700 1 -- 172.21.15.45:0/1113944174 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2f3c0c9ff0 msgr2=0x7f2f3c155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:55.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.391+0000 7f2f410c1700 1 --2- 172.21.15.45:0/1113944174 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2f3c0c9ff0 0x7f2f3c155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:55.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.391+0000 7f2f408c0700 1 --2- 172.21.15.45:0/1113944174 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2f3c0c9ff0 0x7f2f3c155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:55.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.391+0000 7f2f408c0700 1 -- 172.21.15.45:0/1113944174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f3c158950 msgr2=0x7f2f3c1f3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:55.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.391+0000 7f2f408c0700 1 --2- 172.21.15.45:0/1113944174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f3c158950 0x7f2f3c1f3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:55.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.391+0000 7f2f408c0700 1 -- 172.21.15.45:0/1113944174 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f30009520 con 0x7f2f3c0cdf60 2023-10-08T12:45:55.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.391+0000 7f2f418c2700 1 --2- 172.21.15.45:0/1113944174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f3c158950 0x7f2f3c1f3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:45:55.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.391+0000 7f2f410c1700 1 --2- 172.21.15.45:0/1113944174 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2f3c0c9ff0 0x7f2f3c155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:45:55.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.391+0000 7f2f408c0700 1 --2- 172.21.15.45:0/1113944174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f3c0cdf60 0x7f2f3c1f2fc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2f30009230 tx=0x7f2f3000f7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:55.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.392+0000 7f2f2dffb700 1 -- 172.21.15.45:0/1113944174 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3000fcf0 con 0x7f2f3c0cdf60 2023-10-08T12:45:55.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.392+0000 7f2f2dffb700 1 -- 172.21.15.45:0/1113944174 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2f30004830 con 0x7f2f3c0cdf60 2023-10-08T12:45:55.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.392+0000 7f2f43325700 1 -- 172.21.15.45:0/1113944174 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f3c0aac90 con 0x7f2f3c0cdf60 2023-10-08T12:45:55.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.392+0000 7f2f2dffb700 1 -- 172.21.15.45:0/1113944174 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f30004c40 con 0x7f2f3c0cdf60 2023-10-08T12:45:55.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.392+0000 7f2f43325700 1 -- 172.21.15.45:0/1113944174 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f3c156240 con 0x7f2f3c0cdf60 2023-10-08T12:45:55.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.393+0000 7f2f43325700 1 -- 172.21.15.45:0/1113944174 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f3c0ab1b0 con 0x7f2f3c0cdf60 2023-10-08T12:45:55.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.393+0000 7f2f2dffb700 1 -- 172.21.15.45:0/1113944174 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2f30004da0 con 0x7f2f3c0cdf60 2023-10-08T12:45:55.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.394+0000 7f2f2dffb700 1 --2- 172.21.15.45:0/1113944174 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f2f2006af00 0x7f2f2006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:55.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.394+0000 7f2f2dffb700 1 -- 172.21.15.45:0/1113944174 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f3008b380 con 0x7f2f3c0cdf60 2023-10-08T12:45:55.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.394+0000 7f2f410c1700 1 --2- 172.21.15.45:0/1113944174 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f2f2006af00 0x7f2f2006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:55.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.394+0000 7f2f410c1700 1 --2- 172.21.15.45:0/1113944174 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f2f2006af00 0x7f2f2006d3c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2f380011e0 tx=0x7f2f38009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:55.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.398+0000 7f2f2dffb700 1 -- 172.21.15.45:0/1113944174 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2f3c0ab1b0 con 0x7f2f3c0cdf60 2023-10-08T12:45:55.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.599+0000 7f2f43325700 1 -- 172.21.15.45:0/1113944174 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f3c0ab1b0 con 0x7f2f3c0cdf60 2023-10-08T12:45:55.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.600+0000 7f2f2dffb700 1 -- 172.21.15.45:0/1113944174 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f2f3c0ab1b0 con 0x7f2f3c0cdf60 2023-10-08T12:45:55.601 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:55.601 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:45:26.206424+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:45:19.183651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:45:22.277383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:45:23.606639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.412453+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.351925+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.428025+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.437246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.441119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.388608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.415524+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.401835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:45:55.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.602+0000 7f2f43325700 1 -- 172.21.15.45:0/1113944174 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f2f2006af00 msgr2=0x7f2f2006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:55.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.602+0000 7f2f43325700 1 --2- 172.21.15.45:0/1113944174 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f2f2006af00 0x7f2f2006d3c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2f380011e0 tx=0x7f2f38009040 comp rx=0 tx=0).stop 2023-10-08T12:45:55.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.602+0000 7f2f43325700 1 -- 172.21.15.45:0/1113944174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f3c0cdf60 msgr2=0x7f2f3c1f2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:55.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.602+0000 7f2f43325700 1 --2- 172.21.15.45:0/1113944174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f3c0cdf60 0x7f2f3c1f2fc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2f30009230 tx=0x7f2f3000f7c0 comp rx=0 tx=0).stop 2023-10-08T12:45:55.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.603+0000 7f2f43325700 1 -- 172.21.15.45:0/1113944174 shutdown_connections 2023-10-08T12:45:55.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.603+0000 7f2f43325700 1 --2- 172.21.15.45:0/1113944174 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f2f2006af00 0x7f2f2006d3c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:55.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.603+0000 7f2f43325700 1 --2- 172.21.15.45:0/1113944174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f3c158950 0x7f2f3c1f3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:55.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.603+0000 7f2f43325700 1 --2- 172.21.15.45:0/1113944174 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2f3c0c9ff0 0x7f2f3c155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:55.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.603+0000 7f2f43325700 1 --2- 172.21.15.45:0/1113944174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f3c0cdf60 0x7f2f3c1f2fc0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:55.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.603+0000 7f2f43325700 1 -- 172.21.15.45:0/1113944174 >> 172.21.15.45:0/1113944174 conn(0x7f2f3c0b0430 msgr2=0x7f2f3c0cbae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:55.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.603+0000 7f2f43325700 1 -- 172.21.15.45:0/1113944174 shutdown_connections 2023-10-08T12:45:55.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.603+0000 7f2f43325700 1 -- 172.21.15.45:0/1113944174 wait complete. 2023-10-08T12:45:55.616 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:45:19.183651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:45:22.277383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:45:23.606639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:45:55.616 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:45:55.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.745+0000 7faf845c7700 1 -- 172.21.15.45:0/2746934072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf68003f40 msgr2=0x7faf68004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:55.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.745+0000 7faf845c7700 1 --2- 172.21.15.45:0/2746934072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf68003f40 0x7faf68004850 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7faf70009d90 tx=0x7faf68005880 comp rx=0 tx=0).stop 2023-10-08T12:45:55.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.745+0000 7faf82b64700 1 -- 172.21.15.45:0/2746934072 reap_dead start 2023-10-08T12:45:55.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.746+0000 7faf845c7700 1 -- 172.21.15.45:0/2746934072 shutdown_connections 2023-10-08T12:45:55.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.746+0000 7faf845c7700 1 -- 172.21.15.45:0/2746934072 >> 172.21.15.45:0/2746934072 conn(0x7faf7c0cddc0 msgr2=0x7faf7c0ce1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:55.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.746+0000 7faf845c7700 1 -- 172.21.15.45:0/2746934072 shutdown_connections 2023-10-08T12:45:55.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.746+0000 7faf845c7700 1 -- 172.21.15.45:0/2746934072 wait complete. 2023-10-08T12:45:55.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.747+0000 7faf845c7700 1 Processor -- start 2023-10-08T12:45:55.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.747+0000 7faf845c7700 1 -- start start 2023-10-08T12:45:55.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.748+0000 7faf845c7700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faf68003f40 0x7faf7c154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:55.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.748+0000 7faf845c7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf7c0addc0 0x7faf7c0ae240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:55.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.748+0000 7faf845c7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf7c099590 0x7faf7c099a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:55.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.748+0000 7faf845c7700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c0ae780 con 0x7faf7c099590 2023-10-08T12:45:55.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.748+0000 7faf845c7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c154e60 con 0x7faf7c0addc0 2023-10-08T12:45:55.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.748+0000 7faf845c7700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c09a310 con 0x7faf68003f40 2023-10-08T12:45:55.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.748+0000 7faf82b64700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf7c099590 0x7faf7c099a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:55.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.748+0000 7faf82b64700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf7c099590 0x7faf7c099a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35858/0 (socket says 172.21.15.45:35858) 2023-10-08T12:45:55.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.748+0000 7faf82b64700 1 -- 172.21.15.45:0/500014398 learned_addr learned my addr 172.21.15.45:0/500014398 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:55.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.748+0000 7faf82363700 1 --2- 172.21.15.45:0/500014398 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faf68003f40 0x7faf7c154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:55.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.748+0000 7faf81b62700 1 --2- 172.21.15.45:0/500014398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf7c0addc0 0x7faf7c0ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:55.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.748+0000 7faf82b64700 1 -- 172.21.15.45:0/500014398 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faf68003f40 msgr2=0x7faf7c154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:55.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.748+0000 7faf82b64700 1 --2- 172.21.15.45:0/500014398 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faf68003f40 0x7faf7c154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:55.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.748+0000 7faf82b64700 1 -- 172.21.15.45:0/500014398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf7c0addc0 msgr2=0x7faf7c0ae240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:55.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.748+0000 7faf82b64700 1 --2- 172.21.15.45:0/500014398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf7c0addc0 0x7faf7c0ae240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:55.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.748+0000 7faf82b64700 1 -- 172.21.15.45:0/500014398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7c09a5f0 con 0x7faf7c099590 2023-10-08T12:45:55.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.748+0000 7faf82363700 1 --2- 172.21.15.45:0/500014398 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faf68003f40 0x7faf7c154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:45:55.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.748+0000 7faf81b62700 1 --2- 172.21.15.45:0/500014398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf7c0addc0 0x7faf7c0ae240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:45:55.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.748+0000 7faf82b64700 1 --2- 172.21.15.45:0/500014398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf7c099590 0x7faf7c099a10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faf74000f80 tx=0x7faf74006690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:55.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.748+0000 7faf6effd700 1 -- 172.21.15.45:0/500014398 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf74011900 con 0x7faf7c099590 2023-10-08T12:45:55.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.748+0000 7faf6effd700 1 -- 172.21.15.45:0/500014398 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7faf74011a60 con 0x7faf7c099590 2023-10-08T12:45:55.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.748+0000 7faf845c7700 1 -- 172.21.15.45:0/500014398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf7c09a8d0 con 0x7faf7c099590 2023-10-08T12:45:55.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.748+0000 7faf6effd700 1 -- 172.21.15.45:0/500014398 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf74011e70 con 0x7faf7c099590 2023-10-08T12:45:55.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.749+0000 7faf845c7700 1 -- 172.21.15.45:0/500014398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf7c09ae90 con 0x7faf7c099590 2023-10-08T12:45:55.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.749+0000 7faf845c7700 1 -- 172.21.15.45:0/500014398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7c067470 con 0x7faf7c099590 2023-10-08T12:45:55.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.750+0000 7faf6effd700 1 -- 172.21.15.45:0/500014398 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7faf7401d460 con 0x7faf7c099590 2023-10-08T12:45:55.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.750+0000 7faf6effd700 1 --2- 172.21.15.45:0/500014398 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7faf6006aed0 0x7faf6006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:55.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.750+0000 7faf6effd700 1 -- 172.21.15.45:0/500014398 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf7408a1a0 con 0x7faf7c099590 2023-10-08T12:45:55.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.750+0000 7faf82363700 1 --2- 172.21.15.45:0/500014398 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7faf6006aed0 0x7faf6006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:55.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.751+0000 7faf82363700 1 --2- 172.21.15.45:0/500014398 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7faf6006aed0 0x7faf6006d390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faf78009cf0 tx=0x7faf78009260 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:55.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.755+0000 7faf6effd700 1 -- 172.21.15.45:0/500014398 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faf74055250 con 0x7faf7c099590 2023-10-08T12:45:55.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.953+0000 7faf845c7700 1 -- 172.21.15.45:0/500014398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faf7c0cb620 con 0x7faf7c099590 2023-10-08T12:45:55.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.954+0000 7faf6effd700 1 -- 172.21.15.45:0/500014398 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7faf74058870 con 0x7faf7c099590 2023-10-08T12:45:55.955 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-08T12:45:55.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.956+0000 7faf845c7700 1 -- 172.21.15.45:0/500014398 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7faf6006aed0 msgr2=0x7faf6006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:55.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.956+0000 7faf845c7700 1 --2- 172.21.15.45:0/500014398 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7faf6006aed0 0x7faf6006d390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faf78009cf0 tx=0x7faf78009260 comp rx=0 tx=0).stop 2023-10-08T12:45:55.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.956+0000 7faf845c7700 1 -- 172.21.15.45:0/500014398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf7c099590 msgr2=0x7faf7c099a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:55.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.956+0000 7faf845c7700 1 --2- 172.21.15.45:0/500014398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf7c099590 0x7faf7c099a10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faf74000f80 tx=0x7faf74006690 comp rx=0 tx=0).stop 2023-10-08T12:45:55.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.956+0000 7faf845c7700 1 -- 172.21.15.45:0/500014398 shutdown_connections 2023-10-08T12:45:55.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.956+0000 7faf845c7700 1 --2- 172.21.15.45:0/500014398 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7faf6006aed0 0x7faf6006d390 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:55.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.956+0000 7faf845c7700 1 --2- 172.21.15.45:0/500014398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf7c099590 0x7faf7c099a10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:55.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.956+0000 7faf845c7700 1 --2- 172.21.15.45:0/500014398 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faf68003f40 0x7faf7c154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:55.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.956+0000 7faf845c7700 1 --2- 172.21.15.45:0/500014398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf7c0addc0 0x7faf7c0ae240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:55.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.956+0000 7faf845c7700 1 -- 172.21.15.45:0/500014398 >> 172.21.15.45:0/500014398 conn(0x7faf7c0cddc0 msgr2=0x7faf7c070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:55.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.956+0000 7faf845c7700 1 -- 172.21.15.45:0/500014398 shutdown_connections 2023-10-08T12:45:55.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:55.956+0000 7faf845c7700 1 -- 172.21.15.45:0/500014398 wait complete. 2023-10-08T12:45:55.969 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:45:56.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.100+0000 7fd8e51ee700 1 -- 172.21.15.45:0/2487153540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e006c6d0 msgr2=0x7fd8e006cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:56.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.100+0000 7fd8e51ee700 1 --2- 172.21.15.45:0/2487153540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e006c6d0 0x7fd8e006cab0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4005fd0 tx=0x7fd8d4009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:56.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.100+0000 7fd8e51ee700 1 -- 172.21.15.45:0/2487153540 shutdown_connections 2023-10-08T12:45:56.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.100+0000 7fd8e51ee700 1 --2- 172.21.15.45:0/2487153540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e006c6d0 0x7fd8e006cab0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:56.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.100+0000 7fd8e51ee700 1 --2- 172.21.15.45:0/2487153540 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8e00ac8e0 0x7fd8e00b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:56.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.100+0000 7fd8e51ee700 1 -- 172.21.15.45:0/2487153540 >> 172.21.15.45:0/2487153540 conn(0x7fd8e006a210 msgr2=0x7fd8e006a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:56.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.100+0000 7fd8e51ee700 1 -- 172.21.15.45:0/2487153540 shutdown_connections 2023-10-08T12:45:56.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.100+0000 7fd8e51ee700 1 -- 172.21.15.45:0/2487153540 wait complete. 2023-10-08T12:45:56.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.101+0000 7fd8e51ee700 1 Processor -- start 2023-10-08T12:45:56.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.101+0000 7fd8e51ee700 1 -- start start 2023-10-08T12:45:56.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.102+0000 7fd8e51ee700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e006c6d0 0x7fd8e014ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:56.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.102+0000 7fd8e51ee700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8e00ac8e0 0x7fd8e01542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:56.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.102+0000 7fd8e51ee700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8e00b0a00 0x7fd8e0154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:56.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.102+0000 7fd8e51ee700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e0153d00 con 0x7fd8e00b0a00 2023-10-08T12:45:56.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.102+0000 7fd8e51ee700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e0156ee0 con 0x7fd8e006c6d0 2023-10-08T12:45:56.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.102+0000 7fd8e51ee700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e0151890 con 0x7fd8e00ac8e0 2023-10-08T12:45:56.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.102+0000 7fd8df59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8e00b0a00 0x7fd8e0154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:56.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.102+0000 7fd8df59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8e00b0a00 0x7fd8e0154820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35872/0 (socket says 172.21.15.45:35872) 2023-10-08T12:45:56.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.102+0000 7fd8df59e700 1 -- 172.21.15.45:0/921285125 learned_addr learned my addr 172.21.15.45:0/921285125 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:56.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.102+0000 7fd8de59c700 1 --2- 172.21.15.45:0/921285125 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8e00ac8e0 0x7fd8e01542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:56.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.102+0000 7fd8ded9d700 1 --2- 172.21.15.45:0/921285125 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e006c6d0 0x7fd8e014ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:56.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.102+0000 7fd8df59e700 1 -- 172.21.15.45:0/921285125 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8e00ac8e0 msgr2=0x7fd8e01542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:56.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.102+0000 7fd8df59e700 1 --2- 172.21.15.45:0/921285125 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8e00ac8e0 0x7fd8e01542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:56.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.102+0000 7fd8df59e700 1 -- 172.21.15.45:0/921285125 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e006c6d0 msgr2=0x7fd8e014ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:56.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.102+0000 7fd8df59e700 1 --2- 172.21.15.45:0/921285125 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e006c6d0 0x7fd8e014ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:56.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.102+0000 7fd8df59e700 1 -- 172.21.15.45:0/921285125 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d40095f0 con 0x7fd8e00b0a00 2023-10-08T12:45:56.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.103+0000 7fd8df59e700 1 --2- 172.21.15.45:0/921285125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8e00b0a00 0x7fd8e0154820 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd8d800cb20 tx=0x7fd8d800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:56.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.103+0000 7fd8c77fe700 1 -- 172.21.15.45:0/921285125 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8003c00 con 0x7fd8e00b0a00 2023-10-08T12:45:56.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.103+0000 7fd8c77fe700 1 -- 172.21.15.45:0/921285125 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd8d8003d60 con 0x7fd8e00b0a00 2023-10-08T12:45:56.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.103+0000 7fd8e51ee700 1 -- 172.21.15.45:0/921285125 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e0151b30 con 0x7fd8e00b0a00 2023-10-08T12:45:56.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.103+0000 7fd8c77fe700 1 -- 172.21.15.45:0/921285125 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d800aa00 con 0x7fd8e00b0a00 2023-10-08T12:45:56.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.103+0000 7fd8e51ee700 1 -- 172.21.15.45:0/921285125 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e01520f0 con 0x7fd8e00b0a00 2023-10-08T12:45:56.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.104+0000 7fd8e51ee700 1 -- 172.21.15.45:0/921285125 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e015b170 con 0x7fd8e00b0a00 2023-10-08T12:45:56.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.105+0000 7fd8c77fe700 1 -- 172.21.15.45:0/921285125 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd8d800ab60 con 0x7fd8e00b0a00 2023-10-08T12:45:56.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.105+0000 7fd8c77fe700 1 --2- 172.21.15.45:0/921285125 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd8cc06aed0 0x7fd8cc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:56.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.105+0000 7fd8c77fe700 1 -- 172.21.15.45:0/921285125 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8d8089590 con 0x7fd8e00b0a00 2023-10-08T12:45:56.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.105+0000 7fd8ded9d700 1 --2- 172.21.15.45:0/921285125 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd8cc06aed0 0x7fd8cc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:56.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.106+0000 7fd8ded9d700 1 --2- 172.21.15.45:0/921285125 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd8cc06aed0 0x7fd8cc06d390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd8e014c720 tx=0x7fd8d40047c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:56.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.109+0000 7fd8c77fe700 1 -- 172.21.15.45:0/921285125 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd8d80546d0 con 0x7fd8e00b0a00 2023-10-08T12:45:56.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.315+0000 7fd8e51ee700 1 -- 172.21.15.45:0/921285125 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd8e0066850 con 0x7fd8e00b0a00 2023-10-08T12:45:56.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.315+0000 7fd8c77fe700 1 -- 172.21.15.45:0/921285125 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd8d8057cf0 con 0x7fd8e00b0a00 2023-10-08T12:45:56.316 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-08T12:45:56.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.318+0000 7fd8e51ee700 1 -- 172.21.15.45:0/921285125 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd8cc06aed0 msgr2=0x7fd8cc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:56.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.318+0000 7fd8e51ee700 1 --2- 172.21.15.45:0/921285125 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd8cc06aed0 0x7fd8cc06d390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd8e014c720 tx=0x7fd8d40047c0 comp rx=0 tx=0).stop 2023-10-08T12:45:56.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.318+0000 7fd8e51ee700 1 -- 172.21.15.45:0/921285125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8e00b0a00 msgr2=0x7fd8e0154820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:56.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.318+0000 7fd8e51ee700 1 --2- 172.21.15.45:0/921285125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8e00b0a00 0x7fd8e0154820 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd8d800cb20 tx=0x7fd8d800ce30 comp rx=0 tx=0).stop 2023-10-08T12:45:56.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.318+0000 7fd8e51ee700 1 -- 172.21.15.45:0/921285125 shutdown_connections 2023-10-08T12:45:56.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.318+0000 7fd8e51ee700 1 --2- 172.21.15.45:0/921285125 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd8cc06aed0 0x7fd8cc06d390 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:56.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.318+0000 7fd8e51ee700 1 --2- 172.21.15.45:0/921285125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8e00b0a00 0x7fd8e0154820 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:56.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.318+0000 7fd8e51ee700 1 --2- 172.21.15.45:0/921285125 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e006c6d0 0x7fd8e014ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:56.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.318+0000 7fd8e51ee700 1 --2- 172.21.15.45:0/921285125 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8e00ac8e0 0x7fd8e01542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:56.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.318+0000 7fd8e51ee700 1 -- 172.21.15.45:0/921285125 >> 172.21.15.45:0/921285125 conn(0x7fd8e006a210 msgr2=0x7fd8e00ae7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:56.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.318+0000 7fd8e51ee700 1 -- 172.21.15.45:0/921285125 shutdown_connections 2023-10-08T12:45:56.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.318+0000 7fd8e51ee700 1 -- 172.21.15.45:0/921285125 wait complete. 2023-10-08T12:45:56.331 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:45:56.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.461+0000 7fcfe9868700 1 -- 172.21.15.45:0/3936583987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfe415bbf0 msgr2=0x7fcfe40d14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:56.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.461+0000 7fcfe9868700 1 --2- 172.21.15.45:0/3936583987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfe415bbf0 0x7fcfe40d14c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40cfc90 tx=0x7fcfd4009ba0 comp rx=0 tx=0).stop 2023-10-08T12:45:56.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.461+0000 7fcfe9868700 1 -- 172.21.15.45:0/3936583987 shutdown_connections 2023-10-08T12:45:56.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.461+0000 7fcfe9868700 1 --2- 172.21.15.45:0/3936583987 >> v2:172.21.15.78:3300/0 conn(0x7fcfe40ccde0 0x7fcfe40cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:56.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.461+0000 7fcfe9868700 1 --2- 172.21.15.45:0/3936583987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfe415bbf0 0x7fcfe40d14c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:56.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.461+0000 7fcfe9868700 1 -- 172.21.15.45:0/3936583987 >> 172.21.15.45:0/3936583987 conn(0x7fcfe4071940 msgr2=0x7fcfe4071d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:56.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.461+0000 7fcfe9868700 1 -- 172.21.15.45:0/3936583987 shutdown_connections 2023-10-08T12:45:56.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.461+0000 7fcfe9868700 1 -- 172.21.15.45:0/3936583987 wait complete. 2023-10-08T12:45:56.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.462+0000 7fcfe9868700 1 Processor -- start 2023-10-08T12:45:56.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.462+0000 7fcfe9868700 1 -- start start 2023-10-08T12:45:56.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.463+0000 7fcfe9868700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfe40ccde0 0x7fcfe4141870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:56.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.463+0000 7fcfe9868700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcfe40cee20 0x7fcfe40c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:56.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.463+0000 7fcfe9868700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfe415bbf0 0x7fcfe40b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:56.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.463+0000 7fcfe9868700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe40c9010 con 0x7fcfe40ccde0 2023-10-08T12:45:56.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.463+0000 7fcfe9868700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe40b4380 con 0x7fcfe415bbf0 2023-10-08T12:45:56.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.463+0000 7fcfe9868700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe4147240 con 0x7fcfe40cee20 2023-10-08T12:45:56.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.463+0000 7fcfe2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfe40ccde0 0x7fcfe4141870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:56.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.463+0000 7fcfe2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfe40ccde0 0x7fcfe4141870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35880/0 (socket says 172.21.15.45:35880) 2023-10-08T12:45:56.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.463+0000 7fcfe2ffd700 1 -- 172.21.15.45:0/3143709309 learned_addr learned my addr 172.21.15.45:0/3143709309 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:56.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.463+0000 7fcfe27fc700 1 --2- 172.21.15.45:0/3143709309 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcfe40cee20 0x7fcfe40c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:56.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.463+0000 7fcfe37fe700 1 --2- 172.21.15.45:0/3143709309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfe415bbf0 0x7fcfe40b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:56.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.463+0000 7fcfe2ffd700 1 -- 172.21.15.45:0/3143709309 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcfe40cee20 msgr2=0x7fcfe40c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:56.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.463+0000 7fcfe2ffd700 1 --2- 172.21.15.45:0/3143709309 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcfe40cee20 0x7fcfe40c8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:56.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.463+0000 7fcfe2ffd700 1 -- 172.21.15.45:0/3143709309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfe415bbf0 msgr2=0x7fcfe40b3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:56.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.463+0000 7fcfe2ffd700 1 --2- 172.21.15.45:0/3143709309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfe415bbf0 0x7fcfe40b3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:56.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.463+0000 7fcfe2ffd700 1 -- 172.21.15.45:0/3143709309 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd4009520 con 0x7fcfe40ccde0 2023-10-08T12:45:56.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.464+0000 7fcfe2ffd700 1 --2- 172.21.15.45:0/3143709309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfe40ccde0 0x7fcfe4141870 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40b7040 tx=0x7fcfd400f780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:56.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.464+0000 7fcfcbfff700 1 -- 172.21.15.45:0/3143709309 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd401b040 con 0x7fcfe40ccde0 2023-10-08T12:45:56.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.464+0000 7fcfcbfff700 1 -- 172.21.15.45:0/3143709309 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcfd400fe40 con 0x7fcfe40ccde0 2023-10-08T12:45:56.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.464+0000 7fcfe9868700 1 -- 172.21.15.45:0/3143709309 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe4147520 con 0x7fcfe40ccde0 2023-10-08T12:45:56.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.464+0000 7fcfcbfff700 1 -- 172.21.15.45:0/3143709309 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd401f680 con 0x7fcfe40ccde0 2023-10-08T12:45:56.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.464+0000 7fcfe9868700 1 -- 172.21.15.45:0/3143709309 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe40cba70 con 0x7fcfe40ccde0 2023-10-08T12:45:56.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.465+0000 7fcfe9868700 1 -- 172.21.15.45:0/3143709309 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe4066850 con 0x7fcfe40ccde0 2023-10-08T12:45:56.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.465+0000 7fcfcbfff700 1 -- 172.21.15.45:0/3143709309 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcfd401f7e0 con 0x7fcfe40ccde0 2023-10-08T12:45:56.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.466+0000 7fcfcbfff700 1 --2- 172.21.15.45:0/3143709309 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fcfd006aed0 0x7fcfd006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:56.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.466+0000 7fcfcbfff700 1 -- 172.21.15.45:0/3143709309 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcfd408b530 con 0x7fcfe40ccde0 2023-10-08T12:45:56.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.466+0000 7fcfe27fc700 1 --2- 172.21.15.45:0/3143709309 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fcfd006aed0 0x7fcfd006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:56.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.466+0000 7fcfe27fc700 1 --2- 172.21.15.45:0/3143709309 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fcfd006aed0 0x7fcfd006d390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40c7f50 tx=0x7fcfd8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:56.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.470+0000 7fcfcbfff700 1 -- 172.21.15.45:0/3143709309 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcfd4056670 con 0x7fcfe40ccde0 2023-10-08T12:45:56.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.669+0000 7fcfe9868700 1 -- 172.21.15.45:0/3143709309 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcfe40c61e0 con 0x7fcfe40ccde0 2023-10-08T12:45:56.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.670+0000 7fcfcbfff700 1 -- 172.21.15.45:0/3143709309 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcfd4059c90 con 0x7fcfe40ccde0 2023-10-08T12:45:56.671 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-08T12:45:56.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.672+0000 7fcfe9868700 1 -- 172.21.15.45:0/3143709309 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fcfd006aed0 msgr2=0x7fcfd006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:56.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.672+0000 7fcfe9868700 1 --2- 172.21.15.45:0/3143709309 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fcfd006aed0 0x7fcfd006d390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40c7f50 tx=0x7fcfd8009040 comp rx=0 tx=0).stop 2023-10-08T12:45:56.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.672+0000 7fcfe9868700 1 -- 172.21.15.45:0/3143709309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfe40ccde0 msgr2=0x7fcfe4141870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:56.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.672+0000 7fcfe9868700 1 --2- 172.21.15.45:0/3143709309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfe40ccde0 0x7fcfe4141870 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40b7040 tx=0x7fcfd400f780 comp rx=0 tx=0).stop 2023-10-08T12:45:56.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.672+0000 7fcfe9868700 1 -- 172.21.15.45:0/3143709309 shutdown_connections 2023-10-08T12:45:56.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.672+0000 7fcfe9868700 1 --2- 172.21.15.45:0/3143709309 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fcfd006aed0 0x7fcfd006d390 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:56.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.672+0000 7fcfe9868700 1 --2- 172.21.15.45:0/3143709309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfe415bbf0 0x7fcfe40b3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:56.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.672+0000 7fcfe9868700 1 --2- 172.21.15.45:0/3143709309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfe40ccde0 0x7fcfe4141870 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:56.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.672+0000 7fcfe9868700 1 --2- 172.21.15.45:0/3143709309 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcfe40cee20 0x7fcfe40c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:56.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.672+0000 7fcfe9868700 1 -- 172.21.15.45:0/3143709309 >> 172.21.15.45:0/3143709309 conn(0x7fcfe4071940 msgr2=0x7fcfe415ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:56.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.672+0000 7fcfe9868700 1 -- 172.21.15.45:0/3143709309 shutdown_connections 2023-10-08T12:45:56.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.672+0000 7fcfe9868700 1 -- 172.21.15.45:0/3143709309 wait complete. 2023-10-08T12:45:56.685 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:45:56.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.811+0000 7f32ea052700 1 -- 172.21.15.45:0/3453478284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32e40c8d50 msgr2=0x7f32e406b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:56.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.811+0000 7f32ea052700 1 --2- 172.21.15.45:0/3453478284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32e40c8d50 0x7f32e406b320 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f32dc009f60 tx=0x7f32dc009f90 comp rx=0 tx=0).stop 2023-10-08T12:45:56.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.811+0000 7f32ea052700 1 -- 172.21.15.45:0/3453478284 shutdown_connections 2023-10-08T12:45:56.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.811+0000 7f32ea052700 1 --2- 172.21.15.45:0/3453478284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32e40c8d50 0x7f32e406b320 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:56.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.811+0000 7f32ea052700 1 -- 172.21.15.45:0/3453478284 >> 172.21.15.45:0/3453478284 conn(0x7f32e40afae0 msgr2=0x7f32e40afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:56.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.811+0000 7f32ea052700 1 -- 172.21.15.45:0/3453478284 shutdown_connections 2023-10-08T12:45:56.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.811+0000 7f32ea052700 1 -- 172.21.15.45:0/3453478284 wait complete. 2023-10-08T12:45:56.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.812+0000 7f32ea052700 1 Processor -- start 2023-10-08T12:45:56.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.812+0000 7f32ea052700 1 -- start start 2023-10-08T12:45:56.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.813+0000 7f32ea052700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32e40c1680 0x7f32e40c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:56.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.813+0000 7f32ea052700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32e40c8d50 0x7f32e4152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:56.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.813+0000 7f32ea052700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32e415cf90 0x7f32e40c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:56.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.813+0000 7f32ea052700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e4153270 con 0x7f32e40c8d50 2023-10-08T12:45:56.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.813+0000 7f32ea052700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e40c6f70 con 0x7f32e40c1680 2023-10-08T12:45:56.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.813+0000 7f32ea052700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e40c60c0 con 0x7f32e415cf90 2023-10-08T12:45:56.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.813+0000 7f32e2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32e40c8d50 0x7f32e4152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:56.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.813+0000 7f32e2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32e40c8d50 0x7f32e4152d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35896/0 (socket says 172.21.15.45:35896) 2023-10-08T12:45:56.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.813+0000 7f32e2ffd700 1 -- 172.21.15.45:0/303419330 learned_addr learned my addr 172.21.15.45:0/303419330 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:56.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.813+0000 7f32e37fe700 1 --2- 172.21.15.45:0/303419330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32e40c1680 0x7f32e40c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:56.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.813+0000 7f32e3fff700 1 --2- 172.21.15.45:0/303419330 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32e415cf90 0x7f32e40c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:56.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.813+0000 7f32e2ffd700 1 -- 172.21.15.45:0/303419330 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32e415cf90 msgr2=0x7f32e40c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:56.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.813+0000 7f32e2ffd700 1 --2- 172.21.15.45:0/303419330 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32e415cf90 0x7f32e40c5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:56.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.813+0000 7f32e2ffd700 1 -- 172.21.15.45:0/303419330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32e40c1680 msgr2=0x7f32e40c8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:56.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.813+0000 7f32e2ffd700 1 --2- 172.21.15.45:0/303419330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32e40c1680 0x7f32e40c8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:56.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.813+0000 7f32e2ffd700 1 -- 172.21.15.45:0/303419330 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32dc009c40 con 0x7f32e40c8d50 2023-10-08T12:45:56.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.813+0000 7f32e37fe700 1 --2- 172.21.15.45:0/303419330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32e40c1680 0x7f32e40c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:45:56.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.814+0000 7f32e2ffd700 1 --2- 172.21.15.45:0/303419330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32e40c8d50 0x7f32e4152d30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f32d800c500 tx=0x7f32d800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:56.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.814+0000 7f32cbfff700 1 -- 172.21.15.45:0/303419330 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d8011790 con 0x7f32e40c8d50 2023-10-08T12:45:56.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.814+0000 7f32cbfff700 1 -- 172.21.15.45:0/303419330 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f32d80119e0 con 0x7f32e40c8d50 2023-10-08T12:45:56.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.814+0000 7f32cbfff700 1 -- 172.21.15.45:0/303419330 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d8011dd0 con 0x7f32e40c8d50 2023-10-08T12:45:56.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.814+0000 7f32ea052700 1 -- 172.21.15.45:0/303419330 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e40c6360 con 0x7f32e40c8d50 2023-10-08T12:45:56.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.814+0000 7f32ea052700 1 -- 172.21.15.45:0/303419330 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e40c6920 con 0x7f32e40c8d50 2023-10-08T12:45:56.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.815+0000 7f32ea052700 1 -- 172.21.15.45:0/303419330 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e40674a0 con 0x7f32e40c8d50 2023-10-08T12:45:56.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.815+0000 7f32cbfff700 1 -- 172.21.15.45:0/303419330 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f32d801c460 con 0x7f32e40c8d50 2023-10-08T12:45:56.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.816+0000 7f32cbfff700 1 --2- 172.21.15.45:0/303419330 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f32d006aed0 0x7f32d006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:56.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.816+0000 7f32cbfff700 1 -- 172.21.15.45:0/303419330 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32d8089690 con 0x7f32e40c8d50 2023-10-08T12:45:56.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.816+0000 7f32e37fe700 1 --2- 172.21.15.45:0/303419330 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f32d006aed0 0x7f32d006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:56.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.817+0000 7f32e37fe700 1 --2- 172.21.15.45:0/303419330 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f32d006aed0 0x7f32d006d390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f32d4001670 tx=0x7f32d4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:56.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:56.821+0000 7f32cbfff700 1 -- 172.21.15.45:0/303419330 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f32d8054740 con 0x7f32e40c8d50 2023-10-08T12:45:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.021+0000 7f32ea052700 1 -- 172.21.15.45:0/303419330 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32e404e4c0 con 0x7f32e40c8d50 2023-10-08T12:45:57.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.022+0000 7f32cbfff700 1 -- 172.21.15.45:0/303419330 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f32d8057d60 con 0x7f32e40c8d50 2023-10-08T12:45:57.023 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:57.023 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:45:26.206424+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:45:19.183651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:45:22.277383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:45:23.606639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.412453+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.351925+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.428025+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.437246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.441119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.388608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.415524+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.401835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:45:57.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.024+0000 7f32ea052700 1 -- 172.21.15.45:0/303419330 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f32d006aed0 msgr2=0x7f32d006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:57.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.024+0000 7f32ea052700 1 --2- 172.21.15.45:0/303419330 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f32d006aed0 0x7f32d006d390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f32d4001670 tx=0x7f32d4009040 comp rx=0 tx=0).stop 2023-10-08T12:45:57.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.024+0000 7f32ea052700 1 -- 172.21.15.45:0/303419330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32e40c8d50 msgr2=0x7f32e4152d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:57.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.024+0000 7f32ea052700 1 --2- 172.21.15.45:0/303419330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32e40c8d50 0x7f32e4152d30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f32d800c500 tx=0x7f32d800c8c0 comp rx=0 tx=0).stop 2023-10-08T12:45:57.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.024+0000 7f32ea052700 1 -- 172.21.15.45:0/303419330 shutdown_connections 2023-10-08T12:45:57.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.025+0000 7f32ea052700 1 --2- 172.21.15.45:0/303419330 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f32d006aed0 0x7f32d006d390 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:57.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.025+0000 7f32ea052700 1 --2- 172.21.15.45:0/303419330 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32e415cf90 0x7f32e40c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:57.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.025+0000 7f32ea052700 1 --2- 172.21.15.45:0/303419330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32e40c1680 0x7f32e40c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:57.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.025+0000 7f32ea052700 1 --2- 172.21.15.45:0/303419330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32e40c8d50 0x7f32e4152d30 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:57.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.025+0000 7f32ea052700 1 -- 172.21.15.45:0/303419330 >> 172.21.15.45:0/303419330 conn(0x7f32e40afae0 msgr2=0x7f32e409c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:57.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.025+0000 7f32ea052700 1 -- 172.21.15.45:0/303419330 shutdown_connections 2023-10-08T12:45:57.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.025+0000 7f32ea052700 1 -- 172.21.15.45:0/303419330 wait complete. 2023-10-08T12:45:57.038 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:45:19.183651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:45:22.277383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:45:23.606639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:45:57.038 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:45:57.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.168+0000 7f7615521700 1 -- 172.21.15.45:0/1042357636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75f8003f80 msgr2=0x7f75f8004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:57.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.168+0000 7f7615521700 1 --2- 172.21.15.45:0/1042357636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75f8003f80 0x7f75f8004850 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f760400c340 tx=0x7f75f8005880 comp rx=0 tx=0).stop 2023-10-08T12:45:57.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.168+0000 7f760f7fe700 1 -- 172.21.15.45:0/1042357636 reap_dead start 2023-10-08T12:45:57.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.168+0000 7f7615521700 1 -- 172.21.15.45:0/1042357636 shutdown_connections 2023-10-08T12:45:57.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.168+0000 7f7615521700 1 -- 172.21.15.45:0/1042357636 >> 172.21.15.45:0/1042357636 conn(0x7f7610071940 msgr2=0x7f7610071d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:57.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.169+0000 7f7615521700 1 -- 172.21.15.45:0/1042357636 shutdown_connections 2023-10-08T12:45:57.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.169+0000 7f7615521700 1 -- 172.21.15.45:0/1042357636 wait complete. 2023-10-08T12:45:57.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.170+0000 7f7615521700 1 Processor -- start 2023-10-08T12:45:57.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.170+0000 7f7615521700 1 -- start start 2023-10-08T12:45:57.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.171+0000 7f7615521700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75f8003f80 0x7f76100c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:57.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.171+0000 7f7615521700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7610155310 0x7f76100b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:57.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.171+0000 7f7615521700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f76101e5fc0 0x7f76101e6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:57.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.171+0000 7f7615521700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76101e6980 con 0x7f7610155310 2023-10-08T12:45:57.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.171+0000 7f7615521700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7610155790 con 0x7f75f8003f80 2023-10-08T12:45:57.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.171+0000 7f7615521700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7610152390 con 0x7f76101e5fc0 2023-10-08T12:45:57.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.171+0000 7f760e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7610155310 0x7f76100b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:57.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.171+0000 7f760e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7610155310 0x7f76100b32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35916/0 (socket says 172.21.15.45:35916) 2023-10-08T12:45:57.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.171+0000 7f760e7fc700 1 -- 172.21.15.45:0/1891981460 learned_addr learned my addr 172.21.15.45:0/1891981460 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:57.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.171+0000 7f760f7fe700 1 --2- 172.21.15.45:0/1891981460 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f76101e5fc0 0x7f76101e6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:57.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.171+0000 7f760effd700 1 --2- 172.21.15.45:0/1891981460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75f8003f80 0x7f76100c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:57.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.171+0000 7f760e7fc700 1 -- 172.21.15.45:0/1891981460 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f76101e5fc0 msgr2=0x7f76101e6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:57.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.171+0000 7f760e7fc700 1 --2- 172.21.15.45:0/1891981460 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f76101e5fc0 0x7f76101e6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:57.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.171+0000 7f760e7fc700 1 -- 172.21.15.45:0/1891981460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75f8003f80 msgr2=0x7f76100c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:57.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.171+0000 7f760e7fc700 1 --2- 172.21.15.45:0/1891981460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75f8003f80 0x7f76100c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:57.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.171+0000 7f760e7fc700 1 -- 172.21.15.45:0/1891981460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76100b39c0 con 0x7f7610155310 2023-10-08T12:45:57.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.171+0000 7f760e7fc700 1 --2- 172.21.15.45:0/1891981460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7610155310 0x7f76100b32e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7604011000 tx=0x7f760400cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:57.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.171+0000 7f75f77fe700 1 -- 172.21.15.45:0/1891981460 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7604006650 con 0x7f7610155310 2023-10-08T12:45:57.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.172+0000 7f75f77fe700 1 -- 172.21.15.45:0/1891981460 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7604003680 con 0x7f7610155310 2023-10-08T12:45:57.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.172+0000 7f7615521700 1 -- 172.21.15.45:0/1891981460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76100b3ca0 con 0x7f7610155310 2023-10-08T12:45:57.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.172+0000 7f75f77fe700 1 -- 172.21.15.45:0/1891981460 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7604003ab0 con 0x7f7610155310 2023-10-08T12:45:57.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.172+0000 7f7615521700 1 -- 172.21.15.45:0/1891981460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76100b4260 con 0x7f7610155310 2023-10-08T12:45:57.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.173+0000 7f7615521700 1 -- 172.21.15.45:0/1891981460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76100cf5f0 con 0x7f7610155310 2023-10-08T12:45:57.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.173+0000 7f75f77fe700 1 -- 172.21.15.45:0/1891981460 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7604022070 con 0x7f7610155310 2023-10-08T12:45:57.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.173+0000 7f75f77fe700 1 --2- 172.21.15.45:0/1891981460 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f75fc06aed0 0x7f75fc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:57.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.174+0000 7f75f77fe700 1 -- 172.21.15.45:0/1891981460 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f760408b5b0 con 0x7f7610155310 2023-10-08T12:45:57.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.174+0000 7f760effd700 1 --2- 172.21.15.45:0/1891981460 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f75fc06aed0 0x7f75fc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:57.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.174+0000 7f760effd700 1 --2- 172.21.15.45:0/1891981460 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f75fc06aed0 0x7f75fc06d390 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7600009c60 tx=0x7f7600009260 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:57.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.178+0000 7f75f77fe700 1 -- 172.21.15.45:0/1891981460 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7604056810 con 0x7f7610155310 2023-10-08T12:45:57.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.382+0000 7f7615521700 1 -- 172.21.15.45:0/1891981460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7610066850 con 0x7f7610155310 2023-10-08T12:45:57.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.382+0000 7f75f77fe700 1 -- 172.21.15.45:0/1891981460 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7604059e30 con 0x7f7610155310 2023-10-08T12:45:57.383 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-08T12:45:57.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.384+0000 7f7615521700 1 -- 172.21.15.45:0/1891981460 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f75fc06aed0 msgr2=0x7f75fc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:57.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.384+0000 7f7615521700 1 --2- 172.21.15.45:0/1891981460 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f75fc06aed0 0x7f75fc06d390 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7600009c60 tx=0x7f7600009260 comp rx=0 tx=0).stop 2023-10-08T12:45:57.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.384+0000 7f7615521700 1 -- 172.21.15.45:0/1891981460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7610155310 msgr2=0x7f76100b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:57.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.384+0000 7f7615521700 1 --2- 172.21.15.45:0/1891981460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7610155310 0x7f76100b32e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7604011000 tx=0x7f760400cd20 comp rx=0 tx=0).stop 2023-10-08T12:45:57.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.384+0000 7f7615521700 1 -- 172.21.15.45:0/1891981460 shutdown_connections 2023-10-08T12:45:57.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.384+0000 7f7615521700 1 --2- 172.21.15.45:0/1891981460 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f75fc06aed0 0x7f75fc06d390 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:57.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.384+0000 7f7615521700 1 --2- 172.21.15.45:0/1891981460 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f76101e5fc0 0x7f76101e6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:57.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.384+0000 7f7615521700 1 --2- 172.21.15.45:0/1891981460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75f8003f80 0x7f76100c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:57.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.384+0000 7f7615521700 1 --2- 172.21.15.45:0/1891981460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7610155310 0x7f76100b32e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:57.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.384+0000 7f7615521700 1 -- 172.21.15.45:0/1891981460 >> 172.21.15.45:0/1891981460 conn(0x7f7610071940 msgr2=0x7f761015aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:57.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.384+0000 7f7615521700 1 -- 172.21.15.45:0/1891981460 shutdown_connections 2023-10-08T12:45:57.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.384+0000 7f7615521700 1 -- 172.21.15.45:0/1891981460 wait complete. 2023-10-08T12:45:57.397 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:45:57.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.527+0000 7fd16d36e700 1 -- 172.21.15.45:0/3481764887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1680b06d0 msgr2=0x7fd168098130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:57.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.527+0000 7fd16d36e700 1 --2- 172.21.15.45:0/3481764887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1680b06d0 0x7fd168098130 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd1580098c0 tx=0x7fd158009bd0 comp rx=0 tx=0).stop 2023-10-08T12:45:57.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.527+0000 7fd16d36e700 1 -- 172.21.15.45:0/3481764887 shutdown_connections 2023-10-08T12:45:57.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.527+0000 7fd16d36e700 1 --2- 172.21.15.45:0/3481764887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1680b06d0 0x7fd168098130 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:57.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.527+0000 7fd16d36e700 1 -- 172.21.15.45:0/3481764887 >> 172.21.15.45:0/3481764887 conn(0x7fd1680b1290 msgr2=0x7fd1680b16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:57.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.527+0000 7fd16d36e700 1 -- 172.21.15.45:0/3481764887 shutdown_connections 2023-10-08T12:45:57.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.527+0000 7fd16d36e700 1 -- 172.21.15.45:0/3481764887 wait complete. 2023-10-08T12:45:57.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.528+0000 7fd16d36e700 1 Processor -- start 2023-10-08T12:45:57.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.528+0000 7fd16d36e700 1 -- start start 2023-10-08T12:45:57.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.529+0000 7fd16d36e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1680b06d0 0x7fd1680b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:57.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.529+0000 7fd16d36e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1680cafc0 0x7fd1681426d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:57.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.529+0000 7fd16d36e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd16815d0c0 0x7fd1680c9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:57.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.529+0000 7fd16d36e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1680b50c0 con 0x7fd1680b06d0 2023-10-08T12:45:57.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.529+0000 7fd16d36e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd168154f70 con 0x7fd16815d0c0 2023-10-08T12:45:57.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.529+0000 7fd16d36e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd168155250 con 0x7fd1680cafc0 2023-10-08T12:45:57.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.529+0000 7fd166ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1680b06d0 0x7fd1680b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:57.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.529+0000 7fd166ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1680b06d0 0x7fd1680b4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35928/0 (socket says 172.21.15.45:35928) 2023-10-08T12:45:57.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.529+0000 7fd166ffd700 1 -- 172.21.15.45:0/374037925 learned_addr learned my addr 172.21.15.45:0/374037925 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:57.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.529+0000 7fd1667fc700 1 --2- 172.21.15.45:0/374037925 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1680cafc0 0x7fd1681426d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:57.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.529+0000 7fd1677fe700 1 --2- 172.21.15.45:0/374037925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd16815d0c0 0x7fd1680c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:57.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.529+0000 7fd166ffd700 1 -- 172.21.15.45:0/374037925 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1680cafc0 msgr2=0x7fd1681426d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:57.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.529+0000 7fd166ffd700 1 --2- 172.21.15.45:0/374037925 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1680cafc0 0x7fd1681426d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:57.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.529+0000 7fd166ffd700 1 -- 172.21.15.45:0/374037925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd16815d0c0 msgr2=0x7fd1680c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:57.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.529+0000 7fd166ffd700 1 --2- 172.21.15.45:0/374037925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd16815d0c0 0x7fd1680c9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:57.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.529+0000 7fd166ffd700 1 -- 172.21.15.45:0/374037925 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd158009520 con 0x7fd1680b06d0 2023-10-08T12:45:57.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.529+0000 7fd166ffd700 1 --2- 172.21.15.45:0/374037925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1680b06d0 0x7fd1680b4b80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd15c00c450 tx=0x7fd15c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:57.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.530+0000 7fd14f7fe700 1 -- 172.21.15.45:0/374037925 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c0054e0 con 0x7fd1680b06d0 2023-10-08T12:45:57.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.530+0000 7fd14f7fe700 1 -- 172.21.15.45:0/374037925 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd15c003680 con 0x7fd1680b06d0 2023-10-08T12:45:57.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.530+0000 7fd16d36e700 1 -- 172.21.15.45:0/374037925 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd168155530 con 0x7fd1680b06d0 2023-10-08T12:45:57.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.530+0000 7fd14f7fe700 1 -- 172.21.15.45:0/374037925 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c003a90 con 0x7fd1680b06d0 2023-10-08T12:45:57.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.530+0000 7fd16d36e700 1 -- 172.21.15.45:0/374037925 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd168155af0 con 0x7fd1680b06d0 2023-10-08T12:45:57.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.531+0000 7fd16d36e700 1 -- 172.21.15.45:0/374037925 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd168070710 con 0x7fd1680b06d0 2023-10-08T12:45:57.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.531+0000 7fd14f7fe700 1 -- 172.21.15.45:0/374037925 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd15c003bf0 con 0x7fd1680b06d0 2023-10-08T12:45:57.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.531+0000 7fd14f7fe700 1 --2- 172.21.15.45:0/374037925 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd15406aed0 0x7fd15406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:57.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.532+0000 7fd14f7fe700 1 -- 172.21.15.45:0/374037925 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd15c088ba0 con 0x7fd1680b06d0 2023-10-08T12:45:57.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.532+0000 7fd1667fc700 1 --2- 172.21.15.45:0/374037925 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd15406aed0 0x7fd15406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:57.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.532+0000 7fd1667fc700 1 --2- 172.21.15.45:0/374037925 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd15406aed0 0x7fd15406d390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd158009230 tx=0x7fd158019040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:57.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.536+0000 7fd14f7fe700 1 -- 172.21.15.45:0/374037925 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd15c053ce0 con 0x7fd1680b06d0 2023-10-08T12:45:57.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.738+0000 7fd16d36e700 1 -- 172.21.15.45:0/374037925 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd168066850 con 0x7fd1680b06d0 2023-10-08T12:45:57.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.738+0000 7fd14f7fe700 1 -- 172.21.15.45:0/374037925 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd15c0170a0 con 0x7fd1680b06d0 2023-10-08T12:45:57.739 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-08T12:45:57.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.740+0000 7fd16d36e700 1 -- 172.21.15.45:0/374037925 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd15406aed0 msgr2=0x7fd15406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:57.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.740+0000 7fd16d36e700 1 --2- 172.21.15.45:0/374037925 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd15406aed0 0x7fd15406d390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd158009230 tx=0x7fd158019040 comp rx=0 tx=0).stop 2023-10-08T12:45:57.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.740+0000 7fd16d36e700 1 -- 172.21.15.45:0/374037925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1680b06d0 msgr2=0x7fd1680b4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:57.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.740+0000 7fd16d36e700 1 --2- 172.21.15.45:0/374037925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1680b06d0 0x7fd1680b4b80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd15c00c450 tx=0x7fd15c00c810 comp rx=0 tx=0).stop 2023-10-08T12:45:57.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.740+0000 7fd16d36e700 1 -- 172.21.15.45:0/374037925 shutdown_connections 2023-10-08T12:45:57.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.740+0000 7fd16d36e700 1 --2- 172.21.15.45:0/374037925 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd15406aed0 0x7fd15406d390 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:57.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.740+0000 7fd16d36e700 1 --2- 172.21.15.45:0/374037925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd16815d0c0 0x7fd1680c9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:57.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.740+0000 7fd16d36e700 1 --2- 172.21.15.45:0/374037925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1680b06d0 0x7fd1680b4b80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:57.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.740+0000 7fd16d36e700 1 --2- 172.21.15.45:0/374037925 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1680cafc0 0x7fd1681426d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:57.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.740+0000 7fd16d36e700 1 -- 172.21.15.45:0/374037925 >> 172.21.15.45:0/374037925 conn(0x7fd1680b1290 msgr2=0x7fd16815a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:57.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.740+0000 7fd16d36e700 1 -- 172.21.15.45:0/374037925 shutdown_connections 2023-10-08T12:45:57.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.740+0000 7fd16d36e700 1 -- 172.21.15.45:0/374037925 wait complete. 2023-10-08T12:45:57.753 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:45:57.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.883+0000 7f4d738a3700 1 -- 172.21.15.45:0/2983755255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d58004d90 msgr2=0x7f4d58005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:57.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.883+0000 7f4d738a3700 1 --2- 172.21.15.45:0/2983755255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d58004d90 0x7f4d58005210 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4d64009ce0 tx=0x7f4d58005880 comp rx=0 tx=0).stop 2023-10-08T12:45:57.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.883+0000 7f4d71e40700 1 -- 172.21.15.45:0/2983755255 reap_dead start 2023-10-08T12:45:57.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.883+0000 7f4d738a3700 1 -- 172.21.15.45:0/2983755255 shutdown_connections 2023-10-08T12:45:57.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.883+0000 7f4d738a3700 1 -- 172.21.15.45:0/2983755255 >> 172.21.15.45:0/2983755255 conn(0x7f4d6c097a20 msgr2=0x7f4d6c0ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:57.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.883+0000 7f4d738a3700 1 -- 172.21.15.45:0/2983755255 shutdown_connections 2023-10-08T12:45:57.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.883+0000 7f4d738a3700 1 -- 172.21.15.45:0/2983755255 wait complete. 2023-10-08T12:45:57.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.884+0000 7f4d738a3700 1 Processor -- start 2023-10-08T12:45:57.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.884+0000 7f4d738a3700 1 -- start start 2023-10-08T12:45:57.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.885+0000 7f4d738a3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4d58004d90 0x7f4d6c0cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:57.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.885+0000 7f4d738a3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d6c14ca00 0x7f4d6c153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:57.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.885+0000 7f4d738a3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d6c156a30 0x7f4d6c156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:57.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.885+0000 7f4d738a3700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c155f90 con 0x7f4d6c156a30 2023-10-08T12:45:57.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.885+0000 7f4d738a3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c1547d0 con 0x7f4d6c14ca00 2023-10-08T12:45:57.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.885+0000 7f4d738a3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c156230 con 0x7f4d58004d90 2023-10-08T12:45:57.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.885+0000 7f4d71e40700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d6c156a30 0x7f4d6c156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:57.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.885+0000 7f4d71e40700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d6c156a30 0x7f4d6c156ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35952/0 (socket says 172.21.15.45:35952) 2023-10-08T12:45:57.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.885+0000 7f4d71e40700 1 -- 172.21.15.45:0/1108447895 learned_addr learned my addr 172.21.15.45:0/1108447895 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:57.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.885+0000 7f4d7163f700 1 --2- 172.21.15.45:0/1108447895 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4d58004d90 0x7f4d6c0cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:57.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.885+0000 7f4d70e3e700 1 --2- 172.21.15.45:0/1108447895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d6c14ca00 0x7f4d6c153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:57.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.886+0000 7f4d71e40700 1 -- 172.21.15.45:0/1108447895 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4d58004d90 msgr2=0x7f4d6c0cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:57.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.886+0000 7f4d71e40700 1 --2- 172.21.15.45:0/1108447895 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4d58004d90 0x7f4d6c0cc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:57.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.886+0000 7f4d71e40700 1 -- 172.21.15.45:0/1108447895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d6c14ca00 msgr2=0x7f4d6c153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:57.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.886+0000 7f4d71e40700 1 --2- 172.21.15.45:0/1108447895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d6c14ca00 0x7f4d6c153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:57.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.886+0000 7f4d71e40700 1 -- 172.21.15.45:0/1108447895 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6c156510 con 0x7f4d6c156a30 2023-10-08T12:45:57.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.886+0000 7f4d71e40700 1 --2- 172.21.15.45:0/1108447895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d6c156a30 0x7f4d6c156ec0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4d5800bc30 tx=0x7f4d640138e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:57.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.886+0000 7f4d61ffb700 1 -- 172.21.15.45:0/1108447895 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64024070 con 0x7f4d6c156a30 2023-10-08T12:45:57.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.886+0000 7f4d61ffb700 1 -- 172.21.15.45:0/1108447895 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4d64013c60 con 0x7f4d6c156a30 2023-10-08T12:45:57.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.886+0000 7f4d738a3700 1 -- 172.21.15.45:0/1108447895 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d6c154ab0 con 0x7f4d6c156a30 2023-10-08T12:45:57.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.886+0000 7f4d61ffb700 1 -- 172.21.15.45:0/1108447895 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64006000 con 0x7f4d6c156a30 2023-10-08T12:45:57.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.886+0000 7f4d738a3700 1 -- 172.21.15.45:0/1108447895 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d6c14ce80 con 0x7f4d6c156a30 2023-10-08T12:45:57.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.887+0000 7f4d738a3700 1 -- 172.21.15.45:0/1108447895 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6c066850 con 0x7f4d6c156a30 2023-10-08T12:45:57.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.888+0000 7f4d61ffb700 1 -- 172.21.15.45:0/1108447895 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4d64029410 con 0x7f4d6c156a30 2023-10-08T12:45:57.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.888+0000 7f4d61ffb700 1 --2- 172.21.15.45:0/1108447895 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4d5006aed0 0x7f4d5006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:57.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.888+0000 7f4d61ffb700 1 -- 172.21.15.45:0/1108447895 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d64089bc0 con 0x7f4d6c156a30 2023-10-08T12:45:57.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.888+0000 7f4d7163f700 1 --2- 172.21.15.45:0/1108447895 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4d5006aed0 0x7f4d5006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:57.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.889+0000 7f4d7163f700 1 --2- 172.21.15.45:0/1108447895 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4d5006aed0 0x7f4d5006d390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c0cb680 tx=0x7f4d5c000fa0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:57.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:57.893+0000 7f4d61ffb700 1 -- 172.21.15.45:0/1108447895 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4d64054d00 con 0x7f4d6c156a30 2023-10-08T12:45:58.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.094+0000 7f4d738a3700 1 -- 172.21.15.45:0/1108447895 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4d6c0cae00 con 0x7f4d6c156a30 2023-10-08T12:45:58.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.094+0000 7f4d61ffb700 1 -- 172.21.15.45:0/1108447895 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4d64058320 con 0x7f4d6c156a30 2023-10-08T12:45:58.095 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-08T12:45:58.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.097+0000 7f4d738a3700 1 -- 172.21.15.45:0/1108447895 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4d5006aed0 msgr2=0x7f4d5006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:58.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.097+0000 7f4d738a3700 1 --2- 172.21.15.45:0/1108447895 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4d5006aed0 0x7f4d5006d390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c0cb680 tx=0x7f4d5c000fa0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.097+0000 7f4d738a3700 1 -- 172.21.15.45:0/1108447895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d6c156a30 msgr2=0x7f4d6c156ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:58.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.097+0000 7f4d738a3700 1 --2- 172.21.15.45:0/1108447895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d6c156a30 0x7f4d6c156ec0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4d5800bc30 tx=0x7f4d640138e0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.097+0000 7f4d738a3700 1 -- 172.21.15.45:0/1108447895 shutdown_connections 2023-10-08T12:45:58.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.097+0000 7f4d738a3700 1 --2- 172.21.15.45:0/1108447895 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f4d5006aed0 0x7f4d5006d390 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.097+0000 7f4d738a3700 1 --2- 172.21.15.45:0/1108447895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d6c156a30 0x7f4d6c156ec0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.097+0000 7f4d738a3700 1 --2- 172.21.15.45:0/1108447895 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4d58004d90 0x7f4d6c0cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.097+0000 7f4d738a3700 1 --2- 172.21.15.45:0/1108447895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d6c14ca00 0x7f4d6c153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.097+0000 7f4d738a3700 1 -- 172.21.15.45:0/1108447895 >> 172.21.15.45:0/1108447895 conn(0x7f4d6c097a20 msgr2=0x7f4d6c0b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:58.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.097+0000 7f4d738a3700 1 -- 172.21.15.45:0/1108447895 shutdown_connections 2023-10-08T12:45:58.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.097+0000 7f4d738a3700 1 -- 172.21.15.45:0/1108447895 wait complete. 2023-10-08T12:45:58.113 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:45:58.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.239+0000 7fe05d8aa700 1 -- 172.21.15.45:0/3882033946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0580cca10 msgr2=0x7fe0580b4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:58.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.239+0000 7fe05d8aa700 1 --2- 172.21.15.45:0/3882033946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0580cca10 0x7fe0580b4be0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe0580cf110 tx=0x7fe04c009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:58.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.239+0000 7fe05d8aa700 1 -- 172.21.15.45:0/3882033946 shutdown_connections 2023-10-08T12:45:58.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.239+0000 7fe05d8aa700 1 --2- 172.21.15.45:0/3882033946 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe0580ce2f0 0x7fe0580ce760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.239+0000 7fe05d8aa700 1 --2- 172.21.15.45:0/3882033946 >> v2:172.21.15.78:3300/0 conn(0x7fe05815b9a0 0x7fe0581601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.239+0000 7fe05d8aa700 1 --2- 172.21.15.45:0/3882033946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0580cca10 0x7fe0580b4be0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.239+0000 7fe05d8aa700 1 -- 172.21.15.45:0/3882033946 >> 172.21.15.45:0/3882033946 conn(0x7fe058071940 msgr2=0x7fe058071d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:58.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.239+0000 7fe05d8aa700 1 -- 172.21.15.45:0/3882033946 shutdown_connections 2023-10-08T12:45:58.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.239+0000 7fe05d8aa700 1 -- 172.21.15.45:0/3882033946 wait complete. 2023-10-08T12:45:58.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.240+0000 7fe05d8aa700 1 Processor -- start 2023-10-08T12:45:58.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.240+0000 7fe05d8aa700 1 -- start start 2023-10-08T12:45:58.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.241+0000 7fe05d8aa700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe0580cca10 0x7fe0581f36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:58.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.241+0000 7fe05d8aa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0580ce2f0 0x7fe058152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:58.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.241+0000 7fe05d8aa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe05815b9a0 0x7fe0581585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:58.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.241+0000 7fe05d8aa700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe058153530 con 0x7fe05815b9a0 2023-10-08T12:45:58.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.241+0000 7fe05d8aa700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0580c98f0 con 0x7fe0580ce2f0 2023-10-08T12:45:58.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.241+0000 7fe05d8aa700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0580c9bd0 con 0x7fe0580cca10 2023-10-08T12:45:58.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.241+0000 7fe0577fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe05815b9a0 0x7fe0581585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:58.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.241+0000 7fe0577fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe05815b9a0 0x7fe0581585b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35966/0 (socket says 172.21.15.45:35966) 2023-10-08T12:45:58.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.241+0000 7fe0577fe700 1 -- 172.21.15.45:0/440892123 learned_addr learned my addr 172.21.15.45:0/440892123 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:58.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.241+0000 7fe0567fc700 1 --2- 172.21.15.45:0/440892123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0580ce2f0 0x7fe058152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:58.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.241+0000 7fe056ffd700 1 --2- 172.21.15.45:0/440892123 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe0580cca10 0x7fe0581f36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:58.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.241+0000 7fe0577fe700 1 -- 172.21.15.45:0/440892123 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe0580cca10 msgr2=0x7fe0581f36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:58.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.241+0000 7fe0577fe700 1 --2- 172.21.15.45:0/440892123 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe0580cca10 0x7fe0581f36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.241+0000 7fe0577fe700 1 -- 172.21.15.45:0/440892123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0580ce2f0 msgr2=0x7fe058152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:58.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.241+0000 7fe0577fe700 1 --2- 172.21.15.45:0/440892123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0580ce2f0 0x7fe058152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.241+0000 7fe0577fe700 1 -- 172.21.15.45:0/440892123 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c0095f0 con 0x7fe05815b9a0 2023-10-08T12:45:58.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.241+0000 7fe0577fe700 1 --2- 172.21.15.45:0/440892123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe05815b9a0 0x7fe0581585b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe050007cd0 tx=0x7fe05000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:58.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.242+0000 7fe03ffff700 1 -- 172.21.15.45:0/440892123 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05000ddd0 con 0x7fe05815b9a0 2023-10-08T12:45:58.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.242+0000 7fe03ffff700 1 -- 172.21.15.45:0/440892123 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe05000f040 con 0x7fe05815b9a0 2023-10-08T12:45:58.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.242+0000 7fe05d8aa700 1 -- 172.21.15.45:0/440892123 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0580c9eb0 con 0x7fe05815b9a0 2023-10-08T12:45:58.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.242+0000 7fe03ffff700 1 -- 172.21.15.45:0/440892123 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe050003c60 con 0x7fe05815b9a0 2023-10-08T12:45:58.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.242+0000 7fe05d8aa700 1 -- 172.21.15.45:0/440892123 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0580ca470 con 0x7fe05815b9a0 2023-10-08T12:45:58.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.243+0000 7fe05d8aa700 1 -- 172.21.15.45:0/440892123 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe05804e4c0 con 0x7fe05815b9a0 2023-10-08T12:45:58.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.243+0000 7fe03ffff700 1 -- 172.21.15.45:0/440892123 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe050015400 con 0x7fe05815b9a0 2023-10-08T12:45:58.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.243+0000 7fe03ffff700 1 --2- 172.21.15.45:0/440892123 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe04406aed0 0x7fe04406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:58.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.244+0000 7fe03ffff700 1 -- 172.21.15.45:0/440892123 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe050089670 con 0x7fe05815b9a0 2023-10-08T12:45:58.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.244+0000 7fe056ffd700 1 --2- 172.21.15.45:0/440892123 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe04406aed0 0x7fe04406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:58.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.244+0000 7fe056ffd700 1 --2- 172.21.15.45:0/440892123 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe04406aed0 0x7fe04406d390 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe048005950 tx=0x7fe0480058e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:58.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.248+0000 7fe03ffff700 1 -- 172.21.15.45:0/440892123 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe0500547b0 con 0x7fe05815b9a0 2023-10-08T12:45:58.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.448+0000 7fe05d8aa700 1 -- 172.21.15.45:0/440892123 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0580cf710 con 0x7fe05815b9a0 2023-10-08T12:45:58.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.449+0000 7fe03ffff700 1 -- 172.21.15.45:0/440892123 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7fe050057dd0 con 0x7fe05815b9a0 2023-10-08T12:45:58.450 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:58.450 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:45:26.206424+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:45:19.183651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:45:22.277383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:45:23.606639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.412453+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.351925+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.428025+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.437246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.441119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.388608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.415524+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.401835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:45:58.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.451+0000 7fe05d8aa700 1 -- 172.21.15.45:0/440892123 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe04406aed0 msgr2=0x7fe04406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:58.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.451+0000 7fe05d8aa700 1 --2- 172.21.15.45:0/440892123 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe04406aed0 0x7fe04406d390 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe048005950 tx=0x7fe0480058e0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.451+0000 7fe05d8aa700 1 -- 172.21.15.45:0/440892123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe05815b9a0 msgr2=0x7fe0581585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:58.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.451+0000 7fe05d8aa700 1 --2- 172.21.15.45:0/440892123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe05815b9a0 0x7fe0581585b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe050007cd0 tx=0x7fe05000d3b0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.451+0000 7fe05d8aa700 1 -- 172.21.15.45:0/440892123 shutdown_connections 2023-10-08T12:45:58.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.451+0000 7fe05d8aa700 1 --2- 172.21.15.45:0/440892123 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe04406aed0 0x7fe04406d390 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.451+0000 7fe05d8aa700 1 --2- 172.21.15.45:0/440892123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe05815b9a0 0x7fe0581585b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.451+0000 7fe05d8aa700 1 --2- 172.21.15.45:0/440892123 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe0580cca10 0x7fe0581f36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.451+0000 7fe05d8aa700 1 --2- 172.21.15.45:0/440892123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0580ce2f0 0x7fe058152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.451+0000 7fe05d8aa700 1 -- 172.21.15.45:0/440892123 >> 172.21.15.45:0/440892123 conn(0x7fe058071940 msgr2=0x7fe0580d1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:58.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.451+0000 7fe05d8aa700 1 -- 172.21.15.45:0/440892123 shutdown_connections 2023-10-08T12:45:58.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.451+0000 7fe05d8aa700 1 -- 172.21.15.45:0/440892123 wait complete. 2023-10-08T12:45:58.464 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:45:19.183651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:45:22.277383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:45:23.606639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:45:58.465 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:45:58.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.594+0000 7f777d9a4700 1 -- 172.21.15.45:0/3769890010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f777815bbf0 msgr2=0x7f77780d14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:58.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.594+0000 7f777d9a4700 1 --2- 172.21.15.45:0/3769890010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f777815bbf0 0x7f77780d14c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f77780c5330 tx=0x7f776c009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:58.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.594+0000 7f777d9a4700 1 -- 172.21.15.45:0/3769890010 shutdown_connections 2023-10-08T12:45:58.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.594+0000 7f777d9a4700 1 --2- 172.21.15.45:0/3769890010 >> v2:172.21.15.78:3300/0 conn(0x7f77780cc6d0 0x7f77780ccb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.594+0000 7f777d9a4700 1 --2- 172.21.15.45:0/3769890010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f777815bbf0 0x7f77780d14c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.594+0000 7f777d9a4700 1 --2- 172.21.15.45:0/3769890010 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f77780cee20 0x7f77780cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.594+0000 7f777d9a4700 1 -- 172.21.15.45:0/3769890010 >> 172.21.15.45:0/3769890010 conn(0x7f7778071940 msgr2=0x7f7778071d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:58.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.594+0000 7f777d9a4700 1 -- 172.21.15.45:0/3769890010 shutdown_connections 2023-10-08T12:45:58.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.594+0000 7f777d9a4700 1 -- 172.21.15.45:0/3769890010 wait complete. 2023-10-08T12:45:58.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.595+0000 7f777d9a4700 1 Processor -- start 2023-10-08T12:45:58.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.595+0000 7f777d9a4700 1 -- start start 2023-10-08T12:45:58.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.596+0000 7f777d9a4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77780cc6d0 0x7f77780c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:58.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.596+0000 7f777d9a4700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f77780cee20 0x7f77781e4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:58.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.596+0000 7f777d9a4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f777815bbf0 0x7f77780cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:58.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.596+0000 7f777d9a4700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7778148930 con 0x7f77780cc6d0 2023-10-08T12:45:58.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.596+0000 7f777d9a4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77780c74d0 con 0x7f777815bbf0 2023-10-08T12:45:58.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.596+0000 7f777d9a4700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77780c7f60 con 0x7f77780cee20 2023-10-08T12:45:58.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.596+0000 7f7776ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77780cc6d0 0x7f77780c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:58.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.596+0000 7f7776ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77780cc6d0 0x7f77780c6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35976/0 (socket says 172.21.15.45:35976) 2023-10-08T12:45:58.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.596+0000 7f7776ffd700 1 -- 172.21.15.45:0/2913383232 learned_addr learned my addr 172.21.15.45:0/2913383232 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:58.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.596+0000 7f77777fe700 1 --2- 172.21.15.45:0/2913383232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f777815bbf0 0x7f77780cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:58.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.596+0000 7f7776ffd700 1 -- 172.21.15.45:0/2913383232 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f77780cee20 msgr2=0x7f77781e4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:58.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.596+0000 7f77767fc700 1 --2- 172.21.15.45:0/2913383232 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f77780cee20 0x7f77781e4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:58.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.596+0000 7f7776ffd700 1 --2- 172.21.15.45:0/2913383232 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f77780cee20 0x7f77781e4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.596+0000 7f7776ffd700 1 -- 172.21.15.45:0/2913383232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f777815bbf0 msgr2=0x7f77780cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:58.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.596+0000 7f7776ffd700 1 --2- 172.21.15.45:0/2913383232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f777815bbf0 0x7f77780cb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.597+0000 7f7776ffd700 1 -- 172.21.15.45:0/2913383232 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776c0095f0 con 0x7f77780cc6d0 2023-10-08T12:45:58.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.597+0000 7f7776ffd700 1 --2- 172.21.15.45:0/2913383232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77780cc6d0 0x7f77780c6f90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7778089ba0 tx=0x7f776c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:58.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.597+0000 7f775ffff700 1 -- 172.21.15.45:0/2913383232 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c01c070 con 0x7f77780cc6d0 2023-10-08T12:45:58.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.597+0000 7f775ffff700 1 -- 172.21.15.45:0/2913383232 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f776c003890 con 0x7f77780cc6d0 2023-10-08T12:45:58.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.597+0000 7f777d9a4700 1 -- 172.21.15.45:0/2913383232 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77781e4a90 con 0x7f77780cc6d0 2023-10-08T12:45:58.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.597+0000 7f775ffff700 1 -- 172.21.15.45:0/2913383232 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c003cc0 con 0x7f77780cc6d0 2023-10-08T12:45:58.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.597+0000 7f777d9a4700 1 -- 172.21.15.45:0/2913383232 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77780c79a0 con 0x7f77780cc6d0 2023-10-08T12:45:58.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.598+0000 7f777d9a4700 1 -- 172.21.15.45:0/2913383232 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7778148a70 con 0x7f77780cc6d0 2023-10-08T12:45:58.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.598+0000 7f775ffff700 1 -- 172.21.15.45:0/2913383232 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f776c00f460 con 0x7f77780cc6d0 2023-10-08T12:45:58.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.599+0000 7f775ffff700 1 --2- 172.21.15.45:0/2913383232 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f776406aed0 0x7f776406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:58.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.599+0000 7f775ffff700 1 -- 172.21.15.45:0/2913383232 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f776c08a9a0 con 0x7f77780cc6d0 2023-10-08T12:45:58.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.599+0000 7f77767fc700 1 --2- 172.21.15.45:0/2913383232 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f776406aed0 0x7f776406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:58.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.600+0000 7f77767fc700 1 --2- 172.21.15.45:0/2913383232 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f776406aed0 0x7f776406d390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f77781f5590 tx=0x7f7768005cf0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:58.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.604+0000 7f775ffff700 1 -- 172.21.15.45:0/2913383232 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f776c055ae0 con 0x7f77780cc6d0 2023-10-08T12:45:58.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.807+0000 7f777d9a4700 1 -- 172.21.15.45:0/2913383232 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f77781e4a90 con 0x7f77780cc6d0 2023-10-08T12:45:58.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.807+0000 7f775ffff700 1 -- 172.21.15.45:0/2913383232 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f77781e4a90 con 0x7f77780cc6d0 2023-10-08T12:45:58.808 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-08T12:45:58.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.809+0000 7f777d9a4700 1 -- 172.21.15.45:0/2913383232 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f776406aed0 msgr2=0x7f776406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:58.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.809+0000 7f777d9a4700 1 --2- 172.21.15.45:0/2913383232 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f776406aed0 0x7f776406d390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f77781f5590 tx=0x7f7768005cf0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.809+0000 7f777d9a4700 1 -- 172.21.15.45:0/2913383232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77780cc6d0 msgr2=0x7f77780c6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:58.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.809+0000 7f777d9a4700 1 --2- 172.21.15.45:0/2913383232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77780cc6d0 0x7f77780c6f90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7778089ba0 tx=0x7f776c0042f0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.809+0000 7f777d9a4700 1 -- 172.21.15.45:0/2913383232 shutdown_connections 2023-10-08T12:45:58.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.809+0000 7f777d9a4700 1 --2- 172.21.15.45:0/2913383232 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f776406aed0 0x7f776406d390 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.809+0000 7f777d9a4700 1 --2- 172.21.15.45:0/2913383232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f777815bbf0 0x7f77780cb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.809+0000 7f777d9a4700 1 --2- 172.21.15.45:0/2913383232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77780cc6d0 0x7f77780c6f90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.809+0000 7f777d9a4700 1 --2- 172.21.15.45:0/2913383232 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f77780cee20 0x7f77781e4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.809+0000 7f777d9a4700 1 -- 172.21.15.45:0/2913383232 >> 172.21.15.45:0/2913383232 conn(0x7f7778071940 msgr2=0x7f77780ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:58.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.809+0000 7f777d9a4700 1 -- 172.21.15.45:0/2913383232 shutdown_connections 2023-10-08T12:45:58.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.809+0000 7f777d9a4700 1 -- 172.21.15.45:0/2913383232 wait complete. 2023-10-08T12:45:58.822 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:45:58.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.952+0000 7efc1b468700 1 -- 172.21.15.45:0/518552026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc140ad140 msgr2=0x7efc140c2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:58.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.952+0000 7efc1b468700 1 --2- 172.21.15.45:0/518552026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc140ad140 0x7efc140c2c80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efc0c009fd0 tx=0x7efc0c00b380 comp rx=0 tx=0).stop 2023-10-08T12:45:58.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.952+0000 7efc1b468700 1 -- 172.21.15.45:0/518552026 shutdown_connections 2023-10-08T12:45:58.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.952+0000 7efc1b468700 1 --2- 172.21.15.45:0/518552026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc140ad140 0x7efc140c2c80 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.952+0000 7efc1b468700 1 --2- 172.21.15.45:0/518552026 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efc1406e6e0 0x7efc140cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.952+0000 7efc1b468700 1 -- 172.21.15.45:0/518552026 >> 172.21.15.45:0/518552026 conn(0x7efc140ca840 msgr2=0x7efc140cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:58.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.952+0000 7efc1b468700 1 -- 172.21.15.45:0/518552026 shutdown_connections 2023-10-08T12:45:58.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.952+0000 7efc1b468700 1 -- 172.21.15.45:0/518552026 wait complete. 2023-10-08T12:45:58.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.953+0000 7efc1b468700 1 Processor -- start 2023-10-08T12:45:58.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.954+0000 7efc1b468700 1 -- start start 2023-10-08T12:45:58.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.954+0000 7efc1b468700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc1406e6e0 0x7efc140c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:58.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.954+0000 7efc1b468700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc140ad140 0x7efc1414c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:58.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.955+0000 7efc1b468700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efc14158630 0x7efc140c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:58.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.955+0000 7efc1b468700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1414d070 con 0x7efc1406e6e0 2023-10-08T12:45:58.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.955+0000 7efc1b468700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc140c9720 con 0x7efc140ad140 2023-10-08T12:45:58.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.955+0000 7efc1b468700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc140c9a00 con 0x7efc14158630 2023-10-08T12:45:58.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.955+0000 7efc19204700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc1406e6e0 0x7efc140c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:58.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.955+0000 7efc19204700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc1406e6e0 0x7efc140c8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35988/0 (socket says 172.21.15.45:35988) 2023-10-08T12:45:58.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.955+0000 7efc19204700 1 -- 172.21.15.45:0/1890149282 learned_addr learned my addr 172.21.15.45:0/1890149282 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:58.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.955+0000 7efc19a05700 1 --2- 172.21.15.45:0/1890149282 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efc14158630 0x7efc140c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:58.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.955+0000 7efc18a03700 1 --2- 172.21.15.45:0/1890149282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc140ad140 0x7efc1414c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:58.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.955+0000 7efc19204700 1 -- 172.21.15.45:0/1890149282 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efc14158630 msgr2=0x7efc140c77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:58.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.955+0000 7efc19204700 1 --2- 172.21.15.45:0/1890149282 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efc14158630 0x7efc140c77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.955+0000 7efc19204700 1 -- 172.21.15.45:0/1890149282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc140ad140 msgr2=0x7efc1414c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:58.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.955+0000 7efc19204700 1 --2- 172.21.15.45:0/1890149282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc140ad140 0x7efc1414c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:58.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.955+0000 7efc19204700 1 -- 172.21.15.45:0/1890149282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0c009d00 con 0x7efc1406e6e0 2023-10-08T12:45:58.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.955+0000 7efc18a03700 1 --2- 172.21.15.45:0/1890149282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc140ad140 0x7efc1414c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:45:58.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.955+0000 7efc19204700 1 --2- 172.21.15.45:0/1890149282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc1406e6e0 0x7efc140c8630 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efc0400c450 tx=0x7efc0400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:58.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.955+0000 7efc09ffb700 1 -- 172.21.15.45:0/1890149282 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc040052d0 con 0x7efc1406e6e0 2023-10-08T12:45:58.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.955+0000 7efc09ffb700 1 -- 172.21.15.45:0/1890149282 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7efc04005520 con 0x7efc1406e6e0 2023-10-08T12:45:58.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.955+0000 7efc1b468700 1 -- 172.21.15.45:0/1890149282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc140c9ce0 con 0x7efc1406e6e0 2023-10-08T12:45:58.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.955+0000 7efc09ffb700 1 -- 172.21.15.45:0/1890149282 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc040038e0 con 0x7efc1406e6e0 2023-10-08T12:45:58.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.956+0000 7efc1b468700 1 -- 172.21.15.45:0/1890149282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1414ccd0 con 0x7efc1406e6e0 2023-10-08T12:45:58.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.956+0000 7efc1b468700 1 -- 172.21.15.45:0/1890149282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc140ca1a0 con 0x7efc1406e6e0 2023-10-08T12:45:58.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.957+0000 7efc09ffb700 1 -- 172.21.15.45:0/1890149282 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efc04003a40 con 0x7efc1406e6e0 2023-10-08T12:45:58.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.957+0000 7efc09ffb700 1 --2- 172.21.15.45:0/1890149282 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7efbf806aed0 0x7efbf806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:58.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.957+0000 7efc09ffb700 1 -- 172.21.15.45:0/1890149282 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc04088ca0 con 0x7efc1406e6e0 2023-10-08T12:45:58.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.957+0000 7efc18a03700 1 --2- 172.21.15.45:0/1890149282 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7efbf806aed0 0x7efbf806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:58.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.958+0000 7efc18a03700 1 --2- 172.21.15.45:0/1890149282 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7efbf806aed0 0x7efbf806d390 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efc10005fd0 tx=0x7efc10005e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:58.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:58.962+0000 7efc09ffb700 1 -- 172.21.15.45:0/1890149282 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efc04053cb0 con 0x7efc1406e6e0 2023-10-08T12:45:59.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.163+0000 7efc1b468700 1 -- 172.21.15.45:0/1890149282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efc14066850 con 0x7efc1406e6e0 2023-10-08T12:45:59.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.163+0000 7efc09ffb700 1 -- 172.21.15.45:0/1890149282 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7efc040572d0 con 0x7efc1406e6e0 2023-10-08T12:45:59.164 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-08T12:45:59.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.165+0000 7efc1b468700 1 -- 172.21.15.45:0/1890149282 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7efbf806aed0 msgr2=0x7efbf806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:59.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.165+0000 7efc1b468700 1 --2- 172.21.15.45:0/1890149282 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7efbf806aed0 0x7efbf806d390 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efc10005fd0 tx=0x7efc10005e40 comp rx=0 tx=0).stop 2023-10-08T12:45:59.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.165+0000 7efc1b468700 1 -- 172.21.15.45:0/1890149282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc1406e6e0 msgr2=0x7efc140c8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:59.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.165+0000 7efc1b468700 1 --2- 172.21.15.45:0/1890149282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc1406e6e0 0x7efc140c8630 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efc0400c450 tx=0x7efc0400c810 comp rx=0 tx=0).stop 2023-10-08T12:45:59.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.165+0000 7efc1b468700 1 -- 172.21.15.45:0/1890149282 shutdown_connections 2023-10-08T12:45:59.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.165+0000 7efc1b468700 1 --2- 172.21.15.45:0/1890149282 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7efbf806aed0 0x7efbf806d390 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:59.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.165+0000 7efc1b468700 1 --2- 172.21.15.45:0/1890149282 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efc14158630 0x7efc140c77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:59.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.165+0000 7efc1b468700 1 --2- 172.21.15.45:0/1890149282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc1406e6e0 0x7efc140c8630 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:59.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.165+0000 7efc1b468700 1 --2- 172.21.15.45:0/1890149282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc140ad140 0x7efc1414c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:59.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.165+0000 7efc1b468700 1 -- 172.21.15.45:0/1890149282 >> 172.21.15.45:0/1890149282 conn(0x7efc140ca840 msgr2=0x7efc1406deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:59.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.165+0000 7efc1b468700 1 -- 172.21.15.45:0/1890149282 shutdown_connections 2023-10-08T12:45:59.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.165+0000 7efc1b468700 1 -- 172.21.15.45:0/1890149282 wait complete. 2023-10-08T12:45:59.178 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:45:59.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.307+0000 7f941b5d4700 1 -- 172.21.15.45:0/2340864238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9414158870 msgr2=0x7f94140ced00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:59.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.307+0000 7f941b5d4700 1 --2- 172.21.15.45:0/2340864238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9414158870 0x7f94140ced00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f94140ce5a0 tx=0x7f9410009ba0 comp rx=0 tx=0).stop 2023-10-08T12:45:59.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.307+0000 7f941b5d4700 1 -- 172.21.15.45:0/2340864238 shutdown_connections 2023-10-08T12:45:59.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.307+0000 7f941b5d4700 1 --2- 172.21.15.45:0/2340864238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9414158870 0x7f94140ced00 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:59.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.307+0000 7f941b5d4700 1 --2- 172.21.15.45:0/2340864238 >> v2:172.21.15.78:3300/0 conn(0x7f9414158c50 0x7f94140ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:59.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.307+0000 7f941b5d4700 1 -- 172.21.15.45:0/2340864238 >> 172.21.15.45:0/2340864238 conn(0x7f9414097a20 msgr2=0x7f94140ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:59.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.307+0000 7f941b5d4700 1 -- 172.21.15.45:0/2340864238 shutdown_connections 2023-10-08T12:45:59.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.307+0000 7f941b5d4700 1 -- 172.21.15.45:0/2340864238 wait complete. 2023-10-08T12:45:59.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.308+0000 7f941b5d4700 1 Processor -- start 2023-10-08T12:45:59.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.309+0000 7f941b5d4700 1 -- start start 2023-10-08T12:45:59.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.309+0000 7f941b5d4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94140cf240 0x7f94141ee9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:59.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.309+0000 7f941b5d4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9414158870 0x7f9414150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:59.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.309+0000 7f941b5d4700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f94140c6400 0x7f94141524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:59.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.309+0000 7f941b5d4700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9414149370 con 0x7f94140cf240 2023-10-08T12:45:59.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.309+0000 7f941b5d4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94141511a0 con 0x7f9414158870 2023-10-08T12:45:59.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.310+0000 7f941b5d4700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9414150900 con 0x7f94140c6400 2023-10-08T12:45:59.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.310+0000 7f9419370700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94140cf240 0x7f94141ee9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:59.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.310+0000 7f9419370700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94140cf240 0x7f94141ee9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36002/0 (socket says 172.21.15.45:36002) 2023-10-08T12:45:59.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.310+0000 7f9419370700 1 -- 172.21.15.45:0/1029898135 learned_addr learned my addr 172.21.15.45:0/1029898135 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:59.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.310+0000 7f9418b6f700 1 --2- 172.21.15.45:0/1029898135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9414158870 0x7f9414150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:59.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.310+0000 7f9419b71700 1 --2- 172.21.15.45:0/1029898135 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f94140c6400 0x7f94141524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:59.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.310+0000 7f9419370700 1 -- 172.21.15.45:0/1029898135 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f94140c6400 msgr2=0x7f94141524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:59.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.310+0000 7f9419370700 1 --2- 172.21.15.45:0/1029898135 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f94140c6400 0x7f94141524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:59.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.310+0000 7f9419370700 1 -- 172.21.15.45:0/1029898135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9414158870 msgr2=0x7f9414150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:59.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.310+0000 7f9419370700 1 --2- 172.21.15.45:0/1029898135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9414158870 0x7f9414150000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:59.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.310+0000 7f9419370700 1 -- 172.21.15.45:0/1029898135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9410009520 con 0x7f94140cf240 2023-10-08T12:45:59.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.310+0000 7f9419370700 1 --2- 172.21.15.45:0/1029898135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94140cf240 0x7f94141ee9c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9414070010 tx=0x7f9410017630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:59.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.310+0000 7f9405ffb700 1 -- 172.21.15.45:0/1029898135 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941001c070 con 0x7f94140cf240 2023-10-08T12:45:59.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.310+0000 7f9405ffb700 1 -- 172.21.15.45:0/1029898135 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9410017c20 con 0x7f94140cf240 2023-10-08T12:45:59.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.310+0000 7f941b5d4700 1 -- 172.21.15.45:0/1029898135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9414150be0 con 0x7f94140cf240 2023-10-08T12:45:59.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.310+0000 7f9405ffb700 1 -- 172.21.15.45:0/1029898135 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9410004050 con 0x7f94140cf240 2023-10-08T12:45:59.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.310+0000 7f941b5d4700 1 -- 172.21.15.45:0/1029898135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94140c6cb0 con 0x7f94140cf240 2023-10-08T12:45:59.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.311+0000 7f941b5d4700 1 -- 172.21.15.45:0/1029898135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94140c6b10 con 0x7f94140cf240 2023-10-08T12:45:59.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.312+0000 7f9405ffb700 1 -- 172.21.15.45:0/1029898135 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f94100041b0 con 0x7f94140cf240 2023-10-08T12:45:59.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.312+0000 7f9405ffb700 1 --2- 172.21.15.45:0/1029898135 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f93f806aef0 0x7f93f806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:59.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.312+0000 7f9405ffb700 1 -- 172.21.15.45:0/1029898135 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f941008a730 con 0x7f94140cf240 2023-10-08T12:45:59.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.313+0000 7f9418b6f700 1 --2- 172.21.15.45:0/1029898135 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f93f806aef0 0x7f93f806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:59.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.313+0000 7f9418b6f700 1 --2- 172.21.15.45:0/1029898135 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f93f806aef0 0x7f93f806d3b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9408005950 tx=0x7f94080058e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:59.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.317+0000 7f9405ffb700 1 -- 172.21.15.45:0/1029898135 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f94140c6b10 con 0x7f94140cf240 2023-10-08T12:45:59.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.518+0000 7f941b5d4700 1 -- 172.21.15.45:0/1029898135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f94140c6b10 con 0x7f94140cf240 2023-10-08T12:45:59.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.518+0000 7f9405ffb700 1 -- 172.21.15.45:0/1029898135 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f94140c6b10 con 0x7f94140cf240 2023-10-08T12:45:59.519 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-08T12:45:59.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.520+0000 7f941b5d4700 1 -- 172.21.15.45:0/1029898135 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f93f806aef0 msgr2=0x7f93f806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:59.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.520+0000 7f941b5d4700 1 --2- 172.21.15.45:0/1029898135 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f93f806aef0 0x7f93f806d3b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9408005950 tx=0x7f94080058e0 comp rx=0 tx=0).stop 2023-10-08T12:45:59.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.520+0000 7f941b5d4700 1 -- 172.21.15.45:0/1029898135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94140cf240 msgr2=0x7f94141ee9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:59.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.520+0000 7f941b5d4700 1 --2- 172.21.15.45:0/1029898135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94140cf240 0x7f94141ee9c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9414070010 tx=0x7f9410017630 comp rx=0 tx=0).stop 2023-10-08T12:45:59.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.521+0000 7f941b5d4700 1 -- 172.21.15.45:0/1029898135 shutdown_connections 2023-10-08T12:45:59.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.521+0000 7f941b5d4700 1 --2- 172.21.15.45:0/1029898135 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f93f806aef0 0x7f93f806d3b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:59.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.521+0000 7f941b5d4700 1 --2- 172.21.15.45:0/1029898135 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f94140c6400 0x7f94141524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:59.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.521+0000 7f941b5d4700 1 --2- 172.21.15.45:0/1029898135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94140cf240 0x7f94141ee9c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:59.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.521+0000 7f941b5d4700 1 --2- 172.21.15.45:0/1029898135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9414158870 0x7f9414150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:59.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.521+0000 7f941b5d4700 1 -- 172.21.15.45:0/1029898135 >> 172.21.15.45:0/1029898135 conn(0x7f9414097a20 msgr2=0x7f9414154e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:59.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.521+0000 7f941b5d4700 1 -- 172.21.15.45:0/1029898135 shutdown_connections 2023-10-08T12:45:59.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.521+0000 7f941b5d4700 1 -- 172.21.15.45:0/1029898135 wait complete. 2023-10-08T12:45:59.584 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-08T12:45:59.584 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:45:59.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.711+0000 7fb6d0945700 1 -- 172.21.15.45:0/1410758557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6cc0b3fb0 msgr2=0x7fb6cc0b4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:59.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.711+0000 7fb6d0945700 1 --2- 172.21.15.45:0/1410758557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6cc0b3fb0 0x7fb6cc0b4410 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0005fd0 tx=0x7fb6c0009c70 comp rx=0 tx=0).stop 2023-10-08T12:45:59.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.712+0000 7fb6d0945700 1 -- 172.21.15.45:0/1410758557 shutdown_connections 2023-10-08T12:45:59.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.712+0000 7fb6d0945700 1 --2- 172.21.15.45:0/1410758557 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb6cc159960 0x7fb6cc0b1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:59.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.712+0000 7fb6d0945700 1 --2- 172.21.15.45:0/1410758557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6cc0b3fb0 0x7fb6cc0b4410 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:59.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.712+0000 7fb6d0945700 1 -- 172.21.15.45:0/1410758557 >> 172.21.15.45:0/1410758557 conn(0x7fb6cc0b0430 msgr2=0x7fb6cc0b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:59.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.712+0000 7fb6d0945700 1 -- 172.21.15.45:0/1410758557 shutdown_connections 2023-10-08T12:45:59.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.712+0000 7fb6d0945700 1 -- 172.21.15.45:0/1410758557 wait complete. 2023-10-08T12:45:59.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.713+0000 7fb6d0945700 1 Processor -- start 2023-10-08T12:45:59.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.713+0000 7fb6d0945700 1 -- start start 2023-10-08T12:45:59.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.714+0000 7fb6d0945700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6cc06a210 0x7fb6cc1510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:59.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.714+0000 7fb6d0945700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb6cc0b3fb0 0x7fb6cc0ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:59.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.714+0000 7fb6d0945700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6cc159960 0x7fb6cc06d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:59.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.714+0000 7fb6d0945700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc1515f0 con 0x7fb6cc159960 2023-10-08T12:45:59.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.714+0000 7fb6d0945700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc0ac030 con 0x7fb6cc06a210 2023-10-08T12:45:59.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.714+0000 7fb6d0945700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc0ab7f0 con 0x7fb6cc0b3fb0 2023-10-08T12:45:59.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.714+0000 7fb6cad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6cc159960 0x7fb6cc06d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:59.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.714+0000 7fb6cad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6cc159960 0x7fb6cc06d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36018/0 (socket says 172.21.15.45:36018) 2023-10-08T12:45:59.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.714+0000 7fb6cad9d700 1 -- 172.21.15.45:0/1699256612 learned_addr learned my addr 172.21.15.45:0/1699256612 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:45:59.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.714+0000 7fb6c9d9b700 1 --2- 172.21.15.45:0/1699256612 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb6cc0b3fb0 0x7fb6cc0ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:59.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.714+0000 7fb6ca59c700 1 --2- 172.21.15.45:0/1699256612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6cc06a210 0x7fb6cc1510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:59.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.714+0000 7fb6cad9d700 1 -- 172.21.15.45:0/1699256612 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb6cc0b3fb0 msgr2=0x7fb6cc0ab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:59.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.714+0000 7fb6cad9d700 1 --2- 172.21.15.45:0/1699256612 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb6cc0b3fb0 0x7fb6cc0ab2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:59.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.714+0000 7fb6cad9d700 1 -- 172.21.15.45:0/1699256612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6cc06a210 msgr2=0x7fb6cc1510b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:59.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.714+0000 7fb6cad9d700 1 --2- 172.21.15.45:0/1699256612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6cc06a210 0x7fb6cc1510b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:59.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.714+0000 7fb6cad9d700 1 -- 172.21.15.45:0/1699256612 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c00095f0 con 0x7fb6cc159960 2023-10-08T12:45:59.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.714+0000 7fb6c9d9b700 1 --2- 172.21.15.45:0/1699256612 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb6cc0b3fb0 0x7fb6cc0ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:59.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.714+0000 7fb6cad9d700 1 --2- 172.21.15.45:0/1699256612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6cc159960 0x7fb6cc06d950 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb6c400c870 tx=0x7fb6c400cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:59.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.715+0000 7fb6baffd700 1 -- 172.21.15.45:0/1699256612 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4003e30 con 0x7fb6cc159960 2023-10-08T12:45:59.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.715+0000 7fb6baffd700 1 -- 172.21.15.45:0/1699256612 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb6c4005070 con 0x7fb6cc159960 2023-10-08T12:45:59.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.715+0000 7fb6d0945700 1 -- 172.21.15.45:0/1699256612 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6cc0aba70 con 0x7fb6cc159960 2023-10-08T12:45:59.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.715+0000 7fb6baffd700 1 -- 172.21.15.45:0/1699256612 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4005480 con 0x7fb6cc159960 2023-10-08T12:45:59.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.715+0000 7fb6d0945700 1 -- 172.21.15.45:0/1699256612 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6cc0cc5d0 con 0x7fb6cc159960 2023-10-08T12:45:59.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.716+0000 7fb6d0945700 1 -- 172.21.15.45:0/1699256612 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6cc0cc430 con 0x7fb6cc159960 2023-10-08T12:45:59.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.716+0000 7fb6baffd700 1 -- 172.21.15.45:0/1699256612 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb6c40055e0 con 0x7fb6cc159960 2023-10-08T12:45:59.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.716+0000 7fb6baffd700 1 --2- 172.21.15.45:0/1699256612 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb6ac06aed0 0x7fb6ac06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:59.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.717+0000 7fb6baffd700 1 -- 172.21.15.45:0/1699256612 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6c4088e60 con 0x7fb6cc159960 2023-10-08T12:45:59.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.717+0000 7fb6ca59c700 1 --2- 172.21.15.45:0/1699256612 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb6ac06aed0 0x7fb6ac06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:59.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.717+0000 7fb6ca59c700 1 --2- 172.21.15.45:0/1699256612 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb6ac06aed0 0x7fb6ac06d390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc009bc0 tx=0x7fb6bc009260 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:59.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.721+0000 7fb6baffd700 1 -- 172.21.15.45:0/1699256612 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb6cc0cc430 con 0x7fb6cc159960 2023-10-08T12:45:59.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.923+0000 7fb6d0945700 1 -- 172.21.15.45:0/1699256612 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6cc0cc430 con 0x7fb6cc159960 2023-10-08T12:45:59.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.924+0000 7fb6baffd700 1 -- 172.21.15.45:0/1699256612 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7fb6cc0cc430 con 0x7fb6cc159960 2023-10-08T12:45:59.925 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:45:59.925 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:45:26.206424+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:45:19.183651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:45:22.277383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:45:23.606639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.412453+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.351925+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.428025+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.437246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.441119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.388608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.415524+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.401835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:45:59.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.926+0000 7fb6d0945700 1 -- 172.21.15.45:0/1699256612 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb6ac06aed0 msgr2=0x7fb6ac06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:59.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.926+0000 7fb6d0945700 1 --2- 172.21.15.45:0/1699256612 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb6ac06aed0 0x7fb6ac06d390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc009bc0 tx=0x7fb6bc009260 comp rx=0 tx=0).stop 2023-10-08T12:45:59.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.926+0000 7fb6d0945700 1 -- 172.21.15.45:0/1699256612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6cc159960 msgr2=0x7fb6cc06d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:59.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.926+0000 7fb6d0945700 1 --2- 172.21.15.45:0/1699256612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6cc159960 0x7fb6cc06d950 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb6c400c870 tx=0x7fb6c400cb80 comp rx=0 tx=0).stop 2023-10-08T12:45:59.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.926+0000 7fb6d0945700 1 -- 172.21.15.45:0/1699256612 shutdown_connections 2023-10-08T12:45:59.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.926+0000 7fb6d0945700 1 --2- 172.21.15.45:0/1699256612 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb6ac06aed0 0x7fb6ac06d390 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:59.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.926+0000 7fb6d0945700 1 --2- 172.21.15.45:0/1699256612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6cc159960 0x7fb6cc06d950 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:59.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.926+0000 7fb6d0945700 1 --2- 172.21.15.45:0/1699256612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6cc06a210 0x7fb6cc1510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:59.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.926+0000 7fb6d0945700 1 --2- 172.21.15.45:0/1699256612 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb6cc0b3fb0 0x7fb6cc0ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:59.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.926+0000 7fb6d0945700 1 -- 172.21.15.45:0/1699256612 >> 172.21.15.45:0/1699256612 conn(0x7fb6cc0b0430 msgr2=0x7fb6cc0c7940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:59.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.926+0000 7fb6d0945700 1 -- 172.21.15.45:0/1699256612 shutdown_connections 2023-10-08T12:45:59.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:45:59.926+0000 7fb6d0945700 1 -- 172.21.15.45:0/1699256612 wait complete. 2023-10-08T12:45:59.939 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:45:19.183651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:45:22.277383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:45:23.606639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:45:59.940 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:46:00.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.069+0000 7f0cf37c4700 1 -- 172.21.15.45:0/2433709212 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0cec1586b0 msgr2=0x7f0cec0cee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:00.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.069+0000 7f0cf37c4700 1 --2- 172.21.15.45:0/2433709212 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0cec1586b0 0x7f0cec0cee10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0ce80098f0 tx=0x7f0ce8009c00 comp rx=0 tx=0).stop 2023-10-08T12:46:00.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.069+0000 7f0cf37c4700 1 -- 172.21.15.45:0/2433709212 shutdown_connections 2023-10-08T12:46:00.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.069+0000 7f0cf37c4700 1 --2- 172.21.15.45:0/2433709212 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0cec1586b0 0x7f0cec0cee10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:00.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.069+0000 7f0cf37c4700 1 -- 172.21.15.45:0/2433709212 >> 172.21.15.45:0/2433709212 conn(0x7f0cec06b320 msgr2=0x7f0cec06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:00.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.069+0000 7f0cf37c4700 1 -- 172.21.15.45:0/2433709212 shutdown_connections 2023-10-08T12:46:00.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.069+0000 7f0cf37c4700 1 -- 172.21.15.45:0/2433709212 wait complete. 2023-10-08T12:46:00.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.070+0000 7f0cf37c4700 1 Processor -- start 2023-10-08T12:46:00.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.070+0000 7f0cf37c4700 1 -- start start 2023-10-08T12:46:00.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.071+0000 7f0cf37c4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cec0cc820 0x7f0cec14dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:00.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.071+0000 7f0cf37c4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cec1586b0 0x7f0cec1f3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:00.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.071+0000 7f0cf37c4700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0cec158a90 0x7f0cec1535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:00.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.071+0000 7f0cf37c4700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec1f2c70 con 0x7f0cec1586b0 2023-10-08T12:46:00.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.071+0000 7f0cf37c4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec0ae440 con 0x7f0cec0cc820 2023-10-08T12:46:00.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.071+0000 7f0cf37c4700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec0ae720 con 0x7f0cec158a90 2023-10-08T12:46:00.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.071+0000 7f0cf0d5f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cec1586b0 0x7f0cec1f3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:00.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.071+0000 7f0cf0d5f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cec1586b0 0x7f0cec1f3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36030/0 (socket says 172.21.15.45:36030) 2023-10-08T12:46:00.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.071+0000 7f0cf0d5f700 1 -- 172.21.15.45:0/2089594310 learned_addr learned my addr 172.21.15.45:0/2089594310 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:00.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.071+0000 7f0cf1560700 1 --2- 172.21.15.45:0/2089594310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cec0cc820 0x7f0cec14dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:00.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.071+0000 7f0cf1d61700 1 --2- 172.21.15.45:0/2089594310 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0cec158a90 0x7f0cec1535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:00.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.072+0000 7f0cf0d5f700 1 -- 172.21.15.45:0/2089594310 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0cec158a90 msgr2=0x7f0cec1535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:00.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.072+0000 7f0cf0d5f700 1 --2- 172.21.15.45:0/2089594310 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0cec158a90 0x7f0cec1535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:00.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.072+0000 7f0cf0d5f700 1 -- 172.21.15.45:0/2089594310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cec0cc820 msgr2=0x7f0cec14dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:00.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.072+0000 7f0cf0d5f700 1 --2- 172.21.15.45:0/2089594310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cec0cc820 0x7f0cec14dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:00.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.072+0000 7f0cf0d5f700 1 -- 172.21.15.45:0/2089594310 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce8009520 con 0x7f0cec1586b0 2023-10-08T12:46:00.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.072+0000 7f0cf0d5f700 1 --2- 172.21.15.45:0/2089594310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cec1586b0 0x7f0cec1f3070 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc00c4d0 tx=0x7f0cdc00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:00.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.072+0000 7f0ce1ffb700 1 -- 172.21.15.45:0/2089594310 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc004230 con 0x7f0cec1586b0 2023-10-08T12:46:00.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.072+0000 7f0ce1ffb700 1 -- 172.21.15.45:0/2089594310 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0cdc0044a0 con 0x7f0cec1586b0 2023-10-08T12:46:00.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.072+0000 7f0cf37c4700 1 -- 172.21.15.45:0/2089594310 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cec0aea00 con 0x7f0cec1586b0 2023-10-08T12:46:00.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.072+0000 7f0ce1ffb700 1 -- 172.21.15.45:0/2089594310 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc0038e0 con 0x7f0cec1586b0 2023-10-08T12:46:00.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.072+0000 7f0cf37c4700 1 -- 172.21.15.45:0/2089594310 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cec14e1d0 con 0x7f0cec1586b0 2023-10-08T12:46:00.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.073+0000 7f0cf37c4700 1 -- 172.21.15.45:0/2089594310 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cec0aec20 con 0x7f0cec1586b0 2023-10-08T12:46:00.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.074+0000 7f0ce1ffb700 1 -- 172.21.15.45:0/2089594310 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0cdc003a40 con 0x7f0cec1586b0 2023-10-08T12:46:00.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.074+0000 7f0ce1ffb700 1 --2- 172.21.15.45:0/2089594310 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0cd006aed0 0x7f0cd006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:00.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.074+0000 7f0ce1ffb700 1 -- 172.21.15.45:0/2089594310 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0cdc088f50 con 0x7f0cec1586b0 2023-10-08T12:46:00.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.075+0000 7f0cf1560700 1 --2- 172.21.15.45:0/2089594310 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0cd006aed0 0x7f0cd006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:00.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.075+0000 7f0cf1560700 1 --2- 172.21.15.45:0/2089594310 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0cd006aed0 0x7f0cd006d390 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8009230 tx=0x7f0ce80047c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:00.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.078+0000 7f0ce1ffb700 1 -- 172.21.15.45:0/2089594310 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0cdc0540e0 con 0x7f0cec1586b0 2023-10-08T12:46:00.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.277+0000 7f0cf37c4700 1 -- 172.21.15.45:0/2089594310 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0cec066850 con 0x7f0cec1586b0 2023-10-08T12:46:00.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.277+0000 7f0ce1ffb700 1 -- 172.21.15.45:0/2089594310 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0cdc0170a0 con 0x7f0cec1586b0 2023-10-08T12:46:00.278 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-08T12:46:00.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.279+0000 7f0cf37c4700 1 -- 172.21.15.45:0/2089594310 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0cd006aed0 msgr2=0x7f0cd006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:00.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.279+0000 7f0cf37c4700 1 --2- 172.21.15.45:0/2089594310 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0cd006aed0 0x7f0cd006d390 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8009230 tx=0x7f0ce80047c0 comp rx=0 tx=0).stop 2023-10-08T12:46:00.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.279+0000 7f0cf37c4700 1 -- 172.21.15.45:0/2089594310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cec1586b0 msgr2=0x7f0cec1f3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:00.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.279+0000 7f0cf37c4700 1 --2- 172.21.15.45:0/2089594310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cec1586b0 0x7f0cec1f3070 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc00c4d0 tx=0x7f0cdc00c7e0 comp rx=0 tx=0).stop 2023-10-08T12:46:00.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.279+0000 7f0cf37c4700 1 -- 172.21.15.45:0/2089594310 shutdown_connections 2023-10-08T12:46:00.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.279+0000 7f0cf37c4700 1 --2- 172.21.15.45:0/2089594310 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0cd006aed0 0x7f0cd006d390 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:00.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.279+0000 7f0cf37c4700 1 --2- 172.21.15.45:0/2089594310 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0cec158a90 0x7f0cec1535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:00.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.279+0000 7f0cf37c4700 1 --2- 172.21.15.45:0/2089594310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cec0cc820 0x7f0cec14dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:00.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.279+0000 7f0cf37c4700 1 --2- 172.21.15.45:0/2089594310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cec1586b0 0x7f0cec1f3070 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:00.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.279+0000 7f0cf37c4700 1 -- 172.21.15.45:0/2089594310 >> 172.21.15.45:0/2089594310 conn(0x7f0cec06b320 msgr2=0x7f0cec14e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:00.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.279+0000 7f0cf37c4700 1 -- 172.21.15.45:0/2089594310 shutdown_connections 2023-10-08T12:46:00.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.279+0000 7f0cf37c4700 1 -- 172.21.15.45:0/2089594310 wait complete. 2023-10-08T12:46:00.292 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:46:00.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.422+0000 7fa5a09ef700 1 -- 172.21.15.45:0/488906416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa584005210 msgr2=0x7fa58400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:00.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.422+0000 7fa5a09ef700 1 --2- 172.21.15.45:0/488906416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa584005210 0x7fa58400ba10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa594001e10 tx=0x7fa584005880 comp rx=0 tx=0).stop 2023-10-08T12:46:00.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.422+0000 7fa5a09ef700 1 -- 172.21.15.45:0/488906416 shutdown_connections 2023-10-08T12:46:00.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.422+0000 7fa5a09ef700 1 --2- 172.21.15.45:0/488906416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa584005210 0x7fa58400ba10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:00.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.422+0000 7fa5a09ef700 1 -- 172.21.15.45:0/488906416 >> 172.21.15.45:0/488906416 conn(0x7fa59c097a20 msgr2=0x7fa59c0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:00.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.422+0000 7fa5a09ef700 1 -- 172.21.15.45:0/488906416 shutdown_connections 2023-10-08T12:46:00.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.422+0000 7fa5a09ef700 1 -- 172.21.15.45:0/488906416 wait complete. 2023-10-08T12:46:00.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.423+0000 7fa5a09ef700 1 Processor -- start 2023-10-08T12:46:00.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.423+0000 7fa5a09ef700 1 -- start start 2023-10-08T12:46:00.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.424+0000 7fa5a09ef700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa584005210 0x7fa59c148b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:00.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.424+0000 7fa5a09ef700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa59c156540 0x7fa59c157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:00.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.424+0000 7fa5a09ef700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa59c155c10 0x7fa59c0acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:00.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.424+0000 7fa5a09ef700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c1576c0 con 0x7fa584005210 2023-10-08T12:46:00.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.424+0000 7fa5a09ef700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c149070 con 0x7fa59c155c10 2023-10-08T12:46:00.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.424+0000 7fa5a09ef700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c158090 con 0x7fa59c156540 2023-10-08T12:46:00.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.424+0000 7fa59a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa584005210 0x7fa59c148b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:00.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.424+0000 7fa59a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa584005210 0x7fa59c148b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36048/0 (socket says 172.21.15.45:36048) 2023-10-08T12:46:00.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.424+0000 7fa59a59c700 1 -- 172.21.15.45:0/1445772773 learned_addr learned my addr 172.21.15.45:0/1445772773 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:00.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.424+0000 7fa59ad9d700 1 --2- 172.21.15.45:0/1445772773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa59c155c10 0x7fa59c0acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:00.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.424+0000 7fa599d9b700 1 --2- 172.21.15.45:0/1445772773 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa59c156540 0x7fa59c157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:00.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.424+0000 7fa59a59c700 1 -- 172.21.15.45:0/1445772773 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa59c156540 msgr2=0x7fa59c157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:00.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.424+0000 7fa59a59c700 1 --2- 172.21.15.45:0/1445772773 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa59c156540 0x7fa59c157b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:00.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.424+0000 7fa59a59c700 1 -- 172.21.15.45:0/1445772773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa59c155c10 msgr2=0x7fa59c0acdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:00.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.424+0000 7fa59a59c700 1 --2- 172.21.15.45:0/1445772773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa59c155c10 0x7fa59c0acdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:00.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.424+0000 7fa59a59c700 1 -- 172.21.15.45:0/1445772773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59c156ab0 con 0x7fa584005210 2023-10-08T12:46:00.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.425+0000 7fa59a59c700 1 --2- 172.21.15.45:0/1445772773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa584005210 0x7fa59c148b30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa58c00e650 tx=0x7fa58c00ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:00.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.425+0000 7fa58affd700 1 -- 172.21.15.45:0/1445772773 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c010890 con 0x7fa584005210 2023-10-08T12:46:00.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.425+0000 7fa58affd700 1 -- 172.21.15.45:0/1445772773 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa58c010ae0 con 0x7fa584005210 2023-10-08T12:46:00.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.425+0000 7fa5a09ef700 1 -- 172.21.15.45:0/1445772773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa59c156d90 con 0x7fa584005210 2023-10-08T12:46:00.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.425+0000 7fa58affd700 1 -- 172.21.15.45:0/1445772773 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c010e90 con 0x7fa584005210 2023-10-08T12:46:00.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.425+0000 7fa5a09ef700 1 -- 172.21.15.45:0/1445772773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa59c157350 con 0x7fa584005210 2023-10-08T12:46:00.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.426+0000 7fa5a09ef700 1 -- 172.21.15.45:0/1445772773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa59c1574e0 con 0x7fa584005210 2023-10-08T12:46:00.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.426+0000 7fa58affd700 1 -- 172.21.15.45:0/1445772773 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa58c011460 con 0x7fa584005210 2023-10-08T12:46:00.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.427+0000 7fa58affd700 1 --2- 172.21.15.45:0/1445772773 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa57c06aed0 0x7fa57c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:00.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.427+0000 7fa58affd700 1 -- 172.21.15.45:0/1445772773 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa58c089c90 con 0x7fa584005210 2023-10-08T12:46:00.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.427+0000 7fa599d9b700 1 --2- 172.21.15.45:0/1445772773 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa57c06aed0 0x7fa57c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:00.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.428+0000 7fa599d9b700 1 --2- 172.21.15.45:0/1445772773 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa57c06aed0 0x7fa57c06d390 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa59c159a70 tx=0x7fa590009260 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:00.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.432+0000 7fa58affd700 1 -- 172.21.15.45:0/1445772773 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa58c0587d0 con 0x7fa584005210 2023-10-08T12:46:00.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.630+0000 7fa5a09ef700 1 -- 172.21.15.45:0/1445772773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa59c066850 con 0x7fa584005210 2023-10-08T12:46:00.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.631+0000 7fa58affd700 1 -- 172.21.15.45:0/1445772773 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa58c01f020 con 0x7fa584005210 2023-10-08T12:46:00.632 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-08T12:46:00.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.633+0000 7fa5a09ef700 1 -- 172.21.15.45:0/1445772773 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa57c06aed0 msgr2=0x7fa57c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:00.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.633+0000 7fa5a09ef700 1 --2- 172.21.15.45:0/1445772773 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa57c06aed0 0x7fa57c06d390 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa59c159a70 tx=0x7fa590009260 comp rx=0 tx=0).stop 2023-10-08T12:46:00.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.633+0000 7fa5a09ef700 1 -- 172.21.15.45:0/1445772773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa584005210 msgr2=0x7fa59c148b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:00.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.633+0000 7fa5a09ef700 1 --2- 172.21.15.45:0/1445772773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa584005210 0x7fa59c148b30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa58c00e650 tx=0x7fa58c00ea10 comp rx=0 tx=0).stop 2023-10-08T12:46:00.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.633+0000 7fa5a09ef700 1 -- 172.21.15.45:0/1445772773 shutdown_connections 2023-10-08T12:46:00.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.633+0000 7fa5a09ef700 1 --2- 172.21.15.45:0/1445772773 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa57c06aed0 0x7fa57c06d390 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:00.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.633+0000 7fa5a09ef700 1 --2- 172.21.15.45:0/1445772773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa59c155c10 0x7fa59c0acdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:00.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.633+0000 7fa5a09ef700 1 --2- 172.21.15.45:0/1445772773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa584005210 0x7fa59c148b30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:00.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.633+0000 7fa5a09ef700 1 --2- 172.21.15.45:0/1445772773 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa59c156540 0x7fa59c157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:00.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.633+0000 7fa5a09ef700 1 -- 172.21.15.45:0/1445772773 >> 172.21.15.45:0/1445772773 conn(0x7fa59c097a20 msgr2=0x7fa59c06e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:00.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.633+0000 7fa5a09ef700 1 -- 172.21.15.45:0/1445772773 shutdown_connections 2023-10-08T12:46:00.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.633+0000 7fa5a09ef700 1 -- 172.21.15.45:0/1445772773 wait complete. 2023-10-08T12:46:00.646 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:46:00.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.775+0000 7f97aeb99700 1 -- 172.21.15.45:0/1086713475 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97a815bf50 msgr2=0x7f97a80cc420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:00.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.775+0000 7f97aeb99700 1 --2- 172.21.15.45:0/1086713475 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97a815bf50 0x7f97a80cc420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f979c0098c0 tx=0x7f979c009bd0 comp rx=0 tx=0).stop 2023-10-08T12:46:00.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.776+0000 7f97aeb99700 1 -- 172.21.15.45:0/1086713475 shutdown_connections 2023-10-08T12:46:00.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.776+0000 7f97aeb99700 1 --2- 172.21.15.45:0/1086713475 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97a815bf50 0x7f97a80cc420 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:00.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.776+0000 7f97aeb99700 1 --2- 172.21.15.45:0/1086713475 >> v2:172.21.15.78:3300/0 conn(0x7f97a806f7b0 0x7f97a80ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:00.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.776+0000 7f97aeb99700 1 -- 172.21.15.45:0/1086713475 >> 172.21.15.45:0/1086713475 conn(0x7f97a8097a20 msgr2=0x7f97a80ce850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:00.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.776+0000 7f97aeb99700 1 -- 172.21.15.45:0/1086713475 shutdown_connections 2023-10-08T12:46:00.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.776+0000 7f97aeb99700 1 -- 172.21.15.45:0/1086713475 wait complete. 2023-10-08T12:46:00.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.777+0000 7f97aeb99700 1 Processor -- start 2023-10-08T12:46:00.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.777+0000 7f97aeb99700 1 -- start start 2023-10-08T12:46:00.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.778+0000 7f97aeb99700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97a806f7b0 0x7f97a81501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:00.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.778+0000 7f97aeb99700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a80c9b90 0x7f97a8098760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:00.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.778+0000 7f97aeb99700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97a815bf50 0x7f97a8098ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:00.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.778+0000 7f97aeb99700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a80af800 con 0x7f97a806f7b0 2023-10-08T12:46:00.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.778+0000 7f97aeb99700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a81506e0 con 0x7f97a80c9b90 2023-10-08T12:46:00.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.778+0000 7f97aeb99700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a809c2b0 con 0x7f97a815bf50 2023-10-08T12:46:00.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.778+0000 7f97ac935700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97a806f7b0 0x7f97a81501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:00.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.778+0000 7f97ac935700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97a806f7b0 0x7f97a81501a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36062/0 (socket says 172.21.15.45:36062) 2023-10-08T12:46:00.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.778+0000 7f97ac935700 1 -- 172.21.15.45:0/17940802 learned_addr learned my addr 172.21.15.45:0/17940802 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:00.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.778+0000 7f97a7fff700 1 --2- 172.21.15.45:0/17940802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a80c9b90 0x7f97a8098760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:00.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.778+0000 7f97ad136700 1 --2- 172.21.15.45:0/17940802 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97a815bf50 0x7f97a8098ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:00.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.778+0000 7f97ac935700 1 -- 172.21.15.45:0/17940802 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97a815bf50 msgr2=0x7f97a8098ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:00.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.778+0000 7f97ac935700 1 --2- 172.21.15.45:0/17940802 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97a815bf50 0x7f97a8098ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:00.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.778+0000 7f97ac935700 1 -- 172.21.15.45:0/17940802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a80c9b90 msgr2=0x7f97a8098760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:00.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.778+0000 7f97ac935700 1 --2- 172.21.15.45:0/17940802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a80c9b90 0x7f97a8098760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:00.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.778+0000 7f97ac935700 1 -- 172.21.15.45:0/17940802 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979c009520 con 0x7f97a806f7b0 2023-10-08T12:46:00.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.778+0000 7f97ad136700 1 --2- 172.21.15.45:0/17940802 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97a815bf50 0x7f97a8098ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:00.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.778+0000 7f97ac935700 1 --2- 172.21.15.45:0/17940802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97a806f7b0 0x7f97a81501a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f97a806f460 tx=0x7f979c00f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:00.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.778+0000 7f97a57fa700 1 -- 172.21.15.45:0/17940802 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c01b070 con 0x7f97a806f7b0 2023-10-08T12:46:00.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.778+0000 7f97aeb99700 1 -- 172.21.15.45:0/17940802 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a806dc50 con 0x7f97a806f7b0 2023-10-08T12:46:00.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.778+0000 7f97a57fa700 1 -- 172.21.15.45:0/17940802 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f979c00f9b0 con 0x7f97a806f7b0 2023-10-08T12:46:00.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.778+0000 7f97a57fa700 1 -- 172.21.15.45:0/17940802 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c00fde0 con 0x7f97a806f7b0 2023-10-08T12:46:00.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.779+0000 7f97aeb99700 1 -- 172.21.15.45:0/17940802 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a80afa50 con 0x7f97a806f7b0 2023-10-08T12:46:00.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.780+0000 7f97a57fa700 1 -- 172.21.15.45:0/17940802 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f979c02a400 con 0x7f97a806f7b0 2023-10-08T12:46:00.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.780+0000 7f97aeb99700 1 -- 172.21.15.45:0/17940802 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a809c7d0 con 0x7f97a806f7b0 2023-10-08T12:46:00.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.780+0000 7f97a57fa700 1 --2- 172.21.15.45:0/17940802 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f978c06aed0 0x7f978c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:00.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.780+0000 7f97a57fa700 1 -- 172.21.15.45:0/17940802 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f979c08b1d0 con 0x7f97a806f7b0 2023-10-08T12:46:00.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.780+0000 7f97a7fff700 1 --2- 172.21.15.45:0/17940802 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f978c06aed0 0x7f978c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:00.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.781+0000 7f97a7fff700 1 --2- 172.21.15.45:0/17940802 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f978c06aed0 0x7f978c06d390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f97a8159680 tx=0x7f9794009260 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:00.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.785+0000 7f97a57fa700 1 -- 172.21.15.45:0/17940802 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f979c0563b0 con 0x7f97a806f7b0 2023-10-08T12:46:00.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.984+0000 7f97aeb99700 1 -- 172.21.15.45:0/17940802 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f97a8066850 con 0x7f97a806f7b0 2023-10-08T12:46:00.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.984+0000 7f97a57fa700 1 -- 172.21.15.45:0/17940802 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f979c0599d0 con 0x7f97a806f7b0 2023-10-08T12:46:00.985 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-08T12:46:00.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.986+0000 7f97aeb99700 1 -- 172.21.15.45:0/17940802 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f978c06aed0 msgr2=0x7f978c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:00.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.986+0000 7f97aeb99700 1 --2- 172.21.15.45:0/17940802 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f978c06aed0 0x7f978c06d390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f97a8159680 tx=0x7f9794009260 comp rx=0 tx=0).stop 2023-10-08T12:46:00.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.986+0000 7f97aeb99700 1 -- 172.21.15.45:0/17940802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97a806f7b0 msgr2=0x7f97a81501a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:00.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.986+0000 7f97aeb99700 1 --2- 172.21.15.45:0/17940802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97a806f7b0 0x7f97a81501a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f97a806f460 tx=0x7f979c00f710 comp rx=0 tx=0).stop 2023-10-08T12:46:00.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.987+0000 7f97aeb99700 1 -- 172.21.15.45:0/17940802 shutdown_connections 2023-10-08T12:46:00.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.987+0000 7f97aeb99700 1 --2- 172.21.15.45:0/17940802 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f978c06aed0 0x7f978c06d390 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:00.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.987+0000 7f97aeb99700 1 --2- 172.21.15.45:0/17940802 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97a815bf50 0x7f97a8098ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:00.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.987+0000 7f97aeb99700 1 --2- 172.21.15.45:0/17940802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97a806f7b0 0x7f97a81501a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:00.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.987+0000 7f97aeb99700 1 --2- 172.21.15.45:0/17940802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97a80c9b90 0x7f97a8098760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:00.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.987+0000 7f97aeb99700 1 -- 172.21.15.45:0/17940802 >> 172.21.15.45:0/17940802 conn(0x7f97a8097a20 msgr2=0x7f97a815b180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:00.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.987+0000 7f97aeb99700 1 -- 172.21.15.45:0/17940802 shutdown_connections 2023-10-08T12:46:00.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:00.987+0000 7f97aeb99700 1 -- 172.21.15.45:0/17940802 wait complete. 2023-10-08T12:46:01.000 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-10-08T12:46:01.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.127+0000 7f7ef70c7700 1 -- 172.21.15.45:0/1260596426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ef00cdf60 msgr2=0x7f7ef015c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:01.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.127+0000 7f7ef70c7700 1 --2- 172.21.15.45:0/1260596426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ef00cdf60 0x7f7ef015c320 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7edc0098c0 tx=0x7f7edc009bd0 comp rx=0 tx=0).stop 2023-10-08T12:46:01.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.127+0000 7f7ef70c7700 1 -- 172.21.15.45:0/1260596426 shutdown_connections 2023-10-08T12:46:01.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.127+0000 7f7ef70c7700 1 --2- 172.21.15.45:0/1260596426 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7ef00c9ff0 0x7f7ef00ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:01.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.127+0000 7f7ef70c7700 1 --2- 172.21.15.45:0/1260596426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ef00cdf60 0x7f7ef015c320 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:01.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.127+0000 7f7ef70c7700 1 -- 172.21.15.45:0/1260596426 >> 172.21.15.45:0/1260596426 conn(0x7f7ef00b0430 msgr2=0x7f7ef00b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:01.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.127+0000 7f7ef70c7700 1 -- 172.21.15.45:0/1260596426 shutdown_connections 2023-10-08T12:46:01.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.127+0000 7f7ef70c7700 1 -- 172.21.15.45:0/1260596426 wait complete. 2023-10-08T12:46:01.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.128+0000 7f7ef70c7700 1 Processor -- start 2023-10-08T12:46:01.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.128+0000 7f7ef70c7700 1 -- start start 2023-10-08T12:46:01.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.129+0000 7f7ef70c7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ef00c9ff0 0x7f7ef01f2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:01.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.129+0000 7f7ef70c7700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7ef00cdf60 0x7f7ef00c5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:01.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.129+0000 7f7ef70c7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ef0158950 0x7f7ef00c5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:01.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.129+0000 7f7ef70c7700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef01f2fb0 con 0x7f7ef0158950 2023-10-08T12:46:01.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.129+0000 7f7ef70c7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef01e2c30 con 0x7f7ef00c9ff0 2023-10-08T12:46:01.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.129+0000 7f7ef70c7700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef01e2ed0 con 0x7f7ef00cdf60 2023-10-08T12:46:01.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.129+0000 7f7ef5664700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ef0158950 0x7f7ef00c5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:01.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.129+0000 7f7ef5664700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ef0158950 0x7f7ef00c5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36080/0 (socket says 172.21.15.45:36080) 2023-10-08T12:46:01.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.129+0000 7f7ef5664700 1 -- 172.21.15.45:0/2345063813 learned_addr learned my addr 172.21.15.45:0/2345063813 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:01.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.129+0000 7f7ef4e63700 1 --2- 172.21.15.45:0/2345063813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ef00c9ff0 0x7f7ef01f2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:01.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.129+0000 7f7eeffff700 1 --2- 172.21.15.45:0/2345063813 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7ef00cdf60 0x7f7ef00c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:01.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.129+0000 7f7ef5664700 1 -- 172.21.15.45:0/2345063813 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7ef00cdf60 msgr2=0x7f7ef00c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:01.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.129+0000 7f7ef5664700 1 --2- 172.21.15.45:0/2345063813 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7ef00cdf60 0x7f7ef00c5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:01.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.129+0000 7f7ef5664700 1 -- 172.21.15.45:0/2345063813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ef00c9ff0 msgr2=0x7f7ef01f2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:01.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.129+0000 7f7ef5664700 1 --2- 172.21.15.45:0/2345063813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ef00c9ff0 0x7f7ef01f2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:01.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.129+0000 7f7ef5664700 1 -- 172.21.15.45:0/2345063813 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7edc009520 con 0x7f7ef0158950 2023-10-08T12:46:01.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.129+0000 7f7ef5664700 1 --2- 172.21.15.45:0/2345063813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ef0158950 0x7f7ef00c5e70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8007d70 tx=0x7f7ee800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:01.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.130+0000 7f7eed7fa700 1 -- 172.21.15.45:0/2345063813 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee800ad40 con 0x7f7ef0158950 2023-10-08T12:46:01.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.130+0000 7f7eed7fa700 1 -- 172.21.15.45:0/2345063813 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7ee8012420 con 0x7f7ef0158950 2023-10-08T12:46:01.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.130+0000 7f7eed7fa700 1 -- 172.21.15.45:0/2345063813 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8012830 con 0x7f7ef0158950 2023-10-08T12:46:01.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.130+0000 7f7ef70c7700 1 -- 172.21.15.45:0/2345063813 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef01e31b0 con 0x7f7ef0158950 2023-10-08T12:46:01.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.130+0000 7f7ef70c7700 1 -- 172.21.15.45:0/2345063813 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef01e3770 con 0x7f7ef0158950 2023-10-08T12:46:01.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.131+0000 7f7ef70c7700 1 -- 172.21.15.45:0/2345063813 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef01e3990 con 0x7f7ef0158950 2023-10-08T12:46:01.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.131+0000 7f7eed7fa700 1 -- 172.21.15.45:0/2345063813 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7ee801b400 con 0x7f7ef0158950 2023-10-08T12:46:01.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.131+0000 7f7eed7fa700 1 --2- 172.21.15.45:0/2345063813 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f7ed406aed0 0x7f7ed406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:01.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.132+0000 7f7eed7fa700 1 -- 172.21.15.45:0/2345063813 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ee808a0e0 con 0x7f7ef0158950 2023-10-08T12:46:01.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.132+0000 7f7ef4e63700 1 --2- 172.21.15.45:0/2345063813 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f7ed406aed0 0x7f7ed406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:01.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.132+0000 7f7ef4e63700 1 --2- 172.21.15.45:0/2345063813 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f7ed406aed0 0x7f7ed406d390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4000f60 tx=0x7f7ee4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:01.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.136+0000 7f7eed7fa700 1 -- 172.21.15.45:0/2345063813 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7ee8055190 con 0x7f7ef0158950 2023-10-08T12:46:01.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:01.418+0000 7f7ef70c7700 1 -- 172.21.15.45:0/2345063813 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f7ef004e4c0 con 0x7f7ef0158950 2023-10-08T12:46:02.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.367+0000 7f7eed7fa700 1 -- 172.21.15.45:0/2345063813 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v50) v1 ==== 147+0+0 (secure 0 0 0) 0x7f7ee80587b0 con 0x7f7ef0158950 2023-10-08T12:46:02.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.370+0000 7f7ef70c7700 1 -- 172.21.15.45:0/2345063813 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f7ed406aed0 msgr2=0x7f7ed406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:02.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.370+0000 7f7ef70c7700 1 --2- 172.21.15.45:0/2345063813 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f7ed406aed0 0x7f7ed406d390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4000f60 tx=0x7f7ee4009040 comp rx=0 tx=0).stop 2023-10-08T12:46:02.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.370+0000 7f7ef70c7700 1 -- 172.21.15.45:0/2345063813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ef0158950 msgr2=0x7f7ef00c5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:02.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.370+0000 7f7ef70c7700 1 --2- 172.21.15.45:0/2345063813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ef0158950 0x7f7ef00c5e70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8007d70 tx=0x7f7ee800a340 comp rx=0 tx=0).stop 2023-10-08T12:46:02.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.370+0000 7f7ef70c7700 1 -- 172.21.15.45:0/2345063813 shutdown_connections 2023-10-08T12:46:02.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.370+0000 7f7ef70c7700 1 --2- 172.21.15.45:0/2345063813 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f7ed406aed0 0x7f7ed406d390 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:02.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.370+0000 7f7ef70c7700 1 --2- 172.21.15.45:0/2345063813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ef0158950 0x7f7ef00c5e70 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:02.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.370+0000 7f7ef70c7700 1 --2- 172.21.15.45:0/2345063813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ef00c9ff0 0x7f7ef01f2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:02.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.370+0000 7f7ef70c7700 1 --2- 172.21.15.45:0/2345063813 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7ef00cdf60 0x7f7ef00c5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:02.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.370+0000 7f7ef70c7700 1 -- 172.21.15.45:0/2345063813 >> 172.21.15.45:0/2345063813 conn(0x7f7ef00b0430 msgr2=0x7f7ef015c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:02.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.370+0000 7f7ef70c7700 1 -- 172.21.15.45:0/2345063813 shutdown_connections 2023-10-08T12:46:02.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.370+0000 7f7ef70c7700 1 -- 172.21.15.45:0/2345063813 wait complete. 2023-10-08T12:46:02.386 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2023-10-08T12:46:02.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.523+0000 7fdaaff60700 1 -- 172.21.15.45:0/1024689511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaa815c320 msgr2=0x7fdaa8071f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:02.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.523+0000 7fdaaff60700 1 --2- 172.21.15.45:0/1024689511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaa815c320 0x7fdaa8071f80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80cf960 tx=0x7fda9c009c70 comp rx=0 tx=0).stop 2023-10-08T12:46:02.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.523+0000 7fdaaff60700 1 -- 172.21.15.45:0/1024689511 shutdown_connections 2023-10-08T12:46:02.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.523+0000 7fdaaff60700 1 --2- 172.21.15.45:0/1024689511 >> v2:172.21.15.78:3300/0 conn(0x7fdaa8158950 0x7fdaa80cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:02.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.523+0000 7fdaaff60700 1 --2- 172.21.15.45:0/1024689511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaa815c320 0x7fdaa8071f80 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:02.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.523+0000 7fdaaff60700 1 -- 172.21.15.45:0/1024689511 >> 172.21.15.45:0/1024689511 conn(0x7fdaa80b0430 msgr2=0x7fdaa80b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:02.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.524+0000 7fdaaff60700 1 -- 172.21.15.45:0/1024689511 shutdown_connections 2023-10-08T12:46:02.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.524+0000 7fdaaff60700 1 -- 172.21.15.45:0/1024689511 wait complete. 2023-10-08T12:46:02.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.525+0000 7fdaaff60700 1 Processor -- start 2023-10-08T12:46:02.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.525+0000 7fdaaff60700 1 -- start start 2023-10-08T12:46:02.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.525+0000 7fdaaff60700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdaa80724c0 0x7fdaa80c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:02.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.525+0000 7fdaaff60700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdaa8158950 0x7fdaa806a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:02.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.525+0000 7fdaaff60700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaa815c320 0x7fdaa806a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:02.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.525+0000 7fdaaff60700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa814e860 con 0x7fdaa815c320 2023-10-08T12:46:02.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.526+0000 7fdaaff60700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa80ad250 con 0x7fdaa80724c0 2023-10-08T12:46:02.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.526+0000 7fdaaff60700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa80ac1b0 con 0x7fdaa8158950 2023-10-08T12:46:02.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.526+0000 7fdaae4fd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaa815c320 0x7fdaa806a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:02.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.526+0000 7fdaae4fd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaa815c320 0x7fdaa806a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36094/0 (socket says 172.21.15.45:36094) 2023-10-08T12:46:02.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.526+0000 7fdaae4fd700 1 -- 172.21.15.45:0/3383133106 learned_addr learned my addr 172.21.15.45:0/3383133106 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:02.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.526+0000 7fdaadcfc700 1 --2- 172.21.15.45:0/3383133106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdaa80724c0 0x7fdaa80c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:02.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.526+0000 7fdaad4fb700 1 --2- 172.21.15.45:0/3383133106 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdaa8158950 0x7fdaa806a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:02.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.526+0000 7fdaae4fd700 1 -- 172.21.15.45:0/3383133106 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdaa8158950 msgr2=0x7fdaa806a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:02.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.526+0000 7fdaae4fd700 1 --2- 172.21.15.45:0/3383133106 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdaa8158950 0x7fdaa806a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:02.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.526+0000 7fdaae4fd700 1 -- 172.21.15.45:0/3383133106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdaa80724c0 msgr2=0x7fdaa80c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:02.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.526+0000 7fdaae4fd700 1 --2- 172.21.15.45:0/3383133106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdaa80724c0 0x7fdaa80c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:02.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.526+0000 7fdaae4fd700 1 -- 172.21.15.45:0/3383133106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c0095f0 con 0x7fdaa815c320 2023-10-08T12:46:02.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.526+0000 7fdaae4fd700 1 --2- 172.21.15.45:0/3383133106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaa815c320 0x7fdaa806a750 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdaa000c7a0 tx=0x7fdaa000cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:02.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.526+0000 7fda9a7fc700 1 -- 172.21.15.45:0/3383133106 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0003e10 con 0x7fdaa815c320 2023-10-08T12:46:02.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.526+0000 7fda9a7fc700 1 -- 172.21.15.45:0/3383133106 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdaa0005180 con 0x7fdaa815c320 2023-10-08T12:46:02.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.526+0000 7fdaaff60700 1 -- 172.21.15.45:0/3383133106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa80ac490 con 0x7fdaa815c320 2023-10-08T12:46:02.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.526+0000 7fda9a7fc700 1 -- 172.21.15.45:0/3383133106 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0005590 con 0x7fdaa815c320 2023-10-08T12:46:02.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.526+0000 7fdaaff60700 1 -- 172.21.15.45:0/3383133106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa80aca50 con 0x7fdaa815c320 2023-10-08T12:46:02.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.527+0000 7fdaaff60700 1 -- 172.21.15.45:0/3383133106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa804e4c0 con 0x7fdaa815c320 2023-10-08T12:46:02.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.528+0000 7fda9a7fc700 1 -- 172.21.15.45:0/3383133106 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdaa00056f0 con 0x7fdaa815c320 2023-10-08T12:46:02.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.528+0000 7fda9a7fc700 1 --2- 172.21.15.45:0/3383133106 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fda8c06aed0 0x7fda8c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:02.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.528+0000 7fda9a7fc700 1 -- 172.21.15.45:0/3383133106 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdaa0088fe0 con 0x7fdaa815c320 2023-10-08T12:46:02.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.528+0000 7fdaadcfc700 1 --2- 172.21.15.45:0/3383133106 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fda8c06aed0 0x7fda8c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:02.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.529+0000 7fdaadcfc700 1 --2- 172.21.15.45:0/3383133106 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fda8c06aed0 0x7fda8c06d390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4005950 tx=0x7fdaa4005eb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:02.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.533+0000 7fda9a7fc700 1 -- 172.21.15.45:0/3383133106 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdaa0054010 con 0x7fdaa815c320 2023-10-08T12:46:02.619 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:46:02.621 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:46:02.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.735+0000 7fdaaff60700 1 -- 172.21.15.45:0/3383133106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config dump"} v 0) v1 -- 0x7fdaa80b12a0 con 0x7fdaa815c320 2023-10-08T12:46:02.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.736+0000 7fda9a7fc700 1 -- 172.21.15.45:0/3383133106 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v30) v1 ==== 59+0+2220 (secure 0 0 0) 0x7fdaa0017020 con 0x7fdaa815c320 2023-10-08T12:46:02.737 INFO:teuthology.orchestra.run.smithi045.stdout:WHO MASK LEVEL OPTION VALUE RO 2023-10-08T12:46:02.737 INFO:teuthology.orchestra.run.smithi045.stdout:mon advanced mon_op_complaint_time 120 2023-10-08T12:46:02.737 INFO:teuthology.orchestra.run.smithi045.stdout:osd advanced osd_op_complaint_time 180.000000 2023-10-08T12:46:02.737 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 6115.625190 2023-10-08T12:46:02.737 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 6063.340296 2023-10-08T12:46:02.737 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 6044.666531 2023-10-08T12:46:02.737 INFO:teuthology.orchestra.run.smithi045.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 6184.513144 2023-10-08T12:46:02.737 INFO:teuthology.orchestra.run.smithi045.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 5693.462207 2023-10-08T12:46:02.737 INFO:teuthology.orchestra.run.smithi045.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 6439.751490 2023-10-08T12:46:02.738 INFO:teuthology.orchestra.run.smithi045.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 6430.501939 2023-10-08T12:46:02.738 INFO:teuthology.orchestra.run.smithi045.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 6046.334866 2023-10-08T12:46:02.738 INFO:teuthology.orchestra.run.smithi045.stdout:mds advanced debug_mds 20/20 2023-10-08T12:46:02.738 INFO:teuthology.orchestra.run.smithi045.stdout:mds advanced debug_mds_balancer 20/20 2023-10-08T12:46:02.738 INFO:teuthology.orchestra.run.smithi045.stdout:mds advanced debug_ms 1/1 2023-10-08T12:46:02.738 INFO:teuthology.orchestra.run.smithi045.stdout:mds advanced mds_bal_fragment_size_max 10000 2023-10-08T12:46:02.738 INFO:teuthology.orchestra.run.smithi045.stdout:mds advanced mds_bal_merge_size 5 2023-10-08T12:46:02.738 INFO:teuthology.orchestra.run.smithi045.stdout:mds advanced mds_bal_split_bits 3 2023-10-08T12:46:02.738 INFO:teuthology.orchestra.run.smithi045.stdout:mds advanced mds_bal_split_size 100 2023-10-08T12:46:02.738 INFO:teuthology.orchestra.run.smithi045.stdout:mds dev mds_debug_frag true 2023-10-08T12:46:02.738 INFO:teuthology.orchestra.run.smithi045.stdout:mds dev mds_debug_scatterstat true 2023-10-08T12:46:02.738 INFO:teuthology.orchestra.run.smithi045.stdout:mds advanced mds_op_complaint_time 180.000000 2023-10-08T12:46:02.739 INFO:teuthology.orchestra.run.smithi045.stdout:mds dev mds_verify_scatter true 2023-10-08T12:46:02.739 INFO:teuthology.orchestra.run.smithi045.stdout:mds advanced osd_op_complaint_time 180.000000 2023-10-08T12:46:02.739 INFO:teuthology.orchestra.run.smithi045.stdout:mds advanced rados_mon_op_timeout 900 2023-10-08T12:46:02.739 INFO:teuthology.orchestra.run.smithi045.stdout:mds advanced rados_osd_op_timeout 900 2023-10-08T12:46:02.739 INFO:teuthology.orchestra.run.smithi045.stdout:client advanced client_mount_timeout 600 2023-10-08T12:46:02.739 INFO:teuthology.orchestra.run.smithi045.stdout:client advanced debug_client 20/20 2023-10-08T12:46:02.739 INFO:teuthology.orchestra.run.smithi045.stdout:client advanced debug_ms 1/1 2023-10-08T12:46:02.739 INFO:teuthology.orchestra.run.smithi045.stdout:client advanced rados_mon_op_timeout 900 2023-10-08T12:46:02.739 INFO:teuthology.orchestra.run.smithi045.stdout:client advanced rados_osd_op_timeout 900 2023-10-08T12:46:02.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.738+0000 7fdaaff60700 1 -- 172.21.15.45:0/3383133106 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fda8c06aed0 msgr2=0x7fda8c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:02.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.738+0000 7fdaaff60700 1 --2- 172.21.15.45:0/3383133106 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fda8c06aed0 0x7fda8c06d390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4005950 tx=0x7fdaa4005eb0 comp rx=0 tx=0).stop 2023-10-08T12:46:02.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.738+0000 7fdaaff60700 1 -- 172.21.15.45:0/3383133106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaa815c320 msgr2=0x7fdaa806a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:02.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.738+0000 7fdaaff60700 1 --2- 172.21.15.45:0/3383133106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaa815c320 0x7fdaa806a750 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdaa000c7a0 tx=0x7fdaa000cb60 comp rx=0 tx=0).stop 2023-10-08T12:46:02.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.738+0000 7fdaaff60700 1 -- 172.21.15.45:0/3383133106 shutdown_connections 2023-10-08T12:46:02.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.738+0000 7fdaaff60700 1 --2- 172.21.15.45:0/3383133106 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fda8c06aed0 0x7fda8c06d390 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:02.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.738+0000 7fdaaff60700 1 --2- 172.21.15.45:0/3383133106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaa815c320 0x7fdaa806a750 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:02.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.738+0000 7fdaaff60700 1 --2- 172.21.15.45:0/3383133106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdaa80724c0 0x7fdaa80c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:02.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.738+0000 7fdaaff60700 1 --2- 172.21.15.45:0/3383133106 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdaa8158950 0x7fdaa806a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:02.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.738+0000 7fdaaff60700 1 -- 172.21.15.45:0/3383133106 >> 172.21.15.45:0/3383133106 conn(0x7fdaa80b0430 msgr2=0x7fdaa80b34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:02.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.738+0000 7fdaaff60700 1 -- 172.21.15.45:0/3383133106 shutdown_connections 2023-10-08T12:46:02.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.738+0000 7fdaaff60700 1 -- 172.21.15.45:0/3383133106 wait complete. 2023-10-08T12:46:02.751 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T12:46:02.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.881+0000 7f007bc99700 1 -- 172.21.15.45:0/518856099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0060003fb0 msgr2=0x7f0060004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:02.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.881+0000 7f007bc99700 1 --2- 172.21.15.45:0/518856099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0060003fb0 0x7f0060004850 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f006400c2e0 tx=0x7f0060005880 comp rx=0 tx=0).stop 2023-10-08T12:46:02.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.881+0000 7f007a236700 1 -- 172.21.15.45:0/518856099 reap_dead start 2023-10-08T12:46:02.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.881+0000 7f007bc99700 1 -- 172.21.15.45:0/518856099 shutdown_connections 2023-10-08T12:46:02.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.881+0000 7f007bc99700 1 -- 172.21.15.45:0/518856099 >> 172.21.15.45:0/518856099 conn(0x7f007406b320 msgr2=0x7f007406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:02.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.881+0000 7f007bc99700 1 -- 172.21.15.45:0/518856099 shutdown_connections 2023-10-08T12:46:02.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.881+0000 7f007bc99700 1 -- 172.21.15.45:0/518856099 wait complete. 2023-10-08T12:46:02.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.882+0000 7f007bc99700 1 Processor -- start 2023-10-08T12:46:02.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.883+0000 7f007bc99700 1 -- start start 2023-10-08T12:46:02.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.883+0000 7f007bc99700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0060003fb0 0x7f0074145ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:02.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.883+0000 7f007bc99700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f00740c8430 0x7f00741484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:02.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.884+0000 7f007bc99700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0074148a30 0x7f00740b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:02.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.884+0000 7f007bc99700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00741461e0 con 0x7f0060003fb0 2023-10-08T12:46:02.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.884+0000 7f007bc99700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00740c9850 con 0x7f0074148a30 2023-10-08T12:46:02.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.884+0000 7f007bc99700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00740c7fa0 con 0x7f00740c8430 2023-10-08T12:46:02.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.884+0000 7f0079a35700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0060003fb0 0x7f0074145ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:02.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.884+0000 7f0079a35700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0060003fb0 0x7f0074145ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36110/0 (socket says 172.21.15.45:36110) 2023-10-08T12:46:02.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.884+0000 7f0079a35700 1 -- 172.21.15.45:0/2795379117 learned_addr learned my addr 172.21.15.45:0/2795379117 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:02.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.884+0000 7f0079234700 1 --2- 172.21.15.45:0/2795379117 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f00740c8430 0x7f00741484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:02.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.884+0000 7f007a236700 1 --2- 172.21.15.45:0/2795379117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0074148a30 0x7f00740b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:02.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.884+0000 7f0079a35700 1 -- 172.21.15.45:0/2795379117 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f00740c8430 msgr2=0x7f00741484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:02.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.884+0000 7f0079a35700 1 --2- 172.21.15.45:0/2795379117 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f00740c8430 0x7f00741484f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:02.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.884+0000 7f0079a35700 1 -- 172.21.15.45:0/2795379117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0074148a30 msgr2=0x7f00740b19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:02.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.884+0000 7f0079a35700 1 --2- 172.21.15.45:0/2795379117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0074148a30 0x7f00740b19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:02.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.884+0000 7f0079a35700 1 -- 172.21.15.45:0/2795379117 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0074148f40 con 0x7f0060003fb0 2023-10-08T12:46:02.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.884+0000 7f007a236700 1 --2- 172.21.15.45:0/2795379117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0074148a30 0x7f00740b19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:46:02.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.884+0000 7f0079a35700 1 --2- 172.21.15.45:0/2795379117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0060003fb0 0x7f0074145ca0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0070011ae0 tx=0x7f0070011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:02.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.884+0000 7f006a7fc700 1 -- 172.21.15.45:0/2795379117 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007000fb20 con 0x7f0060003fb0 2023-10-08T12:46:02.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.884+0000 7f006a7fc700 1 -- 172.21.15.45:0/2795379117 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f007000fc80 con 0x7f0060003fb0 2023-10-08T12:46:02.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.884+0000 7f007bc99700 1 -- 172.21.15.45:0/2795379117 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0074149220 con 0x7f0060003fb0 2023-10-08T12:46:02.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.884+0000 7f006a7fc700 1 -- 172.21.15.45:0/2795379117 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0070004020 con 0x7f0060003fb0 2023-10-08T12:46:02.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.884+0000 7f007bc99700 1 -- 172.21.15.45:0/2795379117 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0074152680 con 0x7f0060003fb0 2023-10-08T12:46:02.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.885+0000 7f007bc99700 1 -- 172.21.15.45:0/2795379117 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0074152810 con 0x7f0060003fb0 2023-10-08T12:46:02.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.886+0000 7f006a7fc700 1 -- 172.21.15.45:0/2795379117 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0070004180 con 0x7f0060003fb0 2023-10-08T12:46:02.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.886+0000 7f006a7fc700 1 --2- 172.21.15.45:0/2795379117 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f005806aed0 0x7f005806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:02.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.886+0000 7f006a7fc700 1 -- 172.21.15.45:0/2795379117 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0070089f70 con 0x7f0060003fb0 2023-10-08T12:46:02.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.886+0000 7f0079234700 1 --2- 172.21.15.45:0/2795379117 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f005806aed0 0x7f005806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:02.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.887+0000 7f0079234700 1 --2- 172.21.15.45:0/2795379117 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f005806aed0 0x7f005806d390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0064000c00 tx=0x7f006400f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:02.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:02.891+0000 7f006a7fc700 1 -- 172.21.15.45:0/2795379117 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f00700bcca0 con 0x7f0060003fb0 2023-10-08T12:46:03.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.090+0000 7f007bc99700 1 -- 172.21.15.45:0/2795379117 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0074149460 con 0x7f0060003fb0 2023-10-08T12:46:03.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.093+0000 7f006a7fc700 1 -- 172.21.15.45:0/2795379117 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v31)=0 v31) v1 ==== 122+0+0 (secure 0 0 0) 0x7f00700550e0 con 0x7f0060003fb0 2023-10-08T12:46:03.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.095+0000 7f007bc99700 1 -- 172.21.15.45:0/2795379117 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f005806aed0 msgr2=0x7f005806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:03.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.095+0000 7f007bc99700 1 --2- 172.21.15.45:0/2795379117 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f005806aed0 0x7f005806d390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0064000c00 tx=0x7f006400f000 comp rx=0 tx=0).stop 2023-10-08T12:46:03.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.095+0000 7f007bc99700 1 -- 172.21.15.45:0/2795379117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0060003fb0 msgr2=0x7f0074145ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:03.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.095+0000 7f007bc99700 1 --2- 172.21.15.45:0/2795379117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0060003fb0 0x7f0074145ca0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0070011ae0 tx=0x7f0070011ea0 comp rx=0 tx=0).stop 2023-10-08T12:46:03.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.095+0000 7f007bc99700 1 -- 172.21.15.45:0/2795379117 shutdown_connections 2023-10-08T12:46:03.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.095+0000 7f007bc99700 1 --2- 172.21.15.45:0/2795379117 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f005806aed0 0x7f005806d390 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:03.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.095+0000 7f007bc99700 1 --2- 172.21.15.45:0/2795379117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0074148a30 0x7f00740b19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:03.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.095+0000 7f007bc99700 1 --2- 172.21.15.45:0/2795379117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0060003fb0 0x7f0074145ca0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:03.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.095+0000 7f007bc99700 1 --2- 172.21.15.45:0/2795379117 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f00740c8430 0x7f00741484f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:03.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.095+0000 7f007bc99700 1 -- 172.21.15.45:0/2795379117 >> 172.21.15.45:0/2795379117 conn(0x7f007406b320 msgr2=0x7f00740b0500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:03.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.095+0000 7f007bc99700 1 -- 172.21.15.45:0/2795379117 shutdown_connections 2023-10-08T12:46:03.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.095+0000 7f007bc99700 1 -- 172.21.15.45:0/2795379117 wait complete. 2023-10-08T12:46:03.108 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T12:46:03.108 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T12:46:03.153 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T12:46:03.198 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T12:46:03.198 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:46:03.198 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T12:46:03.216 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:46:03.217 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T12:46:03.274 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:46:03.274 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T12:46:03.331 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:46:03.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.497+0000 7f3b2d77c700 1 -- 172.21.15.45:0/611891285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b10004850 msgr2=0x7f3b10004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:03.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.497+0000 7f3b2d77c700 1 --2- 172.21.15.45:0/611891285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b10004850 0x7f3b10004cd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3b18009bc0 tx=0x7f3b10005880 comp rx=0 tx=0).stop 2023-10-08T12:46:03.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.497+0000 7f3b277fe700 1 -- 172.21.15.45:0/611891285 reap_dead start 2023-10-08T12:46:03.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.497+0000 7f3b2d77c700 1 -- 172.21.15.45:0/611891285 shutdown_connections 2023-10-08T12:46:03.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.497+0000 7f3b2d77c700 1 -- 172.21.15.45:0/611891285 >> 172.21.15.45:0/611891285 conn(0x7f3b28071940 msgr2=0x7f3b28071d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:03.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.497+0000 7f3b2d77c700 1 -- 172.21.15.45:0/611891285 shutdown_connections 2023-10-08T12:46:03.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.497+0000 7f3b2d77c700 1 -- 172.21.15.45:0/611891285 wait complete. 2023-10-08T12:46:03.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.499+0000 7f3b2d77c700 1 Processor -- start 2023-10-08T12:46:03.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.499+0000 7f3b2d77c700 1 -- start start 2023-10-08T12:46:03.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.500+0000 7f3b2d77c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b10004850 0x7f3b2814cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:03.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.500+0000 7f3b2d77c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b281501c0 0x7f3b28150640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:03.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.500+0000 7f3b2d77c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b2814dc90 0x7f3b2814e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:03.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.500+0000 7f3b2d77c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b28150b80 con 0x7f3b10004850 2023-10-08T12:46:03.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.500+0000 7f3b2d77c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2814e9a0 con 0x7f3b2814dc90 2023-10-08T12:46:03.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.500+0000 7f3b2d77c700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2814ec80 con 0x7f3b281501c0 2023-10-08T12:46:03.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.500+0000 7f3b26ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b10004850 0x7f3b2814cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:03.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.500+0000 7f3b26ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b10004850 0x7f3b2814cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36130/0 (socket says 172.21.15.45:36130) 2023-10-08T12:46:03.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.500+0000 7f3b26ffd700 1 -- 172.21.15.45:0/2136112040 learned_addr learned my addr 172.21.15.45:0/2136112040 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:03.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.500+0000 7f3b267fc700 1 --2- 172.21.15.45:0/2136112040 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b281501c0 0x7f3b28150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:03.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.500+0000 7f3b277fe700 1 --2- 172.21.15.45:0/2136112040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b2814dc90 0x7f3b2814e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:03.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.500+0000 7f3b26ffd700 1 -- 172.21.15.45:0/2136112040 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b281501c0 msgr2=0x7f3b28150640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:03.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.500+0000 7f3b26ffd700 1 --2- 172.21.15.45:0/2136112040 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b281501c0 0x7f3b28150640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:03.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.500+0000 7f3b26ffd700 1 -- 172.21.15.45:0/2136112040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b2814dc90 msgr2=0x7f3b2814e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:03.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.500+0000 7f3b26ffd700 1 --2- 172.21.15.45:0/2136112040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b2814dc90 0x7f3b2814e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:03.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.500+0000 7f3b26ffd700 1 -- 172.21.15.45:0/2136112040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2814ef60 con 0x7f3b10004850 2023-10-08T12:46:03.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.500+0000 7f3b267fc700 1 --2- 172.21.15.45:0/2136112040 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b281501c0 0x7f3b28150640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:03.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.500+0000 7f3b277fe700 1 --2- 172.21.15.45:0/2136112040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b2814dc90 0x7f3b2814e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:03.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.500+0000 7f3b26ffd700 1 --2- 172.21.15.45:0/2136112040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b10004850 0x7f3b2814cd60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c0066b0 tx=0x7f3b1c003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:03.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.500+0000 7f3b0f7fe700 1 -- 172.21.15.45:0/2136112040 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c011840 con 0x7f3b10004850 2023-10-08T12:46:03.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.500+0000 7f3b0f7fe700 1 -- 172.21.15.45:0/2136112040 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3b1c0119c0 con 0x7f3b10004850 2023-10-08T12:46:03.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.500+0000 7f3b2d77c700 1 -- 172.21.15.45:0/2136112040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b2814f240 con 0x7f3b10004850 2023-10-08T12:46:03.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.500+0000 7f3b0f7fe700 1 -- 172.21.15.45:0/2136112040 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c011dd0 con 0x7f3b10004850 2023-10-08T12:46:03.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.500+0000 7f3b2d77c700 1 -- 172.21.15.45:0/2136112040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b2814e660 con 0x7f3b10004850 2023-10-08T12:46:03.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.501+0000 7f3b2d77c700 1 -- 172.21.15.45:0/2136112040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b2804e4c0 con 0x7f3b10004850 2023-10-08T12:46:03.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.502+0000 7f3b0f7fe700 1 -- 172.21.15.45:0/2136112040 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3b1c0103c0 con 0x7f3b10004850 2023-10-08T12:46:03.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.502+0000 7f3b0f7fe700 1 --2- 172.21.15.45:0/2136112040 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3b1406aed0 0x7f3b1406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:03.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.502+0000 7f3b0f7fe700 1 -- 172.21.15.45:0/2136112040 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b1c08a530 con 0x7f3b10004850 2023-10-08T12:46:03.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.502+0000 7f3b267fc700 1 --2- 172.21.15.45:0/2136112040 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3b1406aed0 0x7f3b1406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:03.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.503+0000 7f3b267fc700 1 --2- 172.21.15.45:0/2136112040 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3b1406aed0 0x7f3b1406d390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3b18009ae0 tx=0x7f3b18004750 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:03.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.507+0000 7f3b0f7fe700 1 -- 172.21.15.45:0/2136112040 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3b1c0555e0 con 0x7f3b10004850 2023-10-08T12:46:03.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.712+0000 7f3b2d77c700 1 -- 172.21.15.45:0/2136112040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b280ceca0 con 0x7f3b10004850 2023-10-08T12:46:03.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.713+0000 7f3b0f7fe700 1 -- 172.21.15.45:0/2136112040 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f3b280ceca0 con 0x7f3b10004850 2023-10-08T12:46:03.714 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:46:03.715 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:45:26.206424+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:45:19.183651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:45:22.277383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:45:23.606639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.412453+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.351925+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.428025+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.437246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.441119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.388608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.415524+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.401835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:46:03.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.716+0000 7f3b2d77c700 1 -- 172.21.15.45:0/2136112040 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3b1406aed0 msgr2=0x7f3b1406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:03.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.716+0000 7f3b2d77c700 1 --2- 172.21.15.45:0/2136112040 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3b1406aed0 0x7f3b1406d390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3b18009ae0 tx=0x7f3b18004750 comp rx=0 tx=0).stop 2023-10-08T12:46:03.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.716+0000 7f3b2d77c700 1 -- 172.21.15.45:0/2136112040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b10004850 msgr2=0x7f3b2814cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:03.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.716+0000 7f3b2d77c700 1 --2- 172.21.15.45:0/2136112040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b10004850 0x7f3b2814cd60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c0066b0 tx=0x7f3b1c003960 comp rx=0 tx=0).stop 2023-10-08T12:46:03.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.716+0000 7f3b2d77c700 1 -- 172.21.15.45:0/2136112040 shutdown_connections 2023-10-08T12:46:03.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.716+0000 7f3b2d77c700 1 --2- 172.21.15.45:0/2136112040 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3b1406aed0 0x7f3b1406d390 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:03.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.716+0000 7f3b2d77c700 1 --2- 172.21.15.45:0/2136112040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b2814dc90 0x7f3b2814e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:03.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.716+0000 7f3b2d77c700 1 --2- 172.21.15.45:0/2136112040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b10004850 0x7f3b2814cd60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:03.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.716+0000 7f3b2d77c700 1 --2- 172.21.15.45:0/2136112040 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b281501c0 0x7f3b28150640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:03.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.716+0000 7f3b2d77c700 1 -- 172.21.15.45:0/2136112040 >> 172.21.15.45:0/2136112040 conn(0x7f3b28071940 msgr2=0x7f3b28159d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:03.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.716+0000 7f3b2d77c700 1 -- 172.21.15.45:0/2136112040 shutdown_connections 2023-10-08T12:46:03.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.716+0000 7f3b2d77c700 1 -- 172.21.15.45:0/2136112040 wait complete. 2023-10-08T12:46:03.729 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:45:19.183651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:45:22.277383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:45:23.606639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:46:03.729 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:46:03.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.859+0000 7fb22e114700 1 -- 172.21.15.45:0/2569771480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb210004b10 msgr2=0x7fb210004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:03.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.859+0000 7fb22e114700 1 --2- 172.21.15.45:0/2569771480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb210004b10 0x7fb210004f30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb21800c340 tx=0x7fb210006990 comp rx=0 tx=0).stop 2023-10-08T12:46:03.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.859+0000 7fb227fff700 1 -- 172.21.15.45:0/2569771480 reap_dead start 2023-10-08T12:46:03.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.859+0000 7fb22e114700 1 -- 172.21.15.45:0/2569771480 shutdown_connections 2023-10-08T12:46:03.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.859+0000 7fb22e114700 1 -- 172.21.15.45:0/2569771480 >> 172.21.15.45:0/2569771480 conn(0x7fb2280cddc0 msgr2=0x7fb2280ce1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:03.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.859+0000 7fb22e114700 1 -- 172.21.15.45:0/2569771480 shutdown_connections 2023-10-08T12:46:03.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.859+0000 7fb22e114700 1 -- 172.21.15.45:0/2569771480 wait complete. 2023-10-08T12:46:03.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.860+0000 7fb22e114700 1 Processor -- start 2023-10-08T12:46:03.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.861+0000 7fb22e114700 1 -- start start 2023-10-08T12:46:03.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.861+0000 7fb22e114700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb210004b10 0x7fb22814daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:03.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.861+0000 7fb22e114700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2281e2710 0x7fb228152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:03.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.861+0000 7fb22e114700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb22815b390 0x7fb228152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:03.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.861+0000 7fb22e114700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22814e030 con 0x7fb210004b10 2023-10-08T12:46:03.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.861+0000 7fb22e114700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb228151d30 con 0x7fb2281e2710 2023-10-08T12:46:03.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.861+0000 7fb22e114700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb228152010 con 0x7fb22815b390 2023-10-08T12:46:03.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.861+0000 7fb2277fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb210004b10 0x7fb22814daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:03.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.861+0000 7fb2277fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb210004b10 0x7fb22814daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36150/0 (socket says 172.21.15.45:36150) 2023-10-08T12:46:03.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.862+0000 7fb2277fe700 1 -- 172.21.15.45:0/1244199321 learned_addr learned my addr 172.21.15.45:0/1244199321 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:03.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.862+0000 7fb227fff700 1 --2- 172.21.15.45:0/1244199321 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb22815b390 0x7fb228152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:03.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.862+0000 7fb226ffd700 1 --2- 172.21.15.45:0/1244199321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2281e2710 0x7fb228152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:03.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.862+0000 7fb2277fe700 1 -- 172.21.15.45:0/1244199321 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb22815b390 msgr2=0x7fb228152fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:03.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.862+0000 7fb2277fe700 1 --2- 172.21.15.45:0/1244199321 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb22815b390 0x7fb228152fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:03.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.862+0000 7fb2277fe700 1 -- 172.21.15.45:0/1244199321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2281e2710 msgr2=0x7fb228152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:03.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.862+0000 7fb2277fe700 1 --2- 172.21.15.45:0/1244199321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2281e2710 0x7fb228152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:03.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.862+0000 7fb2277fe700 1 -- 172.21.15.45:0/1244199321 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2281522f0 con 0x7fb210004b10 2023-10-08T12:46:03.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.862+0000 7fb2277fe700 1 --2- 172.21.15.45:0/1244199321 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb210004b10 0x7fb22814daf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb218011000 tx=0x7fb218000fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:03.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.862+0000 7fb20ffff700 1 -- 172.21.15.45:0/1244199321 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb218006650 con 0x7fb210004b10 2023-10-08T12:46:03.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.862+0000 7fb20ffff700 1 -- 172.21.15.45:0/1244199321 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb21800ced0 con 0x7fb210004b10 2023-10-08T12:46:03.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.862+0000 7fb22e114700 1 -- 172.21.15.45:0/1244199321 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2281525d0 con 0x7fb210004b10 2023-10-08T12:46:03.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.862+0000 7fb20ffff700 1 -- 172.21.15.45:0/1244199321 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2180038c0 con 0x7fb210004b10 2023-10-08T12:46:03.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.862+0000 7fb22e114700 1 -- 172.21.15.45:0/1244199321 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb228157ea0 con 0x7fb210004b10 2023-10-08T12:46:03.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.863+0000 7fb22e114700 1 -- 172.21.15.45:0/1244199321 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb228067470 con 0x7fb210004b10 2023-10-08T12:46:03.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.863+0000 7fb20ffff700 1 -- 172.21.15.45:0/1244199321 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb218022070 con 0x7fb210004b10 2023-10-08T12:46:03.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.864+0000 7fb20ffff700 1 --2- 172.21.15.45:0/1244199321 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb21406aed0 0x7fb21406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:03.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.864+0000 7fb20ffff700 1 -- 172.21.15.45:0/1244199321 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb21808b520 con 0x7fb210004b10 2023-10-08T12:46:03.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.864+0000 7fb226ffd700 1 --2- 172.21.15.45:0/1244199321 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb21406aed0 0x7fb21406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:03.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.865+0000 7fb226ffd700 1 --2- 172.21.15.45:0/1244199321 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb21406aed0 0x7fb21406d390 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb2281e2b10 tx=0x7fb21c009260 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:03.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:03.868+0000 7fb20ffff700 1 -- 172.21.15.45:0/1244199321 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb218056660 con 0x7fb210004b10 2023-10-08T12:46:04.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.068+0000 7fb22e114700 1 -- 172.21.15.45:0/1244199321 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb228156410 con 0x7fb210004b10 2023-10-08T12:46:04.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.068+0000 7fb20ffff700 1 -- 172.21.15.45:0/1244199321 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb21802a0a0 con 0x7fb210004b10 2023-10-08T12:46:04.069 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-08T12:46:04.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.070+0000 7fb22e114700 1 -- 172.21.15.45:0/1244199321 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb21406aed0 msgr2=0x7fb21406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:04.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.070+0000 7fb22e114700 1 --2- 172.21.15.45:0/1244199321 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb21406aed0 0x7fb21406d390 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb2281e2b10 tx=0x7fb21c009260 comp rx=0 tx=0).stop 2023-10-08T12:46:04.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.070+0000 7fb22e114700 1 -- 172.21.15.45:0/1244199321 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb210004b10 msgr2=0x7fb22814daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:04.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.070+0000 7fb22e114700 1 --2- 172.21.15.45:0/1244199321 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb210004b10 0x7fb22814daf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb218011000 tx=0x7fb218000fc0 comp rx=0 tx=0).stop 2023-10-08T12:46:04.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.070+0000 7fb22e114700 1 -- 172.21.15.45:0/1244199321 shutdown_connections 2023-10-08T12:46:04.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.070+0000 7fb22e114700 1 --2- 172.21.15.45:0/1244199321 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb21406aed0 0x7fb21406d390 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:04.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.070+0000 7fb22e114700 1 --2- 172.21.15.45:0/1244199321 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb22815b390 0x7fb228152fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:04.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.070+0000 7fb22e114700 1 --2- 172.21.15.45:0/1244199321 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb210004b10 0x7fb22814daf0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:04.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.070+0000 7fb22e114700 1 --2- 172.21.15.45:0/1244199321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2281e2710 0x7fb228152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:04.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.070+0000 7fb22e114700 1 -- 172.21.15.45:0/1244199321 >> 172.21.15.45:0/1244199321 conn(0x7fb2280cddc0 msgr2=0x7fb2280aec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:04.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.070+0000 7fb22e114700 1 -- 172.21.15.45:0/1244199321 shutdown_connections 2023-10-08T12:46:04.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.071+0000 7fb22e114700 1 -- 172.21.15.45:0/1244199321 wait complete. 2023-10-08T12:46:04.083 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:46:04.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.213+0000 7f74246fa700 1 -- 172.21.15.45:0/3957482541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f741c0cb730 msgr2=0x7f741c0b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:04.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.213+0000 7f74246fa700 1 --2- 172.21.15.45:0/3957482541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f741c0cb730 0x7f741c0b20e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f741c071240 tx=0x7f741400b380 comp rx=0 tx=0).stop 2023-10-08T12:46:04.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.213+0000 7f74246fa700 1 -- 172.21.15.45:0/3957482541 shutdown_connections 2023-10-08T12:46:04.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.213+0000 7f74246fa700 1 --2- 172.21.15.45:0/3957482541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f741c0cb730 0x7f741c0b20e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:04.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.213+0000 7f74246fa700 1 --2- 172.21.15.45:0/3957482541 >> v2:172.21.15.78:3300/0 conn(0x7f741c15c0d0 0x7f741c0c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:04.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.213+0000 7f74246fa700 1 -- 172.21.15.45:0/3957482541 >> 172.21.15.45:0/3957482541 conn(0x7f741c097a20 msgr2=0x7f741c0ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:04.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.213+0000 7f74246fa700 1 -- 172.21.15.45:0/3957482541 shutdown_connections 2023-10-08T12:46:04.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.213+0000 7f74246fa700 1 -- 172.21.15.45:0/3957482541 wait complete. 2023-10-08T12:46:04.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.215+0000 7f74246fa700 1 Processor -- start 2023-10-08T12:46:04.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.215+0000 7f74246fa700 1 -- start start 2023-10-08T12:46:04.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.215+0000 7f74246fa700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f741c0cb730 0x7f741c158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:04.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.215+0000 7f74246fa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f741c0cf000 0x7f741c09a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:04.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.215+0000 7f74246fa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f741c15c0d0 0x7f741c06a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:04.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.215+0000 7f74246fa700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c158540 con 0x7f741c15c0d0 2023-10-08T12:46:04.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.215+0000 7f74246fa700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c09b180 con 0x7f741c0cf000 2023-10-08T12:46:04.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.216+0000 7f74246fa700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741c09b460 con 0x7f741c0cb730 2023-10-08T12:46:04.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.216+0000 7f7422c97700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f741c15c0d0 0x7f741c06a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:04.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.216+0000 7f7422496700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f741c0cb730 0x7f741c158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:04.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.216+0000 7f7422c97700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f741c15c0d0 0x7f741c06a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36168/0 (socket says 172.21.15.45:36168) 2023-10-08T12:46:04.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.216+0000 7f7422c97700 1 -- 172.21.15.45:0/2543235981 learned_addr learned my addr 172.21.15.45:0/2543235981 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:04.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.216+0000 7f7421c95700 1 --2- 172.21.15.45:0/2543235981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f741c0cf000 0x7f741c09a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:04.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.216+0000 7f7422c97700 1 -- 172.21.15.45:0/2543235981 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f741c0cb730 msgr2=0x7f741c158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:04.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.216+0000 7f7422c97700 1 --2- 172.21.15.45:0/2543235981 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f741c0cb730 0x7f741c158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:04.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.216+0000 7f7422c97700 1 -- 172.21.15.45:0/2543235981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f741c0cf000 msgr2=0x7f741c09a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:04.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.216+0000 7f7422c97700 1 --2- 172.21.15.45:0/2543235981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f741c0cf000 0x7f741c09a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:04.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.216+0000 7f7422c97700 1 -- 172.21.15.45:0/2543235981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7414009d00 con 0x7f741c15c0d0 2023-10-08T12:46:04.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.216+0000 7f7422c97700 1 --2- 172.21.15.45:0/2543235981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f741c15c0d0 0x7f741c06a210 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7414009fd0 tx=0x7f7414007b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:04.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.216+0000 7f7412ffd700 1 -- 172.21.15.45:0/2543235981 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741400e040 con 0x7f741c15c0d0 2023-10-08T12:46:04.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.216+0000 7f7412ffd700 1 -- 172.21.15.45:0/2543235981 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f741401d6c0 con 0x7f741c15c0d0 2023-10-08T12:46:04.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.216+0000 7f7412ffd700 1 -- 172.21.15.45:0/2543235981 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741401dad0 con 0x7f741c15c0d0 2023-10-08T12:46:04.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.216+0000 7f74246fa700 1 -- 172.21.15.45:0/2543235981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741c09b740 con 0x7f741c15c0d0 2023-10-08T12:46:04.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.216+0000 7f74246fa700 1 -- 172.21.15.45:0/2543235981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741c09bd00 con 0x7f741c15c0d0 2023-10-08T12:46:04.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.217+0000 7f74246fa700 1 -- 172.21.15.45:0/2543235981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f741c0cdd10 con 0x7f741c15c0d0 2023-10-08T12:46:04.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.218+0000 7f7412ffd700 1 -- 172.21.15.45:0/2543235981 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f741401dc30 con 0x7f741c15c0d0 2023-10-08T12:46:04.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.218+0000 7f7412ffd700 1 --2- 172.21.15.45:0/2543235981 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f740006aed0 0x7f740006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:04.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.218+0000 7f7412ffd700 1 -- 172.21.15.45:0/2543235981 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f741408b1d0 con 0x7f741c15c0d0 2023-10-08T12:46:04.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.218+0000 7f7422496700 1 --2- 172.21.15.45:0/2543235981 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f740006aed0 0x7f740006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:04.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.219+0000 7f7422496700 1 --2- 172.21.15.45:0/2543235981 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f740006aed0 0x7f740006d390 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f740c005fd0 tx=0x7f740c00b390 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:04.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.223+0000 7f7412ffd700 1 -- 172.21.15.45:0/2543235981 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7414056280 con 0x7f741c15c0d0 2023-10-08T12:46:04.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.426+0000 7f74246fa700 1 -- 172.21.15.45:0/2543235981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f741c066850 con 0x7f741c15c0d0 2023-10-08T12:46:04.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.426+0000 7f7412ffd700 1 -- 172.21.15.45:0/2543235981 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f74140598a0 con 0x7f741c15c0d0 2023-10-08T12:46:04.427 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-08T12:46:04.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.428+0000 7f74246fa700 1 -- 172.21.15.45:0/2543235981 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f740006aed0 msgr2=0x7f740006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:04.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.428+0000 7f74246fa700 1 --2- 172.21.15.45:0/2543235981 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f740006aed0 0x7f740006d390 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f740c005fd0 tx=0x7f740c00b390 comp rx=0 tx=0).stop 2023-10-08T12:46:04.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.428+0000 7f74246fa700 1 -- 172.21.15.45:0/2543235981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f741c15c0d0 msgr2=0x7f741c06a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:04.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.428+0000 7f74246fa700 1 --2- 172.21.15.45:0/2543235981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f741c15c0d0 0x7f741c06a210 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7414009fd0 tx=0x7f7414007b60 comp rx=0 tx=0).stop 2023-10-08T12:46:04.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.428+0000 7f74246fa700 1 -- 172.21.15.45:0/2543235981 shutdown_connections 2023-10-08T12:46:04.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.428+0000 7f74246fa700 1 --2- 172.21.15.45:0/2543235981 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f740006aed0 0x7f740006d390 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:04.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.428+0000 7f74246fa700 1 --2- 172.21.15.45:0/2543235981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f741c15c0d0 0x7f741c06a210 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:04.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.428+0000 7f74246fa700 1 --2- 172.21.15.45:0/2543235981 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f741c0cb730 0x7f741c158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:04.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.428+0000 7f74246fa700 1 --2- 172.21.15.45:0/2543235981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f741c0cf000 0x7f741c09a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:04.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.428+0000 7f74246fa700 1 -- 172.21.15.45:0/2543235981 >> 172.21.15.45:0/2543235981 conn(0x7f741c097a20 msgr2=0x7f741c0b0490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:04.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.428+0000 7f74246fa700 1 -- 172.21.15.45:0/2543235981 shutdown_connections 2023-10-08T12:46:04.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.428+0000 7f74246fa700 1 -- 172.21.15.45:0/2543235981 wait complete. 2023-10-08T12:46:04.441 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:46:04.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.571+0000 7fb2f9ff6700 1 -- 172.21.15.45:0/1926196979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2f40cf000 msgr2=0x7fb2f40cb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:04.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.571+0000 7fb2f9ff6700 1 --2- 172.21.15.45:0/1926196979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2f40cf000 0x7fb2f40cb020 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4071240 tx=0x7fb2e8009c70 comp rx=0 tx=0).stop 2023-10-08T12:46:04.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.571+0000 7fb2f9ff6700 1 -- 172.21.15.45:0/1926196979 shutdown_connections 2023-10-08T12:46:04.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.571+0000 7fb2f9ff6700 1 --2- 172.21.15.45:0/1926196979 >> v2:172.21.15.78:3300/0 conn(0x7fb2f415c0d0 0x7fb2f40c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:04.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.571+0000 7fb2f9ff6700 1 --2- 172.21.15.45:0/1926196979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2f40cf000 0x7fb2f40cb020 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:04.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.571+0000 7fb2f9ff6700 1 -- 172.21.15.45:0/1926196979 >> 172.21.15.45:0/1926196979 conn(0x7fb2f4097a20 msgr2=0x7fb2f40ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:04.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.571+0000 7fb2f9ff6700 1 -- 172.21.15.45:0/1926196979 shutdown_connections 2023-10-08T12:46:04.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.571+0000 7fb2f9ff6700 1 -- 172.21.15.45:0/1926196979 wait complete. 2023-10-08T12:46:04.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.572+0000 7fb2f9ff6700 1 Processor -- start 2023-10-08T12:46:04.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.572+0000 7fb2f9ff6700 1 -- start start 2023-10-08T12:46:04.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.573+0000 7fb2f9ff6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2f40cb560 0x7fb2f409a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:04.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.573+0000 7fb2f9ff6700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb2f40cf000 0x7fb2f406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:04.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.573+0000 7fb2f9ff6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2f415c0d0 0x7fb2f409acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:04.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.573+0000 7fb2f9ff6700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f409a800 con 0x7fb2f415c0d0 2023-10-08T12:46:04.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.573+0000 7fb2f9ff6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f4099220 con 0x7fb2f40cb560 2023-10-08T12:46:04.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.573+0000 7fb2f9ff6700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f4099500 con 0x7fb2f40cf000 2023-10-08T12:46:04.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.573+0000 7fb2f3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2f415c0d0 0x7fb2f409acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:04.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.573+0000 7fb2f3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2f415c0d0 0x7fb2f409acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36182/0 (socket says 172.21.15.45:36182) 2023-10-08T12:46:04.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.573+0000 7fb2f3fff700 1 -- 172.21.15.45:0/4049775686 learned_addr learned my addr 172.21.15.45:0/4049775686 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:04.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.573+0000 7fb2f2ffd700 1 --2- 172.21.15.45:0/4049775686 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb2f40cf000 0x7fb2f406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:04.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.573+0000 7fb2f37fe700 1 --2- 172.21.15.45:0/4049775686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2f40cb560 0x7fb2f409a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:04.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.573+0000 7fb2f3fff700 1 -- 172.21.15.45:0/4049775686 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb2f40cf000 msgr2=0x7fb2f406a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:04.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.573+0000 7fb2f3fff700 1 --2- 172.21.15.45:0/4049775686 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb2f40cf000 0x7fb2f406a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:04.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.574+0000 7fb2f3fff700 1 -- 172.21.15.45:0/4049775686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2f40cb560 msgr2=0x7fb2f409a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:04.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.574+0000 7fb2f3fff700 1 --2- 172.21.15.45:0/4049775686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2f40cb560 0x7fb2f409a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:04.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.574+0000 7fb2f3fff700 1 -- 172.21.15.45:0/4049775686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e80095f0 con 0x7fb2f415c0d0 2023-10-08T12:46:04.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.574+0000 7fb2f37fe700 1 --2- 172.21.15.45:0/4049775686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2f40cb560 0x7fb2f409a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:04.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.574+0000 7fb2f3fff700 1 --2- 172.21.15.45:0/4049775686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2f415c0d0 0x7fb2f409acd0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec00cc50 tx=0x7fb2ec00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:04.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.574+0000 7fb2dbfff700 1 -- 172.21.15.45:0/4049775686 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec00ad80 con 0x7fb2f415c0d0 2023-10-08T12:46:04.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.574+0000 7fb2dbfff700 1 -- 172.21.15.45:0/4049775686 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb2ec00ce50 con 0x7fb2f415c0d0 2023-10-08T12:46:04.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.574+0000 7fb2f9ff6700 1 -- 172.21.15.45:0/4049775686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f40997e0 con 0x7fb2f415c0d0 2023-10-08T12:46:04.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.574+0000 7fb2dbfff700 1 -- 172.21.15.45:0/4049775686 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec003c60 con 0x7fb2f415c0d0 2023-10-08T12:46:04.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.574+0000 7fb2f9ff6700 1 -- 172.21.15.45:0/4049775686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f4099da0 con 0x7fb2f415c0d0 2023-10-08T12:46:04.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.575+0000 7fb2f9ff6700 1 -- 172.21.15.45:0/4049775686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f4066850 con 0x7fb2f415c0d0 2023-10-08T12:46:04.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.575+0000 7fb2dbfff700 1 -- 172.21.15.45:0/4049775686 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb2ec0050d0 con 0x7fb2f415c0d0 2023-10-08T12:46:04.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.576+0000 7fb2dbfff700 1 --2- 172.21.15.45:0/4049775686 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb2e006aed0 0x7fb2e006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:04.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.576+0000 7fb2dbfff700 1 -- 172.21.15.45:0/4049775686 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2ec0898a0 con 0x7fb2f415c0d0 2023-10-08T12:46:04.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.576+0000 7fb2f37fe700 1 --2- 172.21.15.45:0/4049775686 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb2e006aed0 0x7fb2e006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:04.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.576+0000 7fb2f37fe700 1 --2- 172.21.15.45:0/4049775686 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb2e006aed0 0x7fb2e006d390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4005950 tx=0x7fb2e4005eb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:04.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.580+0000 7fb2dbfff700 1 -- 172.21.15.45:0/4049775686 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb2ec054950 con 0x7fb2f415c0d0 2023-10-08T12:46:04.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.777+0000 7fb2f9ff6700 1 -- 172.21.15.45:0/4049775686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb2f40cf560 con 0x7fb2f415c0d0 2023-10-08T12:46:04.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.777+0000 7fb2dbfff700 1 -- 172.21.15.45:0/4049775686 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb2ec057f70 con 0x7fb2f415c0d0 2023-10-08T12:46:04.778 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-08T12:46:04.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.779+0000 7fb2f9ff6700 1 -- 172.21.15.45:0/4049775686 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb2e006aed0 msgr2=0x7fb2e006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:04.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.780+0000 7fb2f9ff6700 1 --2- 172.21.15.45:0/4049775686 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb2e006aed0 0x7fb2e006d390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4005950 tx=0x7fb2e4005eb0 comp rx=0 tx=0).stop 2023-10-08T12:46:04.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.780+0000 7fb2f9ff6700 1 -- 172.21.15.45:0/4049775686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2f415c0d0 msgr2=0x7fb2f409acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:04.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.780+0000 7fb2f9ff6700 1 --2- 172.21.15.45:0/4049775686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2f415c0d0 0x7fb2f409acd0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec00cc50 tx=0x7fb2ec00a340 comp rx=0 tx=0).stop 2023-10-08T12:46:04.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.780+0000 7fb2f9ff6700 1 -- 172.21.15.45:0/4049775686 shutdown_connections 2023-10-08T12:46:04.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.780+0000 7fb2f9ff6700 1 --2- 172.21.15.45:0/4049775686 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb2e006aed0 0x7fb2e006d390 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:04.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.780+0000 7fb2f9ff6700 1 --2- 172.21.15.45:0/4049775686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2f415c0d0 0x7fb2f409acd0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:04.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.780+0000 7fb2f9ff6700 1 --2- 172.21.15.45:0/4049775686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2f40cb560 0x7fb2f409a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:04.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.780+0000 7fb2f9ff6700 1 --2- 172.21.15.45:0/4049775686 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb2f40cf000 0x7fb2f406a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:04.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.780+0000 7fb2f9ff6700 1 -- 172.21.15.45:0/4049775686 >> 172.21.15.45:0/4049775686 conn(0x7fb2f4097a20 msgr2=0x7fb2f40b01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:04.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.780+0000 7fb2f9ff6700 1 -- 172.21.15.45:0/4049775686 shutdown_connections 2023-10-08T12:46:04.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.780+0000 7fb2f9ff6700 1 -- 172.21.15.45:0/4049775686 wait complete. 2023-10-08T12:46:04.793 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-08T12:46:04.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.920+0000 7f4689486700 1 -- 172.21.15.45:0/1064378718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4670004850 msgr2=0x7f4670004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:04.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.920+0000 7f4689486700 1 --2- 172.21.15.45:0/1064378718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4670004850 0x7f4670004cd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f466c0016f0 tx=0x7f4670005880 comp rx=0 tx=0).stop 2023-10-08T12:46:04.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.920+0000 7f4689486700 1 -- 172.21.15.45:0/1064378718 shutdown_connections 2023-10-08T12:46:04.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.920+0000 7f4689486700 1 --2- 172.21.15.45:0/1064378718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4670004850 0x7f4670004cd0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:04.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.920+0000 7f4689486700 1 -- 172.21.15.45:0/1064378718 >> 172.21.15.45:0/1064378718 conn(0x7f46840b11b0 msgr2=0x7f46840b15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:04.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.920+0000 7f4689486700 1 -- 172.21.15.45:0/1064378718 shutdown_connections 2023-10-08T12:46:04.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.920+0000 7f4689486700 1 -- 172.21.15.45:0/1064378718 wait complete. 2023-10-08T12:46:04.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.922+0000 7f4689486700 1 Processor -- start 2023-10-08T12:46:04.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.922+0000 7f4689486700 1 -- start start 2023-10-08T12:46:04.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.922+0000 7f4689486700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4670004850 0x7f468414f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:04.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.922+0000 7f4689486700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46840b22e0 0x7f46840b2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:04.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.922+0000 7f4689486700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46840c8a80 0x7f46840c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:04.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.922+0000 7f4689486700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46840c9440 con 0x7f4670004850 2023-10-08T12:46:04.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.922+0000 7f4689486700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468414fd70 con 0x7f46840c8a80 2023-10-08T12:46:04.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.922+0000 7f4689486700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f468409a500 con 0x7f46840b22e0 2023-10-08T12:46:04.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.923+0000 7f4682ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4670004850 0x7f468414f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:04.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.923+0000 7f4682ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4670004850 0x7f468414f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36198/0 (socket says 172.21.15.45:36198) 2023-10-08T12:46:04.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.923+0000 7f4682ffd700 1 -- 172.21.15.45:0/4000094508 learned_addr learned my addr 172.21.15.45:0/4000094508 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:04.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.923+0000 7f46837fe700 1 --2- 172.21.15.45:0/4000094508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46840c8a80 0x7f46840c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:04.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.923+0000 7f46827fc700 1 --2- 172.21.15.45:0/4000094508 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46840b22e0 0x7f46840b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:04.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.923+0000 7f4682ffd700 1 -- 172.21.15.45:0/4000094508 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46840b22e0 msgr2=0x7f46840b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:04.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.923+0000 7f4682ffd700 1 --2- 172.21.15.45:0/4000094508 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46840b22e0 0x7f46840b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:04.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.923+0000 7f4682ffd700 1 -- 172.21.15.45:0/4000094508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46840c8a80 msgr2=0x7f46840c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:04.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.923+0000 7f4682ffd700 1 --2- 172.21.15.45:0/4000094508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46840c8a80 0x7f46840c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:04.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.923+0000 7f4682ffd700 1 -- 172.21.15.45:0/4000094508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46840b2d60 con 0x7f4670004850 2023-10-08T12:46:04.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.923+0000 7f4682ffd700 1 --2- 172.21.15.45:0/4000094508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4670004850 0x7f468414f830 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f46740119e0 tx=0x7f4674011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:04.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.923+0000 7f467b7fe700 1 -- 172.21.15.45:0/4000094508 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4674004230 con 0x7f4670004850 2023-10-08T12:46:04.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.923+0000 7f467b7fe700 1 -- 172.21.15.45:0/4000094508 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4674004480 con 0x7f4670004850 2023-10-08T12:46:04.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.923+0000 7f4689486700 1 -- 172.21.15.45:0/4000094508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46840b3040 con 0x7f4670004850 2023-10-08T12:46:04.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.923+0000 7f467b7fe700 1 -- 172.21.15.45:0/4000094508 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467400fa50 con 0x7f4670004850 2023-10-08T12:46:04.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.923+0000 7f4689486700 1 -- 172.21.15.45:0/4000094508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46840b3600 con 0x7f4670004850 2023-10-08T12:46:04.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.924+0000 7f4689486700 1 -- 172.21.15.45:0/4000094508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46840b37c0 con 0x7f4670004850 2023-10-08T12:46:04.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.925+0000 7f467b7fe700 1 -- 172.21.15.45:0/4000094508 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f467400fbb0 con 0x7f4670004850 2023-10-08T12:46:04.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.925+0000 7f467b7fe700 1 --2- 172.21.15.45:0/4000094508 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f466406aed0 0x7f466406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:04.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.925+0000 7f467b7fe700 1 -- 172.21.15.45:0/4000094508 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f467408a160 con 0x7f4670004850 2023-10-08T12:46:04.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.925+0000 7f46827fc700 1 --2- 172.21.15.45:0/4000094508 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f466406aed0 0x7f466406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:04.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.926+0000 7f46827fc700 1 --2- 172.21.15.45:0/4000094508 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f466406aed0 0x7f466406d390 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f466c0016f0 tx=0x7f466c012040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:04.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:04.930+0000 7f467b7fe700 1 -- 172.21.15.45:0/4000094508 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4674055180 con 0x7f4670004850 2023-10-08T12:46:05.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.147+0000 7f4689486700 1 -- 172.21.15.45:0/4000094508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f468404e4c0 con 0x7f4670004850 2023-10-08T12:46:05.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.147+0000 7f467b7fe700 1 -- 172.21.15.45:0/4000094508 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f46740587a0 con 0x7f4670004850 2023-10-08T12:46:05.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.149+0000 7f4689486700 1 -- 172.21.15.45:0/4000094508 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f466406aed0 msgr2=0x7f466406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:05.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.149+0000 7f4689486700 1 --2- 172.21.15.45:0/4000094508 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f466406aed0 0x7f466406d390 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f466c0016f0 tx=0x7f466c012040 comp rx=0 tx=0).stop 2023-10-08T12:46:05.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.149+0000 7f4689486700 1 -- 172.21.15.45:0/4000094508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4670004850 msgr2=0x7f468414f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:05.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.149+0000 7f4689486700 1 --2- 172.21.15.45:0/4000094508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4670004850 0x7f468414f830 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f46740119e0 tx=0x7f4674011cf0 comp rx=0 tx=0).stop 2023-10-08T12:46:05.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.149+0000 7f4689486700 1 -- 172.21.15.45:0/4000094508 shutdown_connections 2023-10-08T12:46:05.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.149+0000 7f4689486700 1 --2- 172.21.15.45:0/4000094508 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f466406aed0 0x7f466406d390 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:05.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.149+0000 7f4689486700 1 --2- 172.21.15.45:0/4000094508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46840c8a80 0x7f46840c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:05.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.149+0000 7f4689486700 1 --2- 172.21.15.45:0/4000094508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4670004850 0x7f468414f830 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:05.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.149+0000 7f4689486700 1 --2- 172.21.15.45:0/4000094508 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46840b22e0 0x7f46840b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:05.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.149+0000 7f4689486700 1 -- 172.21.15.45:0/4000094508 >> 172.21.15.45:0/4000094508 conn(0x7f46840b11b0 msgr2=0x7f46840c7960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:05.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.149+0000 7f4689486700 1 -- 172.21.15.45:0/4000094508 shutdown_connections 2023-10-08T12:46:05.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.149+0000 7f4689486700 1 -- 172.21.15.45:0/4000094508 wait complete. 2023-10-08T12:46:05.152 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-10-08T12:46:05.162 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T12:46:05.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:46:05.163 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-08T12:46:05.208 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-10-08T12:46:05.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:46:05.208 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T12:46:05.240 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T12:46:05.240 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T12:46:05.260 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T12:46:05.260 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T12:46:05.320 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T12:46:05.320 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T12:46:05.379 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:46:05.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.506+0000 7fc37c626700 1 -- 172.21.15.45:0/1412812197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc360004850 msgr2=0x7fc360004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:05.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.506+0000 7fc37c626700 1 --2- 172.21.15.45:0/1412812197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc360004850 0x7fc360004cd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc3700016f0 tx=0x7fc360005880 comp rx=0 tx=0).stop 2023-10-08T12:46:05.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.506+0000 7fc37abc3700 1 -- 172.21.15.45:0/1412812197 reap_dead start 2023-10-08T12:46:05.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.506+0000 7fc37c626700 1 -- 172.21.15.45:0/1412812197 shutdown_connections 2023-10-08T12:46:05.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.506+0000 7fc37c626700 1 -- 172.21.15.45:0/1412812197 >> 172.21.15.45:0/1412812197 conn(0x7fc3740b0430 msgr2=0x7fc3740b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:05.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.506+0000 7fc37c626700 1 -- 172.21.15.45:0/1412812197 shutdown_connections 2023-10-08T12:46:05.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.506+0000 7fc37c626700 1 -- 172.21.15.45:0/1412812197 wait complete. 2023-10-08T12:46:05.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.508+0000 7fc37c626700 1 Processor -- start 2023-10-08T12:46:05.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.508+0000 7fc37c626700 1 -- start start 2023-10-08T12:46:05.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.509+0000 7fc37c626700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc360004850 0x7fc3741f2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:05.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.509+0000 7fc37c626700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc3741efe30 0x7fc374155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:05.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.509+0000 7fc37c626700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc374144ac0 0x7fc374144f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:05.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.509+0000 7fc37c626700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3740ce4a0 con 0x7fc360004850 2023-10-08T12:46:05.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.509+0000 7fc37c626700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3741f2ff0 con 0x7fc374144ac0 2023-10-08T12:46:05.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.509+0000 7fc37c626700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3741f32d0 con 0x7fc3741efe30 2023-10-08T12:46:05.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.509+0000 7fc37a3c2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc360004850 0x7fc3741f2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:05.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.509+0000 7fc37a3c2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc360004850 0x7fc3741f2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36216/0 (socket says 172.21.15.45:36216) 2023-10-08T12:46:05.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.509+0000 7fc37a3c2700 1 -- 172.21.15.45:0/104027952 learned_addr learned my addr 172.21.15.45:0/104027952 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:05.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.509+0000 7fc379bc1700 1 --2- 172.21.15.45:0/104027952 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc3741efe30 0x7fc374155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:05.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.509+0000 7fc37abc3700 1 --2- 172.21.15.45:0/104027952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc374144ac0 0x7fc374144f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:05.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.509+0000 7fc37a3c2700 1 -- 172.21.15.45:0/104027952 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc3741efe30 msgr2=0x7fc374155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:05.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.509+0000 7fc37a3c2700 1 --2- 172.21.15.45:0/104027952 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc3741efe30 0x7fc374155620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:05.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.509+0000 7fc37a3c2700 1 -- 172.21.15.45:0/104027952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc374144ac0 msgr2=0x7fc374144f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:05.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.509+0000 7fc37a3c2700 1 --2- 172.21.15.45:0/104027952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc374144ac0 0x7fc374144f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:05.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.509+0000 7fc37a3c2700 1 -- 172.21.15.45:0/104027952 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc374158ec0 con 0x7fc360004850 2023-10-08T12:46:05.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.509+0000 7fc379bc1700 1 --2- 172.21.15.45:0/104027952 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc3741efe30 0x7fc374155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:05.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.509+0000 7fc37abc3700 1 --2- 172.21.15.45:0/104027952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc374144ac0 0x7fc374144f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:05.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.509+0000 7fc37a3c2700 1 --2- 172.21.15.45:0/104027952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc360004850 0x7fc3741f2710 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc364011ab0 tx=0x7fc364011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:05.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.510+0000 7fc36affd700 1 -- 172.21.15.45:0/104027952 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36400fac0 con 0x7fc360004850 2023-10-08T12:46:05.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.510+0000 7fc36affd700 1 -- 172.21.15.45:0/104027952 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc36400fc20 con 0x7fc360004850 2023-10-08T12:46:05.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.510+0000 7fc37c626700 1 -- 172.21.15.45:0/104027952 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3741591a0 con 0x7fc360004850 2023-10-08T12:46:05.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.510+0000 7fc36affd700 1 -- 172.21.15.45:0/104027952 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc364019410 con 0x7fc360004850 2023-10-08T12:46:05.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.510+0000 7fc37c626700 1 -- 172.21.15.45:0/104027952 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc374153e70 con 0x7fc360004850 2023-10-08T12:46:05.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.511+0000 7fc37c626700 1 -- 172.21.15.45:0/104027952 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3741593e0 con 0x7fc360004850 2023-10-08T12:46:05.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.511+0000 7fc36affd700 1 -- 172.21.15.45:0/104027952 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc364019570 con 0x7fc360004850 2023-10-08T12:46:05.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.512+0000 7fc36affd700 1 --2- 172.21.15.45:0/104027952 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc35806af00 0x7fc35806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:05.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.512+0000 7fc36affd700 1 -- 172.21.15.45:0/104027952 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc364089f50 con 0x7fc360004850 2023-10-08T12:46:05.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.512+0000 7fc379bc1700 1 --2- 172.21.15.45:0/104027952 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc35806af00 0x7fc35806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:05.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.512+0000 7fc379bc1700 1 --2- 172.21.15.45:0/104027952 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc35806af00 0x7fc35806d3c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc3700016f0 tx=0x7fc370001190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:05.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.516+0000 7fc36affd700 1 -- 172.21.15.45:0/104027952 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc3741593e0 con 0x7fc360004850 2023-10-08T12:46:05.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.717+0000 7fc37c626700 1 -- 172.21.15.45:0/104027952 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3741593e0 con 0x7fc360004850 2023-10-08T12:46:05.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.718+0000 7fc36affd700 1 -- 172.21.15.45:0/104027952 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7fc3741593e0 con 0x7fc360004850 2023-10-08T12:46:05.719 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:46:05.719 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:45:26.206424+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:45:19.183651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:45:22.277383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:45:23.606639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.412453+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.351925+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.428025+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.437246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.441119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.388608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.415524+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.401835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:46:05.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.721+0000 7fc37c626700 1 -- 172.21.15.45:0/104027952 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc35806af00 msgr2=0x7fc35806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:05.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.721+0000 7fc37c626700 1 --2- 172.21.15.45:0/104027952 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc35806af00 0x7fc35806d3c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc3700016f0 tx=0x7fc370001190 comp rx=0 tx=0).stop 2023-10-08T12:46:05.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.721+0000 7fc37c626700 1 -- 172.21.15.45:0/104027952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc360004850 msgr2=0x7fc3741f2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:05.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.721+0000 7fc37c626700 1 --2- 172.21.15.45:0/104027952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc360004850 0x7fc3741f2710 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc364011ab0 tx=0x7fc364011e70 comp rx=0 tx=0).stop 2023-10-08T12:46:05.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.721+0000 7fc37c626700 1 -- 172.21.15.45:0/104027952 shutdown_connections 2023-10-08T12:46:05.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.721+0000 7fc37c626700 1 --2- 172.21.15.45:0/104027952 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc35806af00 0x7fc35806d3c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:05.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.721+0000 7fc37c626700 1 --2- 172.21.15.45:0/104027952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc374144ac0 0x7fc374144f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:05.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.721+0000 7fc37c626700 1 --2- 172.21.15.45:0/104027952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc360004850 0x7fc3741f2710 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:05.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.721+0000 7fc37c626700 1 --2- 172.21.15.45:0/104027952 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc3741efe30 0x7fc374155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:05.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.721+0000 7fc37c626700 1 -- 172.21.15.45:0/104027952 >> 172.21.15.45:0/104027952 conn(0x7fc3740b0430 msgr2=0x7fc3740ce5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:05.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.721+0000 7fc37c626700 1 -- 172.21.15.45:0/104027952 shutdown_connections 2023-10-08T12:46:05.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.721+0000 7fc37c626700 1 -- 172.21.15.45:0/104027952 wait complete. 2023-10-08T12:46:05.734 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:45:19.183651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:45:22.277383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:45:23.606639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:46:05.734 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:46:05.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.864+0000 7fe17de83700 1 -- 172.21.15.45:0/2083397880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe164005210 msgr2=0x7fe16400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:05.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.864+0000 7fe17de83700 1 --2- 172.21.15.45:0/2083397880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe164005210 0x7fe16400ba10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe170001e10 tx=0x7fe164005880 comp rx=0 tx=0).stop 2023-10-08T12:46:05.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.864+0000 7fe17de83700 1 -- 172.21.15.45:0/2083397880 shutdown_connections 2023-10-08T12:46:05.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.864+0000 7fe17de83700 1 --2- 172.21.15.45:0/2083397880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe164005210 0x7fe16400ba10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:05.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.864+0000 7fe17de83700 1 -- 172.21.15.45:0/2083397880 >> 172.21.15.45:0/2083397880 conn(0x7fe178097a20 msgr2=0x7fe1780ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:05.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.864+0000 7fe17de83700 1 -- 172.21.15.45:0/2083397880 shutdown_connections 2023-10-08T12:46:05.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.864+0000 7fe17de83700 1 -- 172.21.15.45:0/2083397880 wait complete. 2023-10-08T12:46:05.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.865+0000 7fe17de83700 1 Processor -- start 2023-10-08T12:46:05.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.865+0000 7fe17de83700 1 -- start start 2023-10-08T12:46:05.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.866+0000 7fe17de83700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe164005210 0x7fe178154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:05.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.866+0000 7fe17de83700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1781e3940 0x7fe1781e3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:05.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.866+0000 7fe17de83700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1780c6af0 0x7fe1780c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:05.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.866+0000 7fe17de83700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1781e4300 con 0x7fe1780c6af0 2023-10-08T12:46:05.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.866+0000 7fe17de83700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1780b39c0 con 0x7fe1781e3940 2023-10-08T12:46:05.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.866+0000 7fe17de83700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1780b3ca0 con 0x7fe164005210 2023-10-08T12:46:05.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.866+0000 7fe177fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1780c6af0 0x7fe1780c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:05.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.866+0000 7fe177fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1780c6af0 0x7fe1780c6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36240/0 (socket says 172.21.15.45:36240) 2023-10-08T12:46:05.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.866+0000 7fe177fff700 1 -- 172.21.15.45:0/3864127670 learned_addr learned my addr 172.21.15.45:0/3864127670 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:05.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.866+0000 7fe1777fe700 1 --2- 172.21.15.45:0/3864127670 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe164005210 0x7fe178154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:05.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.866+0000 7fe176ffd700 1 --2- 172.21.15.45:0/3864127670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1781e3940 0x7fe1781e3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:05.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.867+0000 7fe177fff700 1 -- 172.21.15.45:0/3864127670 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe164005210 msgr2=0x7fe178154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:05.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.867+0000 7fe177fff700 1 --2- 172.21.15.45:0/3864127670 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe164005210 0x7fe178154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:05.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.867+0000 7fe177fff700 1 -- 172.21.15.45:0/3864127670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1781e3940 msgr2=0x7fe1781e3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:05.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.867+0000 7fe177fff700 1 --2- 172.21.15.45:0/3864127670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1781e3940 0x7fe1781e3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:05.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.867+0000 7fe177fff700 1 -- 172.21.15.45:0/3864127670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1780b3f80 con 0x7fe1780c6af0 2023-10-08T12:46:05.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.867+0000 7fe177fff700 1 --2- 172.21.15.45:0/3864127670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1780c6af0 0x7fe1780c6f80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe1780ce570 tx=0x7fe170001340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:05.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.867+0000 7fe16ffff700 1 -- 172.21.15.45:0/3864127670 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe170003e10 con 0x7fe1780c6af0 2023-10-08T12:46:05.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.867+0000 7fe16ffff700 1 -- 172.21.15.45:0/3864127670 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe1700060d0 con 0x7fe1780c6af0 2023-10-08T12:46:05.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.867+0000 7fe17de83700 1 -- 172.21.15.45:0/3864127670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1780b4260 con 0x7fe1780c6af0 2023-10-08T12:46:05.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.867+0000 7fe16ffff700 1 -- 172.21.15.45:0/3864127670 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe170006500 con 0x7fe1780c6af0 2023-10-08T12:46:05.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.867+0000 7fe17de83700 1 -- 172.21.15.45:0/3864127670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1780c74c0 con 0x7fe1780c6af0 2023-10-08T12:46:05.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.868+0000 7fe17de83700 1 -- 172.21.15.45:0/3864127670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe178066850 con 0x7fe1780c6af0 2023-10-08T12:46:05.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.868+0000 7fe16ffff700 1 -- 172.21.15.45:0/3864127670 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe170017070 con 0x7fe1780c6af0 2023-10-08T12:46:05.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.869+0000 7fe16ffff700 1 --2- 172.21.15.45:0/3864127670 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe15806aed0 0x7fe15806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:05.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.869+0000 7fe16ffff700 1 -- 172.21.15.45:0/3864127670 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe17008a780 con 0x7fe1780c6af0 2023-10-08T12:46:05.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.869+0000 7fe1777fe700 1 --2- 172.21.15.45:0/3864127670 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe15806aed0 0x7fe15806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:05.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.870+0000 7fe1777fe700 1 --2- 172.21.15.45:0/3864127670 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe15806aed0 0x7fe15806d390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe168000c00 tx=0x7fe168000ed0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:05.873+0000 7fe16ffff700 1 -- 172.21.15.45:0/3864127670 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe1700558c0 con 0x7fe1780c6af0 2023-10-08T12:46:06.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.073+0000 7fe17de83700 1 -- 172.21.15.45:0/3864127670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe1780c31d0 con 0x7fe1780c6af0 2023-10-08T12:46:06.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.073+0000 7fe16ffff700 1 -- 172.21.15.45:0/3864127670 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe1700150a0 con 0x7fe1780c6af0 2023-10-08T12:46:06.074 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-08T12:46:06.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.075+0000 7fe17de83700 1 -- 172.21.15.45:0/3864127670 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe15806aed0 msgr2=0x7fe15806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:06.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.075+0000 7fe17de83700 1 --2- 172.21.15.45:0/3864127670 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe15806aed0 0x7fe15806d390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe168000c00 tx=0x7fe168000ed0 comp rx=0 tx=0).stop 2023-10-08T12:46:06.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.075+0000 7fe17de83700 1 -- 172.21.15.45:0/3864127670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1780c6af0 msgr2=0x7fe1780c6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:06.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.075+0000 7fe17de83700 1 --2- 172.21.15.45:0/3864127670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1780c6af0 0x7fe1780c6f80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe1780ce570 tx=0x7fe170001340 comp rx=0 tx=0).stop 2023-10-08T12:46:06.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.075+0000 7fe17de83700 1 -- 172.21.15.45:0/3864127670 shutdown_connections 2023-10-08T12:46:06.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.075+0000 7fe17de83700 1 --2- 172.21.15.45:0/3864127670 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe15806aed0 0x7fe15806d390 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:06.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.075+0000 7fe17de83700 1 --2- 172.21.15.45:0/3864127670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1780c6af0 0x7fe1780c6f80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:06.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.075+0000 7fe17de83700 1 --2- 172.21.15.45:0/3864127670 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe164005210 0x7fe178154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:06.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.075+0000 7fe17de83700 1 --2- 172.21.15.45:0/3864127670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1781e3940 0x7fe1781e3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:06.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.075+0000 7fe17de83700 1 -- 172.21.15.45:0/3864127670 >> 172.21.15.45:0/3864127670 conn(0x7fe178097a20 msgr2=0x7fe1780cb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:06.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.075+0000 7fe17de83700 1 -- 172.21.15.45:0/3864127670 shutdown_connections 2023-10-08T12:46:06.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.075+0000 7fe17de83700 1 -- 172.21.15.45:0/3864127670 wait complete. 2023-10-08T12:46:06.088 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:46:06.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.219+0000 7fb236675700 1 -- 172.21.15.45:0/1101309394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb218003a00 msgr2=0x7fb218003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:06.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.219+0000 7fb236675700 1 --2- 172.21.15.45:0/1101309394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb218003a00 0x7fb218003e20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb220009be0 tx=0x7fb218005880 comp rx=0 tx=0).stop 2023-10-08T12:46:06.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.219+0000 7fb236675700 1 -- 172.21.15.45:0/1101309394 shutdown_connections 2023-10-08T12:46:06.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.219+0000 7fb236675700 1 --2- 172.21.15.45:0/1101309394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb218003a00 0x7fb218003e20 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:06.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.219+0000 7fb236675700 1 -- 172.21.15.45:0/1101309394 >> 172.21.15.45:0/1101309394 conn(0x7fb2300b1290 msgr2=0x7fb2300b16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:06.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.219+0000 7fb236675700 1 -- 172.21.15.45:0/1101309394 shutdown_connections 2023-10-08T12:46:06.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.219+0000 7fb236675700 1 -- 172.21.15.45:0/1101309394 wait complete. 2023-10-08T12:46:06.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.220+0000 7fb236675700 1 Processor -- start 2023-10-08T12:46:06.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.220+0000 7fb236675700 1 -- start start 2023-10-08T12:46:06.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.221+0000 7fb236675700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb218003a00 0x7fb23006c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:06.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.221+0000 7fb236675700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb23006b320 0x7fb2301526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:06.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.221+0000 7fb236675700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb230151020 0x7fb23014fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:06.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.221+0000 7fb236675700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb230150050 con 0x7fb218003a00 2023-10-08T12:46:06.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.221+0000 7fb236675700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23006b7e0 con 0x7fb230151020 2023-10-08T12:46:06.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.221+0000 7fb236675700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23006bac0 con 0x7fb23006b320 2023-10-08T12:46:06.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.221+0000 7fb22ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb218003a00 0x7fb23006c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:06.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.221+0000 7fb22ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb218003a00 0x7fb23006c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36256/0 (socket says 172.21.15.45:36256) 2023-10-08T12:46:06.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.221+0000 7fb22ffff700 1 -- 172.21.15.45:0/3724126357 learned_addr learned my addr 172.21.15.45:0/3724126357 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:06.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.221+0000 7fb234c12700 1 --2- 172.21.15.45:0/3724126357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb230151020 0x7fb23014fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:06.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.221+0000 7fb22f7fe700 1 --2- 172.21.15.45:0/3724126357 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb23006b320 0x7fb2301526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:06.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.221+0000 7fb22ffff700 1 -- 172.21.15.45:0/3724126357 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb23006b320 msgr2=0x7fb2301526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:06.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.221+0000 7fb22ffff700 1 --2- 172.21.15.45:0/3724126357 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb23006b320 0x7fb2301526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:06.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.221+0000 7fb22ffff700 1 -- 172.21.15.45:0/3724126357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb230151020 msgr2=0x7fb23014fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:06.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.221+0000 7fb22ffff700 1 --2- 172.21.15.45:0/3724126357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb230151020 0x7fb23014fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:06.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.221+0000 7fb22ffff700 1 -- 172.21.15.45:0/3724126357 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23015d5b0 con 0x7fb218003a00 2023-10-08T12:46:06.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.222+0000 7fb22ffff700 1 --2- 172.21.15.45:0/3724126357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb218003a00 0x7fb23006c880 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb21800c080 tx=0x7fb220005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:06.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.222+0000 7fb22cff9700 1 -- 172.21.15.45:0/3724126357 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb220003680 con 0x7fb218003a00 2023-10-08T12:46:06.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.222+0000 7fb22cff9700 1 -- 172.21.15.45:0/3724126357 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb220003800 con 0x7fb218003a00 2023-10-08T12:46:06.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.222+0000 7fb236675700 1 -- 172.21.15.45:0/3724126357 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb23006bda0 con 0x7fb218003a00 2023-10-08T12:46:06.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.222+0000 7fb22cff9700 1 -- 172.21.15.45:0/3724126357 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb220003c10 con 0x7fb218003a00 2023-10-08T12:46:06.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.222+0000 7fb236675700 1 -- 172.21.15.45:0/3724126357 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb23006c360 con 0x7fb218003a00 2023-10-08T12:46:06.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.223+0000 7fb236675700 1 -- 172.21.15.45:0/3724126357 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2300727f0 con 0x7fb218003a00 2023-10-08T12:46:06.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.223+0000 7fb22cff9700 1 -- 172.21.15.45:0/3724126357 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb22002a460 con 0x7fb218003a00 2023-10-08T12:46:06.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.224+0000 7fb22cff9700 1 --2- 172.21.15.45:0/3724126357 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb21c06aed0 0x7fb21c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:06.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.224+0000 7fb22cff9700 1 -- 172.21.15.45:0/3724126357 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb220014070 con 0x7fb218003a00 2023-10-08T12:46:06.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.224+0000 7fb22f7fe700 1 --2- 172.21.15.45:0/3724126357 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb21c06aed0 0x7fb21c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:06.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.224+0000 7fb22f7fe700 1 --2- 172.21.15.45:0/3724126357 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb21c06aed0 0x7fb21c06d390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb2300c2a50 tx=0x7fb224006bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:06.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.228+0000 7fb22cff9700 1 -- 172.21.15.45:0/3724126357 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb220056130 con 0x7fb218003a00 2023-10-08T12:46:06.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.428+0000 7fb236675700 1 -- 172.21.15.45:0/3724126357 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb23006c550 con 0x7fb218003a00 2023-10-08T12:46:06.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.428+0000 7fb22cff9700 1 -- 172.21.15.45:0/3724126357 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb220059750 con 0x7fb218003a00 2023-10-08T12:46:06.429 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-08T12:46:06.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.430+0000 7fb236675700 1 -- 172.21.15.45:0/3724126357 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb21c06aed0 msgr2=0x7fb21c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:06.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.430+0000 7fb236675700 1 --2- 172.21.15.45:0/3724126357 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb21c06aed0 0x7fb21c06d390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb2300c2a50 tx=0x7fb224006bc0 comp rx=0 tx=0).stop 2023-10-08T12:46:06.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.430+0000 7fb236675700 1 -- 172.21.15.45:0/3724126357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb218003a00 msgr2=0x7fb23006c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:06.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.430+0000 7fb236675700 1 --2- 172.21.15.45:0/3724126357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb218003a00 0x7fb23006c880 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb21800c080 tx=0x7fb220005990 comp rx=0 tx=0).stop 2023-10-08T12:46:06.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.430+0000 7fb236675700 1 -- 172.21.15.45:0/3724126357 shutdown_connections 2023-10-08T12:46:06.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.430+0000 7fb236675700 1 --2- 172.21.15.45:0/3724126357 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb21c06aed0 0x7fb21c06d390 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:06.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.430+0000 7fb236675700 1 --2- 172.21.15.45:0/3724126357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb230151020 0x7fb23014fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:06.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.430+0000 7fb236675700 1 --2- 172.21.15.45:0/3724126357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb218003a00 0x7fb23006c880 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:06.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.430+0000 7fb236675700 1 --2- 172.21.15.45:0/3724126357 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb23006b320 0x7fb2301526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:06.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.430+0000 7fb236675700 1 -- 172.21.15.45:0/3724126357 >> 172.21.15.45:0/3724126357 conn(0x7fb2300b1290 msgr2=0x7fb230158ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:06.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.430+0000 7fb236675700 1 -- 172.21.15.45:0/3724126357 shutdown_connections 2023-10-08T12:46:06.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.430+0000 7fb236675700 1 -- 172.21.15.45:0/3724126357 wait complete. 2023-10-08T12:46:06.443 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:46:06.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.573+0000 7fd56ad91700 1 -- 172.21.15.45:0/775960588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5640cb560 msgr2=0x7fd5640b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:06.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.573+0000 7fd56ad91700 1 --2- 172.21.15.45:0/775960588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5640cb560 0x7fd5640b20e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd55c009fd0 tx=0x7fd55c00b380 comp rx=0 tx=0).stop 2023-10-08T12:46:06.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.574+0000 7fd56ad91700 1 -- 172.21.15.45:0/775960588 shutdown_connections 2023-10-08T12:46:06.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.574+0000 7fd56ad91700 1 --2- 172.21.15.45:0/775960588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5640cb560 0x7fd5640b20e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:06.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.574+0000 7fd56ad91700 1 --2- 172.21.15.45:0/775960588 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd5640c9c00 0x7fd5640cb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:06.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.574+0000 7fd56ad91700 1 -- 172.21.15.45:0/775960588 >> 172.21.15.45:0/775960588 conn(0x7fd564097a20 msgr2=0x7fd5640ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:06.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.574+0000 7fd56ad91700 1 -- 172.21.15.45:0/775960588 shutdown_connections 2023-10-08T12:46:06.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.574+0000 7fd56ad91700 1 -- 172.21.15.45:0/775960588 wait complete. 2023-10-08T12:46:06.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.575+0000 7fd56ad91700 1 Processor -- start 2023-10-08T12:46:06.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.575+0000 7fd56ad91700 1 -- start start 2023-10-08T12:46:06.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.576+0000 7fd56ad91700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5640c9c00 0x7fd564156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:06.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.576+0000 7fd56ad91700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd5640cb560 0x7fd5641f0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:06.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.576+0000 7fd56ad91700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd56415c0d0 0x7fd5640abf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:06.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.576+0000 7fd56ad91700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5640ace40 con 0x7fd56415c0d0 2023-10-08T12:46:06.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.576+0000 7fd56ad91700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5641f0040 con 0x7fd5640c9c00 2023-10-08T12:46:06.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.576+0000 7fd56ad91700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5640ac880 con 0x7fd5640cb560 2023-10-08T12:46:06.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.576+0000 7fd56932e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd56415c0d0 0x7fd5640abf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:06.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.577+0000 7fd56932e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd56415c0d0 0x7fd5640abf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36274/0 (socket says 172.21.15.45:36274) 2023-10-08T12:46:06.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.577+0000 7fd56932e700 1 -- 172.21.15.45:0/3329317382 learned_addr learned my addr 172.21.15.45:0/3329317382 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:06.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.577+0000 7fd568b2d700 1 --2- 172.21.15.45:0/3329317382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5640c9c00 0x7fd564156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:06.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.577+0000 7fd563fff700 1 --2- 172.21.15.45:0/3329317382 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd5640cb560 0x7fd5641f0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:06.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.577+0000 7fd56932e700 1 -- 172.21.15.45:0/3329317382 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd5640cb560 msgr2=0x7fd5641f0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:06.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.577+0000 7fd56932e700 1 --2- 172.21.15.45:0/3329317382 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd5640cb560 0x7fd5641f0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:06.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.577+0000 7fd56932e700 1 -- 172.21.15.45:0/3329317382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5640c9c00 msgr2=0x7fd564156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:06.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.577+0000 7fd56932e700 1 --2- 172.21.15.45:0/3329317382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5640c9c00 0x7fd564156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:06.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.577+0000 7fd56932e700 1 -- 172.21.15.45:0/3329317382 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55c009d00 con 0x7fd56415c0d0 2023-10-08T12:46:06.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.577+0000 7fd56932e700 1 --2- 172.21.15.45:0/3329317382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd56415c0d0 0x7fd5640abf10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd55c00b780 tx=0x7fd55c007b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:06.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.577+0000 7fd5617fa700 1 -- 172.21.15.45:0/3329317382 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55c00e040 con 0x7fd56415c0d0 2023-10-08T12:46:06.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.577+0000 7fd5617fa700 1 -- 172.21.15.45:0/3329317382 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd55c01d6c0 con 0x7fd56415c0d0 2023-10-08T12:46:06.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.577+0000 7fd56ad91700 1 -- 172.21.15.45:0/3329317382 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5640acb60 con 0x7fd56415c0d0 2023-10-08T12:46:06.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.577+0000 7fd5617fa700 1 -- 172.21.15.45:0/3329317382 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55c01dad0 con 0x7fd56415c0d0 2023-10-08T12:46:06.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.577+0000 7fd56ad91700 1 -- 172.21.15.45:0/3329317382 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5641f0590 con 0x7fd56415c0d0 2023-10-08T12:46:06.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.578+0000 7fd56ad91700 1 -- 172.21.15.45:0/3329317382 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5640732f0 con 0x7fd56415c0d0 2023-10-08T12:46:06.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.579+0000 7fd5617fa700 1 -- 172.21.15.45:0/3329317382 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd55c01dc30 con 0x7fd56415c0d0 2023-10-08T12:46:06.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.579+0000 7fd5617fa700 1 --2- 172.21.15.45:0/3329317382 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd54806aed0 0x7fd54806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:06.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.579+0000 7fd5617fa700 1 -- 172.21.15.45:0/3329317382 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd55c08b610 con 0x7fd56415c0d0 2023-10-08T12:46:06.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.579+0000 7fd568b2d700 1 --2- 172.21.15.45:0/3329317382 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd54806aed0 0x7fd54806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:06.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.580+0000 7fd568b2d700 1 --2- 172.21.15.45:0/3329317382 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd54806aed0 0x7fd54806d390 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd558007fd0 tx=0x7fd558009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:06.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.584+0000 7fd5617fa700 1 -- 172.21.15.45:0/3329317382 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd55c056750 con 0x7fd56415c0d0 2023-10-08T12:46:06.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.783+0000 7fd56ad91700 1 -- 172.21.15.45:0/3329317382 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd564066850 con 0x7fd56415c0d0 2023-10-08T12:46:06.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.783+0000 7fd5617fa700 1 -- 172.21.15.45:0/3329317382 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd55c059d70 con 0x7fd56415c0d0 2023-10-08T12:46:06.784 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-08T12:46:06.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.786+0000 7fd56ad91700 1 -- 172.21.15.45:0/3329317382 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd54806aed0 msgr2=0x7fd54806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:06.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.786+0000 7fd56ad91700 1 --2- 172.21.15.45:0/3329317382 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd54806aed0 0x7fd54806d390 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd558007fd0 tx=0x7fd558009040 comp rx=0 tx=0).stop 2023-10-08T12:46:06.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.786+0000 7fd56ad91700 1 -- 172.21.15.45:0/3329317382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd56415c0d0 msgr2=0x7fd5640abf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:06.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.786+0000 7fd56ad91700 1 --2- 172.21.15.45:0/3329317382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd56415c0d0 0x7fd5640abf10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd55c00b780 tx=0x7fd55c007b60 comp rx=0 tx=0).stop 2023-10-08T12:46:06.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.786+0000 7fd56ad91700 1 -- 172.21.15.45:0/3329317382 shutdown_connections 2023-10-08T12:46:06.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.786+0000 7fd56ad91700 1 --2- 172.21.15.45:0/3329317382 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd54806aed0 0x7fd54806d390 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:06.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.786+0000 7fd56ad91700 1 --2- 172.21.15.45:0/3329317382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd56415c0d0 0x7fd5640abf10 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:06.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.786+0000 7fd56ad91700 1 --2- 172.21.15.45:0/3329317382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5640c9c00 0x7fd564156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:06.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.786+0000 7fd56ad91700 1 --2- 172.21.15.45:0/3329317382 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd5640cb560 0x7fd5641f0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:06.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.786+0000 7fd56ad91700 1 -- 172.21.15.45:0/3329317382 >> 172.21.15.45:0/3329317382 conn(0x7fd564097a20 msgr2=0x7fd564158c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:06.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.786+0000 7fd56ad91700 1 -- 172.21.15.45:0/3329317382 shutdown_connections 2023-10-08T12:46:06.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.786+0000 7fd56ad91700 1 -- 172.21.15.45:0/3329317382 wait complete. 2023-10-08T12:46:06.799 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-08T12:46:06.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.926+0000 7f7827702700 1 -- 172.21.15.45:0/1466039553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78200c9ff0 msgr2=0x7f78200ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:06.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.926+0000 7f7827702700 1 --2- 172.21.15.45:0/1466039553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78200c9ff0 0x7f78200ca460 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f78200cf960 tx=0x7f781800b380 comp rx=0 tx=0).stop 2023-10-08T12:46:06.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.926+0000 7f7827702700 1 -- 172.21.15.45:0/1466039553 shutdown_connections 2023-10-08T12:46:06.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.926+0000 7f7827702700 1 --2- 172.21.15.45:0/1466039553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78200c9ff0 0x7f78200ca460 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:06.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.926+0000 7f7827702700 1 --2- 172.21.15.45:0/1466039553 >> v2:172.21.15.78:3300/0 conn(0x7f7820158950 0x7f78200cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:06.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.926+0000 7f7827702700 1 -- 172.21.15.45:0/1466039553 >> 172.21.15.45:0/1466039553 conn(0x7f78200b0430 msgr2=0x7f78200b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:06.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.926+0000 7f7827702700 1 -- 172.21.15.45:0/1466039553 shutdown_connections 2023-10-08T12:46:06.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.926+0000 7f7827702700 1 -- 172.21.15.45:0/1466039553 wait complete. 2023-10-08T12:46:06.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.928+0000 7f7827702700 1 Processor -- start 2023-10-08T12:46:06.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.928+0000 7f7827702700 1 -- start start 2023-10-08T12:46:06.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.929+0000 7f7827702700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78200c9ff0 0x7f78200acf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:06.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.929+0000 7f7827702700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7820158950 0x7f7820155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:06.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.929+0000 7f7827702700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f782015c320 0x7f7820158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:06.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.929+0000 7f7827702700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782015b9e0 con 0x7f78200c9ff0 2023-10-08T12:46:06.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.929+0000 7f7827702700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782006adb0 con 0x7f782015c320 2023-10-08T12:46:06.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.929+0000 7f7827702700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782015b0b0 con 0x7f7820158950 2023-10-08T12:46:06.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.929+0000 7f782549e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78200c9ff0 0x7f78200acf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:06.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.929+0000 7f782549e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78200c9ff0 0x7f78200acf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36282/0 (socket says 172.21.15.45:36282) 2023-10-08T12:46:06.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.929+0000 7f782549e700 1 -- 172.21.15.45:0/4283756555 learned_addr learned my addr 172.21.15.45:0/4283756555 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:06.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.929+0000 7f7825c9f700 1 --2- 172.21.15.45:0/4283756555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f782015c320 0x7f7820158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:06.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.929+0000 7f7824c9d700 1 --2- 172.21.15.45:0/4283756555 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7820158950 0x7f7820155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:06.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.929+0000 7f782549e700 1 -- 172.21.15.45:0/4283756555 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7820158950 msgr2=0x7f7820155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:06.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.929+0000 7f782549e700 1 --2- 172.21.15.45:0/4283756555 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7820158950 0x7f7820155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:06.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.929+0000 7f782549e700 1 -- 172.21.15.45:0/4283756555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f782015c320 msgr2=0x7f7820158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:06.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.929+0000 7f782549e700 1 --2- 172.21.15.45:0/4283756555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f782015c320 0x7f7820158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:06.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.929+0000 7f782549e700 1 -- 172.21.15.45:0/4283756555 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7818009d00 con 0x7f78200c9ff0 2023-10-08T12:46:06.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.929+0000 7f7825c9f700 1 --2- 172.21.15.45:0/4283756555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f782015c320 0x7f7820158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:46:06.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.929+0000 7f782549e700 1 --2- 172.21.15.45:0/4283756555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78200c9ff0 0x7f78200acf90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f781c00e9a0 tx=0x7f781c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:06.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.930+0000 7f7815ffb700 1 -- 172.21.15.45:0/4283756555 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c009790 con 0x7f78200c9ff0 2023-10-08T12:46:06.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.930+0000 7f7815ffb700 1 -- 172.21.15.45:0/4283756555 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f781c00ccc0 con 0x7f78200c9ff0 2023-10-08T12:46:06.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.930+0000 7f7827702700 1 -- 172.21.15.45:0/4283756555 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782015b390 con 0x7f78200c9ff0 2023-10-08T12:46:06.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.930+0000 7f7815ffb700 1 -- 172.21.15.45:0/4283756555 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c010690 con 0x7f78200c9ff0 2023-10-08T12:46:06.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.930+0000 7f7827702700 1 -- 172.21.15.45:0/4283756555 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7820156320 con 0x7f78200c9ff0 2023-10-08T12:46:06.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.931+0000 7f7827702700 1 -- 172.21.15.45:0/4283756555 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f782004e4c0 con 0x7f78200c9ff0 2023-10-08T12:46:06.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.931+0000 7f7815ffb700 1 -- 172.21.15.45:0/4283756555 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f781c0107f0 con 0x7f78200c9ff0 2023-10-08T12:46:06.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.932+0000 7f7815ffb700 1 --2- 172.21.15.45:0/4283756555 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f780406aed0 0x7f780406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:06.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.932+0000 7f7815ffb700 1 -- 172.21.15.45:0/4283756555 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f781c014070 con 0x7f78200c9ff0 2023-10-08T12:46:06.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.932+0000 7f7824c9d700 1 --2- 172.21.15.45:0/4283756555 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f780406aed0 0x7f780406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:06.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.932+0000 7f7824c9d700 1 --2- 172.21.15.45:0/4283756555 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f780406aed0 0x7f780406d390 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f78200c97c0 tx=0x7f7810009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:06.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:06.936+0000 7f7815ffb700 1 -- 172.21.15.45:0/4283756555 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f781c051ca0 con 0x7f78200c9ff0 2023-10-08T12:46:07.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.154+0000 7f7827702700 1 -- 172.21.15.45:0/4283756555 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f78200b12a0 con 0x7f78200c9ff0 2023-10-08T12:46:07.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.154+0000 7f7815ffb700 1 -- 172.21.15.45:0/4283756555 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f781c058bf0 con 0x7f78200c9ff0 2023-10-08T12:46:07.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.156+0000 7f7827702700 1 -- 172.21.15.45:0/4283756555 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f780406aed0 msgr2=0x7f780406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:07.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.156+0000 7f7827702700 1 --2- 172.21.15.45:0/4283756555 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f780406aed0 0x7f780406d390 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f78200c97c0 tx=0x7f7810009040 comp rx=0 tx=0).stop 2023-10-08T12:46:07.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.156+0000 7f7827702700 1 -- 172.21.15.45:0/4283756555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78200c9ff0 msgr2=0x7f78200acf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:07.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.156+0000 7f7827702700 1 --2- 172.21.15.45:0/4283756555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78200c9ff0 0x7f78200acf90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f781c00e9a0 tx=0x7f781c00ed60 comp rx=0 tx=0).stop 2023-10-08T12:46:07.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.156+0000 7f7827702700 1 -- 172.21.15.45:0/4283756555 shutdown_connections 2023-10-08T12:46:07.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.156+0000 7f7827702700 1 --2- 172.21.15.45:0/4283756555 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f780406aed0 0x7f780406d390 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:07.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.156+0000 7f7827702700 1 --2- 172.21.15.45:0/4283756555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f782015c320 0x7f7820158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:07.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.156+0000 7f7827702700 1 --2- 172.21.15.45:0/4283756555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78200c9ff0 0x7f78200acf90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:07.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.156+0000 7f7827702700 1 --2- 172.21.15.45:0/4283756555 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7820158950 0x7f7820155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:07.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.156+0000 7f7827702700 1 -- 172.21.15.45:0/4283756555 >> 172.21.15.45:0/4283756555 conn(0x7f78200b0430 msgr2=0x7f7820156b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:07.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.156+0000 7f7827702700 1 -- 172.21.15.45:0/4283756555 shutdown_connections 2023-10-08T12:46:07.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.156+0000 7f7827702700 1 -- 172.21.15.45:0/4283756555 wait complete. 2023-10-08T12:46:07.159 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-10-08T12:46:07.169 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-08T12:46:07.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:46:07.170 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-08T12:46:07.232 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2023-10-08T12:46:07.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:46:07.232 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T12:46:07.256 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:46:07.257 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T12:46:07.275 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:46:07.275 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T12:46:07.332 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:46:07.332 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T12:46:07.391 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:46:07.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.557+0000 7fa85be93700 1 -- 172.21.15.45:0/2479547416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8541599f0 msgr2=0x7fa85406ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:07.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.557+0000 7fa85be93700 1 --2- 172.21.15.45:0/2479547416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8541599f0 0x7fa85406ee90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa8540cd320 tx=0x7fa850009ba0 comp rx=0 tx=0).stop 2023-10-08T12:46:07.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.557+0000 7fa85be93700 1 -- 172.21.15.45:0/2479547416 shutdown_connections 2023-10-08T12:46:07.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.557+0000 7fa85be93700 1 --2- 172.21.15.45:0/2479547416 >> v2:172.21.15.78:3300/0 conn(0x7fa8540cc870 0x7fa8540ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:07.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.557+0000 7fa85be93700 1 --2- 172.21.15.45:0/2479547416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8541599f0 0x7fa85406ee90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:07.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.557+0000 7fa85be93700 1 -- 172.21.15.45:0/2479547416 >> 172.21.15.45:0/2479547416 conn(0x7fa8540cf750 msgr2=0x7fa8540cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:07.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.557+0000 7fa85be93700 1 -- 172.21.15.45:0/2479547416 shutdown_connections 2023-10-08T12:46:07.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.557+0000 7fa85be93700 1 -- 172.21.15.45:0/2479547416 wait complete. 2023-10-08T12:46:07.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.558+0000 7fa85be93700 1 Processor -- start 2023-10-08T12:46:07.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.558+0000 7fa85be93700 1 -- start start 2023-10-08T12:46:07.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.559+0000 7fa85be93700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa85406f3d0 0x7fa8540c2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:07.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.559+0000 7fa85be93700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8540cc870 0x7fa8540c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:07.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.559+0000 7fa85be93700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8541599f0 0x7fa8540c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:07.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.559+0000 7fa85be93700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8540c7ef0 con 0x7fa8541599f0 2023-10-08T12:46:07.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.559+0000 7fa85be93700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8540c2a70 con 0x7fa8540cc870 2023-10-08T12:46:07.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.559+0000 7fa85be93700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8540c72e0 con 0x7fa85406f3d0 2023-10-08T12:46:07.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.559+0000 7fa85a430700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8541599f0 0x7fa8540c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:07.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.559+0000 7fa85a430700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8541599f0 0x7fa8540c6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36300/0 (socket says 172.21.15.45:36300) 2023-10-08T12:46:07.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.559+0000 7fa85a430700 1 -- 172.21.15.45:0/208903388 learned_addr learned my addr 172.21.15.45:0/208903388 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:07.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.559+0000 7fa85942e700 1 --2- 172.21.15.45:0/208903388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8540cc870 0x7fa8540c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:07.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.559+0000 7fa859c2f700 1 --2- 172.21.15.45:0/208903388 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa85406f3d0 0x7fa8540c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:07.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.559+0000 7fa85a430700 1 -- 172.21.15.45:0/208903388 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa85406f3d0 msgr2=0x7fa8540c2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:07.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.559+0000 7fa85a430700 1 --2- 172.21.15.45:0/208903388 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa85406f3d0 0x7fa8540c2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:07.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.559+0000 7fa85a430700 1 -- 172.21.15.45:0/208903388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8540cc870 msgr2=0x7fa8540c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:07.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.559+0000 7fa85a430700 1 --2- 172.21.15.45:0/208903388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8540cc870 0x7fa8540c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:07.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.559+0000 7fa85a430700 1 -- 172.21.15.45:0/208903388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa850009520 con 0x7fa8541599f0 2023-10-08T12:46:07.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.559+0000 7fa85942e700 1 --2- 172.21.15.45:0/208903388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8540cc870 0x7fa8540c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:07.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.559+0000 7fa85a430700 1 --2- 172.21.15.45:0/208903388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8541599f0 0x7fa8540c6820 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa84c00ef30 tx=0x7fa84c00c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:07.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.559+0000 7fa8467fc700 1 -- 172.21.15.45:0/208903388 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84c018070 con 0x7fa8541599f0 2023-10-08T12:46:07.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.559+0000 7fa8467fc700 1 -- 172.21.15.45:0/208903388 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa84c00f040 con 0x7fa8541599f0 2023-10-08T12:46:07.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.559+0000 7fa8467fc700 1 -- 172.21.15.45:0/208903388 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84c004bb0 con 0x7fa8541599f0 2023-10-08T12:46:07.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.559+0000 7fa85be93700 1 -- 172.21.15.45:0/208903388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8540c75c0 con 0x7fa8541599f0 2023-10-08T12:46:07.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.560+0000 7fa85be93700 1 -- 172.21.15.45:0/208903388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8540c7b80 con 0x7fa8541599f0 2023-10-08T12:46:07.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.560+0000 7fa85be93700 1 -- 172.21.15.45:0/208903388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8540c7d40 con 0x7fa8541599f0 2023-10-08T12:46:07.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.561+0000 7fa8467fc700 1 -- 172.21.15.45:0/208903388 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa84c004d10 con 0x7fa8541599f0 2023-10-08T12:46:07.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.562+0000 7fa8467fc700 1 --2- 172.21.15.45:0/208903388 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa83806aed0 0x7fa83806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:07.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.562+0000 7fa8467fc700 1 -- 172.21.15.45:0/208903388 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa84c089ea0 con 0x7fa8541599f0 2023-10-08T12:46:07.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.562+0000 7fa859c2f700 1 --2- 172.21.15.45:0/208903388 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa83806aed0 0x7fa83806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:07.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.563+0000 7fa859c2f700 1 --2- 172.21.15.45:0/208903388 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa83806aed0 0x7fa83806d390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa850009230 tx=0x7fa850011040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:07.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.566+0000 7fa8467fc700 1 -- 172.21.15.45:0/208903388 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa84c0550c0 con 0x7fa8541599f0 2023-10-08T12:46:07.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.765+0000 7fa85be93700 1 -- 172.21.15.45:0/208903388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa85404e4c0 con 0x7fa8541599f0 2023-10-08T12:46:07.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.767+0000 7fa8467fc700 1 -- 172.21.15.45:0/208903388 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7fa84c0586e0 con 0x7fa8541599f0 2023-10-08T12:46:07.768 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:46:07.768 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:45:26.206424+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:45:19.183651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:45:22.277383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:45:23.606639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.412453+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.351925+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.428025+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.437246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.441119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.388608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.415524+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.401835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:46:07.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.769+0000 7fa85be93700 1 -- 172.21.15.45:0/208903388 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa83806aed0 msgr2=0x7fa83806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:07.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.769+0000 7fa85be93700 1 --2- 172.21.15.45:0/208903388 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa83806aed0 0x7fa83806d390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa850009230 tx=0x7fa850011040 comp rx=0 tx=0).stop 2023-10-08T12:46:07.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.769+0000 7fa85be93700 1 -- 172.21.15.45:0/208903388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8541599f0 msgr2=0x7fa8540c6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:07.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.769+0000 7fa85be93700 1 --2- 172.21.15.45:0/208903388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8541599f0 0x7fa8540c6820 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa84c00ef30 tx=0x7fa84c00c450 comp rx=0 tx=0).stop 2023-10-08T12:46:07.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.769+0000 7fa85be93700 1 -- 172.21.15.45:0/208903388 shutdown_connections 2023-10-08T12:46:07.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.769+0000 7fa85be93700 1 --2- 172.21.15.45:0/208903388 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa83806aed0 0x7fa83806d390 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:07.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.769+0000 7fa85be93700 1 --2- 172.21.15.45:0/208903388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8541599f0 0x7fa8540c6820 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:07.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.769+0000 7fa85be93700 1 --2- 172.21.15.45:0/208903388 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa85406f3d0 0x7fa8540c2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:07.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.769+0000 7fa85be93700 1 --2- 172.21.15.45:0/208903388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8540cc870 0x7fa8540c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:07.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.769+0000 7fa85be93700 1 -- 172.21.15.45:0/208903388 >> 172.21.15.45:0/208903388 conn(0x7fa8540cf750 msgr2=0x7fa854158be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:07.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.769+0000 7fa85be93700 1 -- 172.21.15.45:0/208903388 shutdown_connections 2023-10-08T12:46:07.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.769+0000 7fa85be93700 1 -- 172.21.15.45:0/208903388 wait complete. 2023-10-08T12:46:07.782 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:45:19.183651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:45:22.277383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:45:23.606639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:46:07.783 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:46:07.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.912+0000 7f68d3f86700 1 -- 172.21.15.45:0/3758168552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68cc0af890 msgr2=0x7f68cc0c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:07.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.912+0000 7f68d3f86700 1 --2- 172.21.15.45:0/3758168552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68cc0af890 0x7f68cc0c9c10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f68cc097ec0 tx=0x7f68bc009ba0 comp rx=0 tx=0).stop 2023-10-08T12:46:07.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.912+0000 7f68d3f86700 1 -- 172.21.15.45:0/3758168552 shutdown_connections 2023-10-08T12:46:07.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.912+0000 7f68d3f86700 1 --2- 172.21.15.45:0/3758168552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68cc0af890 0x7f68cc0c9c10 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:07.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.912+0000 7f68d3f86700 1 --2- 172.21.15.45:0/3758168552 >> v2:172.21.15.78:3300/0 conn(0x7f68cc0afc70 0x7f68cc0ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:07.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.912+0000 7f68d3f86700 1 -- 172.21.15.45:0/3758168552 >> 172.21.15.45:0/3758168552 conn(0x7f68cc097a20 msgr2=0x7f68cc0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:07.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.912+0000 7f68d3f86700 1 -- 172.21.15.45:0/3758168552 shutdown_connections 2023-10-08T12:46:07.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.912+0000 7f68d3f86700 1 -- 172.21.15.45:0/3758168552 wait complete. 2023-10-08T12:46:07.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.913+0000 7f68d3f86700 1 Processor -- start 2023-10-08T12:46:07.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.913+0000 7f68d3f86700 1 -- start start 2023-10-08T12:46:07.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.914+0000 7f68d3f86700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68cc0af890 0x7f68cc153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:07.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.914+0000 7f68d3f86700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f68cc0afc70 0x7f68cc0c6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:07.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.914+0000 7f68d3f86700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68cc0ca150 0x7f68cc15b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:07.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.914+0000 7f68d3f86700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc154190 con 0x7f68cc0af890 2023-10-08T12:46:07.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.914+0000 7f68d3f86700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc0c77e0 con 0x7f68cc0ca150 2023-10-08T12:46:07.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.914+0000 7f68d3f86700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc0c7220 con 0x7f68cc0afc70 2023-10-08T12:46:07.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.914+0000 7f68d1d22700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68cc0af890 0x7f68cc153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:07.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.914+0000 7f68d1d22700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68cc0af890 0x7f68cc153c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36310/0 (socket says 172.21.15.45:36310) 2023-10-08T12:46:07.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.914+0000 7f68d1d22700 1 -- 172.21.15.45:0/661348148 learned_addr learned my addr 172.21.15.45:0/661348148 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:07.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.914+0000 7f68d2523700 1 --2- 172.21.15.45:0/661348148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68cc0ca150 0x7f68cc15b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:07.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.914+0000 7f68d1521700 1 --2- 172.21.15.45:0/661348148 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f68cc0afc70 0x7f68cc0c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:07.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.914+0000 7f68d1d22700 1 -- 172.21.15.45:0/661348148 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f68cc0afc70 msgr2=0x7f68cc0c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:07.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.915+0000 7f68d1d22700 1 --2- 172.21.15.45:0/661348148 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f68cc0afc70 0x7f68cc0c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:07.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.915+0000 7f68d1d22700 1 -- 172.21.15.45:0/661348148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68cc0ca150 msgr2=0x7f68cc15b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:07.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.915+0000 7f68d1d22700 1 --2- 172.21.15.45:0/661348148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68cc0ca150 0x7f68cc15b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:07.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.915+0000 7f68d1d22700 1 -- 172.21.15.45:0/661348148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68bc009520 con 0x7f68cc0af890 2023-10-08T12:46:07.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.915+0000 7f68d1521700 1 --2- 172.21.15.45:0/661348148 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f68cc0afc70 0x7f68cc0c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:46:07.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.915+0000 7f68d1d22700 1 --2- 172.21.15.45:0/661348148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68cc0af890 0x7f68cc153c50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f68cc0b4680 tx=0x7f68bc017760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:07.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.915+0000 7f68c27fc700 1 -- 172.21.15.45:0/661348148 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc01b040 con 0x7f68cc0af890 2023-10-08T12:46:07.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.915+0000 7f68c27fc700 1 -- 172.21.15.45:0/661348148 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f68bc017e10 con 0x7f68cc0af890 2023-10-08T12:46:07.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.915+0000 7f68d3f86700 1 -- 172.21.15.45:0/661348148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68cc0c7500 con 0x7f68cc0af890 2023-10-08T12:46:07.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.915+0000 7f68c27fc700 1 -- 172.21.15.45:0/661348148 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc00f6c0 con 0x7f68cc0af890 2023-10-08T12:46:07.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.915+0000 7f68d3f86700 1 -- 172.21.15.45:0/661348148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68cc15afa0 con 0x7f68cc0af890 2023-10-08T12:46:07.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.916+0000 7f68d3f86700 1 -- 172.21.15.45:0/661348148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68cc0cbb40 con 0x7f68cc0af890 2023-10-08T12:46:07.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.916+0000 7f68c27fc700 1 -- 172.21.15.45:0/661348148 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f68bc00f820 con 0x7f68cc0af890 2023-10-08T12:46:07.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.917+0000 7f68c27fc700 1 --2- 172.21.15.45:0/661348148 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f68b006aed0 0x7f68b006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:07.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.917+0000 7f68c27fc700 1 -- 172.21.15.45:0/661348148 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f68bc08ba70 con 0x7f68cc0af890 2023-10-08T12:46:07.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.917+0000 7f68d1521700 1 --2- 172.21.15.45:0/661348148 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f68b006aed0 0x7f68b006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:07.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.917+0000 7f68d1521700 1 --2- 172.21.15.45:0/661348148 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f68b006aed0 0x7f68b006d390 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f68c8005fd0 tx=0x7f68c8005ee0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:07.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:07.921+0000 7f68c27fc700 1 -- 172.21.15.45:0/661348148 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f68bc056b20 con 0x7f68cc0af890 2023-10-08T12:46:08.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.121+0000 7f68d3f86700 1 -- 172.21.15.45:0/661348148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f68cc066850 con 0x7f68cc0af890 2023-10-08T12:46:08.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.121+0000 7f68c27fc700 1 -- 172.21.15.45:0/661348148 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f68bc05a140 con 0x7f68cc0af890 2023-10-08T12:46:08.122 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-08T12:46:08.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.123+0000 7f68d3f86700 1 -- 172.21.15.45:0/661348148 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f68b006aed0 msgr2=0x7f68b006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:08.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.123+0000 7f68d3f86700 1 --2- 172.21.15.45:0/661348148 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f68b006aed0 0x7f68b006d390 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f68c8005fd0 tx=0x7f68c8005ee0 comp rx=0 tx=0).stop 2023-10-08T12:46:08.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.123+0000 7f68d3f86700 1 -- 172.21.15.45:0/661348148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68cc0af890 msgr2=0x7f68cc153c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:08.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.123+0000 7f68d3f86700 1 --2- 172.21.15.45:0/661348148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68cc0af890 0x7f68cc153c50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f68cc0b4680 tx=0x7f68bc017760 comp rx=0 tx=0).stop 2023-10-08T12:46:08.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.123+0000 7f68d3f86700 1 -- 172.21.15.45:0/661348148 shutdown_connections 2023-10-08T12:46:08.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.123+0000 7f68d3f86700 1 --2- 172.21.15.45:0/661348148 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f68b006aed0 0x7f68b006d390 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:08.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.123+0000 7f68d3f86700 1 --2- 172.21.15.45:0/661348148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68cc0ca150 0x7f68cc15b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:08.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.124+0000 7f68d3f86700 1 --2- 172.21.15.45:0/661348148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68cc0af890 0x7f68cc153c50 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:08.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.124+0000 7f68d3f86700 1 --2- 172.21.15.45:0/661348148 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f68cc0afc70 0x7f68cc0c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:08.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.124+0000 7f68d3f86700 1 -- 172.21.15.45:0/661348148 >> 172.21.15.45:0/661348148 conn(0x7f68cc097a20 msgr2=0x7f68cc157e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:08.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.124+0000 7f68d3f86700 1 -- 172.21.15.45:0/661348148 shutdown_connections 2023-10-08T12:46:08.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.124+0000 7f68d3f86700 1 -- 172.21.15.45:0/661348148 wait complete. 2023-10-08T12:46:08.137 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:46:08.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.267+0000 7fdbe990e700 1 -- 172.21.15.45:0/935911829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbcc003a00 msgr2=0x7fdbcc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:08.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.267+0000 7fdbe990e700 1 --2- 172.21.15.45:0/935911829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbcc003a00 0x7fdbcc003e20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8009c10 tx=0x7fdbcc005880 comp rx=0 tx=0).stop 2023-10-08T12:46:08.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.267+0000 7fdbe37fe700 1 -- 172.21.15.45:0/935911829 reap_dead start 2023-10-08T12:46:08.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.267+0000 7fdbe990e700 1 -- 172.21.15.45:0/935911829 shutdown_connections 2023-10-08T12:46:08.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.267+0000 7fdbe990e700 1 -- 172.21.15.45:0/935911829 >> 172.21.15.45:0/935911829 conn(0x7fdbe4071940 msgr2=0x7fdbe4071d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:08.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.267+0000 7fdbe990e700 1 -- 172.21.15.45:0/935911829 shutdown_connections 2023-10-08T12:46:08.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.267+0000 7fdbe990e700 1 -- 172.21.15.45:0/935911829 wait complete. 2023-10-08T12:46:08.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.268+0000 7fdbe990e700 1 Processor -- start 2023-10-08T12:46:08.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.268+0000 7fdbe990e700 1 -- start start 2023-10-08T12:46:08.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.269+0000 7fdbe990e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbcc003a00 0x7fdbe40ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:08.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.269+0000 7fdbe990e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbe40c8ad0 0x7fdbe415ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:08.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.269+0000 7fdbe990e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdbe40c8f50 0x7fdbe415b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:08.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.269+0000 7fdbe990e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe40c9fc0 con 0x7fdbe40c8ad0 2023-10-08T12:46:08.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.269+0000 7fdbe990e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe40c9440 con 0x7fdbcc003a00 2023-10-08T12:46:08.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.269+0000 7fdbe990e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe40c9720 con 0x7fdbe40c8f50 2023-10-08T12:46:08.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.269+0000 7fdbe27fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbe40c8ad0 0x7fdbe415ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:08.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.269+0000 7fdbe27fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbe40c8ad0 0x7fdbe415ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36332/0 (socket says 172.21.15.45:36332) 2023-10-08T12:46:08.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.269+0000 7fdbe27fc700 1 -- 172.21.15.45:0/3835468722 learned_addr learned my addr 172.21.15.45:0/3835468722 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:08.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.269+0000 7fdbe2ffd700 1 --2- 172.21.15.45:0/3835468722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbcc003a00 0x7fdbe40ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:08.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.269+0000 7fdbe37fe700 1 --2- 172.21.15.45:0/3835468722 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdbe40c8f50 0x7fdbe415b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:08.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.269+0000 7fdbe27fc700 1 -- 172.21.15.45:0/3835468722 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdbe40c8f50 msgr2=0x7fdbe415b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:08.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.269+0000 7fdbe27fc700 1 --2- 172.21.15.45:0/3835468722 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdbe40c8f50 0x7fdbe415b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:08.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.269+0000 7fdbe27fc700 1 -- 172.21.15.45:0/3835468722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbcc003a00 msgr2=0x7fdbe40ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:08.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.269+0000 7fdbe27fc700 1 --2- 172.21.15.45:0/3835468722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbcc003a00 0x7fdbe40ca780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:08.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.269+0000 7fdbe27fc700 1 -- 172.21.15.45:0/3835468722 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe40c9a00 con 0x7fdbe40c8ad0 2023-10-08T12:46:08.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.269+0000 7fdbe2ffd700 1 --2- 172.21.15.45:0/3835468722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbcc003a00 0x7fdbe40ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:08.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.270+0000 7fdbe27fc700 1 --2- 172.21.15.45:0/3835468722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbe40c8ad0 0x7fdbe415ab20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4011a00 tx=0x7fdbd4011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:08.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.270+0000 7fdbcbfff700 1 -- 172.21.15.45:0/3835468722 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd400fc60 con 0x7fdbe40c8ad0 2023-10-08T12:46:08.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.270+0000 7fdbcbfff700 1 -- 172.21.15.45:0/3835468722 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdbd400fdc0 con 0x7fdbe40c8ad0 2023-10-08T12:46:08.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.270+0000 7fdbcbfff700 1 -- 172.21.15.45:0/3835468722 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd40126b0 con 0x7fdbe40c8ad0 2023-10-08T12:46:08.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.270+0000 7fdbe990e700 1 -- 172.21.15.45:0/3835468722 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe40c9ce0 con 0x7fdbe40c8ad0 2023-10-08T12:46:08.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.270+0000 7fdbe990e700 1 -- 172.21.15.45:0/3835468722 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe40caea0 con 0x7fdbe40c8ad0 2023-10-08T12:46:08.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.271+0000 7fdbe990e700 1 -- 172.21.15.45:0/3835468722 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe4066850 con 0x7fdbe40c8ad0 2023-10-08T12:46:08.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.271+0000 7fdbcbfff700 1 -- 172.21.15.45:0/3835468722 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdbd4012810 con 0x7fdbe40c8ad0 2023-10-08T12:46:08.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.272+0000 7fdbcbfff700 1 --2- 172.21.15.45:0/3835468722 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fdbd006aed0 0x7fdbd006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:08.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.272+0000 7fdbcbfff700 1 -- 172.21.15.45:0/3835468722 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdbd408a040 con 0x7fdbe40c8ad0 2023-10-08T12:46:08.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.272+0000 7fdbe2ffd700 1 --2- 172.21.15.45:0/3835468722 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fdbd006aed0 0x7fdbd006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:08.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.272+0000 7fdbe2ffd700 1 --2- 172.21.15.45:0/3835468722 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fdbd006aed0 0x7fdbd006d390 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8009c10 tx=0x7fdbd8004750 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:08.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.276+0000 7fdbcbfff700 1 -- 172.21.15.45:0/3835468722 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdbd4055230 con 0x7fdbe40c8ad0 2023-10-08T12:46:08.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.478+0000 7fdbe990e700 1 -- 172.21.15.45:0/3835468722 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdbe40caea0 con 0x7fdbe40c8ad0 2023-10-08T12:46:08.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.478+0000 7fdbcbfff700 1 -- 172.21.15.45:0/3835468722 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdbe40caea0 con 0x7fdbe40c8ad0 2023-10-08T12:46:08.479 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-08T12:46:08.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.480+0000 7fdbe990e700 1 -- 172.21.15.45:0/3835468722 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fdbd006aed0 msgr2=0x7fdbd006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:08.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.480+0000 7fdbe990e700 1 --2- 172.21.15.45:0/3835468722 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fdbd006aed0 0x7fdbd006d390 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8009c10 tx=0x7fdbd8004750 comp rx=0 tx=0).stop 2023-10-08T12:46:08.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.480+0000 7fdbe990e700 1 -- 172.21.15.45:0/3835468722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbe40c8ad0 msgr2=0x7fdbe415ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:08.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.480+0000 7fdbe990e700 1 --2- 172.21.15.45:0/3835468722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbe40c8ad0 0x7fdbe415ab20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4011a00 tx=0x7fdbd4011dc0 comp rx=0 tx=0).stop 2023-10-08T12:46:08.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.480+0000 7fdbe990e700 1 -- 172.21.15.45:0/3835468722 shutdown_connections 2023-10-08T12:46:08.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.480+0000 7fdbe990e700 1 --2- 172.21.15.45:0/3835468722 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fdbd006aed0 0x7fdbd006d390 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:08.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.480+0000 7fdbe990e700 1 --2- 172.21.15.45:0/3835468722 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdbe40c8f50 0x7fdbe415b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:08.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.480+0000 7fdbe990e700 1 --2- 172.21.15.45:0/3835468722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbcc003a00 0x7fdbe40ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:08.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.480+0000 7fdbe990e700 1 --2- 172.21.15.45:0/3835468722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbe40c8ad0 0x7fdbe415ab20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:08.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.480+0000 7fdbe990e700 1 -- 172.21.15.45:0/3835468722 >> 172.21.15.45:0/3835468722 conn(0x7fdbe4071940 msgr2=0x7fdbe41e4240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:08.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.480+0000 7fdbe990e700 1 -- 172.21.15.45:0/3835468722 shutdown_connections 2023-10-08T12:46:08.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.480+0000 7fdbe990e700 1 -- 172.21.15.45:0/3835468722 wait complete. 2023-10-08T12:46:08.494 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:46:08.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.623+0000 7f06bd5fc700 1 -- 172.21.15.45:0/2140463813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06b80cff40 msgr2=0x7f06b80cc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:08.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.623+0000 7f06bd5fc700 1 --2- 172.21.15.45:0/2140463813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06b80cff40 0x7f06b80cc750 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f06b80b3c60 tx=0x7f06a8009c70 comp rx=0 tx=0).stop 2023-10-08T12:46:08.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.623+0000 7f06bd5fc700 1 -- 172.21.15.45:0/2140463813 shutdown_connections 2023-10-08T12:46:08.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.623+0000 7f06bd5fc700 1 --2- 172.21.15.45:0/2140463813 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06b80ccc90 0x7f06b80d1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:08.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.623+0000 7f06bd5fc700 1 --2- 172.21.15.45:0/2140463813 >> v2:172.21.15.78:3300/0 conn(0x7f06b815bc70 0x7f06b80cfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:08.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.623+0000 7f06bd5fc700 1 --2- 172.21.15.45:0/2140463813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06b80cff40 0x7f06b80cc750 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:08.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.623+0000 7f06bd5fc700 1 -- 172.21.15.45:0/2140463813 >> 172.21.15.45:0/2140463813 conn(0x7f06b8071d60 msgr2=0x7f06b8072170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:08.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.623+0000 7f06bd5fc700 1 -- 172.21.15.45:0/2140463813 shutdown_connections 2023-10-08T12:46:08.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.623+0000 7f06bd5fc700 1 -- 172.21.15.45:0/2140463813 wait complete. 2023-10-08T12:46:08.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.625+0000 7f06bd5fc700 1 Processor -- start 2023-10-08T12:46:08.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.625+0000 7f06bd5fc700 1 -- start start 2023-10-08T12:46:08.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.625+0000 7f06bd5fc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06b80ccc90 0x7f06b80c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:08.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.625+0000 7f06bd5fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06b80cff40 0x7f06b81e6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:08.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.625+0000 7f06bd5fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06b815bc70 0x7f06b81539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:08.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.625+0000 7f06bd5fc700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b80c9220 con 0x7f06b815bc70 2023-10-08T12:46:08.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.625+0000 7f06bd5fc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b81e7150 con 0x7f06b80cff40 2023-10-08T12:46:08.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.625+0000 7f06bd5fc700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b81436e0 con 0x7f06b80ccc90 2023-10-08T12:46:08.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.625+0000 7f06b77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06b815bc70 0x7f06b81539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:08.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.625+0000 7f06b77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06b815bc70 0x7f06b81539e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36348/0 (socket says 172.21.15.45:36348) 2023-10-08T12:46:08.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.625+0000 7f06b77fe700 1 -- 172.21.15.45:0/1625679081 learned_addr learned my addr 172.21.15.45:0/1625679081 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:08.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.626+0000 7f06b67fc700 1 --2- 172.21.15.45:0/1625679081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06b80cff40 0x7f06b81e6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:08.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.626+0000 7f06b6ffd700 1 --2- 172.21.15.45:0/1625679081 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06b80ccc90 0x7f06b80c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:08.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.626+0000 7f06b77fe700 1 -- 172.21.15.45:0/1625679081 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06b80ccc90 msgr2=0x7f06b80c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:08.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.626+0000 7f06b77fe700 1 --2- 172.21.15.45:0/1625679081 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06b80ccc90 0x7f06b80c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:08.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.626+0000 7f06b77fe700 1 -- 172.21.15.45:0/1625679081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06b80cff40 msgr2=0x7f06b81e6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:08.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.626+0000 7f06b77fe700 1 --2- 172.21.15.45:0/1625679081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06b80cff40 0x7f06b81e6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:08.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.626+0000 7f06b77fe700 1 -- 172.21.15.45:0/1625679081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a80095f0 con 0x7f06b815bc70 2023-10-08T12:46:08.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.626+0000 7f06b67fc700 1 --2- 172.21.15.45:0/1625679081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06b80cff40 0x7f06b81e6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:46:08.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.626+0000 7f06b77fe700 1 --2- 172.21.15.45:0/1625679081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06b815bc70 0x7f06b81539e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f06b0007ee0 tx=0x7f06b000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:08.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.626+0000 7f069f7fe700 1 -- 172.21.15.45:0/1625679081 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b0017070 con 0x7f06b815bc70 2023-10-08T12:46:08.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.626+0000 7f069f7fe700 1 -- 172.21.15.45:0/1625679081 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f06b000f040 con 0x7f06b815bc70 2023-10-08T12:46:08.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.626+0000 7f06bd5fc700 1 -- 172.21.15.45:0/1625679081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b80c8bd0 con 0x7f06b815bc70 2023-10-08T12:46:08.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.626+0000 7f069f7fe700 1 -- 172.21.15.45:0/1625679081 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b000de10 con 0x7f06b815bc70 2023-10-08T12:46:08.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.626+0000 7f06bd5fc700 1 -- 172.21.15.45:0/1625679081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b8153f20 con 0x7f06b815bc70 2023-10-08T12:46:08.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.627+0000 7f06bd5fc700 1 -- 172.21.15.45:0/1625679081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06b80c9390 con 0x7f06b815bc70 2023-10-08T12:46:08.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.628+0000 7f069f7fe700 1 -- 172.21.15.45:0/1625679081 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f06b001c410 con 0x7f06b815bc70 2023-10-08T12:46:08.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.628+0000 7f069f7fe700 1 --2- 172.21.15.45:0/1625679081 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f06a406aed0 0x7f06a406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:08.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.628+0000 7f069f7fe700 1 -- 172.21.15.45:0/1625679081 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06b0089390 con 0x7f06b815bc70 2023-10-08T12:46:08.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.628+0000 7f06b6ffd700 1 --2- 172.21.15.45:0/1625679081 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f06a406aed0 0x7f06a406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:08.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.629+0000 7f06b6ffd700 1 --2- 172.21.15.45:0/1625679081 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f06a406aed0 0x7f06a406d390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f06b80b57b0 tx=0x7f06ac00b510 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:08.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.633+0000 7f069f7fe700 1 -- 172.21.15.45:0/1625679081 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f06b0057ed0 con 0x7f06b815bc70 2023-10-08T12:46:08.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.832+0000 7f06bd5fc700 1 -- 172.21.15.45:0/1625679081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f06b8066850 con 0x7f06b815bc70 2023-10-08T12:46:08.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.833+0000 7f069f7fe700 1 -- 172.21.15.45:0/1625679081 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f06b0057a60 con 0x7f06b815bc70 2023-10-08T12:46:08.834 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-08T12:46:08.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.835+0000 7f06bd5fc700 1 -- 172.21.15.45:0/1625679081 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f06a406aed0 msgr2=0x7f06a406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:08.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.835+0000 7f06bd5fc700 1 --2- 172.21.15.45:0/1625679081 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f06a406aed0 0x7f06a406d390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f06b80b57b0 tx=0x7f06ac00b510 comp rx=0 tx=0).stop 2023-10-08T12:46:08.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.835+0000 7f06bd5fc700 1 -- 172.21.15.45:0/1625679081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06b815bc70 msgr2=0x7f06b81539e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:08.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.835+0000 7f06bd5fc700 1 --2- 172.21.15.45:0/1625679081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06b815bc70 0x7f06b81539e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f06b0007ee0 tx=0x7f06b000d3b0 comp rx=0 tx=0).stop 2023-10-08T12:46:08.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.835+0000 7f06bd5fc700 1 -- 172.21.15.45:0/1625679081 shutdown_connections 2023-10-08T12:46:08.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.835+0000 7f06bd5fc700 1 --2- 172.21.15.45:0/1625679081 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f06a406aed0 0x7f06a406d390 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:08.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.835+0000 7f06bd5fc700 1 --2- 172.21.15.45:0/1625679081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06b815bc70 0x7f06b81539e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:08.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.835+0000 7f06bd5fc700 1 --2- 172.21.15.45:0/1625679081 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06b80ccc90 0x7f06b80c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:08.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.835+0000 7f06bd5fc700 1 --2- 172.21.15.45:0/1625679081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06b80cff40 0x7f06b81e6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:08.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.835+0000 7f06bd5fc700 1 -- 172.21.15.45:0/1625679081 >> 172.21.15.45:0/1625679081 conn(0x7f06b8071d60 msgr2=0x7f06b8156330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:08.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.835+0000 7f06bd5fc700 1 -- 172.21.15.45:0/1625679081 shutdown_connections 2023-10-08T12:46:08.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.835+0000 7f06bd5fc700 1 -- 172.21.15.45:0/1625679081 wait complete. 2023-10-08T12:46:08.848 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-08T12:46:08.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.975+0000 7fe6a7959700 1 -- 172.21.15.45:0/758329609 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a015c320 msgr2=0x7fe6a0071f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:08.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.975+0000 7fe6a7959700 1 --2- 172.21.15.45:0/758329609 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a015c320 0x7fe6a0071f80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe69c005fd0 tx=0x7fe69c009c70 comp rx=0 tx=0).stop 2023-10-08T12:46:08.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.975+0000 7fe6a7959700 1 -- 172.21.15.45:0/758329609 shutdown_connections 2023-10-08T12:46:08.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.975+0000 7fe6a7959700 1 --2- 172.21.15.45:0/758329609 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe6a0158950 0x7fe6a00cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:08.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.975+0000 7fe6a7959700 1 --2- 172.21.15.45:0/758329609 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a015c320 0x7fe6a0071f80 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:08.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.975+0000 7fe6a7959700 1 -- 172.21.15.45:0/758329609 >> 172.21.15.45:0/758329609 conn(0x7fe6a00b0430 msgr2=0x7fe6a00b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:08.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.975+0000 7fe6a7959700 1 -- 172.21.15.45:0/758329609 shutdown_connections 2023-10-08T12:46:08.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.975+0000 7fe6a7959700 1 -- 172.21.15.45:0/758329609 wait complete. 2023-10-08T12:46:08.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.977+0000 7fe6a7959700 1 Processor -- start 2023-10-08T12:46:08.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.977+0000 7fe6a7959700 1 -- start start 2023-10-08T12:46:08.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.977+0000 7fe6a7959700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6a00724c0 0x7fe6a01549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:08.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.977+0000 7fe6a7959700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe6a0158950 0x7fe6a00c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:08.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.977+0000 7fe6a7959700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a015c320 0x7fe6a00c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:08.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.977+0000 7fe6a7959700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a0154ee0 con 0x7fe6a015c320 2023-10-08T12:46:08.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.977+0000 7fe6a7959700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a0158ec0 con 0x7fe6a00724c0 2023-10-08T12:46:08.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.977+0000 7fe6a7959700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a00c6b20 con 0x7fe6a0158950 2023-10-08T12:46:08.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.978+0000 7fe6a5ef6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a015c320 0x7fe6a00c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:08.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.978+0000 7fe6a5ef6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a015c320 0x7fe6a00c7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36360/0 (socket says 172.21.15.45:36360) 2023-10-08T12:46:08.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.978+0000 7fe6a5ef6700 1 -- 172.21.15.45:0/2514583678 learned_addr learned my addr 172.21.15.45:0/2514583678 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:08.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.978+0000 7fe6a56f5700 1 --2- 172.21.15.45:0/2514583678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6a00724c0 0x7fe6a01549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:08.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.978+0000 7fe6a4ef4700 1 --2- 172.21.15.45:0/2514583678 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe6a0158950 0x7fe6a00c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:08.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.978+0000 7fe6a5ef6700 1 -- 172.21.15.45:0/2514583678 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe6a0158950 msgr2=0x7fe6a00c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:08.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.978+0000 7fe6a5ef6700 1 --2- 172.21.15.45:0/2514583678 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe6a0158950 0x7fe6a00c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:08.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.978+0000 7fe6a5ef6700 1 -- 172.21.15.45:0/2514583678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6a00724c0 msgr2=0x7fe6a01549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:08.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.978+0000 7fe6a5ef6700 1 --2- 172.21.15.45:0/2514583678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6a00724c0 0x7fe6a01549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:08.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.978+0000 7fe6a5ef6700 1 -- 172.21.15.45:0/2514583678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69c0095f0 con 0x7fe6a015c320 2023-10-08T12:46:08.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.978+0000 7fe6a5ef6700 1 --2- 172.21.15.45:0/2514583678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a015c320 0x7fe6a00c7a70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe69800cc10 tx=0x7fe69800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:08.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.978+0000 7fe695ffb700 1 -- 172.21.15.45:0/2514583678 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69800aa60 con 0x7fe6a015c320 2023-10-08T12:46:08.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.978+0000 7fe695ffb700 1 -- 172.21.15.45:0/2514583678 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe69800acb0 con 0x7fe6a015c320 2023-10-08T12:46:08.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.978+0000 7fe6a7959700 1 -- 172.21.15.45:0/2514583678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6a0159160 con 0x7fe6a015c320 2023-10-08T12:46:08.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.978+0000 7fe695ffb700 1 -- 172.21.15.45:0/2514583678 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe698012680 con 0x7fe6a015c320 2023-10-08T12:46:08.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.978+0000 7fe6a7959700 1 -- 172.21.15.45:0/2514583678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a00c6830 con 0x7fe6a015c320 2023-10-08T12:46:08.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.979+0000 7fe6a7959700 1 -- 172.21.15.45:0/2514583678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a0159680 con 0x7fe6a015c320 2023-10-08T12:46:08.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.980+0000 7fe695ffb700 1 -- 172.21.15.45:0/2514583678 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe6980127e0 con 0x7fe6a015c320 2023-10-08T12:46:08.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.980+0000 7fe695ffb700 1 --2- 172.21.15.45:0/2514583678 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe68406aed0 0x7fe68406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:08.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.980+0000 7fe695ffb700 1 -- 172.21.15.45:0/2514583678 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe698089b20 con 0x7fe6a015c320 2023-10-08T12:46:08.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.980+0000 7fe6a56f5700 1 --2- 172.21.15.45:0/2514583678 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe68406aed0 0x7fe68406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:08.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.981+0000 7fe6a56f5700 1 --2- 172.21.15.45:0/2514583678 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe68406aed0 0x7fe68406d390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe69000ce60 tx=0x7fe69000e040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:08.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:08.985+0000 7fe695ffb700 1 -- 172.21.15.45:0/2514583678 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe6a0159680 con 0x7fe6a015c320 2023-10-08T12:46:09.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.201+0000 7fe6a7959700 1 -- 172.21.15.45:0/2514583678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe6a0159680 con 0x7fe6a015c320 2023-10-08T12:46:09.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.201+0000 7fe695ffb700 1 -- 172.21.15.45:0/2514583678 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe6a0159680 con 0x7fe6a015c320 2023-10-08T12:46:09.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.203+0000 7fe6a7959700 1 -- 172.21.15.45:0/2514583678 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe68406aed0 msgr2=0x7fe68406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:09.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.203+0000 7fe6a7959700 1 --2- 172.21.15.45:0/2514583678 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe68406aed0 0x7fe68406d390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe69000ce60 tx=0x7fe69000e040 comp rx=0 tx=0).stop 2023-10-08T12:46:09.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.203+0000 7fe6a7959700 1 -- 172.21.15.45:0/2514583678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a015c320 msgr2=0x7fe6a00c7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:09.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.203+0000 7fe6a7959700 1 --2- 172.21.15.45:0/2514583678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a015c320 0x7fe6a00c7a70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe69800cc10 tx=0x7fe69800cf20 comp rx=0 tx=0).stop 2023-10-08T12:46:09.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.203+0000 7fe6a7959700 1 -- 172.21.15.45:0/2514583678 shutdown_connections 2023-10-08T12:46:09.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.203+0000 7fe6a7959700 1 --2- 172.21.15.45:0/2514583678 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe68406aed0 0x7fe68406d390 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:09.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.203+0000 7fe6a7959700 1 --2- 172.21.15.45:0/2514583678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a015c320 0x7fe6a00c7a70 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:09.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.203+0000 7fe6a7959700 1 --2- 172.21.15.45:0/2514583678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6a00724c0 0x7fe6a01549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:09.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.203+0000 7fe6a7959700 1 --2- 172.21.15.45:0/2514583678 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe6a0158950 0x7fe6a00c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:09.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.203+0000 7fe6a7959700 1 -- 172.21.15.45:0/2514583678 >> 172.21.15.45:0/2514583678 conn(0x7fe6a00b0430 msgr2=0x7fe6a00ae6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:09.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.203+0000 7fe6a7959700 1 -- 172.21.15.45:0/2514583678 shutdown_connections 2023-10-08T12:46:09.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.203+0000 7fe6a7959700 1 -- 172.21.15.45:0/2514583678 wait complete. 2023-10-08T12:46:09.206 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-10-08T12:46:09.216 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-08T12:46:09.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:46:09.216 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-08T12:46:09.251 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-10-08T12:46:09.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:46:09.251 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-08T12:46:09.309 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T12:46:09.309 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T12:46:09.331 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T12:46:09.331 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T12:46:09.392 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T12:46:09.392 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T12:46:09.454 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:46:09.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.581+0000 7f54e3f4f700 1 -- 172.21.15.45:0/1839358397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54dc162810 msgr2=0x7f54dc164c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:09.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.581+0000 7f54e3f4f700 1 --2- 172.21.15.45:0/1839358397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54dc162810 0x7f54dc164c00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f54d4009f60 tx=0x7f54d4009f90 comp rx=0 tx=0).stop 2023-10-08T12:46:09.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.581+0000 7f54e3f4f700 1 -- 172.21.15.45:0/1839358397 shutdown_connections 2023-10-08T12:46:09.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.581+0000 7f54e3f4f700 1 --2- 172.21.15.45:0/1839358397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54dc162810 0x7f54dc164c00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:09.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.581+0000 7f54e3f4f700 1 -- 172.21.15.45:0/1839358397 >> 172.21.15.45:0/1839358397 conn(0x7f54dc0afae0 msgr2=0x7f54dc0afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:09.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.581+0000 7f54e3f4f700 1 -- 172.21.15.45:0/1839358397 shutdown_connections 2023-10-08T12:46:09.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.581+0000 7f54e3f4f700 1 -- 172.21.15.45:0/1839358397 wait complete. 2023-10-08T12:46:09.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.583+0000 7f54e3f4f700 1 Processor -- start 2023-10-08T12:46:09.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.583+0000 7f54e3f4f700 1 -- start start 2023-10-08T12:46:09.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.584+0000 7f54e3f4f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54dc072e00 0x7f54dc156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:09.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.584+0000 7f54e3f4f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f54dc159a80 0x7f54dc158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:09.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.584+0000 7f54e3f4f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54dc162810 0x7f54dc162bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:09.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.584+0000 7f54e3f4f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc157000 con 0x7f54dc162810 2023-10-08T12:46:09.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.584+0000 7f54e3f4f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc09c6b0 con 0x7f54dc072e00 2023-10-08T12:46:09.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.584+0000 7f54e3f4f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc09c990 con 0x7f54dc159a80 2023-10-08T12:46:09.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.584+0000 7f54e24ec700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54dc162810 0x7f54dc162bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:09.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.584+0000 7f54e24ec700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54dc162810 0x7f54dc162bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36374/0 (socket says 172.21.15.45:36374) 2023-10-08T12:46:09.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.584+0000 7f54e24ec700 1 -- 172.21.15.45:0/1950103236 learned_addr learned my addr 172.21.15.45:0/1950103236 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:09.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.584+0000 7f54e1ceb700 1 --2- 172.21.15.45:0/1950103236 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54dc072e00 0x7f54dc156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:09.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.584+0000 7f54e24ec700 1 -- 172.21.15.45:0/1950103236 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f54dc159a80 msgr2=0x7f54dc158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:09.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.584+0000 7f54e24ec700 1 --2- 172.21.15.45:0/1950103236 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f54dc159a80 0x7f54dc158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:09.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.584+0000 7f54e24ec700 1 -- 172.21.15.45:0/1950103236 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54dc072e00 msgr2=0x7f54dc156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:09.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.584+0000 7f54e24ec700 1 --2- 172.21.15.45:0/1950103236 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54dc072e00 0x7f54dc156ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:09.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.584+0000 7f54e24ec700 1 -- 172.21.15.45:0/1950103236 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d4009c40 con 0x7f54dc162810 2023-10-08T12:46:09.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.584+0000 7f54e24ec700 1 --2- 172.21.15.45:0/1950103236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54dc162810 0x7f54dc162bf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f54d400b610 tx=0x7f54d4007b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:09.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.585+0000 7f54ce7fc700 1 -- 172.21.15.45:0/1950103236 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d400e040 con 0x7f54dc162810 2023-10-08T12:46:09.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.585+0000 7f54ce7fc700 1 -- 172.21.15.45:0/1950103236 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f54d4003c00 con 0x7f54dc162810 2023-10-08T12:46:09.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.585+0000 7f54e3f4f700 1 -- 172.21.15.45:0/1950103236 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54dc09cc70 con 0x7f54dc162810 2023-10-08T12:46:09.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.585+0000 7f54ce7fc700 1 -- 172.21.15.45:0/1950103236 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d4009ac0 con 0x7f54dc162810 2023-10-08T12:46:09.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.585+0000 7f54e3f4f700 1 -- 172.21.15.45:0/1950103236 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54dc09d230 con 0x7f54dc162810 2023-10-08T12:46:09.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.586+0000 7f54e3f4f700 1 -- 172.21.15.45:0/1950103236 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54dc0674a0 con 0x7f54dc162810 2023-10-08T12:46:09.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.586+0000 7f54ce7fc700 1 -- 172.21.15.45:0/1950103236 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f54d4012600 con 0x7f54dc162810 2023-10-08T12:46:09.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.587+0000 7f54ce7fc700 1 --2- 172.21.15.45:0/1950103236 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f54c006aed0 0x7f54c006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:09.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.587+0000 7f54ce7fc700 1 -- 172.21.15.45:0/1950103236 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54d408a4c0 con 0x7f54dc162810 2023-10-08T12:46:09.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.587+0000 7f54e1ceb700 1 --2- 172.21.15.45:0/1950103236 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f54c006aed0 0x7f54c006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:09.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.587+0000 7f54e1ceb700 1 --2- 172.21.15.45:0/1950103236 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f54c006aed0 0x7f54c006d390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f54d8007fd0 tx=0x7f54d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:09.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.591+0000 7f54ce7fc700 1 -- 172.21.15.45:0/1950103236 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f54d4055600 con 0x7f54dc162810 2023-10-08T12:46:09.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.793+0000 7f54e3f4f700 1 -- 172.21.15.45:0/1950103236 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54dc04e4c0 con 0x7f54dc162810 2023-10-08T12:46:09.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.794+0000 7f54ce7fc700 1 -- 172.21.15.45:0/1950103236 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f54d4022090 con 0x7f54dc162810 2023-10-08T12:46:09.795 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:46:09.795 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:45:26.206424+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:45:19.183651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:45:22.277383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:45:23.606639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.412453+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.351925+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.428025+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.437246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.441119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.388608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.415524+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.401835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:46:09.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.796+0000 7f54e3f4f700 1 -- 172.21.15.45:0/1950103236 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f54c006aed0 msgr2=0x7f54c006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:09.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.796+0000 7f54e3f4f700 1 --2- 172.21.15.45:0/1950103236 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f54c006aed0 0x7f54c006d390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f54d8007fd0 tx=0x7f54d8009040 comp rx=0 tx=0).stop 2023-10-08T12:46:09.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.796+0000 7f54e3f4f700 1 -- 172.21.15.45:0/1950103236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54dc162810 msgr2=0x7f54dc162bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:09.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.796+0000 7f54e3f4f700 1 --2- 172.21.15.45:0/1950103236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54dc162810 0x7f54dc162bf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f54d400b610 tx=0x7f54d4007b50 comp rx=0 tx=0).stop 2023-10-08T12:46:09.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.796+0000 7f54e3f4f700 1 -- 172.21.15.45:0/1950103236 shutdown_connections 2023-10-08T12:46:09.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.796+0000 7f54e3f4f700 1 --2- 172.21.15.45:0/1950103236 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f54c006aed0 0x7f54c006d390 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:09.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.796+0000 7f54e3f4f700 1 --2- 172.21.15.45:0/1950103236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54dc162810 0x7f54dc162bf0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:09.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.796+0000 7f54e3f4f700 1 --2- 172.21.15.45:0/1950103236 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54dc072e00 0x7f54dc156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:09.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.796+0000 7f54e3f4f700 1 --2- 172.21.15.45:0/1950103236 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f54dc159a80 0x7f54dc158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:09.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.796+0000 7f54e3f4f700 1 -- 172.21.15.45:0/1950103236 >> 172.21.15.45:0/1950103236 conn(0x7f54dc0afae0 msgr2=0x7f54dc0b1870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:09.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.796+0000 7f54e3f4f700 1 -- 172.21.15.45:0/1950103236 shutdown_connections 2023-10-08T12:46:09.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.796+0000 7f54e3f4f700 1 -- 172.21.15.45:0/1950103236 wait complete. 2023-10-08T12:46:09.809 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:45:19.183651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:45:22.277383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:45:23.606639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:46:09.810 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:46:09.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.940+0000 7f96469b7700 1 -- 172.21.15.45:0/2853134004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f964015c0d0 msgr2=0x7f96400c9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:09.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.940+0000 7f96469b7700 1 --2- 172.21.15.45:0/2853134004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f964015c0d0 0x7f96400c9c00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f96400c8bf0 tx=0x7f9630009ba0 comp rx=0 tx=0).stop 2023-10-08T12:46:09.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.940+0000 7f96469b7700 1 -- 172.21.15.45:0/2853134004 shutdown_connections 2023-10-08T12:46:09.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.940+0000 7f96469b7700 1 --2- 172.21.15.45:0/2853134004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f964015c0d0 0x7f96400c9c00 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:09.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.940+0000 7f96469b7700 1 --2- 172.21.15.45:0/2853134004 >> v2:172.21.15.78:3300/0 conn(0x7f96400cf000 0x7f96400cb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:09.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.940+0000 7f96469b7700 1 -- 172.21.15.45:0/2853134004 >> 172.21.15.45:0/2853134004 conn(0x7f9640097a20 msgr2=0x7f96400ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:09.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.940+0000 7f96469b7700 1 -- 172.21.15.45:0/2853134004 shutdown_connections 2023-10-08T12:46:09.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.940+0000 7f96469b7700 1 -- 172.21.15.45:0/2853134004 wait complete. 2023-10-08T12:46:09.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.942+0000 7f96469b7700 1 Processor -- start 2023-10-08T12:46:09.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.942+0000 7f96469b7700 1 -- start start 2023-10-08T12:46:09.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.943+0000 7f96469b7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96400cb560 0x7f96401527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:09.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.943+0000 7f96469b7700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96400cf000 0x7f9640147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:09.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.943+0000 7f96469b7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f964015c0d0 0x7f964006a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:09.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.943+0000 7f96469b7700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964006f390 con 0x7f96400cb560 2023-10-08T12:46:09.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.943+0000 7f96469b7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9640153850 con 0x7f964015c0d0 2023-10-08T12:46:09.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.943+0000 7f96469b7700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9640152cf0 con 0x7f96400cf000 2023-10-08T12:46:09.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.943+0000 7f963ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96400cb560 0x7f96401527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:09.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.943+0000 7f963ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96400cb560 0x7f96401527b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36384/0 (socket says 172.21.15.45:36384) 2023-10-08T12:46:09.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.943+0000 7f963ffff700 1 -- 172.21.15.45:0/51422342 learned_addr learned my addr 172.21.15.45:0/51422342 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:09.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.943+0000 7f9644f54700 1 --2- 172.21.15.45:0/51422342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f964015c0d0 0x7f964006a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:09.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.943+0000 7f963f7fe700 1 --2- 172.21.15.45:0/51422342 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96400cf000 0x7f9640147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:09.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.943+0000 7f963ffff700 1 -- 172.21.15.45:0/51422342 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96400cf000 msgr2=0x7f9640147af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:09.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.943+0000 7f963ffff700 1 --2- 172.21.15.45:0/51422342 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96400cf000 0x7f9640147af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:09.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.943+0000 7f963ffff700 1 -- 172.21.15.45:0/51422342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f964015c0d0 msgr2=0x7f964006a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:09.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.943+0000 7f963ffff700 1 --2- 172.21.15.45:0/51422342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f964015c0d0 0x7f964006a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:09.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.943+0000 7f963ffff700 1 -- 172.21.15.45:0/51422342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9630009520 con 0x7f96400cb560 2023-10-08T12:46:09.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.943+0000 7f9644f54700 1 --2- 172.21.15.45:0/51422342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f964015c0d0 0x7f964006a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:46:09.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.943+0000 7f963f7fe700 1 --2- 172.21.15.45:0/51422342 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96400cf000 0x7f9640147af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:46:09.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.943+0000 7f963ffff700 1 --2- 172.21.15.45:0/51422342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96400cb560 0x7f96401527b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9630009810 tx=0x7f96300107b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:09.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.943+0000 7f963cff9700 1 -- 172.21.15.45:0/51422342 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9630010e60 con 0x7f96400cb560 2023-10-08T12:46:09.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.944+0000 7f963cff9700 1 -- 172.21.15.45:0/51422342 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9630017510 con 0x7f96400cb560 2023-10-08T12:46:09.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.944+0000 7f96469b7700 1 -- 172.21.15.45:0/51422342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9640152fb0 con 0x7f96400cb560 2023-10-08T12:46:09.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.944+0000 7f963cff9700 1 -- 172.21.15.45:0/51422342 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9630017920 con 0x7f96400cb560 2023-10-08T12:46:09.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.944+0000 7f96469b7700 1 -- 172.21.15.45:0/51422342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9640153570 con 0x7f96400cb560 2023-10-08T12:46:09.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.944+0000 7f96469b7700 1 -- 172.21.15.45:0/51422342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9640066850 con 0x7f96400cb560 2023-10-08T12:46:09.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.945+0000 7f963cff9700 1 -- 172.21.15.45:0/51422342 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9630017a80 con 0x7f96400cb560 2023-10-08T12:46:09.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.945+0000 7f963cff9700 1 --2- 172.21.15.45:0/51422342 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f962006aed0 0x7f962006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:09.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.946+0000 7f963cff9700 1 -- 172.21.15.45:0/51422342 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f963008b290 con 0x7f96400cb560 2023-10-08T12:46:09.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.946+0000 7f963f7fe700 1 --2- 172.21.15.45:0/51422342 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f962006aed0 0x7f962006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:09.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.946+0000 7f963f7fe700 1 --2- 172.21.15.45:0/51422342 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f962006aed0 0x7f962006d390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9628005fd0 tx=0x7f9628005ee0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:09.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:09.950+0000 7f963cff9700 1 -- 172.21.15.45:0/51422342 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9630056340 con 0x7f96400cb560 2023-10-08T12:46:10.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.148+0000 7f96469b7700 1 -- 172.21.15.45:0/51422342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9640159f90 con 0x7f96400cb560 2023-10-08T12:46:10.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.149+0000 7f963cff9700 1 -- 172.21.15.45:0/51422342 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9630059960 con 0x7f96400cb560 2023-10-08T12:46:10.150 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-08T12:46:10.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.151+0000 7f96469b7700 1 -- 172.21.15.45:0/51422342 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f962006aed0 msgr2=0x7f962006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:10.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.151+0000 7f96469b7700 1 --2- 172.21.15.45:0/51422342 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f962006aed0 0x7f962006d390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9628005fd0 tx=0x7f9628005ee0 comp rx=0 tx=0).stop 2023-10-08T12:46:10.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.151+0000 7f96469b7700 1 -- 172.21.15.45:0/51422342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96400cb560 msgr2=0x7f96401527b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:10.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.151+0000 7f96469b7700 1 --2- 172.21.15.45:0/51422342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96400cb560 0x7f96401527b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9630009810 tx=0x7f96300107b0 comp rx=0 tx=0).stop 2023-10-08T12:46:10.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.151+0000 7f96469b7700 1 -- 172.21.15.45:0/51422342 shutdown_connections 2023-10-08T12:46:10.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.151+0000 7f96469b7700 1 --2- 172.21.15.45:0/51422342 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f962006aed0 0x7f962006d390 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:10.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.151+0000 7f96469b7700 1 --2- 172.21.15.45:0/51422342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f964015c0d0 0x7f964006a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:10.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.151+0000 7f96469b7700 1 --2- 172.21.15.45:0/51422342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96400cb560 0x7f96401527b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:10.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.151+0000 7f96469b7700 1 --2- 172.21.15.45:0/51422342 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96400cf000 0x7f9640147af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:10.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.151+0000 7f96469b7700 1 -- 172.21.15.45:0/51422342 >> 172.21.15.45:0/51422342 conn(0x7f9640097a20 msgr2=0x7f964014fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:10.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.151+0000 7f96469b7700 1 -- 172.21.15.45:0/51422342 shutdown_connections 2023-10-08T12:46:10.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.151+0000 7f96469b7700 1 -- 172.21.15.45:0/51422342 wait complete. 2023-10-08T12:46:10.164 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:46:10.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.294+0000 7f29ba606700 1 -- 172.21.15.45:0/1963227387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29b415c0d0 msgr2=0x7f29b40c9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:10.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.294+0000 7f29ba606700 1 --2- 172.21.15.45:0/1963227387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29b415c0d0 0x7f29b40c9c00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f299c0098c0 tx=0x7f299c009bd0 comp rx=0 tx=0).stop 2023-10-08T12:46:10.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.294+0000 7f29ba606700 1 -- 172.21.15.45:0/1963227387 shutdown_connections 2023-10-08T12:46:10.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.294+0000 7f29ba606700 1 --2- 172.21.15.45:0/1963227387 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f29b40cb730 0x7f29b40b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:10.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.294+0000 7f29ba606700 1 --2- 172.21.15.45:0/1963227387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29b415c0d0 0x7f29b40c9c00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:10.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.294+0000 7f29ba606700 1 -- 172.21.15.45:0/1963227387 >> 172.21.15.45:0/1963227387 conn(0x7f29b4097a20 msgr2=0x7f29b40ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:10.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.294+0000 7f29ba606700 1 -- 172.21.15.45:0/1963227387 shutdown_connections 2023-10-08T12:46:10.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.294+0000 7f29ba606700 1 -- 172.21.15.45:0/1963227387 wait complete. 2023-10-08T12:46:10.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.295+0000 7f29ba606700 1 Processor -- start 2023-10-08T12:46:10.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.295+0000 7f29ba606700 1 -- start start 2023-10-08T12:46:10.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.296+0000 7f29ba606700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29b40cb730 0x7f29b40c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:10.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.296+0000 7f29ba606700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f29b40cf000 0x7f29b40c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:10.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.296+0000 7f29ba606700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29b415c0d0 0x7f29b4150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:10.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.296+0000 7f29ba606700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40c2270 con 0x7f29b40cb730 2023-10-08T12:46:10.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.296+0000 7f29ba606700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40c3500 con 0x7f29b415c0d0 2023-10-08T12:46:10.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.296+0000 7f29ba606700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40c2d00 con 0x7f29b40cf000 2023-10-08T12:46:10.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.296+0000 7f29b3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29b40cb730 0x7f29b40c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:10.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.296+0000 7f29b3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29b40cb730 0x7f29b40c6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36398/0 (socket says 172.21.15.45:36398) 2023-10-08T12:46:10.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.296+0000 7f29b3fff700 1 -- 172.21.15.45:0/3785189596 learned_addr learned my addr 172.21.15.45:0/3785189596 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:10.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.296+0000 7f29b8ba3700 1 --2- 172.21.15.45:0/3785189596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29b415c0d0 0x7f29b4150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:10.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.296+0000 7f29b37fe700 1 --2- 172.21.15.45:0/3785189596 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f29b40cf000 0x7f29b40c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:10.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.296+0000 7f29b3fff700 1 -- 172.21.15.45:0/3785189596 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f29b40cf000 msgr2=0x7f29b40c1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:10.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.296+0000 7f29b3fff700 1 --2- 172.21.15.45:0/3785189596 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f29b40cf000 0x7f29b40c1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:10.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.296+0000 7f29b3fff700 1 -- 172.21.15.45:0/3785189596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29b415c0d0 msgr2=0x7f29b4150f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:10.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.296+0000 7f29b3fff700 1 --2- 172.21.15.45:0/3785189596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29b415c0d0 0x7f29b4150f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:10.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.296+0000 7f29b3fff700 1 -- 172.21.15.45:0/3785189596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ac009c40 con 0x7f29b40cb730 2023-10-08T12:46:10.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.297+0000 7f29b3fff700 1 --2- 172.21.15.45:0/3785189596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29b40cb730 0x7f29b40c6b10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f299c009f20 tx=0x7f299c00bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:10.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.297+0000 7f29b0ff9700 1 -- 172.21.15.45:0/3785189596 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c01b040 con 0x7f29b40cb730 2023-10-08T12:46:10.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.297+0000 7f29b0ff9700 1 -- 172.21.15.45:0/3785189596 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f299c022480 con 0x7f29b40cb730 2023-10-08T12:46:10.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.297+0000 7f29ba606700 1 -- 172.21.15.45:0/3785189596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299c009520 con 0x7f29b40cb730 2023-10-08T12:46:10.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.297+0000 7f29b0ff9700 1 -- 172.21.15.45:0/3785189596 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c0228b0 con 0x7f29b40cb730 2023-10-08T12:46:10.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.297+0000 7f29ba606700 1 -- 172.21.15.45:0/3785189596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b40c2740 con 0x7f29b40cb730 2023-10-08T12:46:10.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.298+0000 7f29ba606700 1 -- 172.21.15.45:0/3785189596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b40c32d0 con 0x7f29b40cb730 2023-10-08T12:46:10.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.298+0000 7f29b0ff9700 1 -- 172.21.15.45:0/3785189596 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f299c022a10 con 0x7f29b40cb730 2023-10-08T12:46:10.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.298+0000 7f29b0ff9700 1 --2- 172.21.15.45:0/3785189596 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f299406aed0 0x7f299406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:10.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.299+0000 7f29b0ff9700 1 -- 172.21.15.45:0/3785189596 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f299c08e1b0 con 0x7f29b40cb730 2023-10-08T12:46:10.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.299+0000 7f29b37fe700 1 --2- 172.21.15.45:0/3785189596 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f299406aed0 0x7f299406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:10.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.299+0000 7f29b37fe700 1 --2- 172.21.15.45:0/3785189596 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f299406aed0 0x7f299406d390 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f29b415b160 tx=0x7f29a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:10.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.303+0000 7f29b0ff9700 1 -- 172.21.15.45:0/3785189596 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f299c059260 con 0x7f29b40cb730 2023-10-08T12:46:10.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.506+0000 7f29ba606700 1 -- 172.21.15.45:0/3785189596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f29b4066850 con 0x7f29b40cb730 2023-10-08T12:46:10.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.507+0000 7f29b0ff9700 1 -- 172.21.15.45:0/3785189596 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f299c05c880 con 0x7f29b40cb730 2023-10-08T12:46:10.508 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-08T12:46:10.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.509+0000 7f29ba606700 1 -- 172.21.15.45:0/3785189596 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f299406aed0 msgr2=0x7f299406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:10.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.509+0000 7f29ba606700 1 --2- 172.21.15.45:0/3785189596 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f299406aed0 0x7f299406d390 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f29b415b160 tx=0x7f29a4009040 comp rx=0 tx=0).stop 2023-10-08T12:46:10.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.509+0000 7f29ba606700 1 -- 172.21.15.45:0/3785189596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29b40cb730 msgr2=0x7f29b40c6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:10.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.509+0000 7f29ba606700 1 --2- 172.21.15.45:0/3785189596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29b40cb730 0x7f29b40c6b10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f299c009f20 tx=0x7f299c00bfd0 comp rx=0 tx=0).stop 2023-10-08T12:46:10.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.509+0000 7f29ba606700 1 -- 172.21.15.45:0/3785189596 shutdown_connections 2023-10-08T12:46:10.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.509+0000 7f29ba606700 1 --2- 172.21.15.45:0/3785189596 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f299406aed0 0x7f299406d390 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:10.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.509+0000 7f29ba606700 1 --2- 172.21.15.45:0/3785189596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29b415c0d0 0x7f29b4150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:10.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.509+0000 7f29ba606700 1 --2- 172.21.15.45:0/3785189596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29b40cb730 0x7f29b40c6b10 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:10.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.509+0000 7f29ba606700 1 --2- 172.21.15.45:0/3785189596 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f29b40cf000 0x7f29b40c1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:10.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.509+0000 7f29ba606700 1 -- 172.21.15.45:0/3785189596 >> 172.21.15.45:0/3785189596 conn(0x7f29b4097a20 msgr2=0x7f29b40b0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:10.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.509+0000 7f29ba606700 1 -- 172.21.15.45:0/3785189596 shutdown_connections 2023-10-08T12:46:10.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.509+0000 7f29ba606700 1 -- 172.21.15.45:0/3785189596 wait complete. 2023-10-08T12:46:10.522 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:46:10.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.651+0000 7f82a9ab2700 1 -- 172.21.15.45:0/3718110641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a41587a0 msgr2=0x7f82a40acf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:10.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.651+0000 7f82a9ab2700 1 --2- 172.21.15.45:0/3718110641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a41587a0 0x7f82a40acf90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f82980098c0 tx=0x7f8298009bd0 comp rx=0 tx=0).stop 2023-10-08T12:46:10.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.651+0000 7f82a9ab2700 1 -- 172.21.15.45:0/3718110641 shutdown_connections 2023-10-08T12:46:10.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.651+0000 7f82a9ab2700 1 --2- 172.21.15.45:0/3718110641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a41587a0 0x7f82a40acf90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:10.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.651+0000 7f82a9ab2700 1 -- 172.21.15.45:0/3718110641 >> 172.21.15.45:0/3718110641 conn(0x7f82a40cddc0 msgr2=0x7f82a40ce1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:10.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.651+0000 7f82a9ab2700 1 -- 172.21.15.45:0/3718110641 shutdown_connections 2023-10-08T12:46:10.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.651+0000 7f82a9ab2700 1 -- 172.21.15.45:0/3718110641 wait complete. 2023-10-08T12:46:10.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.652+0000 7f82a9ab2700 1 Processor -- start 2023-10-08T12:46:10.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.652+0000 7f82a9ab2700 1 -- start start 2023-10-08T12:46:10.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.653+0000 7f82a9ab2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f82a406ce00 0x7f82a414d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:10.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.653+0000 7f82a9ab2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a41587a0 0x7f82a40abdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:10.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.653+0000 7f82a9ab2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82a415c480 0x7f82a40ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:10.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.653+0000 7f82a9ab2700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a41f1a50 con 0x7f82a41587a0 2023-10-08T12:46:10.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.653+0000 7f82a9ab2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a409b560 con 0x7f82a415c480 2023-10-08T12:46:10.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.653+0000 7f82a9ab2700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a41f0db0 con 0x7f82a406ce00 2023-10-08T12:46:10.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.653+0000 7f82a2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a41587a0 0x7f82a40abdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:10.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.653+0000 7f82a2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a41587a0 0x7f82a40abdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36412/0 (socket says 172.21.15.45:36412) 2023-10-08T12:46:10.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.653+0000 7f82a2ffd700 1 -- 172.21.15.45:0/2147608151 learned_addr learned my addr 172.21.15.45:0/2147608151 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:10.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.653+0000 7f82a3fff700 1 --2- 172.21.15.45:0/2147608151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82a415c480 0x7f82a40ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:10.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.653+0000 7f82a2ffd700 1 -- 172.21.15.45:0/2147608151 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f82a406ce00 msgr2=0x7f82a414d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:10.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.653+0000 7f82a2ffd700 1 --2- 172.21.15.45:0/2147608151 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f82a406ce00 0x7f82a414d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:10.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.653+0000 7f82a2ffd700 1 -- 172.21.15.45:0/2147608151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82a415c480 msgr2=0x7f82a40ac2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:10.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.653+0000 7f82a2ffd700 1 --2- 172.21.15.45:0/2147608151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82a415c480 0x7f82a40ac2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:10.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.653+0000 7f82a2ffd700 1 -- 172.21.15.45:0/2147608151 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8298009520 con 0x7f82a41587a0 2023-10-08T12:46:10.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.653+0000 7f82a3fff700 1 --2- 172.21.15.45:0/2147608151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82a415c480 0x7f82a40ac2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:46:10.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.654+0000 7f82a2ffd700 1 --2- 172.21.15.45:0/2147608151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a41587a0 0x7f82a40abdb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f829400c500 tx=0x7f829400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:10.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.654+0000 7f828bfff700 1 -- 172.21.15.45:0/2147608151 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8294011790 con 0x7f82a41587a0 2023-10-08T12:46:10.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.654+0000 7f828bfff700 1 -- 172.21.15.45:0/2147608151 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f82940119e0 con 0x7f82a41587a0 2023-10-08T12:46:10.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.654+0000 7f82a9ab2700 1 -- 172.21.15.45:0/2147608151 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a41f1090 con 0x7f82a41587a0 2023-10-08T12:46:10.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.654+0000 7f828bfff700 1 -- 172.21.15.45:0/2147608151 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8294011dd0 con 0x7f82a41587a0 2023-10-08T12:46:10.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.654+0000 7f82a9ab2700 1 -- 172.21.15.45:0/2147608151 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a41f1670 con 0x7f82a41587a0 2023-10-08T12:46:10.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.655+0000 7f82a9ab2700 1 -- 172.21.15.45:0/2147608151 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82a41f1800 con 0x7f82a41587a0 2023-10-08T12:46:10.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.655+0000 7f828bfff700 1 -- 172.21.15.45:0/2147608151 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f829401c460 con 0x7f82a41587a0 2023-10-08T12:46:10.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.656+0000 7f828bfff700 1 --2- 172.21.15.45:0/2147608151 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f829006aed0 0x7f829006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:10.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.656+0000 7f828bfff700 1 -- 172.21.15.45:0/2147608151 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8294089680 con 0x7f82a41587a0 2023-10-08T12:46:10.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.656+0000 7f82a37fe700 1 --2- 172.21.15.45:0/2147608151 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f829006aed0 0x7f829006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:10.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.657+0000 7f82a37fe700 1 --2- 172.21.15.45:0/2147608151 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f829006aed0 0x7f829006d390 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f82a406b290 tx=0x7f8298004750 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:10.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.660+0000 7f828bfff700 1 -- 172.21.15.45:0/2147608151 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8294054730 con 0x7f82a41587a0 2023-10-08T12:46:10.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.860+0000 7f82a9ab2700 1 -- 172.21.15.45:0/2147608151 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f82a41f1b90 con 0x7f82a41587a0 2023-10-08T12:46:10.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.860+0000 7f828bfff700 1 -- 172.21.15.45:0/2147608151 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f82a41f1b90 con 0x7f82a41587a0 2023-10-08T12:46:10.861 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-08T12:46:10.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.862+0000 7f82a9ab2700 1 -- 172.21.15.45:0/2147608151 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f829006aed0 msgr2=0x7f829006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:10.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.862+0000 7f82a9ab2700 1 --2- 172.21.15.45:0/2147608151 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f829006aed0 0x7f829006d390 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f82a406b290 tx=0x7f8298004750 comp rx=0 tx=0).stop 2023-10-08T12:46:10.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.862+0000 7f82a9ab2700 1 -- 172.21.15.45:0/2147608151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a41587a0 msgr2=0x7f82a40abdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:10.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.862+0000 7f82a9ab2700 1 --2- 172.21.15.45:0/2147608151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a41587a0 0x7f82a40abdb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f829400c500 tx=0x7f829400c8c0 comp rx=0 tx=0).stop 2023-10-08T12:46:10.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.862+0000 7f82a9ab2700 1 -- 172.21.15.45:0/2147608151 shutdown_connections 2023-10-08T12:46:10.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.862+0000 7f82a9ab2700 1 --2- 172.21.15.45:0/2147608151 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f829006aed0 0x7f829006d390 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:10.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.862+0000 7f82a9ab2700 1 --2- 172.21.15.45:0/2147608151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82a415c480 0x7f82a40ac2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:10.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.862+0000 7f82a9ab2700 1 --2- 172.21.15.45:0/2147608151 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f82a406ce00 0x7f82a414d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:10.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.862+0000 7f82a9ab2700 1 --2- 172.21.15.45:0/2147608151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a41587a0 0x7f82a40abdb0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:10.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.862+0000 7f82a9ab2700 1 -- 172.21.15.45:0/2147608151 >> 172.21.15.45:0/2147608151 conn(0x7f82a40cddc0 msgr2=0x7f82a414e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:10.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.862+0000 7f82a9ab2700 1 -- 172.21.15.45:0/2147608151 shutdown_connections 2023-10-08T12:46:10.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:10.862+0000 7f82a9ab2700 1 -- 172.21.15.45:0/2147608151 wait complete. 2023-10-08T12:46:10.875 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-08T12:46:11.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.003+0000 7f0ffa829700 1 -- 172.21.15.45:0/1478021145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ff415c320 msgr2=0x7f0ff4071f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:11.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.003+0000 7f0ffa829700 1 --2- 172.21.15.45:0/1478021145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ff415c320 0x7f0ff4071f80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4005fd0 tx=0x7f0fe4009c70 comp rx=0 tx=0).stop 2023-10-08T12:46:11.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.003+0000 7f0ffa829700 1 -- 172.21.15.45:0/1478021145 shutdown_connections 2023-10-08T12:46:11.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.003+0000 7f0ffa829700 1 --2- 172.21.15.45:0/1478021145 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0ff4158950 0x7f0ff40cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.003+0000 7f0ffa829700 1 --2- 172.21.15.45:0/1478021145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ff415c320 0x7f0ff4071f80 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.003+0000 7f0ffa829700 1 -- 172.21.15.45:0/1478021145 >> 172.21.15.45:0/1478021145 conn(0x7f0ff40b0430 msgr2=0x7f0ff40b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:11.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.003+0000 7f0ffa829700 1 -- 172.21.15.45:0/1478021145 shutdown_connections 2023-10-08T12:46:11.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.003+0000 7f0ffa829700 1 -- 172.21.15.45:0/1478021145 wait complete. 2023-10-08T12:46:11.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.004+0000 7f0ffa829700 1 Processor -- start 2023-10-08T12:46:11.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.004+0000 7f0ffa829700 1 -- start start 2023-10-08T12:46:11.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.005+0000 7f0ffa829700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ff40724c0 0x7f0ff41556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:11.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.005+0000 7f0ffa829700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0ff4158950 0x7f0ff40ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:11.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.005+0000 7f0ffa829700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ff415c320 0x7f0ff40b2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:11.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.005+0000 7f0ffa829700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff4155c30 con 0x7f0ff40724c0 2023-10-08T12:46:11.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.005+0000 7f0ffa829700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff4157150 con 0x7f0ff415c320 2023-10-08T12:46:11.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.005+0000 7f0ffa829700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff41568b0 con 0x7f0ff4158950 2023-10-08T12:46:11.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.005+0000 7f0ff3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ff40724c0 0x7f0ff41556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:11.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.005+0000 7f0ff3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ff40724c0 0x7f0ff41556f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36422/0 (socket says 172.21.15.45:36422) 2023-10-08T12:46:11.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.005+0000 7f0ff3fff700 1 -- 172.21.15.45:0/4129060672 learned_addr learned my addr 172.21.15.45:0/4129060672 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:11.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.005+0000 7f0ff37fe700 1 --2- 172.21.15.45:0/4129060672 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0ff4158950 0x7f0ff40ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:11.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.005+0000 7f0ff8dc6700 1 --2- 172.21.15.45:0/4129060672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ff415c320 0x7f0ff40b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:11.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.005+0000 7f0ff3fff700 1 -- 172.21.15.45:0/4129060672 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0ff4158950 msgr2=0x7f0ff40ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:11.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.005+0000 7f0ff3fff700 1 --2- 172.21.15.45:0/4129060672 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0ff4158950 0x7f0ff40ac1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.005+0000 7f0ff3fff700 1 -- 172.21.15.45:0/4129060672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ff415c320 msgr2=0x7f0ff40b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:11.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.005+0000 7f0ff3fff700 1 --2- 172.21.15.45:0/4129060672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ff415c320 0x7f0ff40b2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.005+0000 7f0ff3fff700 1 -- 172.21.15.45:0/4129060672 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe40095f0 con 0x7f0ff40724c0 2023-10-08T12:46:11.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.005+0000 7f0ff3fff700 1 --2- 172.21.15.45:0/4129060672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ff40724c0 0x7f0ff41556f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc00e9a0 tx=0x7f0fdc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:11.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.006+0000 7f0ff0ff9700 1 -- 172.21.15.45:0/4129060672 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc009790 con 0x7f0ff40724c0 2023-10-08T12:46:11.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.006+0000 7f0ff0ff9700 1 -- 172.21.15.45:0/4129060672 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0fdc00ccc0 con 0x7f0ff40724c0 2023-10-08T12:46:11.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.006+0000 7f0ff0ff9700 1 -- 172.21.15.45:0/4129060672 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc010690 con 0x7f0ff40724c0 2023-10-08T12:46:11.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.006+0000 7f0ffa829700 1 -- 172.21.15.45:0/4129060672 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff4156b90 con 0x7f0ff40724c0 2023-10-08T12:46:11.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.006+0000 7f0ffa829700 1 -- 172.21.15.45:0/4129060672 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff40ad2f0 con 0x7f0ff40724c0 2023-10-08T12:46:11.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.007+0000 7f0ffa829700 1 -- 172.21.15.45:0/4129060672 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff404e4c0 con 0x7f0ff40724c0 2023-10-08T12:46:11.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.007+0000 7f0ff0ff9700 1 -- 172.21.15.45:0/4129060672 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0fdc0107f0 con 0x7f0ff40724c0 2023-10-08T12:46:11.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.008+0000 7f0ff0ff9700 1 --2- 172.21.15.45:0/4129060672 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0fd406aed0 0x7f0fd406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:11.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.008+0000 7f0ff0ff9700 1 -- 172.21.15.45:0/4129060672 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0fdc014070 con 0x7f0ff40724c0 2023-10-08T12:46:11.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.008+0000 7f0ff37fe700 1 --2- 172.21.15.45:0/4129060672 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0fd406aed0 0x7f0fd406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:11.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.009+0000 7f0ff37fe700 1 --2- 172.21.15.45:0/4129060672 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0fd406aed0 0x7f0fd406d390 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0ff40ac160 tx=0x7f0fe4011040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:11.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.012+0000 7f0ff0ff9700 1 -- 172.21.15.45:0/4129060672 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0fdc051ca0 con 0x7f0ff40724c0 2023-10-08T12:46:11.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.230+0000 7f0ffa829700 1 -- 172.21.15.45:0/4129060672 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0ff40b2420 con 0x7f0ff40724c0 2023-10-08T12:46:11.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.230+0000 7f0ff0ff9700 1 -- 172.21.15.45:0/4129060672 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0fdc058bf0 con 0x7f0ff40724c0 2023-10-08T12:46:11.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.233+0000 7f0ffa829700 1 -- 172.21.15.45:0/4129060672 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0fd406aed0 msgr2=0x7f0fd406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:11.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.233+0000 7f0ffa829700 1 --2- 172.21.15.45:0/4129060672 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0fd406aed0 0x7f0fd406d390 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0ff40ac160 tx=0x7f0fe4011040 comp rx=0 tx=0).stop 2023-10-08T12:46:11.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.233+0000 7f0ffa829700 1 -- 172.21.15.45:0/4129060672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ff40724c0 msgr2=0x7f0ff41556f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:11.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.233+0000 7f0ffa829700 1 --2- 172.21.15.45:0/4129060672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ff40724c0 0x7f0ff41556f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc00e9a0 tx=0x7f0fdc00ed60 comp rx=0 tx=0).stop 2023-10-08T12:46:11.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.233+0000 7f0ffa829700 1 -- 172.21.15.45:0/4129060672 shutdown_connections 2023-10-08T12:46:11.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.233+0000 7f0ffa829700 1 --2- 172.21.15.45:0/4129060672 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0fd406aed0 0x7f0fd406d390 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.233+0000 7f0ffa829700 1 --2- 172.21.15.45:0/4129060672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ff415c320 0x7f0ff40b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.233+0000 7f0ffa829700 1 --2- 172.21.15.45:0/4129060672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ff40724c0 0x7f0ff41556f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.233+0000 7f0ffa829700 1 --2- 172.21.15.45:0/4129060672 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0ff4158950 0x7f0ff40ac1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.233+0000 7f0ffa829700 1 -- 172.21.15.45:0/4129060672 >> 172.21.15.45:0/4129060672 conn(0x7f0ff40b0430 msgr2=0x7f0ff40ccde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:11.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.233+0000 7f0ffa829700 1 -- 172.21.15.45:0/4129060672 shutdown_connections 2023-10-08T12:46:11.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.233+0000 7f0ffa829700 1 -- 172.21.15.45:0/4129060672 wait complete. 2023-10-08T12:46:11.235 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-10-08T12:46:11.246 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-08T12:46:11.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:46:11.246 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-08T12:46:11.287 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2023-10-08T12:46:11.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:46:11.288 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-08T12:46:11.350 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T12:46:11.350 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:46:11.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.477+0000 7f401f30f700 1 -- 172.21.15.45:0/2948798691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40180c9ff0 msgr2=0x7f40180ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:11.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.477+0000 7f401f30f700 1 --2- 172.21.15.45:0/2948798691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40180c9ff0 0x7f40180ca460 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f40180cf960 tx=0x7f401000b330 comp rx=0 tx=0).stop 2023-10-08T12:46:11.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.478+0000 7f401f30f700 1 -- 172.21.15.45:0/2948798691 shutdown_connections 2023-10-08T12:46:11.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.478+0000 7f401f30f700 1 --2- 172.21.15.45:0/2948798691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40180c9ff0 0x7f40180ca460 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.478+0000 7f401f30f700 1 --2- 172.21.15.45:0/2948798691 >> v2:172.21.15.78:3300/0 conn(0x7f4018158950 0x7f40180cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.478+0000 7f401f30f700 1 -- 172.21.15.45:0/2948798691 >> 172.21.15.45:0/2948798691 conn(0x7f40180b0430 msgr2=0x7f40180b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:11.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.478+0000 7f401f30f700 1 -- 172.21.15.45:0/2948798691 shutdown_connections 2023-10-08T12:46:11.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.478+0000 7f401f30f700 1 -- 172.21.15.45:0/2948798691 wait complete. 2023-10-08T12:46:11.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.479+0000 7f401f30f700 1 Processor -- start 2023-10-08T12:46:11.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.479+0000 7f401f30f700 1 -- start start 2023-10-08T12:46:11.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.480+0000 7f401f30f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40180c9ff0 0x7f40180c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:11.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.480+0000 7f401f30f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4018158950 0x7f40181eea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:11.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.480+0000 7f401f30f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f401815c320 0x7f40181eefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:11.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.480+0000 7f401f30f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40180c7cb0 con 0x7f40180c9ff0 2023-10-08T12:46:11.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.480+0000 7f401f30f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4018157630 con 0x7f401815c320 2023-10-08T12:46:11.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.480+0000 7f401f30f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40180c7030 con 0x7f4018158950 2023-10-08T12:46:11.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.480+0000 7f401d0ab700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40180c9ff0 0x7f40180c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:11.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.480+0000 7f401d0ab700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40180c9ff0 0x7f40180c80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36436/0 (socket says 172.21.15.45:36436) 2023-10-08T12:46:11.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.480+0000 7f401d0ab700 1 -- 172.21.15.45:0/4201561756 learned_addr learned my addr 172.21.15.45:0/4201561756 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:11.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.480+0000 7f401c8aa700 1 --2- 172.21.15.45:0/4201561756 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4018158950 0x7f40181eea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:11.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.480+0000 7f401d8ac700 1 --2- 172.21.15.45:0/4201561756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f401815c320 0x7f40181eefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:11.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.480+0000 7f401d0ab700 1 -- 172.21.15.45:0/4201561756 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4018158950 msgr2=0x7f40181eea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:11.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.480+0000 7f401d0ab700 1 --2- 172.21.15.45:0/4201561756 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4018158950 0x7f40181eea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.480+0000 7f401d0ab700 1 -- 172.21.15.45:0/4201561756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f401815c320 msgr2=0x7f40181eefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:11.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.480+0000 7f401d0ab700 1 --2- 172.21.15.45:0/4201561756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f401815c320 0x7f40181eefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.480+0000 7f401d0ab700 1 -- 172.21.15.45:0/4201561756 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4010009c40 con 0x7f40180c9ff0 2023-10-08T12:46:11.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.480+0000 7f401c8aa700 1 --2- 172.21.15.45:0/4201561756 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4018158950 0x7f40181eea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:46:11.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.480+0000 7f401d8ac700 1 --2- 172.21.15.45:0/4201561756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f401815c320 0x7f40181eefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:46:11.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.480+0000 7f401d0ab700 1 --2- 172.21.15.45:0/4201561756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40180c9ff0 0x7f40180c80d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f400800d9e0 tx=0x7f400800dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:11.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.480+0000 7f400dffb700 1 -- 172.21.15.45:0/4201561756 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400800ecd0 con 0x7f40180c9ff0 2023-10-08T12:46:11.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.480+0000 7f400dffb700 1 -- 172.21.15.45:0/4201561756 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4008016440 con 0x7f40180c9ff0 2023-10-08T12:46:11.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.480+0000 7f401f30f700 1 -- 172.21.15.45:0/4201561756 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40180c7310 con 0x7f40180c9ff0 2023-10-08T12:46:11.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.480+0000 7f400dffb700 1 -- 172.21.15.45:0/4201561756 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4008016850 con 0x7f40180c9ff0 2023-10-08T12:46:11.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.481+0000 7f401f30f700 1 -- 172.21.15.45:0/4201561756 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40180c78d0 con 0x7f40180c9ff0 2023-10-08T12:46:11.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.482+0000 7f401f30f700 1 -- 172.21.15.45:0/4201561756 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40180c7df0 con 0x7f40180c9ff0 2023-10-08T12:46:11.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.482+0000 7f400dffb700 1 -- 172.21.15.45:0/4201561756 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f400801f3b0 con 0x7f40180c9ff0 2023-10-08T12:46:11.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.482+0000 7f400dffb700 1 --2- 172.21.15.45:0/4201561756 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3ffc06aed0 0x7f3ffc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:11.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.482+0000 7f400dffb700 1 -- 172.21.15.45:0/4201561756 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f400808b7b0 con 0x7f40180c9ff0 2023-10-08T12:46:11.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.483+0000 7f401c8aa700 1 --2- 172.21.15.45:0/4201561756 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3ffc06aed0 0x7f3ffc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:11.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.483+0000 7f401c8aa700 1 --2- 172.21.15.45:0/4201561756 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3ffc06aed0 0x7f3ffc06d390 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f40180ae940 tx=0x7f4014009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:11.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.487+0000 7f400dffb700 1 -- 172.21.15.45:0/4201561756 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f40180c7df0 con 0x7f40180c9ff0 2023-10-08T12:46:11.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.734+0000 7f401f30f700 1 -- 172.21.15.45:0/4201561756 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40180c7df0 con 0x7f40180c9ff0 2023-10-08T12:46:11.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.734+0000 7f400dffb700 1 -- 172.21.15.45:0/4201561756 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7f40180c7df0 con 0x7f40180c9ff0 2023-10-08T12:46:11.736 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:46:11.736 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4332,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3352988594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3352988594},{"type":"v1","addr":"172.21.15.45:6834","nonce":3352988594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4335,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/448033669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":448033669},{"type":"v1","addr":"172.21.15.45:6835","nonce":448033669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4347,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2935302656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":2935302656},{"type":"v1","addr":"172.21.15.78:6837","nonce":2935302656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T12:45:24.623822+0000","modified":"2023-10-08T12:45:27.649794+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4372},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4372":{"gid":4372,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6836/2145831865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2145831865},{"type":"v1","addr":"172.21.15.78:6836","nonce":2145831865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:46:11.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.737+0000 7f401f30f700 1 -- 172.21.15.45:0/4201561756 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3ffc06aed0 msgr2=0x7f3ffc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:11.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.737+0000 7f401f30f700 1 --2- 172.21.15.45:0/4201561756 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3ffc06aed0 0x7f3ffc06d390 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f40180ae940 tx=0x7f4014009040 comp rx=0 tx=0).stop 2023-10-08T12:46:11.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.737+0000 7f401f30f700 1 -- 172.21.15.45:0/4201561756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40180c9ff0 msgr2=0x7f40180c80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:11.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.737+0000 7f401f30f700 1 --2- 172.21.15.45:0/4201561756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40180c9ff0 0x7f40180c80d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f400800d9e0 tx=0x7f400800dda0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.737+0000 7f401f30f700 1 -- 172.21.15.45:0/4201561756 shutdown_connections 2023-10-08T12:46:11.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.737+0000 7f401f30f700 1 --2- 172.21.15.45:0/4201561756 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3ffc06aed0 0x7f3ffc06d390 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.737+0000 7f401f30f700 1 --2- 172.21.15.45:0/4201561756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f401815c320 0x7f40181eefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.737+0000 7f401f30f700 1 --2- 172.21.15.45:0/4201561756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40180c9ff0 0x7f40180c80d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.737+0000 7f401f30f700 1 --2- 172.21.15.45:0/4201561756 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4018158950 0x7f40181eea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.737+0000 7f401f30f700 1 -- 172.21.15.45:0/4201561756 >> 172.21.15.45:0/4201561756 conn(0x7f40180b0430 msgr2=0x7f4018157d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:11.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.737+0000 7f401f30f700 1 -- 172.21.15.45:0/4201561756 shutdown_connections 2023-10-08T12:46:11.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.737+0000 7f401f30f700 1 -- 172.21.15.45:0/4201561756 wait complete. 2023-10-08T12:46:11.740 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-10-08T12:46:11.751 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:46:11.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.877+0000 7f7db5811700 1 -- 172.21.15.45:0/2058208592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7db00ca700 msgr2=0x7f7db015c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:11.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.877+0000 7f7db5811700 1 --2- 172.21.15.45:0/2058208592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7db00ca700 0x7f7db015c320 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7da8009f60 tx=0x7f7da8009f90 comp rx=0 tx=0).stop 2023-10-08T12:46:11.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.877+0000 7f7db5811700 1 -- 172.21.15.45:0/2058208592 shutdown_connections 2023-10-08T12:46:11.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.877+0000 7f7db5811700 1 --2- 172.21.15.45:0/2058208592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7db00ca700 0x7f7db015c320 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.877+0000 7f7db5811700 1 -- 172.21.15.45:0/2058208592 >> 172.21.15.45:0/2058208592 conn(0x7f7db00b0430 msgr2=0x7f7db00b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:11.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.877+0000 7f7db5811700 1 -- 172.21.15.45:0/2058208592 shutdown_connections 2023-10-08T12:46:11.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.877+0000 7f7db5811700 1 -- 172.21.15.45:0/2058208592 wait complete. 2023-10-08T12:46:11.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.878+0000 7f7db5811700 1 Processor -- start 2023-10-08T12:46:11.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.879+0000 7f7db5811700 1 -- start start 2023-10-08T12:46:11.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.879+0000 7f7db5811700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7db00ca700 0x7f7db00b1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:11.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.879+0000 7f7db5811700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7db00cdf60 0x7f7db0151440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:11.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.879+0000 7f7db5811700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7db0158950 0x7f7db015b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:11.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.879+0000 7f7db5811700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db01f0230 con 0x7f7db00cdf60 2023-10-08T12:46:11.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.879+0000 7f7db5811700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db00c5ab0 con 0x7f7db0158950 2023-10-08T12:46:11.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.879+0000 7f7db5811700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db00c5d90 con 0x7f7db00ca700 2023-10-08T12:46:11.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.880+0000 7f7dae7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7db00cdf60 0x7f7db0151440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:11.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.880+0000 7f7dae7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7db00cdf60 0x7f7db0151440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36452/0 (socket says 172.21.15.45:36452) 2023-10-08T12:46:11.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.880+0000 7f7dae7fc700 1 -- 172.21.15.45:0/4227677733 learned_addr learned my addr 172.21.15.45:0/4227677733 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:11.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.880+0000 7f7daeffd700 1 --2- 172.21.15.45:0/4227677733 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7db00ca700 0x7f7db00b1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:11.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.880+0000 7f7daf7fe700 1 --2- 172.21.15.45:0/4227677733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7db0158950 0x7f7db015b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:11.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.880+0000 7f7dae7fc700 1 -- 172.21.15.45:0/4227677733 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7db00ca700 msgr2=0x7f7db00b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:11.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.880+0000 7f7dae7fc700 1 --2- 172.21.15.45:0/4227677733 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7db00ca700 0x7f7db00b1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.880+0000 7f7dae7fc700 1 -- 172.21.15.45:0/4227677733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7db0158950 msgr2=0x7f7db015b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:11.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.880+0000 7f7dae7fc700 1 --2- 172.21.15.45:0/4227677733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7db0158950 0x7f7db015b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.880+0000 7f7dae7fc700 1 -- 172.21.15.45:0/4227677733 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da8009c40 con 0x7f7db00cdf60 2023-10-08T12:46:11.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.880+0000 7f7dae7fc700 1 --2- 172.21.15.45:0/4227677733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7db00cdf60 0x7f7db0151440 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7da000c4e0 tx=0x7f7da000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:11.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.880+0000 7f7d97fff700 1 -- 172.21.15.45:0/4227677733 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da00052d0 con 0x7f7db00cdf60 2023-10-08T12:46:11.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.880+0000 7f7d97fff700 1 -- 172.21.15.45:0/4227677733 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7da0005520 con 0x7f7db00cdf60 2023-10-08T12:46:11.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.880+0000 7f7db5811700 1 -- 172.21.15.45:0/4227677733 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7db00c6070 con 0x7f7db00cdf60 2023-10-08T12:46:11.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.880+0000 7f7d97fff700 1 -- 172.21.15.45:0/4227677733 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da00038e0 con 0x7f7db00cdf60 2023-10-08T12:46:11.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.880+0000 7f7db5811700 1 -- 172.21.15.45:0/4227677733 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db00b1c80 con 0x7f7db00cdf60 2023-10-08T12:46:11.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.881+0000 7f7db5811700 1 -- 172.21.15.45:0/4227677733 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7db00c6590 con 0x7f7db00cdf60 2023-10-08T12:46:11.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.882+0000 7f7d97fff700 1 -- 172.21.15.45:0/4227677733 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7da0003a40 con 0x7f7db00cdf60 2023-10-08T12:46:11.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.882+0000 7f7d97fff700 1 --2- 172.21.15.45:0/4227677733 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f7d9c06aed0 0x7f7d9c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:11.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.882+0000 7f7d97fff700 1 -- 172.21.15.45:0/4227677733 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7da0088d60 con 0x7f7db00cdf60 2023-10-08T12:46:11.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.882+0000 7f7daeffd700 1 --2- 172.21.15.45:0/4227677733 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f7d9c06aed0 0x7f7d9c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:11.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.883+0000 7f7daeffd700 1 --2- 172.21.15.45:0/4227677733 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f7d9c06aed0 0x7f7d9c06d390 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7da40011e0 tx=0x7f7da4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:11.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:11.886+0000 7f7d97fff700 1 -- 172.21.15.45:0/4227677733 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7db00c6590 con 0x7f7db00cdf60 2023-10-08T12:46:12.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.089+0000 7f7db5811700 1 -- 172.21.15.45:0/4227677733 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7db00c6590 con 0x7f7db00cdf60 2023-10-08T12:46:12.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.090+0000 7f7d97fff700 1 -- 172.21.15.45:0/4227677733 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f7db00c6590 con 0x7f7db00cdf60 2023-10-08T12:46:12.091 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:46:12.092 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:45:26.206424+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:45:19.183651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:45:22.277383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:45:23.606639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.412453+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.351925+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.428025+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.437246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.441119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.388608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.415524+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.401835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:46:12.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.092+0000 7f7db5811700 1 -- 172.21.15.45:0/4227677733 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f7d9c06aed0 msgr2=0x7f7d9c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:12.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.092+0000 7f7db5811700 1 --2- 172.21.15.45:0/4227677733 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f7d9c06aed0 0x7f7d9c06d390 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7da40011e0 tx=0x7f7da4009040 comp rx=0 tx=0).stop 2023-10-08T12:46:12.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.092+0000 7f7db5811700 1 -- 172.21.15.45:0/4227677733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7db00cdf60 msgr2=0x7f7db0151440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:12.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.092+0000 7f7db5811700 1 --2- 172.21.15.45:0/4227677733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7db00cdf60 0x7f7db0151440 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7da000c4e0 tx=0x7f7da000c8a0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.092+0000 7f7db5811700 1 -- 172.21.15.45:0/4227677733 shutdown_connections 2023-10-08T12:46:12.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.092+0000 7f7db5811700 1 --2- 172.21.15.45:0/4227677733 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f7d9c06aed0 0x7f7d9c06d390 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.092+0000 7f7db5811700 1 --2- 172.21.15.45:0/4227677733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7db0158950 0x7f7db015b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.092+0000 7f7db5811700 1 --2- 172.21.15.45:0/4227677733 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7db00ca700 0x7f7db00b1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.092+0000 7f7db5811700 1 --2- 172.21.15.45:0/4227677733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7db00cdf60 0x7f7db0151440 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.092+0000 7f7db5811700 1 -- 172.21.15.45:0/4227677733 >> 172.21.15.45:0/4227677733 conn(0x7f7db00b0430 msgr2=0x7f7db0156d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:12.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.092+0000 7f7db5811700 1 -- 172.21.15.45:0/4227677733 shutdown_connections 2023-10-08T12:46:12.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.092+0000 7f7db5811700 1 -- 172.21.15.45:0/4227677733 wait complete. 2023-10-08T12:46:12.106 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:45:19.183651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:45:22.277383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:45:23.606639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:46:12.106 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:46:12.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.237+0000 7f03ee5e1700 1 -- 172.21.15.45:0/3176287708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03e815c0d0 msgr2=0x7f03e80c9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:12.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.237+0000 7f03ee5e1700 1 --2- 172.21.15.45:0/3176287708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03e815c0d0 0x7f03e80c9c00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f03dc0098c0 tx=0x7f03dc009bd0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.237+0000 7f03ee5e1700 1 -- 172.21.15.45:0/3176287708 shutdown_connections 2023-10-08T12:46:12.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.237+0000 7f03ee5e1700 1 --2- 172.21.15.45:0/3176287708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03e815c0d0 0x7f03e80c9c00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.237+0000 7f03ee5e1700 1 --2- 172.21.15.45:0/3176287708 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f03e80cf000 0x7f03e80cb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.237+0000 7f03ee5e1700 1 -- 172.21.15.45:0/3176287708 >> 172.21.15.45:0/3176287708 conn(0x7f03e8097a20 msgr2=0x7f03e80ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:12.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.237+0000 7f03ee5e1700 1 -- 172.21.15.45:0/3176287708 shutdown_connections 2023-10-08T12:46:12.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.237+0000 7f03ee5e1700 1 -- 172.21.15.45:0/3176287708 wait complete. 2023-10-08T12:46:12.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.238+0000 7f03ee5e1700 1 Processor -- start 2023-10-08T12:46:12.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.239+0000 7f03ee5e1700 1 -- start start 2023-10-08T12:46:12.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.239+0000 7f03ee5e1700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f03e80cb560 0x7f03e8157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:12.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.239+0000 7f03ee5e1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03e80cf000 0x7f03e8150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:12.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.239+0000 7f03ee5e1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03e815c0d0 0x7f03e8155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:12.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.239+0000 7f03ee5e1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e8150fa0 con 0x7f03e80cf000 2023-10-08T12:46:12.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.239+0000 7f03ee5e1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e81567b0 con 0x7f03e815c0d0 2023-10-08T12:46:12.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.239+0000 7f03ee5e1700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e8156a90 con 0x7f03e80cb560 2023-10-08T12:46:12.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.239+0000 7f03e77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03e80cf000 0x7f03e8150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:12.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.239+0000 7f03e77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03e80cf000 0x7f03e8150a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36466/0 (socket says 172.21.15.45:36466) 2023-10-08T12:46:12.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.240+0000 7f03e77fe700 1 -- 172.21.15.45:0/3025781079 learned_addr learned my addr 172.21.15.45:0/3025781079 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:12.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.240+0000 7f03e7fff700 1 --2- 172.21.15.45:0/3025781079 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f03e80cb560 0x7f03e8157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:12.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.240+0000 7f03ecb7e700 1 --2- 172.21.15.45:0/3025781079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03e815c0d0 0x7f03e8155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:12.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.240+0000 7f03e77fe700 1 -- 172.21.15.45:0/3025781079 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f03e80cb560 msgr2=0x7f03e8157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:12.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.240+0000 7f03e77fe700 1 --2- 172.21.15.45:0/3025781079 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f03e80cb560 0x7f03e8157850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.240+0000 7f03e77fe700 1 -- 172.21.15.45:0/3025781079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03e815c0d0 msgr2=0x7f03e8155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:12.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.240+0000 7f03e77fe700 1 --2- 172.21.15.45:0/3025781079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03e815c0d0 0x7f03e8155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.240+0000 7f03e77fe700 1 -- 172.21.15.45:0/3025781079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03dc009520 con 0x7f03e80cf000 2023-10-08T12:46:12.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.240+0000 7f03e77fe700 1 --2- 172.21.15.45:0/3025781079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03e80cf000 0x7f03e8150a60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f03d800d950 tx=0x7f03d800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:12.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.240+0000 7f03e4ff9700 1 -- 172.21.15.45:0/3025781079 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d800f890 con 0x7f03e80cf000 2023-10-08T12:46:12.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.240+0000 7f03e4ff9700 1 -- 172.21.15.45:0/3025781079 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f03d800fae0 con 0x7f03e80cf000 2023-10-08T12:46:12.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.240+0000 7f03ee5e1700 1 -- 172.21.15.45:0/3025781079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e8156d70 con 0x7f03e80cf000 2023-10-08T12:46:12.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.240+0000 7f03e4ff9700 1 -- 172.21.15.45:0/3025781079 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d8010460 con 0x7f03e80cf000 2023-10-08T12:46:12.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.240+0000 7f03ee5e1700 1 -- 172.21.15.45:0/3025781079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e8157330 con 0x7f03e80cf000 2023-10-08T12:46:12.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.241+0000 7f03ee5e1700 1 -- 172.21.15.45:0/3025781079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03e81574c0 con 0x7f03e80cf000 2023-10-08T12:46:12.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.242+0000 7f03e4ff9700 1 -- 172.21.15.45:0/3025781079 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f03d80105c0 con 0x7f03e80cf000 2023-10-08T12:46:12.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.242+0000 7f03e4ff9700 1 --2- 172.21.15.45:0/3025781079 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f03d406aed0 0x7f03d406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:12.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.242+0000 7f03e4ff9700 1 -- 172.21.15.45:0/3025781079 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03d8089aa0 con 0x7f03e80cf000 2023-10-08T12:46:12.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.242+0000 7f03e7fff700 1 --2- 172.21.15.45:0/3025781079 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f03d406aed0 0x7f03d406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:12.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.243+0000 7f03e7fff700 1 --2- 172.21.15.45:0/3025781079 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f03d406aed0 0x7f03d406d390 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f03dc000c00 tx=0x7f03dc019040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:12.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.247+0000 7f03e4ff9700 1 -- 172.21.15.45:0/3025781079 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f03d8054be0 con 0x7f03e80cf000 2023-10-08T12:46:12.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.448+0000 7f03ee5e1700 1 -- 172.21.15.45:0/3025781079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f03e8066850 con 0x7f03e80cf000 2023-10-08T12:46:12.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.449+0000 7f03e4ff9700 1 -- 172.21.15.45:0/3025781079 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f03d80200a0 con 0x7f03e80cf000 2023-10-08T12:46:12.451 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-08T12:46:12.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.451+0000 7f03ee5e1700 1 -- 172.21.15.45:0/3025781079 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f03d406aed0 msgr2=0x7f03d406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:12.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.451+0000 7f03ee5e1700 1 --2- 172.21.15.45:0/3025781079 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f03d406aed0 0x7f03d406d390 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f03dc000c00 tx=0x7f03dc019040 comp rx=0 tx=0).stop 2023-10-08T12:46:12.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.451+0000 7f03ee5e1700 1 -- 172.21.15.45:0/3025781079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03e80cf000 msgr2=0x7f03e8150a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:12.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.451+0000 7f03ee5e1700 1 --2- 172.21.15.45:0/3025781079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03e80cf000 0x7f03e8150a60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f03d800d950 tx=0x7f03d800dc60 comp rx=0 tx=0).stop 2023-10-08T12:46:12.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.451+0000 7f03ee5e1700 1 -- 172.21.15.45:0/3025781079 shutdown_connections 2023-10-08T12:46:12.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.451+0000 7f03ee5e1700 1 --2- 172.21.15.45:0/3025781079 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f03d406aed0 0x7f03d406d390 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.451+0000 7f03ee5e1700 1 --2- 172.21.15.45:0/3025781079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03e815c0d0 0x7f03e8155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.451+0000 7f03ee5e1700 1 --2- 172.21.15.45:0/3025781079 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f03e80cb560 0x7f03e8157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.451+0000 7f03ee5e1700 1 --2- 172.21.15.45:0/3025781079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03e80cf000 0x7f03e8150a60 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.451+0000 7f03ee5e1700 1 -- 172.21.15.45:0/3025781079 >> 172.21.15.45:0/3025781079 conn(0x7f03e8097a20 msgr2=0x7f03e815b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:12.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.451+0000 7f03ee5e1700 1 -- 172.21.15.45:0/3025781079 shutdown_connections 2023-10-08T12:46:12.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.451+0000 7f03ee5e1700 1 -- 172.21.15.45:0/3025781079 wait complete. 2023-10-08T12:46:12.464 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:46:12.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.594+0000 7f52301a0700 1 -- 172.21.15.45:0/2770536842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5214003a30 msgr2=0x7f5214003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:12.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.594+0000 7f52301a0700 1 --2- 172.21.15.45:0/2770536842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5214003a30 0x7f5214003e10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5218001830 tx=0x7f5214005880 comp rx=0 tx=0).stop 2023-10-08T12:46:12.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.594+0000 7f522e73d700 1 -- 172.21.15.45:0/2770536842 reap_dead start 2023-10-08T12:46:12.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.594+0000 7f52301a0700 1 -- 172.21.15.45:0/2770536842 shutdown_connections 2023-10-08T12:46:12.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.594+0000 7f52301a0700 1 -- 172.21.15.45:0/2770536842 >> 172.21.15.45:0/2770536842 conn(0x7f5228097a20 msgr2=0x7f52280ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:12.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.594+0000 7f52301a0700 1 -- 172.21.15.45:0/2770536842 shutdown_connections 2023-10-08T12:46:12.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.594+0000 7f52301a0700 1 -- 172.21.15.45:0/2770536842 wait complete. 2023-10-08T12:46:12.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.596+0000 7f52301a0700 1 Processor -- start 2023-10-08T12:46:12.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.596+0000 7f52301a0700 1 -- start start 2023-10-08T12:46:12.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.596+0000 7f52301a0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5214003a30 0x7f52280c1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:12.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.596+0000 7f52301a0700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f52280c0f40 0x7f52280c4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:12.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.597+0000 7f52301a0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52280c2060 0x7f52280c24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:12.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.597+0000 7f52301a0700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52280cced0 con 0x7f5214003a30 2023-10-08T12:46:12.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.597+0000 7f52301a0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52280cd1b0 con 0x7f52280c2060 2023-10-08T12:46:12.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.597+0000 7f52301a0700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52280cd490 con 0x7f52280c0f40 2023-10-08T12:46:12.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.597+0000 7f522df3c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5214003a30 0x7f52280c1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:12.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.597+0000 7f522df3c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5214003a30 0x7f52280c1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36482/0 (socket says 172.21.15.45:36482) 2023-10-08T12:46:12.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.597+0000 7f522df3c700 1 -- 172.21.15.45:0/1805950688 learned_addr learned my addr 172.21.15.45:0/1805950688 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:12.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.597+0000 7f522e73d700 1 --2- 172.21.15.45:0/1805950688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52280c2060 0x7f52280c24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:12.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.597+0000 7f522d73b700 1 --2- 172.21.15.45:0/1805950688 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f52280c0f40 0x7f52280c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:12.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.597+0000 7f522df3c700 1 -- 172.21.15.45:0/1805950688 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f52280c0f40 msgr2=0x7f52280c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:12.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.597+0000 7f522df3c700 1 --2- 172.21.15.45:0/1805950688 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f52280c0f40 0x7f52280c4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.597+0000 7f522df3c700 1 -- 172.21.15.45:0/1805950688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52280c2060 msgr2=0x7f52280c24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:12.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.597+0000 7f522df3c700 1 --2- 172.21.15.45:0/1805950688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52280c2060 0x7f52280c24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.597+0000 7f522df3c700 1 -- 172.21.15.45:0/1805950688 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52280cd770 con 0x7f5214003a30 2023-10-08T12:46:12.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.597+0000 7f522df3c700 1 --2- 172.21.15.45:0/1805950688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5214003a30 0x7f52280c1470 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5214005830 tx=0x7f5218001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:12.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.597+0000 7f521e7fc700 1 -- 172.21.15.45:0/1805950688 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5218010680 con 0x7f5214003a30 2023-10-08T12:46:12.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.597+0000 7f521e7fc700 1 -- 172.21.15.45:0/1805950688 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f52180108d0 con 0x7f5214003a30 2023-10-08T12:46:12.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.597+0000 7f52301a0700 1 -- 172.21.15.45:0/1805950688 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52280cda50 con 0x7f5214003a30 2023-10-08T12:46:12.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.597+0000 7f521e7fc700 1 -- 172.21.15.45:0/1805950688 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5218010ce0 con 0x7f5214003a30 2023-10-08T12:46:12.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.597+0000 7f52301a0700 1 -- 172.21.15.45:0/1805950688 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52280c4da0 con 0x7f5214003a30 2023-10-08T12:46:12.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.598+0000 7f52301a0700 1 -- 172.21.15.45:0/1805950688 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52280c4f90 con 0x7f5214003a30 2023-10-08T12:46:12.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.599+0000 7f521e7fc700 1 -- 172.21.15.45:0/1805950688 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5218022070 con 0x7f5214003a30 2023-10-08T12:46:12.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.599+0000 7f521e7fc700 1 --2- 172.21.15.45:0/1805950688 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f520c06aed0 0x7f520c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:12.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.599+0000 7f521e7fc700 1 -- 172.21.15.45:0/1805950688 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f521808b530 con 0x7f5214003a30 2023-10-08T12:46:12.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.599+0000 7f522d73b700 1 --2- 172.21.15.45:0/1805950688 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f520c06aed0 0x7f520c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:12.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.600+0000 7f522d73b700 1 --2- 172.21.15.45:0/1805950688 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f520c06aed0 0x7f520c06d390 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f52240099d0 tx=0x7f5224009260 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:12.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.604+0000 7f521e7fc700 1 -- 172.21.15.45:0/1805950688 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5218056790 con 0x7f5214003a30 2023-10-08T12:46:12.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.805+0000 7f52301a0700 1 -- 172.21.15.45:0/1805950688 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5228066850 con 0x7f5214003a30 2023-10-08T12:46:12.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.806+0000 7f521e7fc700 1 -- 172.21.15.45:0/1805950688 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5218059db0 con 0x7f5214003a30 2023-10-08T12:46:12.807 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-08T12:46:12.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.808+0000 7f52301a0700 1 -- 172.21.15.45:0/1805950688 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f520c06aed0 msgr2=0x7f520c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:12.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.808+0000 7f52301a0700 1 --2- 172.21.15.45:0/1805950688 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f520c06aed0 0x7f520c06d390 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f52240099d0 tx=0x7f5224009260 comp rx=0 tx=0).stop 2023-10-08T12:46:12.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.808+0000 7f52301a0700 1 -- 172.21.15.45:0/1805950688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5214003a30 msgr2=0x7f52280c1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:12.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.808+0000 7f52301a0700 1 --2- 172.21.15.45:0/1805950688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5214003a30 0x7f52280c1470 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5214005830 tx=0x7f5218001e50 comp rx=0 tx=0).stop 2023-10-08T12:46:12.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.808+0000 7f52301a0700 1 -- 172.21.15.45:0/1805950688 shutdown_connections 2023-10-08T12:46:12.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.808+0000 7f52301a0700 1 --2- 172.21.15.45:0/1805950688 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f520c06aed0 0x7f520c06d390 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.808+0000 7f52301a0700 1 --2- 172.21.15.45:0/1805950688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52280c2060 0x7f52280c24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.808+0000 7f52301a0700 1 --2- 172.21.15.45:0/1805950688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5214003a30 0x7f52280c1470 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.808+0000 7f52301a0700 1 --2- 172.21.15.45:0/1805950688 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f52280c0f40 0x7f52280c4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.808+0000 7f52301a0700 1 -- 172.21.15.45:0/1805950688 >> 172.21.15.45:0/1805950688 conn(0x7f5228097a20 msgr2=0x7f522806e670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:12.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.808+0000 7f52301a0700 1 -- 172.21.15.45:0/1805950688 shutdown_connections 2023-10-08T12:46:12.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.808+0000 7f52301a0700 1 -- 172.21.15.45:0/1805950688 wait complete. 2023-10-08T12:46:12.821 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:46:12.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.951+0000 7f2e0c4b4700 1 -- 172.21.15.45:0/1140097239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dec005210 msgr2=0x7f2dec00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:12.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.951+0000 7f2e0c4b4700 1 --2- 172.21.15.45:0/1140097239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dec005210 0x7f2dec00ba10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2df400bb90 tx=0x7f2dec005880 comp rx=0 tx=0).stop 2023-10-08T12:46:12.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.951+0000 7f2e0c4b4700 1 -- 172.21.15.45:0/1140097239 shutdown_connections 2023-10-08T12:46:12.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.951+0000 7f2e0c4b4700 1 --2- 172.21.15.45:0/1140097239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dec005210 0x7f2dec00ba10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.951+0000 7f2e0c4b4700 1 -- 172.21.15.45:0/1140097239 >> 172.21.15.45:0/1140097239 conn(0x7f2e040b12c0 msgr2=0x7f2e040b16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:12.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.951+0000 7f2e0c4b4700 1 -- 172.21.15.45:0/1140097239 shutdown_connections 2023-10-08T12:46:12.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.951+0000 7f2e0c4b4700 1 -- 172.21.15.45:0/1140097239 wait complete. 2023-10-08T12:46:12.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.953+0000 7f2e0c4b4700 1 Processor -- start 2023-10-08T12:46:12.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.953+0000 7f2e0c4b4700 1 -- start start 2023-10-08T12:46:12.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.953+0000 7f2e0c4b4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dec005210 0x7f2e0414b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:12.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.953+0000 7f2e0c4b4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e040c23c0 0x7f2e0415a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:12.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.953+0000 7f2e0c4b4700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2e0415a6f0 0x7f2e0414d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:12.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.953+0000 7f2e0c4b4700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0415ab70 con 0x7f2e040c23c0 2023-10-08T12:46:12.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.953+0000 7f2e0c4b4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0414e400 con 0x7f2dec005210 2023-10-08T12:46:12.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.953+0000 7f2e0c4b4700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e040c2840 con 0x7f2e0415a6f0 2023-10-08T12:46:12.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.953+0000 7f2e09a4f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e040c23c0 0x7f2e0415a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:12.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.953+0000 7f2e09a4f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e040c23c0 0x7f2e0415a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36504/0 (socket says 172.21.15.45:36504) 2023-10-08T12:46:12.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.954+0000 7f2e09a4f700 1 -- 172.21.15.45:0/63969874 learned_addr learned my addr 172.21.15.45:0/63969874 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:12.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.954+0000 7f2e0a250700 1 --2- 172.21.15.45:0/63969874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dec005210 0x7f2e0414b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:12.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.954+0000 7f2e0aa51700 1 --2- 172.21.15.45:0/63969874 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2e0415a6f0 0x7f2e0414d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.954+0000 7f2e09a4f700 1 -- 172.21.15.45:0/63969874 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2e0415a6f0 msgr2=0x7f2e0414d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.954+0000 7f2e09a4f700 1 --2- 172.21.15.45:0/63969874 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2e0415a6f0 0x7f2e0414d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.954+0000 7f2e09a4f700 1 -- 172.21.15.45:0/63969874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dec005210 msgr2=0x7f2e0414b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.954+0000 7f2e09a4f700 1 --2- 172.21.15.45:0/63969874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dec005210 0x7f2e0414b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.954+0000 7f2e09a4f700 1 -- 172.21.15.45:0/63969874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0406b450 con 0x7f2e040c23c0 2023-10-08T12:46:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.954+0000 7f2e09a4f700 1 --2- 172.21.15.45:0/63969874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e040c23c0 0x7f2e0415a1b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2df800e540 tx=0x7f2df800e850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.954+0000 7f2e02ffd700 1 -- 172.21.15.45:0/63969874 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df8011870 con 0x7f2e040c23c0 2023-10-08T12:46:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.954+0000 7f2e02ffd700 1 -- 172.21.15.45:0/63969874 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2df8011ae0 con 0x7f2e040c23c0 2023-10-08T12:46:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.954+0000 7f2e0c4b4700 1 -- 172.21.15.45:0/63969874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e0406b730 con 0x7f2e040c23c0 2023-10-08T12:46:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.954+0000 7f2e02ffd700 1 -- 172.21.15.45:0/63969874 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df80103c0 con 0x7f2e040c23c0 2023-10-08T12:46:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.954+0000 7f2e0c4b4700 1 -- 172.21.15.45:0/63969874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e0406bcf0 con 0x7f2e040c23c0 2023-10-08T12:46:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.955+0000 7f2e0c4b4700 1 -- 172.21.15.45:0/63969874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e04066850 con 0x7f2e040c23c0 2023-10-08T12:46:12.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.956+0000 7f2e02ffd700 1 -- 172.21.15.45:0/63969874 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2df8010520 con 0x7f2e040c23c0 2023-10-08T12:46:12.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.956+0000 7f2e02ffd700 1 --2- 172.21.15.45:0/63969874 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f2df006aed0 0x7f2df006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:12.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.956+0000 7f2e02ffd700 1 -- 172.21.15.45:0/63969874 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2df8089e10 con 0x7f2e040c23c0 2023-10-08T12:46:12.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.956+0000 7f2e0a250700 1 --2- 172.21.15.45:0/63969874 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f2df006aed0 0x7f2df006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:12.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.957+0000 7f2e0a250700 1 --2- 172.21.15.45:0/63969874 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f2df006aed0 0x7f2df006d390 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc004fd0 tx=0x7f2dfc004a90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:12.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:12.961+0000 7f2e02ffd700 1 -- 172.21.15.45:0/63969874 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2df8054f50 con 0x7f2e040c23c0 2023-10-08T12:46:13.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.162+0000 7f2e0c4b4700 1 -- 172.21.15.45:0/63969874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2e040c2cf0 con 0x7f2e040c23c0 2023-10-08T12:46:13.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.162+0000 7f2e02ffd700 1 -- 172.21.15.45:0/63969874 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2df8015020 con 0x7f2e040c23c0 2023-10-08T12:46:13.163 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-08T12:46:13.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.164+0000 7f2e0c4b4700 1 -- 172.21.15.45:0/63969874 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f2df006aed0 msgr2=0x7f2df006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:13.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.164+0000 7f2e0c4b4700 1 --2- 172.21.15.45:0/63969874 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f2df006aed0 0x7f2df006d390 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc004fd0 tx=0x7f2dfc004a90 comp rx=0 tx=0).stop 2023-10-08T12:46:13.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.164+0000 7f2e0c4b4700 1 -- 172.21.15.45:0/63969874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e040c23c0 msgr2=0x7f2e0415a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:13.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.164+0000 7f2e0c4b4700 1 --2- 172.21.15.45:0/63969874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e040c23c0 0x7f2e0415a1b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2df800e540 tx=0x7f2df800e850 comp rx=0 tx=0).stop 2023-10-08T12:46:13.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.164+0000 7f2e0c4b4700 1 -- 172.21.15.45:0/63969874 shutdown_connections 2023-10-08T12:46:13.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.164+0000 7f2e0c4b4700 1 --2- 172.21.15.45:0/63969874 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f2df006aed0 0x7f2df006d390 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.164+0000 7f2e0c4b4700 1 --2- 172.21.15.45:0/63969874 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2e0415a6f0 0x7f2e0414d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.164+0000 7f2e0c4b4700 1 --2- 172.21.15.45:0/63969874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dec005210 0x7f2e0414b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.164+0000 7f2e0c4b4700 1 --2- 172.21.15.45:0/63969874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e040c23c0 0x7f2e0415a1b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.164+0000 7f2e0c4b4700 1 -- 172.21.15.45:0/63969874 >> 172.21.15.45:0/63969874 conn(0x7f2e040b12c0 msgr2=0x7f2e04158bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:13.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.164+0000 7f2e0c4b4700 1 -- 172.21.15.45:0/63969874 shutdown_connections 2023-10-08T12:46:13.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.164+0000 7f2e0c4b4700 1 -- 172.21.15.45:0/63969874 wait complete. 2023-10-08T12:46:13.177 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:46:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.307+0000 7fa0c9d8a700 1 -- 172.21.15.45:0/2317934874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0c41599f0 msgr2=0x7fa0c406ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.307+0000 7fa0c9d8a700 1 --2- 172.21.15.45:0/2317934874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0c41599f0 0x7fa0c406ee90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa0b80098c0 tx=0x7fa0b8009bd0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.307+0000 7fa0c9d8a700 1 -- 172.21.15.45:0/2317934874 shutdown_connections 2023-10-08T12:46:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.307+0000 7fa0c9d8a700 1 --2- 172.21.15.45:0/2317934874 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0c40cc870 0x7fa0c40ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.307+0000 7fa0c9d8a700 1 --2- 172.21.15.45:0/2317934874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0c41599f0 0x7fa0c406ee90 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.307+0000 7fa0c9d8a700 1 -- 172.21.15.45:0/2317934874 >> 172.21.15.45:0/2317934874 conn(0x7fa0c40cf750 msgr2=0x7fa0c40cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.307+0000 7fa0c9d8a700 1 -- 172.21.15.45:0/2317934874 shutdown_connections 2023-10-08T12:46:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.307+0000 7fa0c9d8a700 1 -- 172.21.15.45:0/2317934874 wait complete. 2023-10-08T12:46:13.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.308+0000 7fa0c9d8a700 1 Processor -- start 2023-10-08T12:46:13.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.308+0000 7fa0c9d8a700 1 -- start start 2023-10-08T12:46:13.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.309+0000 7fa0c9d8a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0c406f3d0 0x7fa0c40c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:13.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.309+0000 7fa0c9d8a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0c40cc870 0x7fa0c4153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:13.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.309+0000 7fa0c9d8a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0c41599f0 0x7fa0c415c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:13.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.309+0000 7fa0c9d8a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c40c9870 con 0x7fa0c406f3d0 2023-10-08T12:46:13.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.309+0000 7fa0c9d8a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c40c92b0 con 0x7fa0c40cc870 2023-10-08T12:46:13.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.309+0000 7fa0c9d8a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c40c9590 con 0x7fa0c41599f0 2023-10-08T12:46:13.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.309+0000 7fa0c37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0c406f3d0 0x7fa0c40c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:13.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.309+0000 7fa0c37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0c406f3d0 0x7fa0c40c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36516/0 (socket says 172.21.15.45:36516) 2023-10-08T12:46:13.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.309+0000 7fa0c37fe700 1 -- 172.21.15.45:0/2065436705 learned_addr learned my addr 172.21.15.45:0/2065436705 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:13.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.309+0000 7fa0c37fe700 1 -- 172.21.15.45:0/2065436705 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0c41599f0 msgr2=0x7fa0c415c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:13.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.309+0000 7fa0c37fe700 1 --2- 172.21.15.45:0/2065436705 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0c41599f0 0x7fa0c415c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.309+0000 7fa0c37fe700 1 -- 172.21.15.45:0/2065436705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0c40cc870 msgr2=0x7fa0c4153c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:13.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.309+0000 7fa0c2ffd700 1 --2- 172.21.15.45:0/2065436705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0c40cc870 0x7fa0c4153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:13.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.309+0000 7fa0c37fe700 1 --2- 172.21.15.45:0/2065436705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0c40cc870 0x7fa0c4153c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.309+0000 7fa0c37fe700 1 -- 172.21.15.45:0/2065436705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b8009520 con 0x7fa0c406f3d0 2023-10-08T12:46:13.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.309+0000 7fa0c37fe700 1 --2- 172.21.15.45:0/2065436705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0c406f3d0 0x7fa0c40c89f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8000c00 tx=0x7fa0b80107d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:13.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.309+0000 7fa0abfff700 1 -- 172.21.15.45:0/2065436705 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8010e80 con 0x7fa0c406f3d0 2023-10-08T12:46:13.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.309+0000 7fa0abfff700 1 -- 172.21.15.45:0/2065436705 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa0b80174f0 con 0x7fa0c406f3d0 2023-10-08T12:46:13.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.309+0000 7fa0abfff700 1 -- 172.21.15.45:0/2065436705 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8017900 con 0x7fa0c406f3d0 2023-10-08T12:46:13.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.309+0000 7fa0c9d8a700 1 -- 172.21.15.45:0/2065436705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c406b7e0 con 0x7fa0c406f3d0 2023-10-08T12:46:13.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.310+0000 7fa0c9d8a700 1 -- 172.21.15.45:0/2065436705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c40c8f30 con 0x7fa0c406f3d0 2023-10-08T12:46:13.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.311+0000 7fa0c9d8a700 1 -- 172.21.15.45:0/2065436705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c404e4c0 con 0x7fa0c406f3d0 2023-10-08T12:46:13.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.311+0000 7fa0abfff700 1 -- 172.21.15.45:0/2065436705 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa0b8017a60 con 0x7fa0c406f3d0 2023-10-08T12:46:13.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.311+0000 7fa0abfff700 1 --2- 172.21.15.45:0/2065436705 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa0b006aed0 0x7fa0b006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:13.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.311+0000 7fa0abfff700 1 -- 172.21.15.45:0/2065436705 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0b808b300 con 0x7fa0c406f3d0 2023-10-08T12:46:13.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.312+0000 7fa0c2ffd700 1 --2- 172.21.15.45:0/2065436705 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa0b006aed0 0x7fa0b006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:13.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.312+0000 7fa0c2ffd700 1 --2- 172.21.15.45:0/2065436705 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa0b006aed0 0x7fa0b006d390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4007fd0 tx=0x7fa0b4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:13.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.316+0000 7fa0abfff700 1 -- 172.21.15.45:0/2065436705 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa0b8056440 con 0x7fa0c406f3d0 2023-10-08T12:46:13.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.563+0000 7fa0c9d8a700 1 -- 172.21.15.45:0/2065436705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0c415cfb0 con 0x7fa0c406f3d0 2023-10-08T12:46:13.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.564+0000 7fa0abfff700 1 -- 172.21.15.45:0/2065436705 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7fa0b8059a60 con 0x7fa0c406f3d0 2023-10-08T12:46:13.565 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:46:13.565 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4332,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3352988594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3352988594},{"type":"v1","addr":"172.21.15.45:6834","nonce":3352988594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4335,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/448033669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":448033669},{"type":"v1","addr":"172.21.15.45:6835","nonce":448033669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4347,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2935302656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":2935302656},{"type":"v1","addr":"172.21.15.78:6837","nonce":2935302656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T12:45:24.623822+0000","modified":"2023-10-08T12:45:27.649794+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4372},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4372":{"gid":4372,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6836/2145831865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2145831865},{"type":"v1","addr":"172.21.15.78:6836","nonce":2145831865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:46:13.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.566+0000 7fa0c9d8a700 1 -- 172.21.15.45:0/2065436705 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa0b006aed0 msgr2=0x7fa0b006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:13.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.566+0000 7fa0c9d8a700 1 --2- 172.21.15.45:0/2065436705 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa0b006aed0 0x7fa0b006d390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4007fd0 tx=0x7fa0b4009040 comp rx=0 tx=0).stop 2023-10-08T12:46:13.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.566+0000 7fa0c9d8a700 1 -- 172.21.15.45:0/2065436705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0c406f3d0 msgr2=0x7fa0c40c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:13.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.566+0000 7fa0c9d8a700 1 --2- 172.21.15.45:0/2065436705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0c406f3d0 0x7fa0c40c89f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8000c00 tx=0x7fa0b80107d0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.566+0000 7fa0c9d8a700 1 -- 172.21.15.45:0/2065436705 shutdown_connections 2023-10-08T12:46:13.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.566+0000 7fa0c9d8a700 1 --2- 172.21.15.45:0/2065436705 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa0b006aed0 0x7fa0b006d390 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.566+0000 7fa0c9d8a700 1 --2- 172.21.15.45:0/2065436705 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0c41599f0 0x7fa0c415c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.566+0000 7fa0c9d8a700 1 --2- 172.21.15.45:0/2065436705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0c406f3d0 0x7fa0c40c89f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.566+0000 7fa0c9d8a700 1 --2- 172.21.15.45:0/2065436705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0c40cc870 0x7fa0c4153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.566+0000 7fa0c9d8a700 1 -- 172.21.15.45:0/2065436705 >> 172.21.15.45:0/2065436705 conn(0x7fa0c40cf750 msgr2=0x7fa0c40afc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:13.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.566+0000 7fa0c9d8a700 1 -- 172.21.15.45:0/2065436705 shutdown_connections 2023-10-08T12:46:13.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.566+0000 7fa0c9d8a700 1 -- 172.21.15.45:0/2065436705 wait complete. 2023-10-08T12:46:13.569 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-10-08T12:46:13.579 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:46:13.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.708+0000 7f8782597700 1 -- 172.21.15.45:0/938088760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f877c1599f0 msgr2=0x7f877c06ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:13.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.708+0000 7f8782597700 1 --2- 172.21.15.45:0/938088760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f877c1599f0 0x7f877c06ee90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f876c0098c0 tx=0x7f876c009bd0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.708+0000 7f8782597700 1 -- 172.21.15.45:0/938088760 shutdown_connections 2023-10-08T12:46:13.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.708+0000 7f8782597700 1 --2- 172.21.15.45:0/938088760 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f877c0cc870 0x7f877c0ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.708+0000 7f8782597700 1 --2- 172.21.15.45:0/938088760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f877c1599f0 0x7f877c06ee90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.708+0000 7f8782597700 1 -- 172.21.15.45:0/938088760 >> 172.21.15.45:0/938088760 conn(0x7f877c0cf750 msgr2=0x7f877c0cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:13.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.708+0000 7f8782597700 1 -- 172.21.15.45:0/938088760 shutdown_connections 2023-10-08T12:46:13.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.708+0000 7f8782597700 1 -- 172.21.15.45:0/938088760 wait complete. 2023-10-08T12:46:13.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.709+0000 7f8782597700 1 Processor -- start 2023-10-08T12:46:13.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.709+0000 7f8782597700 1 -- start start 2023-10-08T12:46:13.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.710+0000 7f8782597700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f877c06f3d0 0x7f877c14e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:13.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.710+0000 7f8782597700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f877c0cc870 0x7f877c0c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:13.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.710+0000 7f8782597700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f877c1599f0 0x7f877c14db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:13.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.710+0000 7f8782597700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877c0c9ee0 con 0x7f877c06f3d0 2023-10-08T12:46:13.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.710+0000 7f8782597700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877c0c6130 con 0x7f877c0cc870 2023-10-08T12:46:13.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.710+0000 7f8782597700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877c0c7280 con 0x7f877c1599f0 2023-10-08T12:46:13.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.710+0000 7f877bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f877c06f3d0 0x7f877c14e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:13.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.710+0000 7f877bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f877c06f3d0 0x7f877c14e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36530/0 (socket says 172.21.15.45:36530) 2023-10-08T12:46:13.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.710+0000 7f877bfff700 1 -- 172.21.15.45:0/458932867 learned_addr learned my addr 172.21.15.45:0/458932867 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:13.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.711+0000 7f8780b34700 1 --2- 172.21.15.45:0/458932867 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f877c1599f0 0x7f877c14db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:13.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.711+0000 7f877b7fe700 1 --2- 172.21.15.45:0/458932867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f877c0cc870 0x7f877c0c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:13.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.711+0000 7f877bfff700 1 -- 172.21.15.45:0/458932867 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f877c1599f0 msgr2=0x7f877c14db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:13.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.711+0000 7f877bfff700 1 --2- 172.21.15.45:0/458932867 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f877c1599f0 0x7f877c14db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.711+0000 7f877bfff700 1 -- 172.21.15.45:0/458932867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f877c0cc870 msgr2=0x7f877c0c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:13.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.711+0000 7f877bfff700 1 --2- 172.21.15.45:0/458932867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f877c0cc870 0x7f877c0c99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.711+0000 7f877bfff700 1 -- 172.21.15.45:0/458932867 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f876c009520 con 0x7f877c06f3d0 2023-10-08T12:46:13.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.711+0000 7f8780b34700 1 --2- 172.21.15.45:0/458932867 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f877c1599f0 0x7f877c14db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:13.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.711+0000 7f877bfff700 1 --2- 172.21.15.45:0/458932867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f877c06f3d0 0x7f877c14e500 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f876c000c00 tx=0x7f876c0107d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:13.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.711+0000 7f8778ff9700 1 -- 172.21.15.45:0/458932867 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c010e80 con 0x7f877c06f3d0 2023-10-08T12:46:13.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.711+0000 7f8778ff9700 1 -- 172.21.15.45:0/458932867 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f876c0174f0 con 0x7f877c06f3d0 2023-10-08T12:46:13.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.711+0000 7f8778ff9700 1 -- 172.21.15.45:0/458932867 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c017900 con 0x7f877c06f3d0 2023-10-08T12:46:13.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.711+0000 7f8782597700 1 -- 172.21.15.45:0/458932867 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f877c0c6950 con 0x7f877c06f3d0 2023-10-08T12:46:13.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.711+0000 7f8782597700 1 -- 172.21.15.45:0/458932867 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f877c0c6f10 con 0x7f877c06f3d0 2023-10-08T12:46:13.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.712+0000 7f8782597700 1 -- 172.21.15.45:0/458932867 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f877c04e4c0 con 0x7f877c06f3d0 2023-10-08T12:46:13.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.712+0000 7f8778ff9700 1 -- 172.21.15.45:0/458932867 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f876c017a60 con 0x7f877c06f3d0 2023-10-08T12:46:13.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.713+0000 7f8778ff9700 1 --2- 172.21.15.45:0/458932867 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f876806aed0 0x7f876806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:13.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.713+0000 7f8778ff9700 1 -- 172.21.15.45:0/458932867 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f876c08b310 con 0x7f877c06f3d0 2023-10-08T12:46:13.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.713+0000 7f877b7fe700 1 --2- 172.21.15.45:0/458932867 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f876806aed0 0x7f876806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:13.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.714+0000 7f877b7fe700 1 --2- 172.21.15.45:0/458932867 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f876806aed0 0x7f876806d390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f877c066820 tx=0x7f8770009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.717+0000 7f8778ff9700 1 -- 172.21.15.45:0/458932867 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f876c0564e0 con 0x7f877c06f3d0 2023-10-08T12:46:13.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.921+0000 7f8782597700 1 -- 172.21.15.45:0/458932867 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f877c0ca590 con 0x7f877c06f3d0 2023-10-08T12:46:13.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.922+0000 7f8778ff9700 1 -- 172.21.15.45:0/458932867 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16698 (secure 0 0 0) 0x7f876c059b00 con 0x7f877c06f3d0 2023-10-08T12:46:13.923 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:46:13.923 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:46:13.395889+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:45:19.183651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:45:22.277383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:45:23.606639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.412453+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.351925+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.428025+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.437246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.441119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.388608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.415524+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.401835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:46:13.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.924+0000 7f8782597700 1 -- 172.21.15.45:0/458932867 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f876806aed0 msgr2=0x7f876806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:13.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.924+0000 7f8782597700 1 --2- 172.21.15.45:0/458932867 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f876806aed0 0x7f876806d390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f877c066820 tx=0x7f8770009040 comp rx=0 tx=0).stop 2023-10-08T12:46:13.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.924+0000 7f8782597700 1 -- 172.21.15.45:0/458932867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f877c06f3d0 msgr2=0x7f877c14e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:13.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.924+0000 7f8782597700 1 --2- 172.21.15.45:0/458932867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f877c06f3d0 0x7f877c14e500 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f876c000c00 tx=0x7f876c0107d0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.924+0000 7f8782597700 1 -- 172.21.15.45:0/458932867 shutdown_connections 2023-10-08T12:46:13.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.924+0000 7f8782597700 1 --2- 172.21.15.45:0/458932867 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f876806aed0 0x7f876806d390 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.924+0000 7f8782597700 1 --2- 172.21.15.45:0/458932867 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f877c1599f0 0x7f877c14db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.924+0000 7f8782597700 1 --2- 172.21.15.45:0/458932867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f877c06f3d0 0x7f877c14e500 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.924+0000 7f8782597700 1 --2- 172.21.15.45:0/458932867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f877c0cc870 0x7f877c0c99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:13.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.924+0000 7f8782597700 1 -- 172.21.15.45:0/458932867 >> 172.21.15.45:0/458932867 conn(0x7f877c0cf750 msgr2=0x7f877c0af0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:13.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.924+0000 7f8782597700 1 -- 172.21.15.45:0/458932867 shutdown_connections 2023-10-08T12:46:13.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:13.924+0000 7f8782597700 1 -- 172.21.15.45:0/458932867 wait complete. 2023-10-08T12:46:13.938 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T12:46:13.938 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:46:14.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.064+0000 7fedc0420700 1 -- 172.21.15.45:0/1365994116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedb8158950 msgr2=0x7fedb80cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:14.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.064+0000 7fedc0420700 1 --2- 172.21.15.45:0/1365994116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedb8158950 0x7fedb80cdf60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7feda80098c0 tx=0x7feda8009bd0 comp rx=0 tx=0).stop 2023-10-08T12:46:14.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.064+0000 7fedc0420700 1 -- 172.21.15.45:0/1365994116 shutdown_connections 2023-10-08T12:46:14.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.064+0000 7fedc0420700 1 --2- 172.21.15.45:0/1365994116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedb8158950 0x7fedb80cdf60 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:14.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.064+0000 7fedc0420700 1 -- 172.21.15.45:0/1365994116 >> 172.21.15.45:0/1365994116 conn(0x7fedb80b0430 msgr2=0x7fedb80b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:14.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.064+0000 7fedc0420700 1 -- 172.21.15.45:0/1365994116 shutdown_connections 2023-10-08T12:46:14.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.064+0000 7fedc0420700 1 -- 172.21.15.45:0/1365994116 wait complete. 2023-10-08T12:46:14.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.066+0000 7fedc0420700 1 Processor -- start 2023-10-08T12:46:14.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.066+0000 7fedc0420700 1 -- start start 2023-10-08T12:46:14.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.066+0000 7fedc0420700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedb80c9ff0 0x7fedb81501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:14.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.066+0000 7fedc0420700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedb8158950 0x7fedb80ac960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:14.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.066+0000 7fedc0420700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedb815c320 0x7fedb80acea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:14.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.066+0000 7fedc0420700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb80ce4a0 con 0x7fedb815c320 2023-10-08T12:46:14.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.066+0000 7fedc0420700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb80aee00 con 0x7fedb8158950 2023-10-08T12:46:14.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.066+0000 7fedc0420700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb80adf30 con 0x7fedb80c9ff0 2023-10-08T12:46:14.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.066+0000 7fedbe9bd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedb815c320 0x7fedb80acea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:14.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.067+0000 7fedbe9bd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedb815c320 0x7fedb80acea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36548/0 (socket says 172.21.15.45:36548) 2023-10-08T12:46:14.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.067+0000 7fedbe9bd700 1 -- 172.21.15.45:0/3807977196 learned_addr learned my addr 172.21.15.45:0/3807977196 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:14.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.067+0000 7fedbe1bc700 1 --2- 172.21.15.45:0/3807977196 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedb80c9ff0 0x7fedb81501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:14.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.067+0000 7fedbd9bb700 1 --2- 172.21.15.45:0/3807977196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedb8158950 0x7fedb80ac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:14.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.067+0000 7fedbe9bd700 1 -- 172.21.15.45:0/3807977196 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedb80c9ff0 msgr2=0x7fedb81501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:14.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.067+0000 7fedbe9bd700 1 --2- 172.21.15.45:0/3807977196 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedb80c9ff0 0x7fedb81501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:14.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.067+0000 7fedbe9bd700 1 -- 172.21.15.45:0/3807977196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedb8158950 msgr2=0x7fedb80ac960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:14.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.067+0000 7fedbe9bd700 1 --2- 172.21.15.45:0/3807977196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedb8158950 0x7fedb80ac960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:14.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.067+0000 7fedbe9bd700 1 -- 172.21.15.45:0/3807977196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda8009520 con 0x7fedb815c320 2023-10-08T12:46:14.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.067+0000 7fedbe1bc700 1 --2- 172.21.15.45:0/3807977196 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedb80c9ff0 0x7fedb81501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:14.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.067+0000 7fedbd9bb700 1 --2- 172.21.15.45:0/3807977196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedb8158950 0x7fedb80ac960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:14.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.067+0000 7fedbe9bd700 1 --2- 172.21.15.45:0/3807977196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedb815c320 0x7fedb80acea0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fedb000cc50 tx=0x7fedb000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:14.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.067+0000 7fedaeffd700 1 -- 172.21.15.45:0/3807977196 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb000ad80 con 0x7fedb815c320 2023-10-08T12:46:14.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.067+0000 7fedaeffd700 1 -- 172.21.15.45:0/3807977196 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fedb000ce50 con 0x7fedb815c320 2023-10-08T12:46:14.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.067+0000 7fedaeffd700 1 -- 172.21.15.45:0/3807977196 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb0003c60 con 0x7fedb815c320 2023-10-08T12:46:14.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.067+0000 7fedc0420700 1 -- 172.21.15.45:0/3807977196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb8150710 con 0x7fedb815c320 2023-10-08T12:46:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.067+0000 7fedc0420700 1 -- 172.21.15.45:0/3807977196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb80ae460 con 0x7fedb815c320 2023-10-08T12:46:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.068+0000 7fedc0420700 1 -- 172.21.15.45:0/3807977196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb80c55f0 con 0x7fedb815c320 2023-10-08T12:46:14.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.068+0000 7fedaeffd700 1 -- 172.21.15.45:0/3807977196 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fedb00050d0 con 0x7fedb815c320 2023-10-08T12:46:14.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.069+0000 7fedaeffd700 1 --2- 172.21.15.45:0/3807977196 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fed9c06aed0 0x7fed9c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:14.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.069+0000 7fedaeffd700 1 -- 172.21.15.45:0/3807977196 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fedb0089930 con 0x7fedb815c320 2023-10-08T12:46:14.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.069+0000 7fedbe1bc700 1 --2- 172.21.15.45:0/3807977196 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fed9c06aed0 0x7fed9c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:14.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.070+0000 7fedbe1bc700 1 --2- 172.21.15.45:0/3807977196 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fed9c06aed0 0x7fed9c06d390 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7feda8009230 tx=0x7feda8019040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:14.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.074+0000 7fedaeffd700 1 -- 172.21.15.45:0/3807977196 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fedb0054950 con 0x7fedb815c320 2023-10-08T12:46:14.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.321+0000 7fedc0420700 1 -- 172.21.15.45:0/3807977196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fedb80ad570 con 0x7fedb815c320 2023-10-08T12:46:14.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.322+0000 7fedaeffd700 1 -- 172.21.15.45:0/3807977196 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7fedb0057f70 con 0x7fedb815c320 2023-10-08T12:46:14.323 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:46:14.323 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4332,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3352988594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3352988594},{"type":"v1","addr":"172.21.15.45:6834","nonce":3352988594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4335,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/448033669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":448033669},{"type":"v1","addr":"172.21.15.45:6835","nonce":448033669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4347,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2935302656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":2935302656},{"type":"v1","addr":"172.21.15.78:6837","nonce":2935302656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T12:45:24.623822+0000","modified":"2023-10-08T12:45:27.649794+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4372},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4372":{"gid":4372,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6836/2145831865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2145831865},{"type":"v1","addr":"172.21.15.78:6836","nonce":2145831865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:46:14.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.324+0000 7fedc0420700 1 -- 172.21.15.45:0/3807977196 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fed9c06aed0 msgr2=0x7fed9c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:14.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.324+0000 7fedc0420700 1 --2- 172.21.15.45:0/3807977196 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fed9c06aed0 0x7fed9c06d390 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7feda8009230 tx=0x7feda8019040 comp rx=0 tx=0).stop 2023-10-08T12:46:14.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.324+0000 7fedc0420700 1 -- 172.21.15.45:0/3807977196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedb815c320 msgr2=0x7fedb80acea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:14.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.324+0000 7fedc0420700 1 --2- 172.21.15.45:0/3807977196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedb815c320 0x7fedb80acea0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fedb000cc50 tx=0x7fedb000a340 comp rx=0 tx=0).stop 2023-10-08T12:46:14.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.324+0000 7fedc0420700 1 -- 172.21.15.45:0/3807977196 shutdown_connections 2023-10-08T12:46:14.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.324+0000 7fedc0420700 1 --2- 172.21.15.45:0/3807977196 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fed9c06aed0 0x7fed9c06d390 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:14.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.324+0000 7fedc0420700 1 --2- 172.21.15.45:0/3807977196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedb815c320 0x7fedb80acea0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:14.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.324+0000 7fedc0420700 1 --2- 172.21.15.45:0/3807977196 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedb80c9ff0 0x7fedb81501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:14.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.324+0000 7fedc0420700 1 --2- 172.21.15.45:0/3807977196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedb8158950 0x7fedb80ac960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:14.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.324+0000 7fedc0420700 1 -- 172.21.15.45:0/3807977196 >> 172.21.15.45:0/3807977196 conn(0x7fedb80b0430 msgr2=0x7fedb80b15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:14.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.324+0000 7fedc0420700 1 -- 172.21.15.45:0/3807977196 shutdown_connections 2023-10-08T12:46:14.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.324+0000 7fedc0420700 1 -- 172.21.15.45:0/3807977196 wait complete. 2023-10-08T12:46:14.326 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-10-08T12:46:14.337 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:46:14.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.466+0000 7f0c64b48700 1 -- 172.21.15.45:0/3794013430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c6015c320 msgr2=0x7f0c60071f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:14.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.466+0000 7f0c64b48700 1 --2- 172.21.15.45:0/3794013430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c6015c320 0x7f0c60071f80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0c500098c0 tx=0x7f0c50009bd0 comp rx=0 tx=0).stop 2023-10-08T12:46:14.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.466+0000 7f0c64b48700 1 -- 172.21.15.45:0/3794013430 shutdown_connections 2023-10-08T12:46:14.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.466+0000 7f0c64b48700 1 --2- 172.21.15.45:0/3794013430 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0c60158950 0x7f0c600cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:14.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.466+0000 7f0c64b48700 1 --2- 172.21.15.45:0/3794013430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c6015c320 0x7f0c60071f80 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:14.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.466+0000 7f0c64b48700 1 -- 172.21.15.45:0/3794013430 >> 172.21.15.45:0/3794013430 conn(0x7f0c600b0430 msgr2=0x7f0c600b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:14.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.466+0000 7f0c64b48700 1 -- 172.21.15.45:0/3794013430 shutdown_connections 2023-10-08T12:46:14.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.466+0000 7f0c64b48700 1 -- 172.21.15.45:0/3794013430 wait complete. 2023-10-08T12:46:14.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.468+0000 7f0c64b48700 1 Processor -- start 2023-10-08T12:46:14.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.468+0000 7f0c64b48700 1 -- start start 2023-10-08T12:46:14.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.468+0000 7f0c64b48700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c600724c0 0x7f0c600c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:14.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.468+0000 7f0c64b48700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0c60158950 0x7f0c6014ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:14.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.468+0000 7f0c64b48700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c6015c320 0x7f0c6015b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:14.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.468+0000 7f0c64b48700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c600c6b50 con 0x7f0c6015c320 2023-10-08T12:46:14.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.468+0000 7f0c64b48700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c600c76d0 con 0x7f0c600724c0 2023-10-08T12:46:14.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.468+0000 7f0c64b48700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c600c6d30 con 0x7f0c60158950 2023-10-08T12:46:14.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.468+0000 7f0c5ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c6015c320 0x7f0c6015b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:14.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.469+0000 7f0c5ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c6015c320 0x7f0c6015b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36562/0 (socket says 172.21.15.45:36562) 2023-10-08T12:46:14.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.469+0000 7f0c5ed9d700 1 -- 172.21.15.45:0/1167437759 learned_addr learned my addr 172.21.15.45:0/1167437759 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:14.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.469+0000 7f0c5e59c700 1 --2- 172.21.15.45:0/1167437759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c600724c0 0x7f0c600c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:14.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.469+0000 7f0c5dd9b700 1 --2- 172.21.15.45:0/1167437759 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0c60158950 0x7f0c6014ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:14.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.469+0000 7f0c5ed9d700 1 -- 172.21.15.45:0/1167437759 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0c60158950 msgr2=0x7f0c6014ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:14.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.469+0000 7f0c5ed9d700 1 --2- 172.21.15.45:0/1167437759 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0c60158950 0x7f0c6014ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:14.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.469+0000 7f0c5ed9d700 1 -- 172.21.15.45:0/1167437759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c600724c0 msgr2=0x7f0c600c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:14.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.469+0000 7f0c5ed9d700 1 --2- 172.21.15.45:0/1167437759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c600724c0 0x7f0c600c7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:14.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.469+0000 7f0c5ed9d700 1 -- 172.21.15.45:0/1167437759 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c50009520 con 0x7f0c6015c320 2023-10-08T12:46:14.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.469+0000 7f0c5ed9d700 1 --2- 172.21.15.45:0/1167437759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c6015c320 0x7f0c6015b030 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0c5800c810 tx=0x7f0c5800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:14.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.469+0000 7f0c4effd700 1 -- 172.21.15.45:0/1167437759 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c58003e30 con 0x7f0c6015c320 2023-10-08T12:46:14.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.469+0000 7f0c4effd700 1 -- 172.21.15.45:0/1167437759 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0c58005070 con 0x7f0c6015c320 2023-10-08T12:46:14.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.469+0000 7f0c4effd700 1 -- 172.21.15.45:0/1167437759 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c58005480 con 0x7f0c6015c320 2023-10-08T12:46:14.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.469+0000 7f0c64b48700 1 -- 172.21.15.45:0/1167437759 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c600c7010 con 0x7f0c6015c320 2023-10-08T12:46:14.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.469+0000 7f0c64b48700 1 -- 172.21.15.45:0/1167437759 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c6014cf40 con 0x7f0c6015c320 2023-10-08T12:46:14.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.470+0000 7f0c64b48700 1 -- 172.21.15.45:0/1167437759 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c600c7810 con 0x7f0c6015c320 2023-10-08T12:46:14.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.471+0000 7f0c4effd700 1 -- 172.21.15.45:0/1167437759 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0c580055e0 con 0x7f0c6015c320 2023-10-08T12:46:14.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.472+0000 7f0c4effd700 1 --2- 172.21.15.45:0/1167437759 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0c4006aed0 0x7f0c4006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:14.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.472+0000 7f0c4effd700 1 -- 172.21.15.45:0/1167437759 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f0c58089600 con 0x7f0c6015c320 2023-10-08T12:46:14.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.472+0000 7f0c5e59c700 1 --2- 172.21.15.45:0/1167437759 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0c4006aed0 0x7f0c4006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:14.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.473+0000 7f0c5e59c700 1 --2- 172.21.15.45:0/1167437759 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0c4006aed0 0x7f0c4006d390 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0c54005950 tx=0x7f0c540058e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:14.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.477+0000 7f0c4effd700 1 -- 172.21.15.45:0/1167437759 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0c58054580 con 0x7f0c6015c320 2023-10-08T12:46:14.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.722+0000 7f0c64b48700 1 -- 172.21.15.45:0/1167437759 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c6004e4c0 con 0x7f0c6015c320 2023-10-08T12:46:14.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.723+0000 7f0c4effd700 1 -- 172.21.15.45:0/1167437759 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7f0c58057ba0 con 0x7f0c6015c320 2023-10-08T12:46:14.724 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:46:14.724 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4332,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3352988594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3352988594},{"type":"v1","addr":"172.21.15.45:6834","nonce":3352988594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4335,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/448033669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":448033669},{"type":"v1","addr":"172.21.15.45:6835","nonce":448033669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4347,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2935302656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":2935302656},{"type":"v1","addr":"172.21.15.78:6837","nonce":2935302656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T12:45:24.623822+0000","modified":"2023-10-08T12:45:27.649794+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4372},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4372":{"gid":4372,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6836/2145831865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2145831865},{"type":"v1","addr":"172.21.15.78:6836","nonce":2145831865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:46:14.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.725+0000 7f0c64b48700 1 -- 172.21.15.45:0/1167437759 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0c4006aed0 msgr2=0x7f0c4006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:14.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.725+0000 7f0c64b48700 1 --2- 172.21.15.45:0/1167437759 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0c4006aed0 0x7f0c4006d390 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0c54005950 tx=0x7f0c540058e0 comp rx=0 tx=0).stop 2023-10-08T12:46:14.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.725+0000 7f0c64b48700 1 -- 172.21.15.45:0/1167437759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c6015c320 msgr2=0x7f0c6015b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:14.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.725+0000 7f0c64b48700 1 --2- 172.21.15.45:0/1167437759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c6015c320 0x7f0c6015b030 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0c5800c810 tx=0x7f0c5800cbd0 comp rx=0 tx=0).stop 2023-10-08T12:46:14.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.725+0000 7f0c64b48700 1 -- 172.21.15.45:0/1167437759 shutdown_connections 2023-10-08T12:46:14.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.725+0000 7f0c64b48700 1 --2- 172.21.15.45:0/1167437759 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0c4006aed0 0x7f0c4006d390 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:14.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.725+0000 7f0c64b48700 1 --2- 172.21.15.45:0/1167437759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c6015c320 0x7f0c6015b030 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:14.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.725+0000 7f0c64b48700 1 --2- 172.21.15.45:0/1167437759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c600724c0 0x7f0c600c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:14.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.725+0000 7f0c64b48700 1 --2- 172.21.15.45:0/1167437759 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0c60158950 0x7f0c6014ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:14.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.725+0000 7f0c64b48700 1 -- 172.21.15.45:0/1167437759 >> 172.21.15.45:0/1167437759 conn(0x7f0c600b0430 msgr2=0x7f0c600afbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:14.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.725+0000 7f0c64b48700 1 -- 172.21.15.45:0/1167437759 shutdown_connections 2023-10-08T12:46:14.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.725+0000 7f0c64b48700 1 -- 172.21.15.45:0/1167437759 wait complete. 2023-10-08T12:46:14.727 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-10-08T12:46:14.738 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:46:14.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.864+0000 7f29c9349700 1 -- 172.21.15.45:0/2226940631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29c415ba80 msgr2=0x7f29c40d1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:14.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.864+0000 7f29c9349700 1 --2- 172.21.15.45:0/2226940631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29c415ba80 0x7f29c40d1940 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f29c408abc0 tx=0x7f29b8009ba0 comp rx=0 tx=0).stop 2023-10-08T12:46:14.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.864+0000 7f29c9349700 1 -- 172.21.15.45:0/2226940631 shutdown_connections 2023-10-08T12:46:14.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.864+0000 7f29c9349700 1 --2- 172.21.15.45:0/2226940631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29c415ba80 0x7f29c40d1940 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:14.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.864+0000 7f29c9349700 1 --2- 172.21.15.45:0/2226940631 >> v2:172.21.15.78:3300/0 conn(0x7f29c40b7340 0x7f29c40d1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:14.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.864+0000 7f29c9349700 1 -- 172.21.15.45:0/2226940631 >> 172.21.15.45:0/2226940631 conn(0x7f29c406ba10 msgr2=0x7f29c406be20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:14.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.864+0000 7f29c9349700 1 -- 172.21.15.45:0/2226940631 shutdown_connections 2023-10-08T12:46:14.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.864+0000 7f29c9349700 1 -- 172.21.15.45:0/2226940631 wait complete. 2023-10-08T12:46:14.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.866+0000 7f29c9349700 1 Processor -- start 2023-10-08T12:46:14.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.866+0000 7f29c9349700 1 -- start start 2023-10-08T12:46:14.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.866+0000 7f29c9349700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29c40b7340 0x7f29c4149d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:14.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.866+0000 7f29c9349700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29c415ba80 0x7f29c40b5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:14.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.866+0000 7f29c9349700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f29c415f610 0x7f29c40b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:14.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.866+0000 7f29c9349700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c40c90b0 con 0x7f29c40b7340 2023-10-08T12:46:14.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.866+0000 7f29c9349700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c40c8a80 con 0x7f29c415ba80 2023-10-08T12:46:14.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.866+0000 7f29c9349700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c415a8d0 con 0x7f29c415f610 2023-10-08T12:46:14.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.867+0000 7f29c2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29c40b7340 0x7f29c4149d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:14.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.867+0000 7f29c2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29c40b7340 0x7f29c4149d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36572/0 (socket says 172.21.15.45:36572) 2023-10-08T12:46:14.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.867+0000 7f29c2ffd700 1 -- 172.21.15.45:0/3713320565 learned_addr learned my addr 172.21.15.45:0/3713320565 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:14.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.867+0000 7f29c27fc700 1 --2- 172.21.15.45:0/3713320565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29c415ba80 0x7f29c40b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.867+0000 7f29c37fe700 1 --2- 172.21.15.45:0/3713320565 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f29c415f610 0x7f29c40b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.867+0000 7f29c2ffd700 1 -- 172.21.15.45:0/3713320565 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f29c415f610 msgr2=0x7f29c40b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.867+0000 7f29c2ffd700 1 --2- 172.21.15.45:0/3713320565 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f29c415f610 0x7f29c40b57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.867+0000 7f29c2ffd700 1 -- 172.21.15.45:0/3713320565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29c415ba80 msgr2=0x7f29c40b5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.867+0000 7f29c2ffd700 1 --2- 172.21.15.45:0/3713320565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29c415ba80 0x7f29c40b5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.867+0000 7f29c2ffd700 1 -- 172.21.15.45:0/3713320565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b8009520 con 0x7f29c40b7340 2023-10-08T12:46:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.867+0000 7f29c37fe700 1 --2- 172.21.15.45:0/3713320565 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f29c415f610 0x7f29c40b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:46:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.867+0000 7f29c2ffd700 1 --2- 172.21.15.45:0/3713320565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29c40b7340 0x7f29c4149d60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f29b8000c00 tx=0x7f29b800f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.867+0000 7f29ab7fe700 1 -- 172.21.15.45:0/3713320565 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b800fbc0 con 0x7f29c40b7340 2023-10-08T12:46:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.867+0000 7f29ab7fe700 1 -- 172.21.15.45:0/3713320565 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f29b800fd40 con 0x7f29c40b7340 2023-10-08T12:46:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.867+0000 7f29c9349700 1 -- 172.21.15.45:0/3713320565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c415abb0 con 0x7f29c40b7340 2023-10-08T12:46:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.867+0000 7f29ab7fe700 1 -- 172.21.15.45:0/3713320565 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b8017660 con 0x7f29c40b7340 2023-10-08T12:46:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.867+0000 7f29c9349700 1 -- 172.21.15.45:0/3713320565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c414a2a0 con 0x7f29c40b7340 2023-10-08T12:46:14.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.868+0000 7f29c9349700 1 -- 172.21.15.45:0/3713320565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c404e4c0 con 0x7f29c40b7340 2023-10-08T12:46:14.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.869+0000 7f29ab7fe700 1 -- 172.21.15.45:0/3713320565 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f29b80177c0 con 0x7f29c40b7340 2023-10-08T12:46:14.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.869+0000 7f29ab7fe700 1 --2- 172.21.15.45:0/3713320565 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f29b006aed0 0x7f29b006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:14.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.869+0000 7f29ab7fe700 1 -- 172.21.15.45:0/3713320565 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f29b808bfd0 con 0x7f29c40b7340 2023-10-08T12:46:14.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.870+0000 7f29c27fc700 1 --2- 172.21.15.45:0/3713320565 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f29b006aed0 0x7f29b006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:14.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.870+0000 7f29c27fc700 1 --2- 172.21.15.45:0/3713320565 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f29b006aed0 0x7f29b006d390 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f29c415b490 tx=0x7f29b400b410 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:14.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:14.873+0000 7f29ab7fe700 1 -- 172.21.15.45:0/3713320565 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f29b80570a0 con 0x7f29c40b7340 2023-10-08T12:46:15.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.076+0000 7f29c9349700 1 -- 172.21.15.45:0/3713320565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29c40cdbf0 con 0x7f29c40b7340 2023-10-08T12:46:15.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.077+0000 7f29ab7fe700 1 -- 172.21.15.45:0/3713320565 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16698 (secure 0 0 0) 0x7f29b805a6c0 con 0x7f29c40b7340 2023-10-08T12:46:15.078 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:46:15.078 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:46:14.399923+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:45:19.183651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:45:22.277383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:45:23.606639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.412453+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.351925+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.428025+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.437246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.441119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.388608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.415524+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.401835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:46:15.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.079+0000 7f29c9349700 1 -- 172.21.15.45:0/3713320565 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f29b006aed0 msgr2=0x7f29b006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:15.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.079+0000 7f29c9349700 1 --2- 172.21.15.45:0/3713320565 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f29b006aed0 0x7f29b006d390 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f29c415b490 tx=0x7f29b400b410 comp rx=0 tx=0).stop 2023-10-08T12:46:15.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.079+0000 7f29c9349700 1 -- 172.21.15.45:0/3713320565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29c40b7340 msgr2=0x7f29c4149d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:15.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.079+0000 7f29c9349700 1 --2- 172.21.15.45:0/3713320565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29c40b7340 0x7f29c4149d60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f29b8000c00 tx=0x7f29b800f710 comp rx=0 tx=0).stop 2023-10-08T12:46:15.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.079+0000 7f29c9349700 1 -- 172.21.15.45:0/3713320565 shutdown_connections 2023-10-08T12:46:15.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.079+0000 7f29c9349700 1 --2- 172.21.15.45:0/3713320565 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f29b006aed0 0x7f29b006d390 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.079+0000 7f29c9349700 1 --2- 172.21.15.45:0/3713320565 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f29c415f610 0x7f29c40b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.079+0000 7f29c9349700 1 --2- 172.21.15.45:0/3713320565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29c40b7340 0x7f29c4149d60 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.079+0000 7f29c9349700 1 --2- 172.21.15.45:0/3713320565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29c415ba80 0x7f29c40b5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.079+0000 7f29c9349700 1 -- 172.21.15.45:0/3713320565 >> 172.21.15.45:0/3713320565 conn(0x7f29c406ba10 msgr2=0x7f29c4071940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:15.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.079+0000 7f29c9349700 1 -- 172.21.15.45:0/3713320565 shutdown_connections 2023-10-08T12:46:15.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.079+0000 7f29c9349700 1 -- 172.21.15.45:0/3713320565 wait complete. 2023-10-08T12:46:15.092 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T12:46:15.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.220+0000 7f2cfe036700 1 -- 172.21.15.45:0/4013500225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ce4003a00 msgr2=0x7f2ce4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:15.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.220+0000 7f2cfe036700 1 --2- 172.21.15.45:0/4013500225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ce4003a00 0x7f2ce4003e20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0009be0 tx=0x7f2ce4005880 comp rx=0 tx=0).stop 2023-10-08T12:46:15.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.220+0000 7f2cf7fff700 1 -- 172.21.15.45:0/4013500225 reap_dead start 2023-10-08T12:46:15.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.220+0000 7f2cfe036700 1 -- 172.21.15.45:0/4013500225 shutdown_connections 2023-10-08T12:46:15.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.220+0000 7f2cfe036700 1 -- 172.21.15.45:0/4013500225 >> 172.21.15.45:0/4013500225 conn(0x7f2cf80b0430 msgr2=0x7f2cf80b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:15.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.220+0000 7f2cfe036700 1 -- 172.21.15.45:0/4013500225 shutdown_connections 2023-10-08T12:46:15.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.220+0000 7f2cfe036700 1 -- 172.21.15.45:0/4013500225 wait complete. 2023-10-08T12:46:15.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.221+0000 7f2cfe036700 1 Processor -- start 2023-10-08T12:46:15.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.222+0000 7f2cfe036700 1 -- start start 2023-10-08T12:46:15.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.222+0000 7f2cfe036700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ce4003a00 0x7f2cf80c5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.222+0000 7f2cfe036700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2cf814dd60 0x7f2cf80ab090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.222+0000 7f2cfe036700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cf80ab5d0 0x7f2cf80cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.222+0000 7f2cfe036700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf80abbe0 con 0x7f2ce4003a00 2023-10-08T12:46:15.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.222+0000 7f2cfe036700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf80c5e70 con 0x7f2cf80ab5d0 2023-10-08T12:46:15.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.222+0000 7f2cfe036700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf815a010 con 0x7f2cf814dd60 2023-10-08T12:46:15.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.222+0000 7f2cf77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ce4003a00 0x7f2cf80c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.222+0000 7f2cf77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ce4003a00 0x7f2cf80c5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36592/0 (socket says 172.21.15.45:36592) 2023-10-08T12:46:15.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.222+0000 7f2cf77fe700 1 -- 172.21.15.45:0/524819098 learned_addr learned my addr 172.21.15.45:0/524819098 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:15.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.223+0000 7f2cf7fff700 1 --2- 172.21.15.45:0/524819098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cf80ab5d0 0x7f2cf80cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.223+0000 7f2cf6ffd700 1 --2- 172.21.15.45:0/524819098 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2cf814dd60 0x7f2cf80ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.223+0000 7f2cf77fe700 1 -- 172.21.15.45:0/524819098 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2cf814dd60 msgr2=0x7f2cf80ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:15.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.223+0000 7f2cf77fe700 1 --2- 172.21.15.45:0/524819098 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2cf814dd60 0x7f2cf80ab090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.223+0000 7f2cf77fe700 1 -- 172.21.15.45:0/524819098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cf80ab5d0 msgr2=0x7f2cf80cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:15.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.223+0000 7f2cf77fe700 1 --2- 172.21.15.45:0/524819098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cf80ab5d0 0x7f2cf80cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.223+0000 7f2cf77fe700 1 -- 172.21.15.45:0/524819098 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf8072890 con 0x7f2ce4003a00 2023-10-08T12:46:15.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.223+0000 7f2cf77fe700 1 --2- 172.21.15.45:0/524819098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ce4003a00 0x7f2cf80c5930 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2ce000e630 tx=0x7f2ce0005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:15.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.223+0000 7f2ceffff700 1 -- 172.21.15.45:0/524819098 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0003680 con 0x7f2ce4003a00 2023-10-08T12:46:15.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.223+0000 7f2ceffff700 1 -- 172.21.15.45:0/524819098 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2ce0003800 con 0x7f2ce4003a00 2023-10-08T12:46:15.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.223+0000 7f2cfe036700 1 -- 172.21.15.45:0/524819098 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf815a2f0 con 0x7f2ce4003a00 2023-10-08T12:46:15.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.223+0000 7f2ceffff700 1 -- 172.21.15.45:0/524819098 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0003c10 con 0x7f2ce4003a00 2023-10-08T12:46:15.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.223+0000 7f2cfe036700 1 -- 172.21.15.45:0/524819098 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf815a8b0 con 0x7f2ce4003a00 2023-10-08T12:46:15.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.224+0000 7f2cfe036700 1 -- 172.21.15.45:0/524819098 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf80ab9b0 con 0x7f2ce4003a00 2023-10-08T12:46:15.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.224+0000 7f2ceffff700 1 -- 172.21.15.45:0/524819098 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2ce002a460 con 0x7f2ce4003a00 2023-10-08T12:46:15.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.225+0000 7f2ceffff700 1 --2- 172.21.15.45:0/524819098 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f2cd806aed0 0x7f2cd806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.225+0000 7f2ceffff700 1 -- 172.21.15.45:0/524819098 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f2ce0014070 con 0x7f2ce4003a00 2023-10-08T12:46:15.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.225+0000 7f2cf6ffd700 1 --2- 172.21.15.45:0/524819098 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f2cd806aed0 0x7f2cd806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.226+0000 7f2cf6ffd700 1 --2- 172.21.15.45:0/524819098 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f2cd806aed0 0x7f2cd806d390 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8001820 tx=0x7f2ce8000bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:15.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.230+0000 7f2ceffff700 1 -- 172.21.15.45:0/524819098 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2ce0055b90 con 0x7f2ce4003a00 2023-10-08T12:46:15.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.478+0000 7f2cfe036700 1 -- 172.21.15.45:0/524819098 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2cf804e4c0 con 0x7f2ce4003a00 2023-10-08T12:46:15.479 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-10-08T12:46:15.479+0000 7fc212d6d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T12:46:15.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.480+0000 7f2ceffff700 1 -- 172.21.15.45:0/524819098 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2ce00591b0 con 0x7f2ce4003a00 2023-10-08T12:46:15.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.483+0000 7f2cfe036700 1 -- 172.21.15.45:0/524819098 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f2cd806aed0 msgr2=0x7f2cd806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:15.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.483+0000 7f2cfe036700 1 --2- 172.21.15.45:0/524819098 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f2cd806aed0 0x7f2cd806d390 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8001820 tx=0x7f2ce8000bc0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.483+0000 7f2cfe036700 1 -- 172.21.15.45:0/524819098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ce4003a00 msgr2=0x7f2cf80c5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:15.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.483+0000 7f2cfe036700 1 --2- 172.21.15.45:0/524819098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ce4003a00 0x7f2cf80c5930 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2ce000e630 tx=0x7f2ce0005990 comp rx=0 tx=0).stop 2023-10-08T12:46:15.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.483+0000 7f2cfe036700 1 -- 172.21.15.45:0/524819098 shutdown_connections 2023-10-08T12:46:15.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.483+0000 7f2cfe036700 1 --2- 172.21.15.45:0/524819098 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f2cd806aed0 0x7f2cd806d390 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.483+0000 7f2cfe036700 1 --2- 172.21.15.45:0/524819098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cf80ab5d0 0x7f2cf80cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.483+0000 7f2cfe036700 1 --2- 172.21.15.45:0/524819098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ce4003a00 0x7f2cf80c5930 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.483+0000 7f2cfe036700 1 --2- 172.21.15.45:0/524819098 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2cf814dd60 0x7f2cf80ab090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.483+0000 7f2cfe036700 1 -- 172.21.15.45:0/524819098 >> 172.21.15.45:0/524819098 conn(0x7f2cf80b0430 msgr2=0x7f2cf80b34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:15.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.484+0000 7f2cfe036700 1 -- 172.21.15.45:0/524819098 shutdown_connections 2023-10-08T12:46:15.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.484+0000 7f2cfe036700 1 -- 172.21.15.45:0/524819098 wait complete. 2023-10-08T12:46:15.486 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T12:46:15.497 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T12:46:15.523 INFO:tasks.ceph.mds.d.smithi078.stdout:starting mds.d at 2023-10-08T12:46:15.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.625+0000 7f0cdb228700 1 -- 172.21.15.45:0/1438315692 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cd41586b0 msgr2=0x7f0cd40cee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:15.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.625+0000 7f0cdb228700 1 --2- 172.21.15.45:0/1438315692 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cd41586b0 0x7f0cd40cee10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80098c0 tx=0x7f0cc8009bd0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.625+0000 7f0cdb228700 1 -- 172.21.15.45:0/1438315692 shutdown_connections 2023-10-08T12:46:15.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.625+0000 7f0cdb228700 1 --2- 172.21.15.45:0/1438315692 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0cd4158a90 0x7f0cd40b0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.625+0000 7f0cdb228700 1 --2- 172.21.15.45:0/1438315692 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cd41586b0 0x7f0cd40cee10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.625+0000 7f0cdb228700 1 -- 172.21.15.45:0/1438315692 >> 172.21.15.45:0/1438315692 conn(0x7f0cd406b320 msgr2=0x7f0cd406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:15.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.625+0000 7f0cdb228700 1 -- 172.21.15.45:0/1438315692 shutdown_connections 2023-10-08T12:46:15.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.625+0000 7f0cdb228700 1 -- 172.21.15.45:0/1438315692 wait complete. 2023-10-08T12:46:15.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.626+0000 7f0cdb228700 1 Processor -- start 2023-10-08T12:46:15.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.626+0000 7f0cdb228700 1 -- start start 2023-10-08T12:46:15.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.627+0000 7f0cdb228700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cd40cc820 0x7f0cd4140f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.627+0000 7f0cdb228700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cd41586b0 0x7f0cd4140300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.627+0000 7f0cdb228700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0cd4158a90 0x7f0cd40b1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.627+0000 7f0cdb228700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd413da40 con 0x7f0cd40cc820 2023-10-08T12:46:15.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.627+0000 7f0cdb228700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd413dd20 con 0x7f0cd41586b0 2023-10-08T12:46:15.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.627+0000 7f0cdb228700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd413e000 con 0x7f0cd4158a90 2023-10-08T12:46:15.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.627+0000 7f0cd8fc4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cd40cc820 0x7f0cd4140f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.627+0000 7f0cd8fc4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cd40cc820 0x7f0cd4140f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36606/0 (socket says 172.21.15.45:36606) 2023-10-08T12:46:15.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.627+0000 7f0cd8fc4700 1 -- 172.21.15.45:0/678130145 learned_addr learned my addr 172.21.15.45:0/678130145 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:15.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.627+0000 7f0cd3fff700 1 --2- 172.21.15.45:0/678130145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cd41586b0 0x7f0cd4140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.627+0000 7f0cd97c5700 1 --2- 172.21.15.45:0/678130145 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0cd4158a90 0x7f0cd40b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.627+0000 7f0cd8fc4700 1 -- 172.21.15.45:0/678130145 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0cd4158a90 msgr2=0x7f0cd40b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:15.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.627+0000 7f0cd8fc4700 1 --2- 172.21.15.45:0/678130145 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0cd4158a90 0x7f0cd40b1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.627+0000 7f0cd8fc4700 1 -- 172.21.15.45:0/678130145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cd41586b0 msgr2=0x7f0cd4140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:15.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.627+0000 7f0cd8fc4700 1 --2- 172.21.15.45:0/678130145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cd41586b0 0x7f0cd4140300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:15.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.627+0000 7f0cd8fc4700 1 -- 172.21.15.45:0/678130145 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc8009520 con 0x7f0cd40cc820 2023-10-08T12:46:15.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.628+0000 7f0cd8fc4700 1 --2- 172.21.15.45:0/678130145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cd40cc820 0x7f0cd4140f30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0cd40729f0 tx=0x7f0cc800f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:15.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.628+0000 7f0cd17fa700 1 -- 172.21.15.45:0/678130145 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8025070 con 0x7f0cd40cc820 2023-10-08T12:46:15.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.628+0000 7f0cd17fa700 1 -- 172.21.15.45:0/678130145 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0cc800fb10 con 0x7f0cd40cc820 2023-10-08T12:46:15.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.628+0000 7f0cdb228700 1 -- 172.21.15.45:0/678130145 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd413e2e0 con 0x7f0cd40cc820 2023-10-08T12:46:15.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.628+0000 7f0cd17fa700 1 -- 172.21.15.45:0/678130145 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc801b040 con 0x7f0cd40cc820 2023-10-08T12:46:15.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.628+0000 7f0cdb228700 1 -- 172.21.15.45:0/678130145 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd4140840 con 0x7f0cd40cc820 2023-10-08T12:46:15.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.629+0000 7f0cdb228700 1 -- 172.21.15.45:0/678130145 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd413e800 con 0x7f0cd40cc820 2023-10-08T12:46:15.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.629+0000 7f0cd17fa700 1 -- 172.21.15.45:0/678130145 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0cc802a410 con 0x7f0cd40cc820 2023-10-08T12:46:15.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.630+0000 7f0cd17fa700 1 --2- 172.21.15.45:0/678130145 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0cb806aed0 0x7f0cb806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:15.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.630+0000 7f0cd17fa700 1 -- 172.21.15.45:0/678130145 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f0cc808b010 con 0x7f0cd40cc820 2023-10-08T12:46:15.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.630+0000 7f0cd3fff700 1 --2- 172.21.15.45:0/678130145 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0cb806aed0 0x7f0cb806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:15.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.630+0000 7f0cd3fff700 1 --2- 172.21.15.45:0/678130145 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0cb806aed0 0x7f0cb806d390 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0cd414f0e0 tx=0x7f0cc0007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:15.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.634+0000 7f0cd17fa700 1 -- 172.21.15.45:0/678130145 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0cd413e800 con 0x7f0cd40cc820 2023-10-08T12:46:15.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:15.882+0000 7f0cdb228700 1 -- 172.21.15.45:0/678130145 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0cd413e800 con 0x7f0cd40cc820 2023-10-08T12:46:16.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.481+0000 7f0cd17fa700 1 -- 172.21.15.45:0/678130145 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0cd413e800 con 0x7f0cd40cc820 2023-10-08T12:46:16.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.483+0000 7f0cdb228700 1 -- 172.21.15.45:0/678130145 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0cb806aed0 msgr2=0x7f0cb806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:16.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.483+0000 7f0cdb228700 1 --2- 172.21.15.45:0/678130145 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0cb806aed0 0x7f0cb806d390 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0cd414f0e0 tx=0x7f0cc0007d50 comp rx=0 tx=0).stop 2023-10-08T12:46:16.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.483+0000 7f0cdb228700 1 -- 172.21.15.45:0/678130145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cd40cc820 msgr2=0x7f0cd4140f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:16.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.483+0000 7f0cdb228700 1 --2- 172.21.15.45:0/678130145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cd40cc820 0x7f0cd4140f30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0cd40729f0 tx=0x7f0cc800f710 comp rx=0 tx=0).stop 2023-10-08T12:46:16.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.484+0000 7f0cdb228700 1 -- 172.21.15.45:0/678130145 shutdown_connections 2023-10-08T12:46:16.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.484+0000 7f0cdb228700 1 --2- 172.21.15.45:0/678130145 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0cb806aed0 0x7f0cb806d390 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:16.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.484+0000 7f0cdb228700 1 --2- 172.21.15.45:0/678130145 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0cd4158a90 0x7f0cd40b1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:16.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.484+0000 7f0cdb228700 1 --2- 172.21.15.45:0/678130145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cd40cc820 0x7f0cd4140f30 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:16.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.484+0000 7f0cdb228700 1 --2- 172.21.15.45:0/678130145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cd41586b0 0x7f0cd4140300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:16.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.484+0000 7f0cdb228700 1 -- 172.21.15.45:0/678130145 >> 172.21.15.45:0/678130145 conn(0x7f0cd406b320 msgr2=0x7f0cd406e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:16.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.484+0000 7f0cdb228700 1 -- 172.21.15.45:0/678130145 shutdown_connections 2023-10-08T12:46:16.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.484+0000 7f0cdb228700 1 -- 172.21.15.45:0/678130145 wait complete. 2023-10-08T12:46:16.499 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T12:46:16.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.637+0000 7f910241c700 1 -- 172.21.15.45:0/843801911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90fc158890 msgr2=0x7f90fc15c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:16.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.637+0000 7f910241c700 1 --2- 172.21.15.45:0/843801911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90fc158890 0x7f90fc15c300 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f90fc09f4d0 tx=0x7f90ec009c70 comp rx=0 tx=0).stop 2023-10-08T12:46:16.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.637+0000 7f910241c700 1 -- 172.21.15.45:0/843801911 shutdown_connections 2023-10-08T12:46:16.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.637+0000 7f910241c700 1 --2- 172.21.15.45:0/843801911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90fc158890 0x7f90fc15c300 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:16.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.637+0000 7f910241c700 1 --2- 172.21.15.45:0/843801911 >> v2:172.21.15.78:3300/0 conn(0x7f90fc15cea0 0x7f90fc15c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:16.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.637+0000 7f910241c700 1 -- 172.21.15.45:0/843801911 >> 172.21.15.45:0/843801911 conn(0x7f90fc0ca890 msgr2=0x7f90fc0cac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:16.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.637+0000 7f910241c700 1 -- 172.21.15.45:0/843801911 shutdown_connections 2023-10-08T12:46:16.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.637+0000 7f910241c700 1 -- 172.21.15.45:0/843801911 wait complete. 2023-10-08T12:46:16.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.638+0000 7f910241c700 1 Processor -- start 2023-10-08T12:46:16.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.638+0000 7f910241c700 1 -- start start 2023-10-08T12:46:16.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.639+0000 7f910241c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90fc06e810 0x7f90fc15b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:16.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.639+0000 7f910241c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90fc158890 0x7f90fc1f13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:16.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.639+0000 7f910241c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f90fc15cea0 0x7f90fc1f18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:16.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.639+0000 7f910241c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90fc0c4f80 con 0x7f90fc06e810 2023-10-08T12:46:16.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.639+0000 7f910241c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90fc0c5260 con 0x7f90fc158890 2023-10-08T12:46:16.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.639+0000 7f910241c700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90fc0c5540 con 0x7f90fc15cea0 2023-10-08T12:46:16.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.639+0000 7f90fbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90fc06e810 0x7f90fc15b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:16.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.639+0000 7f90fbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90fc06e810 0x7f90fc15b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36620/0 (socket says 172.21.15.45:36620) 2023-10-08T12:46:16.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.639+0000 7f90fbfff700 1 -- 172.21.15.45:0/588166846 learned_addr learned my addr 172.21.15.45:0/588166846 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:16.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.639+0000 7f90fb7fe700 1 --2- 172.21.15.45:0/588166846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90fc158890 0x7f90fc1f13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:16.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.639+0000 7f91009b9700 1 --2- 172.21.15.45:0/588166846 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f90fc15cea0 0x7f90fc1f18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:16.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.639+0000 7f90fbfff700 1 -- 172.21.15.45:0/588166846 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f90fc15cea0 msgr2=0x7f90fc1f18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:16.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.639+0000 7f90fbfff700 1 --2- 172.21.15.45:0/588166846 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f90fc15cea0 0x7f90fc1f18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:16.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.639+0000 7f90fbfff700 1 -- 172.21.15.45:0/588166846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90fc158890 msgr2=0x7f90fc1f13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:16.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.639+0000 7f90fbfff700 1 --2- 172.21.15.45:0/588166846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90fc158890 0x7f90fc1f13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:16.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.639+0000 7f90fbfff700 1 -- 172.21.15.45:0/588166846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec0095f0 con 0x7f90fc06e810 2023-10-08T12:46:16.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.639+0000 7f90fbfff700 1 --2- 172.21.15.45:0/588166846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90fc06e810 0x7f90fc15b080 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f90ec005fd0 tx=0x7f90ec009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:16.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.640+0000 7f90f8ff9700 1 -- 172.21.15.45:0/588166846 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec01d070 con 0x7f90fc06e810 2023-10-08T12:46:16.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.640+0000 7f90f8ff9700 1 -- 172.21.15.45:0/588166846 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f90ec004830 con 0x7f90fc06e810 2023-10-08T12:46:16.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.640+0000 7f90f8ff9700 1 -- 172.21.15.45:0/588166846 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec0045f0 con 0x7f90fc06e810 2023-10-08T12:46:16.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.640+0000 7f910241c700 1 -- 172.21.15.45:0/588166846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90fc0c5820 con 0x7f90fc06e810 2023-10-08T12:46:16.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.640+0000 7f910241c700 1 -- 172.21.15.45:0/588166846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90fc1f1e20 con 0x7f90fc06e810 2023-10-08T12:46:16.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.641+0000 7f910241c700 1 -- 172.21.15.45:0/588166846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90fc067470 con 0x7f90fc06e810 2023-10-08T12:46:16.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.641+0000 7f90f8ff9700 1 -- 172.21.15.45:0/588166846 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f90ec00b7b0 con 0x7f90fc06e810 2023-10-08T12:46:16.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.641+0000 7f90f8ff9700 1 --2- 172.21.15.45:0/588166846 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f90dc06aed0 0x7f90dc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:16.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.641+0000 7f90f8ff9700 1 -- 172.21.15.45:0/588166846 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f90ec08ace0 con 0x7f90fc06e810 2023-10-08T12:46:16.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.642+0000 7f90fb7fe700 1 --2- 172.21.15.45:0/588166846 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f90dc06aed0 0x7f90dc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:16.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.642+0000 7f90fb7fe700 1 --2- 172.21.15.45:0/588166846 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f90dc06aed0 0x7f90dc06d390 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f90fc1eddd0 tx=0x7f90e4009260 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:16.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.646+0000 7f90f8ff9700 1 -- 172.21.15.45:0/588166846 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f90ec055d30 con 0x7f90fc06e810 2023-10-08T12:46:16.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:16.847+0000 7f910241c700 1 -- 172.21.15.45:0/588166846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f90fc09f280 con 0x7f90fc06e810 2023-10-08T12:46:17.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.485+0000 7f90f8ff9700 1 -- 172.21.15.45:0/588166846 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7f90ec059350 con 0x7f90fc06e810 2023-10-08T12:46:17.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.489+0000 7f910241c700 1 -- 172.21.15.45:0/588166846 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f90dc06aed0 msgr2=0x7f90dc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:17.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.489+0000 7f910241c700 1 --2- 172.21.15.45:0/588166846 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f90dc06aed0 0x7f90dc06d390 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f90fc1eddd0 tx=0x7f90e4009260 comp rx=0 tx=0).stop 2023-10-08T12:46:17.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.489+0000 7f910241c700 1 -- 172.21.15.45:0/588166846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90fc06e810 msgr2=0x7f90fc15b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:17.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.489+0000 7f910241c700 1 --2- 172.21.15.45:0/588166846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90fc06e810 0x7f90fc15b080 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f90ec005fd0 tx=0x7f90ec009570 comp rx=0 tx=0).stop 2023-10-08T12:46:17.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.489+0000 7f910241c700 1 -- 172.21.15.45:0/588166846 shutdown_connections 2023-10-08T12:46:17.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.489+0000 7f910241c700 1 --2- 172.21.15.45:0/588166846 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f90dc06aed0 0x7f90dc06d390 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:17.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.489+0000 7f910241c700 1 --2- 172.21.15.45:0/588166846 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f90fc15cea0 0x7f90fc1f18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:17.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.489+0000 7f910241c700 1 --2- 172.21.15.45:0/588166846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90fc06e810 0x7f90fc15b080 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:17.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.489+0000 7f910241c700 1 --2- 172.21.15.45:0/588166846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90fc158890 0x7f90fc1f13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:17.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.489+0000 7f910241c700 1 -- 172.21.15.45:0/588166846 >> 172.21.15.45:0/588166846 conn(0x7f90fc0ca890 msgr2=0x7f90fc09eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:17.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.489+0000 7f910241c700 1 -- 172.21.15.45:0/588166846 shutdown_connections 2023-10-08T12:46:17.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.489+0000 7f910241c700 1 -- 172.21.15.45:0/588166846 wait complete. 2023-10-08T12:46:17.491 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-10-08T12:46:17.506 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T12:46:17.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.645+0000 7fc8061fb700 1 -- 172.21.15.45:0/663572408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8000ac960 msgr2=0x7fc80006e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:17.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.645+0000 7fc8061fb700 1 --2- 172.21.15.45:0/663572408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8000ac960 0x7fc80006e910 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8009f60 tx=0x7fc7f8009f90 comp rx=0 tx=0).stop 2023-10-08T12:46:17.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.645+0000 7fc8061fb700 1 -- 172.21.15.45:0/663572408 shutdown_connections 2023-10-08T12:46:17.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.645+0000 7fc8061fb700 1 --2- 172.21.15.45:0/663572408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8000ac960 0x7fc80006e910 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:17.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.645+0000 7fc8061fb700 1 -- 172.21.15.45:0/663572408 >> 172.21.15.45:0/663572408 conn(0x7fc800097a20 msgr2=0x7fc8000ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:17.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.645+0000 7fc8061fb700 1 -- 172.21.15.45:0/663572408 shutdown_connections 2023-10-08T12:46:17.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.645+0000 7fc8061fb700 1 -- 172.21.15.45:0/663572408 wait complete. 2023-10-08T12:46:17.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.647+0000 7fc8061fb700 1 Processor -- start 2023-10-08T12:46:17.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.647+0000 7fc8061fb700 1 -- start start 2023-10-08T12:46:17.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.648+0000 7fc8061fb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8000ac960 0x7fc80014fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:17.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.648+0000 7fc8061fb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8000cd1c0 0x7fc8000c5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:17.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.648+0000 7fc8061fb700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc800158a00 0x7fc8000c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:17.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.648+0000 7fc8061fb700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc800150270 con 0x7fc8000ac960 2023-10-08T12:46:17.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.648+0000 7fc8061fb700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8000c79e0 con 0x7fc8000cd1c0 2023-10-08T12:46:17.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.648+0000 7fc8061fb700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8000c7cc0 con 0x7fc800158a00 2023-10-08T12:46:17.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.648+0000 7fc7ff7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8000ac960 0x7fc80014fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:17.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.648+0000 7fc7ff7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8000ac960 0x7fc80014fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36634/0 (socket says 172.21.15.45:36634) 2023-10-08T12:46:17.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.648+0000 7fc7ff7fe700 1 -- 172.21.15.45:0/3511916169 learned_addr learned my addr 172.21.15.45:0/3511916169 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:17.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.648+0000 7fc7ff7fe700 1 -- 172.21.15.45:0/3511916169 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc800158a00 msgr2=0x7fc8000c5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:17.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.648+0000 7fc7ff7fe700 1 --2- 172.21.15.45:0/3511916169 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc800158a00 0x7fc8000c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:17.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.648+0000 7fc7feffd700 1 --2- 172.21.15.45:0/3511916169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8000cd1c0 0x7fc8000c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:17.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.648+0000 7fc7ff7fe700 1 -- 172.21.15.45:0/3511916169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8000cd1c0 msgr2=0x7fc8000c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:17.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.648+0000 7fc7ff7fe700 1 --2- 172.21.15.45:0/3511916169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8000cd1c0 0x7fc8000c5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:17.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.648+0000 7fc7ff7fe700 1 -- 172.21.15.45:0/3511916169 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f8009c40 con 0x7fc8000ac960 2023-10-08T12:46:17.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.649+0000 7fc7ff7fe700 1 --2- 172.21.15.45:0/3511916169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8000ac960 0x7fc80014fd30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc7f400c410 tx=0x7fc7f400c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:17.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.649+0000 7fc7e7fff700 1 -- 172.21.15.45:0/3511916169 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4004230 con 0x7fc8000ac960 2023-10-08T12:46:17.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.649+0000 7fc7e7fff700 1 -- 172.21.15.45:0/3511916169 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc7f40044a0 con 0x7fc8000ac960 2023-10-08T12:46:17.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.649+0000 7fc8061fb700 1 -- 172.21.15.45:0/3511916169 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8000c7fa0 con 0x7fc8000ac960 2023-10-08T12:46:17.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.649+0000 7fc7e7fff700 1 -- 172.21.15.45:0/3511916169 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f40038e0 con 0x7fc8000ac960 2023-10-08T12:46:17.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.649+0000 7fc8061fb700 1 -- 172.21.15.45:0/3511916169 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8000c8560 con 0x7fc8000ac960 2023-10-08T12:46:17.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.650+0000 7fc8061fb700 1 -- 172.21.15.45:0/3511916169 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc80009c710 con 0x7fc8000ac960 2023-10-08T12:46:17.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.650+0000 7fc7e7fff700 1 -- 172.21.15.45:0/3511916169 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc7f4003a40 con 0x7fc8000ac960 2023-10-08T12:46:17.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.651+0000 7fc7e7fff700 1 --2- 172.21.15.45:0/3511916169 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc7ec06af00 0x7fc7ec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:17.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.651+0000 7fc7e7fff700 1 -- 172.21.15.45:0/3511916169 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5502+0+0 (secure 0 0 0) 0x7fc7f4088c10 con 0x7fc8000ac960 2023-10-08T12:46:17.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.651+0000 7fc7feffd700 1 --2- 172.21.15.45:0/3511916169 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc7ec06af00 0x7fc7ec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:17.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.651+0000 7fc7feffd700 1 --2- 172.21.15.45:0/3511916169 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc7ec06af00 0x7fc7ec06d3c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc8001583f0 tx=0x7fc7f0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:17.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.655+0000 7fc7e7fff700 1 -- 172.21.15.45:0/3511916169 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc7f4053dc0 con 0x7fc8000ac960 2023-10-08T12:46:17.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:17.856+0000 7fc8061fb700 1 -- 172.21.15.45:0/3511916169 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc8000cf540 con 0x7fc8000ac960 2023-10-08T12:46:18.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.486+0000 7fc7e7fff700 1 -- 172.21.15.45:0/3511916169 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc7f4017070 con 0x7fc8000ac960 2023-10-08T12:46:18.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.491+0000 7fc8061fb700 1 -- 172.21.15.45:0/3511916169 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc7ec06af00 msgr2=0x7fc7ec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:18.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.491+0000 7fc8061fb700 1 --2- 172.21.15.45:0/3511916169 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc7ec06af00 0x7fc7ec06d3c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc8001583f0 tx=0x7fc7f0009040 comp rx=0 tx=0).stop 2023-10-08T12:46:18.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.491+0000 7fc8061fb700 1 -- 172.21.15.45:0/3511916169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8000ac960 msgr2=0x7fc80014fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:18.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.491+0000 7fc8061fb700 1 --2- 172.21.15.45:0/3511916169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8000ac960 0x7fc80014fd30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc7f400c410 tx=0x7fc7f400c7d0 comp rx=0 tx=0).stop 2023-10-08T12:46:18.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.491+0000 7fc8061fb700 1 -- 172.21.15.45:0/3511916169 shutdown_connections 2023-10-08T12:46:18.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.491+0000 7fc8061fb700 1 --2- 172.21.15.45:0/3511916169 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc7ec06af00 0x7fc7ec06d3c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:18.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.491+0000 7fc8061fb700 1 --2- 172.21.15.45:0/3511916169 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc800158a00 0x7fc8000c5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:18.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.491+0000 7fc8061fb700 1 --2- 172.21.15.45:0/3511916169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8000ac960 0x7fc80014fd30 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:18.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.491+0000 7fc8061fb700 1 --2- 172.21.15.45:0/3511916169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8000cd1c0 0x7fc8000c5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:18.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.491+0000 7fc8061fb700 1 -- 172.21.15.45:0/3511916169 >> 172.21.15.45:0/3511916169 conn(0x7fc800097a20 msgr2=0x7fc8000b34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:18.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.492+0000 7fc8061fb700 1 -- 172.21.15.45:0/3511916169 shutdown_connections 2023-10-08T12:46:18.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.492+0000 7fc8061fb700 1 -- 172.21.15.45:0/3511916169 wait complete. 2023-10-08T12:46:18.500 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-10-08T12:46:18.512 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T12:46:18.512 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T12:46:18.512 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T12:46:18.512 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T12:46:18.513 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T12:46:18.513 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T12:46:18.513 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T12:46:18.513 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T12:46:18.513 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T12:46:18.513 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T12:46:18.513 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T12:46:18.514 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T12:46:18.514 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T12:46:18.514 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T12:46:18.514 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T12:46:18.514 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T12:46:18.524 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T12:46:18.524 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T12:46:18.525 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T12:46:18.525 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T12:46:18.526 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T12:46:18.527 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T12:46:18.527 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T12:46:18.527 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T12:46:18.567 INFO:tasks.ceph.mds.b:Started 2023-10-08T12:46:18.567 DEBUG:teuthology.parallel:result is None 2023-10-08T12:46:18.568 INFO:tasks.ceph.mds.d:Started 2023-10-08T12:46:18.568 DEBUG:teuthology.parallel:result is None 2023-10-08T12:46:18.570 INFO:tasks.ceph.mds.a:Started 2023-10-08T12:46:18.570 DEBUG:teuthology.parallel:result is None 2023-10-08T12:46:18.570 INFO:tasks.ceph.mds.c:Started 2023-10-08T12:46:18.571 DEBUG:teuthology.parallel:result is None 2023-10-08T12:46:18.571 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T12:46:18.658 INFO:tasks.ceph.mds.b.smithi078.stdout:starting mds.b at 2023-10-08T12:46:18.658 INFO:tasks.ceph.mds.d.smithi078.stdout:starting mds.d at 2023-10-08T12:46:18.664 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-10-08T12:46:18.665 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-10-08T12:46:18.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.714+0000 7fc9ace65700 1 -- 172.21.15.45:0/1785563936 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc9a81599f0 msgr2=0x7fc9a806ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:18.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.714+0000 7fc9ace65700 1 --2- 172.21.15.45:0/1785563936 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc9a81599f0 0x7fc9a806ee90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc99c0098c0 tx=0x7fc99c009bd0 comp rx=0 tx=0).stop 2023-10-08T12:46:18.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.715+0000 7fc9ace65700 1 -- 172.21.15.45:0/1785563936 shutdown_connections 2023-10-08T12:46:18.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.715+0000 7fc9ace65700 1 --2- 172.21.15.45:0/1785563936 >> v2:172.21.15.78:3300/0 conn(0x7fc9a80cc870 0x7fc9a80ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:18.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.715+0000 7fc9ace65700 1 --2- 172.21.15.45:0/1785563936 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc9a81599f0 0x7fc9a806ee90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:18.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.715+0000 7fc9ace65700 1 -- 172.21.15.45:0/1785563936 >> 172.21.15.45:0/1785563936 conn(0x7fc9a80cf750 msgr2=0x7fc9a80cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:18.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.715+0000 7fc9ace65700 1 -- 172.21.15.45:0/1785563936 shutdown_connections 2023-10-08T12:46:18.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.715+0000 7fc9ace65700 1 -- 172.21.15.45:0/1785563936 wait complete. 2023-10-08T12:46:18.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.716+0000 7fc9ace65700 1 Processor -- start 2023-10-08T12:46:18.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.716+0000 7fc9ace65700 1 -- start start 2023-10-08T12:46:18.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.717+0000 7fc9ace65700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc9a806f3d0 0x7fc9a80c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:18.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.717+0000 7fc9ace65700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9a80cc870 0x7fc9a809cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:18.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.717+0000 7fc9ace65700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9a81599f0 0x7fc9a814ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:18.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.717+0000 7fc9ace65700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a80c7910 con 0x7fc9a81599f0 2023-10-08T12:46:18.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.717+0000 7fc9ace65700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a80c6c90 con 0x7fc9a80cc870 2023-10-08T12:46:18.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.717+0000 7fc9ace65700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a80c6f70 con 0x7fc9a806f3d0 2023-10-08T12:46:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.717+0000 7fc9a6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9a81599f0 0x7fc9a814ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.717+0000 7fc9a6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9a81599f0 0x7fc9a814ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36676/0 (socket says 172.21.15.45:36676) 2023-10-08T12:46:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.717+0000 7fc9a6d9d700 1 -- 172.21.15.45:0/1347502520 learned_addr learned my addr 172.21.15.45:0/1347502520 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.717+0000 7fc9a659c700 1 --2- 172.21.15.45:0/1347502520 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc9a806f3d0 0x7fc9a80c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.717+0000 7fc9a5d9b700 1 --2- 172.21.15.45:0/1347502520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9a80cc870 0x7fc9a809cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.717+0000 7fc9a6d9d700 1 -- 172.21.15.45:0/1347502520 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc9a806f3d0 msgr2=0x7fc9a80c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.717+0000 7fc9a6d9d700 1 --2- 172.21.15.45:0/1347502520 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc9a806f3d0 0x7fc9a80c7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.717+0000 7fc9a6d9d700 1 -- 172.21.15.45:0/1347502520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9a80cc870 msgr2=0x7fc9a809cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.717+0000 7fc9a6d9d700 1 --2- 172.21.15.45:0/1347502520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9a80cc870 0x7fc9a809cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:18.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.717+0000 7fc9a6d9d700 1 -- 172.21.15.45:0/1347502520 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99c009520 con 0x7fc9a81599f0 2023-10-08T12:46:18.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.717+0000 7fc9a6d9d700 1 --2- 172.21.15.45:0/1347502520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9a81599f0 0x7fc9a814ea20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0009fd0 tx=0x7fc9a000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:18.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.717+0000 7fc996ffd700 1 -- 172.21.15.45:0/1347502520 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0018070 con 0x7fc9a81599f0 2023-10-08T12:46:18.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.718+0000 7fc996ffd700 1 -- 172.21.15.45:0/1347502520 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc9a000f040 con 0x7fc9a81599f0 2023-10-08T12:46:18.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.718+0000 7fc9ace65700 1 -- 172.21.15.45:0/1347502520 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a80c7250 con 0x7fc9a81599f0 2023-10-08T12:46:18.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.718+0000 7fc996ffd700 1 -- 172.21.15.45:0/1347502520 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0004bb0 con 0x7fc9a81599f0 2023-10-08T12:46:18.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.718+0000 7fc9ace65700 1 -- 172.21.15.45:0/1347502520 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a809d490 con 0x7fc9a81599f0 2023-10-08T12:46:18.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.718+0000 7fc9ace65700 1 -- 172.21.15.45:0/1347502520 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a804e4c0 con 0x7fc9a81599f0 2023-10-08T12:46:18.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.719+0000 7fc996ffd700 1 -- 172.21.15.45:0/1347502520 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc9a000c930 con 0x7fc9a81599f0 2023-10-08T12:46:18.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.719+0000 7fc996ffd700 1 --2- 172.21.15.45:0/1347502520 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc98806aed0 0x7fc98806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:18.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.719+0000 7fc996ffd700 1 -- 172.21.15.45:0/1347502520 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc9a00892b0 con 0x7fc9a81599f0 2023-10-08T12:46:18.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.720+0000 7fc9a659c700 1 --2- 172.21.15.45:0/1347502520 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc98806aed0 0x7fc98806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:18.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.720+0000 7fc9a659c700 1 --2- 172.21.15.45:0/1347502520 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc98806aed0 0x7fc98806d390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc99c000c00 tx=0x7fc99c01a040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:18.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.724+0000 7fc996ffd700 1 -- 172.21.15.45:0/1347502520 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc9a0054670 con 0x7fc9a81599f0 2023-10-08T12:46:18.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:18.942+0000 7fc9ace65700 1 -- 172.21.15.45:0/1347502520 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc9a80cd210 con 0x7fc9a81599f0 2023-10-08T12:46:19.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.502+0000 7fc996ffd700 1 -- 172.21.15.45:0/1347502520 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc9a0057c90 con 0x7fc9a81599f0 2023-10-08T12:46:19.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.506+0000 7fc9ace65700 1 -- 172.21.15.45:0/1347502520 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc98806aed0 msgr2=0x7fc98806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:19.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.506+0000 7fc9ace65700 1 --2- 172.21.15.45:0/1347502520 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc98806aed0 0x7fc98806d390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc99c000c00 tx=0x7fc99c01a040 comp rx=0 tx=0).stop 2023-10-08T12:46:19.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.506+0000 7fc9ace65700 1 -- 172.21.15.45:0/1347502520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9a81599f0 msgr2=0x7fc9a814ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:19.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.506+0000 7fc9ace65700 1 --2- 172.21.15.45:0/1347502520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9a81599f0 0x7fc9a814ea20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0009fd0 tx=0x7fc9a000ef90 comp rx=0 tx=0).stop 2023-10-08T12:46:19.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.506+0000 7fc9ace65700 1 -- 172.21.15.45:0/1347502520 shutdown_connections 2023-10-08T12:46:19.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.506+0000 7fc9ace65700 1 --2- 172.21.15.45:0/1347502520 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fc98806aed0 0x7fc98806d390 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:19.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.506+0000 7fc9ace65700 1 --2- 172.21.15.45:0/1347502520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9a81599f0 0x7fc9a814ea20 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:19.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.506+0000 7fc9ace65700 1 --2- 172.21.15.45:0/1347502520 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc9a806f3d0 0x7fc9a80c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:19.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.506+0000 7fc9ace65700 1 --2- 172.21.15.45:0/1347502520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9a80cc870 0x7fc9a809cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:19.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.506+0000 7fc9ace65700 1 -- 172.21.15.45:0/1347502520 >> 172.21.15.45:0/1347502520 conn(0x7fc9a80cf750 msgr2=0x7fc9a80ce7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:19.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.506+0000 7fc9ace65700 1 -- 172.21.15.45:0/1347502520 shutdown_connections 2023-10-08T12:46:19.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.506+0000 7fc9ace65700 1 -- 172.21.15.45:0/1347502520 wait complete. 2023-10-08T12:46:19.508 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-10-08T12:46:19.524 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T12:46:19.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.656+0000 7f1a7448f700 1 -- 172.21.15.45:0/3780504978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a6c158950 msgr2=0x7f1a6c0cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:19.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.656+0000 7f1a7448f700 1 --2- 172.21.15.45:0/3780504978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a6c158950 0x7f1a6c0cdf60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c005fd0 tx=0x7f1a5c009c70 comp rx=0 tx=0).stop 2023-10-08T12:46:19.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.656+0000 7f1a7448f700 1 -- 172.21.15.45:0/3780504978 shutdown_connections 2023-10-08T12:46:19.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.656+0000 7f1a7448f700 1 --2- 172.21.15.45:0/3780504978 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a6c0c9ff0 0x7f1a6c0ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:19.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.656+0000 7f1a7448f700 1 --2- 172.21.15.45:0/3780504978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a6c158950 0x7f1a6c0cdf60 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:19.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.656+0000 7f1a7448f700 1 -- 172.21.15.45:0/3780504978 >> 172.21.15.45:0/3780504978 conn(0x7f1a6c0b0430 msgr2=0x7f1a6c0b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:19.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.656+0000 7f1a7448f700 1 -- 172.21.15.45:0/3780504978 shutdown_connections 2023-10-08T12:46:19.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.656+0000 7f1a7448f700 1 -- 172.21.15.45:0/3780504978 wait complete. 2023-10-08T12:46:19.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.657+0000 7f1a7448f700 1 Processor -- start 2023-10-08T12:46:19.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.658+0000 7f1a7448f700 1 -- start start 2023-10-08T12:46:19.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.658+0000 7f1a7448f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a6c0c9ff0 0x7f1a6c1560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:19.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.658+0000 7f1a7448f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a6c158950 0x7f1a6c0cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:19.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.658+0000 7f1a7448f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a6c15c320 0x7f1a6c14fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:19.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.658+0000 7f1a7448f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c0ad3f0 con 0x7f1a6c0c9ff0 2023-10-08T12:46:19.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.658+0000 7f1a7448f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c0c7dc0 con 0x7f1a6c15c320 2023-10-08T12:46:19.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.658+0000 7f1a7448f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c0ace50 con 0x7f1a6c158950 2023-10-08T12:46:19.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.658+0000 7f1a7222b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a6c0c9ff0 0x7f1a6c1560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:19.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.658+0000 7f1a7222b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a6c0c9ff0 0x7f1a6c1560a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36688/0 (socket says 172.21.15.45:36688) 2023-10-08T12:46:19.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.658+0000 7f1a7222b700 1 -- 172.21.15.45:0/3495109468 learned_addr learned my addr 172.21.15.45:0/3495109468 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:19.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.659+0000 7f1a71a2a700 1 --2- 172.21.15.45:0/3495109468 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a6c158950 0x7f1a6c0cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:19.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.659+0000 7f1a72a2c700 1 --2- 172.21.15.45:0/3495109468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a6c15c320 0x7f1a6c14fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:19.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.659+0000 7f1a7222b700 1 -- 172.21.15.45:0/3495109468 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a6c158950 msgr2=0x7f1a6c0cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:19.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.659+0000 7f1a7222b700 1 --2- 172.21.15.45:0/3495109468 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a6c158950 0x7f1a6c0cd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:19.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.659+0000 7f1a7222b700 1 -- 172.21.15.45:0/3495109468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a6c15c320 msgr2=0x7f1a6c14fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:19.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.659+0000 7f1a7222b700 1 --2- 172.21.15.45:0/3495109468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a6c15c320 0x7f1a6c14fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:19.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.659+0000 7f1a7222b700 1 -- 172.21.15.45:0/3495109468 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5c0095f0 con 0x7f1a6c0c9ff0 2023-10-08T12:46:19.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.659+0000 7f1a71a2a700 1 --2- 172.21.15.45:0/3495109468 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a6c158950 0x7f1a6c0cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:46:19.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.659+0000 7f1a72a2c700 1 --2- 172.21.15.45:0/3495109468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a6c15c320 0x7f1a6c14fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:46:19.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.659+0000 7f1a7222b700 1 --2- 172.21.15.45:0/3495109468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a6c0c9ff0 0x7f1a6c1560a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c070420 tx=0x7f1a5c004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:19.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.659+0000 7f1a62ffd700 1 -- 172.21.15.45:0/3495109468 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c01d070 con 0x7f1a6c0c9ff0 2023-10-08T12:46:19.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.659+0000 7f1a62ffd700 1 -- 172.21.15.45:0/3495109468 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1a5c003910 con 0x7f1a6c0c9ff0 2023-10-08T12:46:19.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.659+0000 7f1a62ffd700 1 -- 172.21.15.45:0/3495109468 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c003d00 con 0x7f1a6c0c9ff0 2023-10-08T12:46:19.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.659+0000 7f1a7448f700 1 -- 172.21.15.45:0/3495109468 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a6c0ad110 con 0x7f1a6c0c9ff0 2023-10-08T12:46:19.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.659+0000 7f1a7448f700 1 -- 172.21.15.45:0/3495109468 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a6c1500b0 con 0x7f1a6c0c9ff0 2023-10-08T12:46:19.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.660+0000 7f1a7448f700 1 -- 172.21.15.45:0/3495109468 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a6c0c7c20 con 0x7f1a6c0c9ff0 2023-10-08T12:46:19.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.660+0000 7f1a62ffd700 1 -- 172.21.15.45:0/3495109468 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1a5c022470 con 0x7f1a6c0c9ff0 2023-10-08T12:46:19.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.661+0000 7f1a62ffd700 1 --2- 172.21.15.45:0/3495109468 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f1a5006aed0 0x7f1a5006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:19.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.661+0000 7f1a62ffd700 1 -- 172.21.15.45:0/3495109468 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1a5c08ac20 con 0x7f1a6c0c9ff0 2023-10-08T12:46:19.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.661+0000 7f1a71a2a700 1 --2- 172.21.15.45:0/3495109468 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f1a5006aed0 0x7f1a5006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:19.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.662+0000 7f1a71a2a700 1 --2- 172.21.15.45:0/3495109468 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f1a5006aed0 0x7f1a5006d390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0c6ea0 tx=0x7f1a68009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:19.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.665+0000 7f1a62ffd700 1 -- 172.21.15.45:0/3495109468 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1a6c0c7c20 con 0x7f1a6c0c9ff0 2023-10-08T12:46:19.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.950+0000 7f1a7448f700 1 -- 172.21.15.45:0/3495109468 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1a6c0c7c20 con 0x7f1a6c0c9ff0 2023-10-08T12:46:19.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.951+0000 7f1a62ffd700 1 -- 172.21.15.45:0/3495109468 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f1a6c0c7c20 con 0x7f1a6c0c9ff0 2023-10-08T12:46:19.952 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:46:19.952 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-08T12:46:19.952 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-10-08T12:46:19.952 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-08T12:46:19.952 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-10-08T12:46:19.952 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAzpCJlc+UFDxAAAMHkpwnDYkbgIR4kUpPkTw==", 2023-10-08T12:46:19.952 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-08T12:46:19.953 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-08T12:46:19.953 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-08T12:46:19.953 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-08T12:46:19.953 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-08T12:46:19.953 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-08T12:46:19.953 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-08T12:46:19.953 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-08T12:46:19.953 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-10-08T12:46:19.953 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAzpCJlyxX+GxAAtph5U6we17gVl3I/UmX1bw==", 2023-10-08T12:46:19.953 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-08T12:46:19.953 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-08T12:46:19.953 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-08T12:46:19.954 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-08T12:46:19.954 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-08T12:46:19.954 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-08T12:46:19.954 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-08T12:46:19.954 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-08T12:46:19.954 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-10-08T12:46:19.954 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAzpCJlXW9vFhAAWPTunfAJhHNwtQjNCxe9Kg==", 2023-10-08T12:46:19.954 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-08T12:46:19.954 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-08T12:46:19.954 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-08T12:46:19.954 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-08T12:46:19.955 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-08T12:46:19.955 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-08T12:46:19.955 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-08T12:46:19.955 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-08T12:46:19.955 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.d", 2023-10-08T12:46:19.955 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAzpCJlhvdXJBAAvhgxHr6hgoFt2ivG8Y0yDg==", 2023-10-08T12:46:19.955 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-08T12:46:19.955 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-08T12:46:19.955 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-08T12:46:19.955 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-08T12:46:19.955 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-08T12:46:19.955 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-08T12:46:19.956 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-08T12:46:19.956 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-08T12:46:19.956 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-10-08T12:46:19.956 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQA1pCJlNwksGBAAdjaWjTcNe4FHEWmXjZxDPQ==", 2023-10-08T12:46:19.956 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-08T12:46:19.956 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-08T12:46:19.956 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-08T12:46:19.956 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-08T12:46:19.956 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-08T12:46:19.956 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-08T12:46:19.956 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-08T12:46:19.956 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-10-08T12:46:19.956 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQA4pCJle9qmFxAAYAUFc2wHo8OdqaS1SIu/Vg==", 2023-10-08T12:46:19.957 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-08T12:46:19.957 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-08T12:46:19.957 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-08T12:46:19.957 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-08T12:46:19.957 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-08T12:46:19.957 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-08T12:46:19.957 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-08T12:46:19.957 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-10-08T12:46:19.957 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQA7pCJlCBl2FxAAxD9Ud7clh2N8GhTHmL+1JQ==", 2023-10-08T12:46:19.957 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-08T12:46:19.957 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-08T12:46:19.958 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-08T12:46:19.958 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-08T12:46:19.958 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-08T12:46:19.958 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-08T12:46:19.958 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-08T12:46:19.958 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-10-08T12:46:19.958 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQA+pCJlCateFxAAeSHMrnpEimeOS+iiAmf3BA==", 2023-10-08T12:46:19.958 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-08T12:46:19.958 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-08T12:46:19.958 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-08T12:46:19.958 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-08T12:46:19.958 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-08T12:46:19.959 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-08T12:46:19.959 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-08T12:46:19.959 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-10-08T12:46:19.959 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBEpCJlS7dqGhAAGboQm+4YVm5bjoU5xcA+Qw==", 2023-10-08T12:46:19.959 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-08T12:46:19.959 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-08T12:46:19.959 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-08T12:46:19.959 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-08T12:46:19.959 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-08T12:46:19.959 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-08T12:46:19.959 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-08T12:46:19.959 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-10-08T12:46:19.959 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBHpCJlcfaGGhAAp8zA/0m78ixdz+1wQREg4w==", 2023-10-08T12:46:19.960 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-08T12:46:19.960 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-08T12:46:19.960 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-08T12:46:19.960 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-08T12:46:19.960 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-08T12:46:19.960 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-08T12:46:19.960 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-08T12:46:19.960 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-10-08T12:46:19.960 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBKpCJlIuI4GhAAWKHlm8wl0c3xxzu7ZOUSmQ==", 2023-10-08T12:46:19.960 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-08T12:46:19.960 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-08T12:46:19.960 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-08T12:46:19.961 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-08T12:46:19.961 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-08T12:46:19.961 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-08T12:46:19.961 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-08T12:46:19.961 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-10-08T12:46:19.961 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBNpCJlgYPgGRAAxCNzKEMJ8o7rRaBvrSMWjg==", 2023-10-08T12:46:19.961 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-08T12:46:19.961 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-08T12:46:19.961 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-08T12:46:19.961 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-08T12:46:19.961 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-08T12:46:19.961 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-08T12:46:19.962 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-08T12:46:19.962 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-10-08T12:46:19.962 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAzpCJli2jsKBAA5aEs8srGibREq3jyZkPnvA==", 2023-10-08T12:46:19.962 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-08T12:46:19.962 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-08T12:46:19.962 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-10-08T12:46:19.962 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-10-08T12:46:19.962 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-10-08T12:46:19.962 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-08T12:46:19.962 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-08T12:46:19.962 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-08T12:46:19.962 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-10-08T12:46:19.963 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAzpCJls2juLxAA0viRgFTgsppNsr8IjgAuhw==", 2023-10-08T12:46:19.963 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-08T12:46:19.963 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-08T12:46:19.963 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-10-08T12:46:19.963 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-10-08T12:46:19.963 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-10-08T12:46:19.963 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-08T12:46:19.963 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-08T12:46:19.963 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-08T12:46:19.963 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.2", 2023-10-08T12:46:19.963 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAzpCJlbr1ZLBAA6Ynm8b6XR0xC82fYfH+daQ==", 2023-10-08T12:46:19.963 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-08T12:46:19.964 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-08T12:46:19.964 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-10-08T12:46:19.964 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-10-08T12:46:19.964 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-10-08T12:46:19.964 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-08T12:46:19.964 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-08T12:46:19.964 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-08T12:46:19.964 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.3", 2023-10-08T12:46:19.964 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAzpCJloOlLMxAAqNsTRZDNdi5Pqx8pABy09g==", 2023-10-08T12:46:19.964 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-08T12:46:19.964 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-08T12:46:19.964 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-10-08T12:46:19.965 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-10-08T12:46:19.965 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-10-08T12:46:19.965 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-08T12:46:19.965 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-08T12:46:19.965 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-08T12:46:19.965 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-10-08T12:46:19.965 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA==", 2023-10-08T12:46:19.965 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-08T12:46:19.965 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-10-08T12:46:19.965 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-08T12:46:19.965 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-08T12:46:19.966 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-08T12:46:19.966 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-08T12:46:19.966 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-08T12:46:19.966 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-08T12:46:19.966 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-mds", 2023-10-08T12:46:19.967 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBTpCJl6BsXGhAA+TpOTXG+AxxuLfqNAGHP6A==", 2023-10-08T12:46:19.967 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-08T12:46:19.967 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-mds" 2023-10-08T12:46:19.967 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-08T12:46:19.967 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-08T12:46:19.967 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-08T12:46:19.967 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-mgr", 2023-10-08T12:46:19.967 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBTpCJl6DEXGhAARc4bCFIFVi+hkBYyLtScBw==", 2023-10-08T12:46:19.967 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-08T12:46:19.968 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-08T12:46:19.968 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-08T12:46:19.968 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-08T12:46:19.968 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-08T12:46:19.968 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-osd", 2023-10-08T12:46:19.968 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBTpCJl90EXGhAAtO2w1R9ANruvwe9iXL6sZQ==", 2023-10-08T12:46:19.968 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-08T12:46:19.968 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-osd" 2023-10-08T12:46:19.968 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-08T12:46:19.968 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-08T12:46:19.968 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-08T12:46:19.969 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-rbd", 2023-10-08T12:46:19.969 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBTpCJlB1EXGhAAOZ5TNeY27qePb41xymJz8Q==", 2023-10-08T12:46:19.969 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-08T12:46:19.969 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-08T12:46:19.969 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-08T12:46:19.969 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-08T12:46:19.969 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-08T12:46:19.969 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-08T12:46:19.969 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBTpCJlXGAXGhAARDliz8HbBluoGhS7aAePOQ==", 2023-10-08T12:46:19.969 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-08T12:46:19.969 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-08T12:46:19.969 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-08T12:46:19.970 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-08T12:46:19.970 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-08T12:46:19.970 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-rgw", 2023-10-08T12:46:19.970 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBTpCJlhG8XGhAALnXrAOMuYpHU5k/d91SIlw==", 2023-10-08T12:46:19.970 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-08T12:46:19.970 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-08T12:46:19.970 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-08T12:46:19.970 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-08T12:46:19.970 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-08T12:46:19.970 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-10-08T12:46:19.970 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAzpCJl2JKJCxAAY84sn4d2TS/oQSVsxMRaOw==", 2023-10-08T12:46:19.970 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-08T12:46:19.971 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-10-08T12:46:19.971 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-10-08T12:46:19.971 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-08T12:46:19.971 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-08T12:46:19.971 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-08T12:46:19.971 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-08T12:46:19.971 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-10-08T12:46:19.971 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAypCJlBbJiOhAA2g7jj3lt5TdjUAnIJDTmQA==", 2023-10-08T12:46:19.971 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-08T12:46:19.971 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-10-08T12:46:19.971 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-10-08T12:46:19.971 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-08T12:46:19.971 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-08T12:46:19.972 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-08T12:46:19.972 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-10-08T12:46:19.972 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-08T12:46:19.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.953+0000 7f1a7448f700 1 -- 172.21.15.45:0/3495109468 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f1a5006aed0 msgr2=0x7f1a5006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:19.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.953+0000 7f1a7448f700 1 --2- 172.21.15.45:0/3495109468 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f1a5006aed0 0x7f1a5006d390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0c6ea0 tx=0x7f1a68009040 comp rx=0 tx=0).stop 2023-10-08T12:46:19.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.953+0000 7f1a7448f700 1 -- 172.21.15.45:0/3495109468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a6c0c9ff0 msgr2=0x7f1a6c1560a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:19.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.953+0000 7f1a7448f700 1 --2- 172.21.15.45:0/3495109468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a6c0c9ff0 0x7f1a6c1560a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c070420 tx=0x7f1a5c004310 comp rx=0 tx=0).stop 2023-10-08T12:46:19.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.953+0000 7f1a7448f700 1 -- 172.21.15.45:0/3495109468 shutdown_connections 2023-10-08T12:46:19.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.953+0000 7f1a7448f700 1 --2- 172.21.15.45:0/3495109468 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f1a5006aed0 0x7f1a5006d390 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:19.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.953+0000 7f1a7448f700 1 --2- 172.21.15.45:0/3495109468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a6c15c320 0x7f1a6c14fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:19.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.953+0000 7f1a7448f700 1 --2- 172.21.15.45:0/3495109468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a6c0c9ff0 0x7f1a6c1560a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:19.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.953+0000 7f1a7448f700 1 --2- 172.21.15.45:0/3495109468 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a6c158950 0x7f1a6c0cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:19.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.953+0000 7f1a7448f700 1 -- 172.21.15.45:0/3495109468 >> 172.21.15.45:0/3495109468 conn(0x7f1a6c0b0430 msgr2=0x7f1a6c157c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:19.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.953+0000 7f1a7448f700 1 -- 172.21.15.45:0/3495109468 shutdown_connections 2023-10-08T12:46:19.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:19.953+0000 7f1a7448f700 1 -- 172.21.15.45:0/3495109468 wait complete. 2023-10-08T12:46:19.975 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-08T12:46:20.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.104+0000 7f5f500e6700 1 -- 172.21.15.45:0/3608069530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f480aeb40 msgr2=0x7f5f481602f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:20.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.104+0000 7f5f500e6700 1 --2- 172.21.15.45:0/3608069530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f480aeb40 0x7f5f481602f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5f48072150 tx=0x7f5f38009c70 comp rx=0 tx=0).stop 2023-10-08T12:46:20.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.104+0000 7f5f500e6700 1 -- 172.21.15.45:0/3608069530 shutdown_connections 2023-10-08T12:46:20.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.104+0000 7f5f500e6700 1 --2- 172.21.15.45:0/3608069530 >> v2:172.21.15.78:3300/0 conn(0x7f5f480cc5f0 0x7f5f4815b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:20.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.104+0000 7f5f500e6700 1 --2- 172.21.15.45:0/3608069530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f480aeb40 0x7f5f481602f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:20.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.104+0000 7f5f500e6700 1 --2- 172.21.15.45:0/3608069530 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f480ca590 0x7f5f480cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:20.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.104+0000 7f5f500e6700 1 -- 172.21.15.45:0/3608069530 >> 172.21.15.45:0/3608069530 conn(0x7f5f480cf750 msgr2=0x7f5f480cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:20.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.104+0000 7f5f500e6700 1 -- 172.21.15.45:0/3608069530 shutdown_connections 2023-10-08T12:46:20.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.104+0000 7f5f500e6700 1 -- 172.21.15.45:0/3608069530 wait complete. 2023-10-08T12:46:20.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.106+0000 7f5f500e6700 1 Processor -- start 2023-10-08T12:46:20.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.106+0000 7f5f500e6700 1 -- start start 2023-10-08T12:46:20.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.106+0000 7f5f500e6700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f480aeb40 0x7f5f480c7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:20.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.107+0000 7f5f500e6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f480ca590 0x7f5f481f1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:20.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.107+0000 7f5f500e6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f480cc5f0 0x7f5f4806c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:20.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.107+0000 7f5f500e6700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f480c7f20 con 0x7f5f480ca590 2023-10-08T12:46:20.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.107+0000 7f5f500e6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f480c7c40 con 0x7f5f480cc5f0 2023-10-08T12:46:20.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.107+0000 7f5f500e6700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f480c3310 con 0x7f5f480aeb40 2023-10-08T12:46:20.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.107+0000 7f5f4d681700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f480ca590 0x7f5f481f1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:20.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.107+0000 7f5f4d681700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f480ca590 0x7f5f481f1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36704/0 (socket says 172.21.15.45:36704) 2023-10-08T12:46:20.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.107+0000 7f5f4d681700 1 -- 172.21.15.45:0/1396869917 learned_addr learned my addr 172.21.15.45:0/1396869917 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:20.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.107+0000 7f5f4de82700 1 --2- 172.21.15.45:0/1396869917 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f480aeb40 0x7f5f480c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:20.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.107+0000 7f5f4e683700 1 --2- 172.21.15.45:0/1396869917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f480cc5f0 0x7f5f4806c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:20.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.107+0000 7f5f4d681700 1 -- 172.21.15.45:0/1396869917 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f480aeb40 msgr2=0x7f5f480c7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:20.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.107+0000 7f5f4d681700 1 --2- 172.21.15.45:0/1396869917 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f480aeb40 0x7f5f480c7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:20.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.107+0000 7f5f4d681700 1 -- 172.21.15.45:0/1396869917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f480cc5f0 msgr2=0x7f5f4806c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:20.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.107+0000 7f5f4d681700 1 --2- 172.21.15.45:0/1396869917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f480cc5f0 0x7f5f4806c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:20.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.107+0000 7f5f4d681700 1 -- 172.21.15.45:0/1396869917 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f380095f0 con 0x7f5f480ca590 2023-10-08T12:46:20.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.107+0000 7f5f4e683700 1 --2- 172.21.15.45:0/1396869917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f480cc5f0 0x7f5f4806c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:20.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.107+0000 7f5f4d681700 1 --2- 172.21.15.45:0/1396869917 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f480ca590 0x7f5f481f1f30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400e9f0 tx=0x7f5f4400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:20.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.107+0000 7f5f3e7fc700 1 -- 172.21.15.45:0/1396869917 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4400eee0 con 0x7f5f480ca590 2023-10-08T12:46:20.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.107+0000 7f5f3e7fc700 1 -- 172.21.15.45:0/1396869917 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5f4400ccc0 con 0x7f5f480ca590 2023-10-08T12:46:20.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.107+0000 7f5f500e6700 1 -- 172.21.15.45:0/1396869917 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f480c35f0 con 0x7f5f480ca590 2023-10-08T12:46:20.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.107+0000 7f5f3e7fc700 1 -- 172.21.15.45:0/1396869917 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44010690 con 0x7f5f480ca590 2023-10-08T12:46:20.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.107+0000 7f5f500e6700 1 -- 172.21.15.45:0/1396869917 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f480c7880 con 0x7f5f480ca590 2023-10-08T12:46:20.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.108+0000 7f5f500e6700 1 -- 172.21.15.45:0/1396869917 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f480c3170 con 0x7f5f480ca590 2023-10-08T12:46:20.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.109+0000 7f5f3e7fc700 1 -- 172.21.15.45:0/1396869917 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5f440107f0 con 0x7f5f480ca590 2023-10-08T12:46:20.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.109+0000 7f5f3e7fc700 1 --2- 172.21.15.45:0/1396869917 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f5f2c06aed0 0x7f5f2c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:20.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.109+0000 7f5f3e7fc700 1 -- 172.21.15.45:0/1396869917 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5f44014070 con 0x7f5f480ca590 2023-10-08T12:46:20.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.109+0000 7f5f4de82700 1 --2- 172.21.15.45:0/1396869917 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f5f2c06aed0 0x7f5f2c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:20.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.110+0000 7f5f4de82700 1 --2- 172.21.15.45:0/1396869917 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f5f2c06aed0 0x7f5f2c06d390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5f380098e0 tx=0x7f5f380047c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:20.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.114+0000 7f5f3e7fc700 1 -- 172.21.15.45:0/1396869917 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5f44051ca0 con 0x7f5f480ca590 2023-10-08T12:46:20.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.398+0000 7f5f500e6700 1 -- 172.21.15.45:0/1396869917 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f5f4804e4c0 con 0x7f5f480ca590 2023-10-08T12:46:20.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.400+0000 7f5f3e7fc700 1 -- 172.21.15.45:0/1396869917 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5f480c3170 con 0x7f5f480ca590 2023-10-08T12:46:20.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.402+0000 7f5f500e6700 1 -- 172.21.15.45:0/1396869917 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f5f2c06aed0 msgr2=0x7f5f2c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:20.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.402+0000 7f5f500e6700 1 --2- 172.21.15.45:0/1396869917 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f5f2c06aed0 0x7f5f2c06d390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5f380098e0 tx=0x7f5f380047c0 comp rx=0 tx=0).stop 2023-10-08T12:46:20.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.402+0000 7f5f500e6700 1 -- 172.21.15.45:0/1396869917 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f480ca590 msgr2=0x7f5f481f1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:20.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.402+0000 7f5f500e6700 1 --2- 172.21.15.45:0/1396869917 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f480ca590 0x7f5f481f1f30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400e9f0 tx=0x7f5f4400ed00 comp rx=0 tx=0).stop 2023-10-08T12:46:20.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.402+0000 7f5f500e6700 1 -- 172.21.15.45:0/1396869917 shutdown_connections 2023-10-08T12:46:20.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.402+0000 7f5f500e6700 1 --2- 172.21.15.45:0/1396869917 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f5f2c06aed0 0x7f5f2c06d390 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:20.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.402+0000 7f5f500e6700 1 --2- 172.21.15.45:0/1396869917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f480cc5f0 0x7f5f4806c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:20.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.402+0000 7f5f500e6700 1 --2- 172.21.15.45:0/1396869917 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f480aeb40 0x7f5f480c7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:20.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.402+0000 7f5f500e6700 1 --2- 172.21.15.45:0/1396869917 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f480ca590 0x7f5f481f1f30 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:20.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.402+0000 7f5f500e6700 1 -- 172.21.15.45:0/1396869917 >> 172.21.15.45:0/1396869917 conn(0x7f5f480cf750 msgr2=0x7f5f480cfb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:20.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.402+0000 7f5f500e6700 1 -- 172.21.15.45:0/1396869917 shutdown_connections 2023-10-08T12:46:20.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.402+0000 7f5f500e6700 1 -- 172.21.15.45:0/1396869917 wait complete. 2023-10-08T12:46:20.415 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-08T12:46:20.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.543+0000 7fa3d9c22700 1 -- 172.21.15.45:0/2791578284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3d40c1680 msgr2=0x7fa3d40c8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:20.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.543+0000 7fa3d9c22700 1 --2- 172.21.15.45:0/2791578284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3d40c1680 0x7fa3d40c8640 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8005fd0 tx=0x7fa3c8009c70 comp rx=0 tx=0).stop 2023-10-08T12:46:20.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.543+0000 7fa3d9c22700 1 -- 172.21.15.45:0/2791578284 shutdown_connections 2023-10-08T12:46:20.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.544+0000 7fa3d9c22700 1 --2- 172.21.15.45:0/2791578284 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3d415cf90 0x7fa3d406b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:20.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.544+0000 7fa3d9c22700 1 --2- 172.21.15.45:0/2791578284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3d40c1680 0x7fa3d40c8640 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:20.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.544+0000 7fa3d9c22700 1 -- 172.21.15.45:0/2791578284 >> 172.21.15.45:0/2791578284 conn(0x7fa3d40afae0 msgr2=0x7fa3d40afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:20.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.544+0000 7fa3d9c22700 1 -- 172.21.15.45:0/2791578284 shutdown_connections 2023-10-08T12:46:20.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.544+0000 7fa3d9c22700 1 -- 172.21.15.45:0/2791578284 wait complete. 2023-10-08T12:46:20.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.545+0000 7fa3d9c22700 1 Processor -- start 2023-10-08T12:46:20.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.545+0000 7fa3d9c22700 1 -- start start 2023-10-08T12:46:20.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.546+0000 7fa3d9c22700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3d40c1680 0x7fa3d415a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:20.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.546+0000 7fa3d9c22700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3d40c8b80 0x7fa3d40c33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:20.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.546+0000 7fa3d9c22700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d415cf90 0x7fa3d40c1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:20.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.546+0000 7fa3d9c22700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d40c2f50 con 0x7fa3d40c8b80 2023-10-08T12:46:20.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.546+0000 7fa3d9c22700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d40c2340 con 0x7fa3d415cf90 2023-10-08T12:46:20.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.546+0000 7fa3d9c22700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d40c2620 con 0x7fa3d40c1680 2023-10-08T12:46:20.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.546+0000 7fa3d2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3d40c8b80 0x7fa3d40c33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:20.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.546+0000 7fa3d2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3d40c8b80 0x7fa3d40c33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36720/0 (socket says 172.21.15.45:36720) 2023-10-08T12:46:20.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.546+0000 7fa3d2ffd700 1 -- 172.21.15.45:0/2583996918 learned_addr learned my addr 172.21.15.45:0/2583996918 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:20.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.546+0000 7fa3d37fe700 1 --2- 172.21.15.45:0/2583996918 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3d40c1680 0x7fa3d415a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:20.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.546+0000 7fa3d3fff700 1 --2- 172.21.15.45:0/2583996918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d415cf90 0x7fa3d40c1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:20.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.547+0000 7fa3d2ffd700 1 -- 172.21.15.45:0/2583996918 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3d40c1680 msgr2=0x7fa3d415a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:20.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.547+0000 7fa3d2ffd700 1 --2- 172.21.15.45:0/2583996918 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3d40c1680 0x7fa3d415a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:20.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.547+0000 7fa3d2ffd700 1 -- 172.21.15.45:0/2583996918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d415cf90 msgr2=0x7fa3d40c1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:20.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.547+0000 7fa3d2ffd700 1 --2- 172.21.15.45:0/2583996918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d415cf90 0x7fa3d40c1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:20.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.547+0000 7fa3d2ffd700 1 -- 172.21.15.45:0/2583996918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c80095f0 con 0x7fa3d40c8b80 2023-10-08T12:46:20.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.547+0000 7fa3d2ffd700 1 --2- 172.21.15.45:0/2583996918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3d40c8b80 0x7fa3d40c33e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40707c0 tx=0x7fa3c8004b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:20.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.547+0000 7fa3bbfff700 1 -- 172.21.15.45:0/2583996918 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c801d070 con 0x7fa3d40c8b80 2023-10-08T12:46:20.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.547+0000 7fa3bbfff700 1 -- 172.21.15.45:0/2583996918 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa3c8004320 con 0x7fa3d40c8b80 2023-10-08T12:46:20.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.547+0000 7fa3d9c22700 1 -- 172.21.15.45:0/2583996918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d40c2900 con 0x7fa3d40c8b80 2023-10-08T12:46:20.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.547+0000 7fa3bbfff700 1 -- 172.21.15.45:0/2583996918 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8003680 con 0x7fa3d40c8b80 2023-10-08T12:46:20.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.547+0000 7fa3d9c22700 1 -- 172.21.15.45:0/2583996918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d40c3920 con 0x7fa3d40c8b80 2023-10-08T12:46:20.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.548+0000 7fa3d9c22700 1 -- 172.21.15.45:0/2583996918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d40674a0 con 0x7fa3d40c8b80 2023-10-08T12:46:20.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.548+0000 7fa3bbfff700 1 -- 172.21.15.45:0/2583996918 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa3c80037e0 con 0x7fa3d40c8b80 2023-10-08T12:46:20.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.549+0000 7fa3bbfff700 1 --2- 172.21.15.45:0/2583996918 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa3c006aed0 0x7fa3c006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:20.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.549+0000 7fa3bbfff700 1 -- 172.21.15.45:0/2583996918 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa3c808aab0 con 0x7fa3d40c8b80 2023-10-08T12:46:20.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.549+0000 7fa3d37fe700 1 --2- 172.21.15.45:0/2583996918 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa3c006aed0 0x7fa3c006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:20.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.549+0000 7fa3d37fe700 1 --2- 172.21.15.45:0/2583996918 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa3c006aed0 0x7fa3c006d390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4005fd0 tx=0x7fa3c400a4c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:20.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.554+0000 7fa3bbfff700 1 -- 172.21.15.45:0/2583996918 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa3c8055e20 con 0x7fa3d40c8b80 2023-10-08T12:46:20.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.834+0000 7fa3d9c22700 1 -- 172.21.15.45:0/2583996918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fa3d415d480 con 0x7fa3d40c8b80 2023-10-08T12:46:20.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.836+0000 7fa3bbfff700 1 -- 172.21.15.45:0/2583996918 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa3c8059440 con 0x7fa3d40c8b80 2023-10-08T12:46:20.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.838+0000 7fa3d9c22700 1 -- 172.21.15.45:0/2583996918 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa3c006aed0 msgr2=0x7fa3c006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:20.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.838+0000 7fa3d9c22700 1 --2- 172.21.15.45:0/2583996918 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa3c006aed0 0x7fa3c006d390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4005fd0 tx=0x7fa3c400a4c0 comp rx=0 tx=0).stop 2023-10-08T12:46:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.838+0000 7fa3d9c22700 1 -- 172.21.15.45:0/2583996918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3d40c8b80 msgr2=0x7fa3d40c33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.838+0000 7fa3d9c22700 1 --2- 172.21.15.45:0/2583996918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3d40c8b80 0x7fa3d40c33e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40707c0 tx=0x7fa3c8004b10 comp rx=0 tx=0).stop 2023-10-08T12:46:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.838+0000 7fa3d9c22700 1 -- 172.21.15.45:0/2583996918 shutdown_connections 2023-10-08T12:46:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.838+0000 7fa3d9c22700 1 --2- 172.21.15.45:0/2583996918 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa3c006aed0 0x7fa3c006d390 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.838+0000 7fa3d9c22700 1 --2- 172.21.15.45:0/2583996918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d415cf90 0x7fa3d40c1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.838+0000 7fa3d9c22700 1 --2- 172.21.15.45:0/2583996918 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3d40c1680 0x7fa3d415a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.838+0000 7fa3d9c22700 1 --2- 172.21.15.45:0/2583996918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3d40c8b80 0x7fa3d40c33e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.838+0000 7fa3d9c22700 1 -- 172.21.15.45:0/2583996918 >> 172.21.15.45:0/2583996918 conn(0x7fa3d40afae0 msgr2=0x7fa3d415c060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.839+0000 7fa3d9c22700 1 -- 172.21.15.45:0/2583996918 shutdown_connections 2023-10-08T12:46:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.839+0000 7fa3d9c22700 1 -- 172.21.15.45:0/2583996918 wait complete. 2023-10-08T12:46:20.851 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-08T12:46:20.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.979+0000 7f51174b8700 1 -- 172.21.15.45:0/2787062384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51100b16a0 msgr2=0x7f51100b1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:20.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.979+0000 7f51174b8700 1 --2- 172.21.15.45:0/2787062384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51100b16a0 0x7f51100b1b30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5108009f90 tx=0x7f510800b330 comp rx=0 tx=0).stop 2023-10-08T12:46:20.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.979+0000 7f51174b8700 1 -- 172.21.15.45:0/2787062384 shutdown_connections 2023-10-08T12:46:20.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.979+0000 7f51174b8700 1 --2- 172.21.15.45:0/2787062384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51100b16a0 0x7f51100b1b30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:20.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.979+0000 7f51174b8700 1 --2- 172.21.15.45:0/2787062384 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f51100b2e10 0x7f51100cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:20.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.979+0000 7f51174b8700 1 -- 172.21.15.45:0/2787062384 >> 172.21.15.45:0/2787062384 conn(0x7f511006a210 msgr2=0x7f511006a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:20.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.979+0000 7f51174b8700 1 -- 172.21.15.45:0/2787062384 shutdown_connections 2023-10-08T12:46:20.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.979+0000 7f51174b8700 1 -- 172.21.15.45:0/2787062384 wait complete. 2023-10-08T12:46:20.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.980+0000 7f51174b8700 1 Processor -- start 2023-10-08T12:46:20.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.980+0000 7f51174b8700 1 -- start start 2023-10-08T12:46:20.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.981+0000 7f51174b8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5110071c20 0x7f5110149080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:20.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.981+0000 7f51174b8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51100b16a0 0x7f511015cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:20.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.981+0000 7f51174b8700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f51100b2e10 0x7f511015d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:20.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.981+0000 7f51174b8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51100aa890 con 0x7f51100b16a0 2023-10-08T12:46:20.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.981+0000 7f51174b8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51100aab70 con 0x7f5110071c20 2023-10-08T12:46:20.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.981+0000 7f51174b8700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51100aae50 con 0x7f51100b2e10 2023-10-08T12:46:20.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.981+0000 7f5114a53700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51100b16a0 0x7f511015cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:20.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.981+0000 7f5114a53700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51100b16a0 0x7f511015cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36734/0 (socket says 172.21.15.45:36734) 2023-10-08T12:46:20.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.981+0000 7f5114a53700 1 -- 172.21.15.45:0/4206093100 learned_addr learned my addr 172.21.15.45:0/4206093100 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:20.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.981+0000 7f5115a55700 1 --2- 172.21.15.45:0/4206093100 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f51100b2e10 0x7f511015d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:20.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.981+0000 7f5115254700 1 --2- 172.21.15.45:0/4206093100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5110071c20 0x7f5110149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:20.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.981+0000 7f5114a53700 1 -- 172.21.15.45:0/4206093100 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f51100b2e10 msgr2=0x7f511015d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:20.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.981+0000 7f5114a53700 1 --2- 172.21.15.45:0/4206093100 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f51100b2e10 0x7f511015d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:20.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.981+0000 7f5114a53700 1 -- 172.21.15.45:0/4206093100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5110071c20 msgr2=0x7f5110149080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:20.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.981+0000 7f5114a53700 1 --2- 172.21.15.45:0/4206093100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5110071c20 0x7f5110149080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:20.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.981+0000 7f5114a53700 1 -- 172.21.15.45:0/4206093100 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510c0095f0 con 0x7f51100b16a0 2023-10-08T12:46:20.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.981+0000 7f5115254700 1 --2- 172.21.15.45:0/4206093100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5110071c20 0x7f5110149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:46:20.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.982+0000 7f5114a53700 1 --2- 172.21.15.45:0/4206093100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51100b16a0 0x7f511015cd10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f510c00eb70 tx=0x7f510c00ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:20.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.982+0000 7f5105ffb700 1 -- 172.21.15.45:0/4206093100 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c009970 con 0x7f51100b16a0 2023-10-08T12:46:20.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.982+0000 7f51174b8700 1 -- 172.21.15.45:0/4206093100 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5108009c40 con 0x7f51100b16a0 2023-10-08T12:46:20.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.982+0000 7f5105ffb700 1 -- 172.21.15.45:0/4206093100 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f510c00cd40 con 0x7f51100b16a0 2023-10-08T12:46:20.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.982+0000 7f5105ffb700 1 -- 172.21.15.45:0/4206093100 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c004280 con 0x7f51100b16a0 2023-10-08T12:46:20.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.982+0000 7f51174b8700 1 -- 172.21.15.45:0/4206093100 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51100ab410 con 0x7f51100b16a0 2023-10-08T12:46:20.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.983+0000 7f51174b8700 1 -- 172.21.15.45:0/4206093100 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51100ab630 con 0x7f51100b16a0 2023-10-08T12:46:20.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.983+0000 7f5105ffb700 1 -- 172.21.15.45:0/4206093100 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f510c0043e0 con 0x7f51100b16a0 2023-10-08T12:46:20.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.984+0000 7f5105ffb700 1 --2- 172.21.15.45:0/4206093100 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f50f406aed0 0x7f50f406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:20.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.984+0000 7f5105ffb700 1 -- 172.21.15.45:0/4206093100 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f510c014070 con 0x7f51100b16a0 2023-10-08T12:46:20.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.984+0000 7f5115254700 1 --2- 172.21.15.45:0/4206093100 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f50f406aed0 0x7f50f406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:20.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.985+0000 7f5115254700 1 --2- 172.21.15.45:0/4206093100 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f50f406aed0 0x7f50f406d390 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5100000f60 tx=0x7f5100009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:20.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:20.988+0000 7f5105ffb700 1 -- 172.21.15.45:0/4206093100 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f510c0552e0 con 0x7f51100b16a0 2023-10-08T12:46:21.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.277+0000 7f51174b8700 1 -- 172.21.15.45:0/4206093100 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f511004e4c0 con 0x7f51100b16a0 2023-10-08T12:46:21.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.279+0000 7f5105ffb700 1 -- 172.21.15.45:0/4206093100 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f510c058900 con 0x7f51100b16a0 2023-10-08T12:46:21.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.281+0000 7f51174b8700 1 -- 172.21.15.45:0/4206093100 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f50f406aed0 msgr2=0x7f50f406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:21.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.281+0000 7f51174b8700 1 --2- 172.21.15.45:0/4206093100 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f50f406aed0 0x7f50f406d390 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5100000f60 tx=0x7f5100009040 comp rx=0 tx=0).stop 2023-10-08T12:46:21.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.281+0000 7f51174b8700 1 -- 172.21.15.45:0/4206093100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51100b16a0 msgr2=0x7f511015cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:21.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.281+0000 7f51174b8700 1 --2- 172.21.15.45:0/4206093100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51100b16a0 0x7f511015cd10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f510c00eb70 tx=0x7f510c00ef30 comp rx=0 tx=0).stop 2023-10-08T12:46:21.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.282+0000 7f51174b8700 1 -- 172.21.15.45:0/4206093100 shutdown_connections 2023-10-08T12:46:21.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.282+0000 7f51174b8700 1 --2- 172.21.15.45:0/4206093100 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f50f406aed0 0x7f50f406d390 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:21.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.282+0000 7f51174b8700 1 --2- 172.21.15.45:0/4206093100 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f51100b2e10 0x7f511015d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:21.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.282+0000 7f51174b8700 1 --2- 172.21.15.45:0/4206093100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5110071c20 0x7f5110149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:21.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.282+0000 7f51174b8700 1 --2- 172.21.15.45:0/4206093100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51100b16a0 0x7f511015cd10 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:21.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.282+0000 7f51174b8700 1 -- 172.21.15.45:0/4206093100 >> 172.21.15.45:0/4206093100 conn(0x7f511006a210 msgr2=0x7f5110150f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:21.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.282+0000 7f51174b8700 1 -- 172.21.15.45:0/4206093100 shutdown_connections 2023-10-08T12:46:21.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.282+0000 7f51174b8700 1 -- 172.21.15.45:0/4206093100 wait complete. 2023-10-08T12:46:21.295 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-08T12:46:21.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.422+0000 7f9ecb4c0700 1 -- 172.21.15.45:0/509755019 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ec40c9ff0 msgr2=0x7f9ec40ca480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:21.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.422+0000 7f9ecb4c0700 1 --2- 172.21.15.45:0/509755019 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ec40c9ff0 0x7f9ec40ca480 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc009f60 tx=0x7f9ebc009f90 comp rx=0 tx=0).stop 2023-10-08T12:46:21.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.422+0000 7f9ecb4c0700 1 -- 172.21.15.45:0/509755019 shutdown_connections 2023-10-08T12:46:21.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.422+0000 7f9ecb4c0700 1 --2- 172.21.15.45:0/509755019 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ec40c9ff0 0x7f9ec40ca480 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:21.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.422+0000 7f9ecb4c0700 1 --2- 172.21.15.45:0/509755019 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ec40cdf60 0x7f9ec415c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:21.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.422+0000 7f9ecb4c0700 1 -- 172.21.15.45:0/509755019 >> 172.21.15.45:0/509755019 conn(0x7f9ec40b0430 msgr2=0x7f9ec40b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:21.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.422+0000 7f9ecb4c0700 1 -- 172.21.15.45:0/509755019 shutdown_connections 2023-10-08T12:46:21.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.422+0000 7f9ecb4c0700 1 -- 172.21.15.45:0/509755019 wait complete. 2023-10-08T12:46:21.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.423+0000 7f9ecb4c0700 1 Processor -- start 2023-10-08T12:46:21.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.423+0000 7f9ecb4c0700 1 -- start start 2023-10-08T12:46:21.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.424+0000 7f9ecb4c0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ec40c9ff0 0x7f9ec414bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:21.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.424+0000 7f9ecb4c0700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ec40cdf60 0x7f9ec41f0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:21.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.424+0000 7f9ecb4c0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ec4158950 0x7f9ec40c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:21.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.424+0000 7f9ecb4c0700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec41f23e0 con 0x7f9ec40c9ff0 2023-10-08T12:46:21.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.424+0000 7f9ecb4c0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec41f1760 con 0x7f9ec4158950 2023-10-08T12:46:21.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.424+0000 7f9ecb4c0700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec41f1a40 con 0x7f9ec40cdf60 2023-10-08T12:46:21.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.424+0000 7f9ec925c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ec40c9ff0 0x7f9ec414bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:21.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.424+0000 7f9ec925c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ec40c9ff0 0x7f9ec414bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36746/0 (socket says 172.21.15.45:36746) 2023-10-08T12:46:21.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.424+0000 7f9ec925c700 1 -- 172.21.15.45:0/3423096829 learned_addr learned my addr 172.21.15.45:0/3423096829 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:21.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.424+0000 7f9ec8a5b700 1 --2- 172.21.15.45:0/3423096829 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ec40cdf60 0x7f9ec41f0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:21.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.424+0000 7f9ec925c700 1 -- 172.21.15.45:0/3423096829 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ec40cdf60 msgr2=0x7f9ec41f0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:21.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.424+0000 7f9ec925c700 1 --2- 172.21.15.45:0/3423096829 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ec40cdf60 0x7f9ec41f0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:21.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.424+0000 7f9ec925c700 1 -- 172.21.15.45:0/3423096829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ec4158950 msgr2=0x7f9ec40c5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:21.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.424+0000 7f9ec925c700 1 --2- 172.21.15.45:0/3423096829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ec4158950 0x7f9ec40c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:21.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.424+0000 7f9ec925c700 1 -- 172.21.15.45:0/3423096829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ebc009c40 con 0x7f9ec40c9ff0 2023-10-08T12:46:21.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.424+0000 7f9ec925c700 1 --2- 172.21.15.45:0/3423096829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ec40c9ff0 0x7f9ec414bff0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9eb400c450 tx=0x7f9eb400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:21.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.424+0000 7f9eb9ffb700 1 -- 172.21.15.45:0/3423096829 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4011790 con 0x7f9ec40c9ff0 2023-10-08T12:46:21.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.425+0000 7f9eb9ffb700 1 -- 172.21.15.45:0/3423096829 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9eb40119e0 con 0x7f9ec40c9ff0 2023-10-08T12:46:21.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.425+0000 7f9ecb4c0700 1 -- 172.21.15.45:0/3423096829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec41f1d20 con 0x7f9ec40c9ff0 2023-10-08T12:46:21.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.425+0000 7f9eb9ffb700 1 -- 172.21.15.45:0/3423096829 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4011dd0 con 0x7f9ec40c9ff0 2023-10-08T12:46:21.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.425+0000 7f9ecb4c0700 1 -- 172.21.15.45:0/3423096829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec41f0e40 con 0x7f9ec40c9ff0 2023-10-08T12:46:21.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.426+0000 7f9ecb4c0700 1 -- 172.21.15.45:0/3423096829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec404e4c0 con 0x7f9ec40c9ff0 2023-10-08T12:46:21.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.426+0000 7f9eb9ffb700 1 -- 172.21.15.45:0/3423096829 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9eb401c460 con 0x7f9ec40c9ff0 2023-10-08T12:46:21.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.427+0000 7f9eb9ffb700 1 --2- 172.21.15.45:0/3423096829 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f9ea806aed0 0x7f9ea806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:21.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.427+0000 7f9eb9ffb700 1 -- 172.21.15.45:0/3423096829 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9eb40891b0 con 0x7f9ec40c9ff0 2023-10-08T12:46:21.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.427+0000 7f9ec8a5b700 1 --2- 172.21.15.45:0/3423096829 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f9ea806aed0 0x7f9ea806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:21.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.427+0000 7f9ec8a5b700 1 --2- 172.21.15.45:0/3423096829 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f9ea806aed0 0x7f9ea806d390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4158370 tx=0x7f9ec0005d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:21.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.431+0000 7f9eb9ffb700 1 -- 172.21.15.45:0/3423096829 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9eb4054640 con 0x7f9ec40c9ff0 2023-10-08T12:46:21.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.716+0000 7f9ecb4c0700 1 -- 172.21.15.45:0/3423096829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f9ec40b12a0 con 0x7f9ec40c9ff0 2023-10-08T12:46:21.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.717+0000 7f9eb9ffb700 1 -- 172.21.15.45:0/3423096829 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9eb4057c60 con 0x7f9ec40c9ff0 2023-10-08T12:46:21.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.720+0000 7f9ecb4c0700 1 -- 172.21.15.45:0/3423096829 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f9ea806aed0 msgr2=0x7f9ea806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:21.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.720+0000 7f9ecb4c0700 1 --2- 172.21.15.45:0/3423096829 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f9ea806aed0 0x7f9ea806d390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4158370 tx=0x7f9ec0005d50 comp rx=0 tx=0).stop 2023-10-08T12:46:21.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.720+0000 7f9ecb4c0700 1 -- 172.21.15.45:0/3423096829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ec40c9ff0 msgr2=0x7f9ec414bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:21.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.720+0000 7f9ecb4c0700 1 --2- 172.21.15.45:0/3423096829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ec40c9ff0 0x7f9ec414bff0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9eb400c450 tx=0x7f9eb400c810 comp rx=0 tx=0).stop 2023-10-08T12:46:21.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.720+0000 7f9ecb4c0700 1 -- 172.21.15.45:0/3423096829 shutdown_connections 2023-10-08T12:46:21.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.720+0000 7f9ecb4c0700 1 --2- 172.21.15.45:0/3423096829 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f9ea806aed0 0x7f9ea806d390 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:21.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.720+0000 7f9ecb4c0700 1 --2- 172.21.15.45:0/3423096829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ec4158950 0x7f9ec40c5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:21.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.720+0000 7f9ecb4c0700 1 --2- 172.21.15.45:0/3423096829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ec40c9ff0 0x7f9ec414bff0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:21.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.720+0000 7f9ecb4c0700 1 --2- 172.21.15.45:0/3423096829 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ec40cdf60 0x7f9ec41f0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:21.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.720+0000 7f9ecb4c0700 1 -- 172.21.15.45:0/3423096829 >> 172.21.15.45:0/3423096829 conn(0x7f9ec40b0430 msgr2=0x7f9ec4157580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:21.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.720+0000 7f9ecb4c0700 1 -- 172.21.15.45:0/3423096829 shutdown_connections 2023-10-08T12:46:21.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.720+0000 7f9ecb4c0700 1 -- 172.21.15.45:0/3423096829 wait complete. 2023-10-08T12:46:21.733 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-08T12:46:21.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.862+0000 7fe2c1f32700 1 -- 172.21.15.45:0/3591201981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2a4004d90 msgr2=0x7fe2a4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:21.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.862+0000 7fe2c1f32700 1 --2- 172.21.15.45:0/3591201981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2a4004d90 0x7fe2a4005210 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc0c9300 tx=0x7fe2a4005880 comp rx=0 tx=0).stop 2023-10-08T12:46:21.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.862+0000 7fe2bbfff700 1 -- 172.21.15.45:0/3591201981 reap_dead start 2023-10-08T12:46:21.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.862+0000 7fe2c1f32700 1 -- 172.21.15.45:0/3591201981 shutdown_connections 2023-10-08T12:46:21.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.862+0000 7fe2c1f32700 1 -- 172.21.15.45:0/3591201981 >> 172.21.15.45:0/3591201981 conn(0x7fe2bc0b0430 msgr2=0x7fe2bc0b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:21.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.862+0000 7fe2c1f32700 1 -- 172.21.15.45:0/3591201981 shutdown_connections 2023-10-08T12:46:21.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.862+0000 7fe2c1f32700 1 -- 172.21.15.45:0/3591201981 wait complete. 2023-10-08T12:46:21.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.863+0000 7fe2c1f32700 1 Processor -- start 2023-10-08T12:46:21.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.863+0000 7fe2c1f32700 1 -- start start 2023-10-08T12:46:21.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.864+0000 7fe2c1f32700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2bc154230 0x7fe2bc0aba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:21.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.864+0000 7fe2c1f32700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2bc0cc950 0x7fe2bc0abf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:21.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.864+0000 7fe2c1f32700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe2bc0ad230 0x7fe2bc155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:21.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.864+0000 7fe2c1f32700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc1577c0 con 0x7fe2bc154230 2023-10-08T12:46:21.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.864+0000 7fe2c1f32700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc156bb0 con 0x7fe2bc0cc950 2023-10-08T12:46:21.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.864+0000 7fe2c1f32700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc156e90 con 0x7fe2bc0ad230 2023-10-08T12:46:21.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.864+0000 7fe2bb7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2bc154230 0x7fe2bc0aba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:21.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.864+0000 7fe2bb7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2bc154230 0x7fe2bc0aba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36766/0 (socket says 172.21.15.45:36766) 2023-10-08T12:46:21.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.864+0000 7fe2bb7fe700 1 -- 172.21.15.45:0/1785120361 learned_addr learned my addr 172.21.15.45:0/1785120361 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:21.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.864+0000 7fe2bbfff700 1 --2- 172.21.15.45:0/1785120361 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe2bc0ad230 0x7fe2bc155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:21.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.864+0000 7fe2baffd700 1 --2- 172.21.15.45:0/1785120361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2bc0cc950 0x7fe2bc0abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:21.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.865+0000 7fe2bb7fe700 1 -- 172.21.15.45:0/1785120361 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe2bc0ad230 msgr2=0x7fe2bc155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:21.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.865+0000 7fe2bb7fe700 1 --2- 172.21.15.45:0/1785120361 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe2bc0ad230 0x7fe2bc155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:21.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.865+0000 7fe2bb7fe700 1 -- 172.21.15.45:0/1785120361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2bc0cc950 msgr2=0x7fe2bc0abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:21.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.865+0000 7fe2bb7fe700 1 --2- 172.21.15.45:0/1785120361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2bc0cc950 0x7fe2bc0abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:21.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.865+0000 7fe2bb7fe700 1 -- 172.21.15.45:0/1785120361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2bc157170 con 0x7fe2bc154230 2023-10-08T12:46:21.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.865+0000 7fe2baffd700 1 --2- 172.21.15.45:0/1785120361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2bc0cc950 0x7fe2bc0abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:21.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.865+0000 7fe2bb7fe700 1 --2- 172.21.15.45:0/1785120361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2bc154230 0x7fe2bc0aba20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac003fa0 tx=0x7fe2ac00b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:21.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.865+0000 7fe2a3fff700 1 -- 172.21.15.45:0/1785120361 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac004a30 con 0x7fe2bc154230 2023-10-08T12:46:21.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.865+0000 7fe2a3fff700 1 -- 172.21.15.45:0/1785120361 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe2ac004b90 con 0x7fe2bc154230 2023-10-08T12:46:21.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.865+0000 7fe2c1f32700 1 -- 172.21.15.45:0/1785120361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2bc157450 con 0x7fe2bc154230 2023-10-08T12:46:21.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.865+0000 7fe2a3fff700 1 -- 172.21.15.45:0/1785120361 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac005020 con 0x7fe2bc154230 2023-10-08T12:46:21.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.865+0000 7fe2c1f32700 1 -- 172.21.15.45:0/1785120361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2bc155d60 con 0x7fe2bc154230 2023-10-08T12:46:21.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.866+0000 7fe2c1f32700 1 -- 172.21.15.45:0/1785120361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2bc157970 con 0x7fe2bc154230 2023-10-08T12:46:21.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.866+0000 7fe2a3fff700 1 -- 172.21.15.45:0/1785120361 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe2ac017070 con 0x7fe2bc154230 2023-10-08T12:46:21.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.867+0000 7fe2a3fff700 1 --2- 172.21.15.45:0/1785120361 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe2a806aed0 0x7fe2a806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:21.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.867+0000 7fe2a3fff700 1 -- 172.21.15.45:0/1785120361 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe2ac089d90 con 0x7fe2bc154230 2023-10-08T12:46:21.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.867+0000 7fe2baffd700 1 --2- 172.21.15.45:0/1785120361 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe2a806aed0 0x7fe2a806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:21.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.868+0000 7fe2baffd700 1 --2- 172.21.15.45:0/1785120361 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe2a806aed0 0x7fe2a806d390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0001050 tx=0x7fe2b0001170 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:21.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:21.871+0000 7fe2a3fff700 1 -- 172.21.15.45:0/1785120361 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe2ac0550f0 con 0x7fe2bc154230 2023-10-08T12:46:22.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.153+0000 7fe2c1f32700 1 -- 172.21.15.45:0/1785120361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fe2bc04e4c0 con 0x7fe2bc154230 2023-10-08T12:46:22.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.155+0000 7fe2a3fff700 1 -- 172.21.15.45:0/1785120361 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe2ac01e020 con 0x7fe2bc154230 2023-10-08T12:46:22.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.158+0000 7fe2c1f32700 1 -- 172.21.15.45:0/1785120361 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe2a806aed0 msgr2=0x7fe2a806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:22.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.158+0000 7fe2c1f32700 1 --2- 172.21.15.45:0/1785120361 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe2a806aed0 0x7fe2a806d390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0001050 tx=0x7fe2b0001170 comp rx=0 tx=0).stop 2023-10-08T12:46:22.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.158+0000 7fe2c1f32700 1 -- 172.21.15.45:0/1785120361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2bc154230 msgr2=0x7fe2bc0aba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:22.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.158+0000 7fe2c1f32700 1 --2- 172.21.15.45:0/1785120361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2bc154230 0x7fe2bc0aba20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac003fa0 tx=0x7fe2ac00b950 comp rx=0 tx=0).stop 2023-10-08T12:46:22.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.158+0000 7fe2c1f32700 1 -- 172.21.15.45:0/1785120361 shutdown_connections 2023-10-08T12:46:22.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.158+0000 7fe2c1f32700 1 --2- 172.21.15.45:0/1785120361 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe2a806aed0 0x7fe2a806d390 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:22.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.158+0000 7fe2c1f32700 1 --2- 172.21.15.45:0/1785120361 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe2bc0ad230 0x7fe2bc155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:22.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.158+0000 7fe2c1f32700 1 --2- 172.21.15.45:0/1785120361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2bc154230 0x7fe2bc0aba20 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:22.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.158+0000 7fe2c1f32700 1 --2- 172.21.15.45:0/1785120361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2bc0cc950 0x7fe2bc0abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:22.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.158+0000 7fe2c1f32700 1 -- 172.21.15.45:0/1785120361 >> 172.21.15.45:0/1785120361 conn(0x7fe2bc0b0430 msgr2=0x7fe2bc154e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:22.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.158+0000 7fe2c1f32700 1 -- 172.21.15.45:0/1785120361 shutdown_connections 2023-10-08T12:46:22.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.158+0000 7fe2c1f32700 1 -- 172.21.15.45:0/1785120361 wait complete. 2023-10-08T12:46:22.171 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-08T12:46:22.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.298+0000 7fd601ac3700 1 -- 172.21.15.45:0/3562634660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5e8003a00 msgr2=0x7fd5e8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:22.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.298+0000 7fd601ac3700 1 --2- 172.21.15.45:0/3562634660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5e8003a00 0x7fd5e8003e20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec005fd0 tx=0x7fd5e8005880 comp rx=0 tx=0).stop 2023-10-08T12:46:22.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.298+0000 7fd5fbfff700 1 -- 172.21.15.45:0/3562634660 reap_dead start 2023-10-08T12:46:22.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.298+0000 7fd601ac3700 1 -- 172.21.15.45:0/3562634660 shutdown_connections 2023-10-08T12:46:22.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.298+0000 7fd601ac3700 1 -- 172.21.15.45:0/3562634660 >> 172.21.15.45:0/3562634660 conn(0x7fd5fc0b0430 msgr2=0x7fd5fc0b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:22.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.298+0000 7fd601ac3700 1 -- 172.21.15.45:0/3562634660 shutdown_connections 2023-10-08T12:46:22.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.298+0000 7fd601ac3700 1 -- 172.21.15.45:0/3562634660 wait complete. 2023-10-08T12:46:22.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.300+0000 7fd601ac3700 1 Processor -- start 2023-10-08T12:46:22.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.300+0000 7fd601ac3700 1 -- start start 2023-10-08T12:46:22.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.301+0000 7fd601ac3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd5e8003a00 0x7fd5fc0cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:22.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.301+0000 7fd601ac3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5fc1518f0 0x7fd5fc1f1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:22.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.301+0000 7fd601ac3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5fc0ab700 0x7fd5fc0abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:22.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.301+0000 7fd601ac3700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5fc0ac0f0 con 0x7fd5fc0ab700 2023-10-08T12:46:22.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.301+0000 7fd601ac3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5fc0cda30 con 0x7fd5fc1518f0 2023-10-08T12:46:22.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.301+0000 7fd601ac3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5fc15a1f0 con 0x7fd5e8003a00 2023-10-08T12:46:22.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.301+0000 7fd5fbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5fc0ab700 0x7fd5fc0abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:22.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.301+0000 7fd5fbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5fc0ab700 0x7fd5fc0abbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36790/0 (socket says 172.21.15.45:36790) 2023-10-08T12:46:22.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.301+0000 7fd5fbfff700 1 -- 172.21.15.45:0/4006510194 learned_addr learned my addr 172.21.15.45:0/4006510194 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:22.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.301+0000 7fd5fb7fe700 1 --2- 172.21.15.45:0/4006510194 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd5e8003a00 0x7fd5fc0cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:22.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.301+0000 7fd5faffd700 1 --2- 172.21.15.45:0/4006510194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5fc1518f0 0x7fd5fc1f1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:22.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.301+0000 7fd5fbfff700 1 -- 172.21.15.45:0/4006510194 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd5e8003a00 msgr2=0x7fd5fc0cd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:22.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.301+0000 7fd5fbfff700 1 --2- 172.21.15.45:0/4006510194 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd5e8003a00 0x7fd5fc0cd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:22.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.301+0000 7fd5fbfff700 1 -- 172.21.15.45:0/4006510194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5fc1518f0 msgr2=0x7fd5fc1f1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:22.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.301+0000 7fd5fbfff700 1 --2- 172.21.15.45:0/4006510194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5fc1518f0 0x7fd5fc1f1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:22.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.301+0000 7fd5fbfff700 1 -- 172.21.15.45:0/4006510194 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5fc0cdca0 con 0x7fd5fc0ab700 2023-10-08T12:46:22.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.301+0000 7fd5faffd700 1 --2- 172.21.15.45:0/4006510194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5fc1518f0 0x7fd5fc1f1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:22.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.301+0000 7fd5fbfff700 1 --2- 172.21.15.45:0/4006510194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5fc0ab700 0x7fd5fc0abbb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc06d490 tx=0x7fd5f400eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:22.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.301+0000 7fd5f3fff700 1 -- 172.21.15.45:0/4006510194 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4010890 con 0x7fd5fc0ab700 2023-10-08T12:46:22.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.301+0000 7fd5f3fff700 1 -- 172.21.15.45:0/4006510194 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd5f4010b00 con 0x7fd5fc0ab700 2023-10-08T12:46:22.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.301+0000 7fd601ac3700 1 -- 172.21.15.45:0/4006510194 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5fc0cdf80 con 0x7fd5fc0ab700 2023-10-08T12:46:22.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.301+0000 7fd5f3fff700 1 -- 172.21.15.45:0/4006510194 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4011460 con 0x7fd5fc0ab700 2023-10-08T12:46:22.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.301+0000 7fd601ac3700 1 -- 172.21.15.45:0/4006510194 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5fc0c3580 con 0x7fd5fc0ab700 2023-10-08T12:46:22.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.302+0000 7fd601ac3700 1 -- 172.21.15.45:0/4006510194 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5fc0ce4a0 con 0x7fd5fc0ab700 2023-10-08T12:46:22.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.303+0000 7fd5f3fff700 1 -- 172.21.15.45:0/4006510194 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd5f40115c0 con 0x7fd5fc0ab700 2023-10-08T12:46:22.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.303+0000 7fd5f3fff700 1 --2- 172.21.15.45:0/4006510194 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd5dc06aed0 0x7fd5dc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:22.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.303+0000 7fd5f3fff700 1 -- 172.21.15.45:0/4006510194 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd5f40898b0 con 0x7fd5fc0ab700 2023-10-08T12:46:22.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.303+0000 7fd5fb7fe700 1 --2- 172.21.15.45:0/4006510194 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd5dc06aed0 0x7fd5dc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:22.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.304+0000 7fd5fb7fe700 1 --2- 172.21.15.45:0/4006510194 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd5dc06aed0 0x7fd5dc06d390 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec00bfd0 tx=0x7fd5ec01d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:22.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.308+0000 7fd5f3fff700 1 -- 172.21.15.45:0/4006510194 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd5fc0ce4a0 con 0x7fd5fc0ab700 2023-10-08T12:46:22.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.594+0000 7fd601ac3700 1 -- 172.21.15.45:0/4006510194 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fd5fc0c33e0 con 0x7fd5fc0ab700 2023-10-08T12:46:22.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.596+0000 7fd5f3fff700 1 -- 172.21.15.45:0/4006510194 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd5fc0c33e0 con 0x7fd5fc0ab700 2023-10-08T12:46:22.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.598+0000 7fd601ac3700 1 -- 172.21.15.45:0/4006510194 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd5dc06aed0 msgr2=0x7fd5dc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:22.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.598+0000 7fd601ac3700 1 --2- 172.21.15.45:0/4006510194 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd5dc06aed0 0x7fd5dc06d390 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec00bfd0 tx=0x7fd5ec01d040 comp rx=0 tx=0).stop 2023-10-08T12:46:22.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.598+0000 7fd601ac3700 1 -- 172.21.15.45:0/4006510194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5fc0ab700 msgr2=0x7fd5fc0abbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:22.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.598+0000 7fd601ac3700 1 --2- 172.21.15.45:0/4006510194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5fc0ab700 0x7fd5fc0abbb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc06d490 tx=0x7fd5f400eb60 comp rx=0 tx=0).stop 2023-10-08T12:46:22.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.598+0000 7fd601ac3700 1 -- 172.21.15.45:0/4006510194 shutdown_connections 2023-10-08T12:46:22.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.598+0000 7fd601ac3700 1 --2- 172.21.15.45:0/4006510194 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd5dc06aed0 0x7fd5dc06d390 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:22.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.598+0000 7fd601ac3700 1 --2- 172.21.15.45:0/4006510194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5fc0ab700 0x7fd5fc0abbb0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:22.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.598+0000 7fd601ac3700 1 --2- 172.21.15.45:0/4006510194 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd5e8003a00 0x7fd5fc0cd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:22.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.598+0000 7fd601ac3700 1 --2- 172.21.15.45:0/4006510194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5fc1518f0 0x7fd5fc1f1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:22.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.598+0000 7fd601ac3700 1 -- 172.21.15.45:0/4006510194 >> 172.21.15.45:0/4006510194 conn(0x7fd5fc0b0430 msgr2=0x7fd5fc0c7940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:22.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.599+0000 7fd601ac3700 1 -- 172.21.15.45:0/4006510194 shutdown_connections 2023-10-08T12:46:22.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.599+0000 7fd601ac3700 1 -- 172.21.15.45:0/4006510194 wait complete. 2023-10-08T12:46:22.612 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:46:22.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.738+0000 7f920aba1700 1 -- 172.21.15.45:0/2399742102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9204158950 msgr2=0x7f92040cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:22.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.738+0000 7f920aba1700 1 --2- 172.21.15.45:0/2399742102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9204158950 0x7f92040cdf60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f91f80098c0 tx=0x7f91f8009bd0 comp rx=0 tx=0).stop 2023-10-08T12:46:22.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.738+0000 7f920aba1700 1 -- 172.21.15.45:0/2399742102 shutdown_connections 2023-10-08T12:46:22.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.738+0000 7f920aba1700 1 --2- 172.21.15.45:0/2399742102 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f92040c9ff0 0x7f92040ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:22.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.738+0000 7f920aba1700 1 --2- 172.21.15.45:0/2399742102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9204158950 0x7f92040cdf60 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:22.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.738+0000 7f920aba1700 1 -- 172.21.15.45:0/2399742102 >> 172.21.15.45:0/2399742102 conn(0x7f92040b0430 msgr2=0x7f92040b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:22.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.738+0000 7f920aba1700 1 -- 172.21.15.45:0/2399742102 shutdown_connections 2023-10-08T12:46:22.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.739+0000 7f920aba1700 1 -- 172.21.15.45:0/2399742102 wait complete. 2023-10-08T12:46:22.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.740+0000 7f920aba1700 1 Processor -- start 2023-10-08T12:46:22.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.740+0000 7f920aba1700 1 -- start start 2023-10-08T12:46:22.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.740+0000 7f920aba1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92040c9ff0 0x7f92040c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:22.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.740+0000 7f920aba1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9204158950 0x7f92041548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:22.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.741+0000 7f920aba1700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f920415c320 0x7f92040b2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:22.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.741+0000 7f920aba1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92041f0020 con 0x7f92040c9ff0 2023-10-08T12:46:22.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.741+0000 7f920aba1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92041f3aa0 con 0x7f9204158950 2023-10-08T12:46:22.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.741+0000 7f920aba1700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92041f3d80 con 0x7f920415c320 2023-10-08T12:46:22.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.741+0000 7f920893d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92040c9ff0 0x7f92040c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:22.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.741+0000 7f920893d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92040c9ff0 0x7f92040c72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36800/0 (socket says 172.21.15.45:36800) 2023-10-08T12:46:22.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.741+0000 7f920893d700 1 -- 172.21.15.45:0/4031812583 learned_addr learned my addr 172.21.15.45:0/4031812583 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:22.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.741+0000 7f9203fff700 1 --2- 172.21.15.45:0/4031812583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9204158950 0x7f92041548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:22.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.741+0000 7f920913e700 1 --2- 172.21.15.45:0/4031812583 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f920415c320 0x7f92040b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:22.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.741+0000 7f920893d700 1 -- 172.21.15.45:0/4031812583 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f920415c320 msgr2=0x7f92040b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:22.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.741+0000 7f920893d700 1 --2- 172.21.15.45:0/4031812583 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f920415c320 0x7f92040b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:22.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.741+0000 7f920893d700 1 -- 172.21.15.45:0/4031812583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9204158950 msgr2=0x7f92041548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:22.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.741+0000 7f920893d700 1 --2- 172.21.15.45:0/4031812583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9204158950 0x7f92041548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:22.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.741+0000 7f920893d700 1 -- 172.21.15.45:0/4031812583 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91fc009d00 con 0x7f92040c9ff0 2023-10-08T12:46:22.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.741+0000 7f920893d700 1 --2- 172.21.15.45:0/4031812583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92040c9ff0 0x7f92040c72c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f91f8000c00 tx=0x7f91f800f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:22.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.741+0000 7f92017fa700 1 -- 172.21.15.45:0/4031812583 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f800fb10 con 0x7f92040c9ff0 2023-10-08T12:46:22.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.741+0000 7f920aba1700 1 -- 172.21.15.45:0/4031812583 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f8009520 con 0x7f92040c9ff0 2023-10-08T12:46:22.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.741+0000 7f92017fa700 1 -- 172.21.15.45:0/4031812583 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f91f800fc70 con 0x7f92040c9ff0 2023-10-08T12:46:22.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.741+0000 7f92017fa700 1 -- 172.21.15.45:0/4031812583 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f8017660 con 0x7f92040c9ff0 2023-10-08T12:46:22.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.741+0000 7f920aba1700 1 -- 172.21.15.45:0/4031812583 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92041f4340 con 0x7f92040c9ff0 2023-10-08T12:46:22.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.742+0000 7f920aba1700 1 -- 172.21.15.45:0/4031812583 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92041f44d0 con 0x7f92040c9ff0 2023-10-08T12:46:22.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.743+0000 7f92017fa700 1 -- 172.21.15.45:0/4031812583 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f91f80177c0 con 0x7f92040c9ff0 2023-10-08T12:46:22.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.743+0000 7f92017fa700 1 --2- 172.21.15.45:0/4031812583 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f91e806aed0 0x7f91e806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:22.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.743+0000 7f92017fa700 1 -- 172.21.15.45:0/4031812583 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f91f808b0e0 con 0x7f92040c9ff0 2023-10-08T12:46:22.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.743+0000 7f9203fff700 1 --2- 172.21.15.45:0/4031812583 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f91e806aed0 0x7f91e806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:22.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.744+0000 7f9203fff700 1 --2- 172.21.15.45:0/4031812583 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f91e806aed0 0x7f91e806d390 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9204153510 tx=0x7f91f0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:22.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.748+0000 7f92017fa700 1 -- 172.21.15.45:0/4031812583 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f91f80564f0 con 0x7f92040c9ff0 2023-10-08T12:46:22.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.948+0000 7f920aba1700 1 -- 172.21.15.45:0/4031812583 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f920404e4c0 con 0x7f92040c9ff0 2023-10-08T12:46:22.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.948+0000 7f92017fa700 1 -- 172.21.15.45:0/4031812583 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+12809 (secure 0 0 0) 0x7f91f8059b10 con 0x7f92040c9ff0 2023-10-08T12:46:22.949 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:46:22.949 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":29,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:46:19.511593+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:45:19.183651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.412453+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.351925+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.428025+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.437246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.441119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.388608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.415524+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.401835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:46:22.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.951+0000 7f920aba1700 1 -- 172.21.15.45:0/4031812583 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f91e806aed0 msgr2=0x7f91e806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:22.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.951+0000 7f920aba1700 1 --2- 172.21.15.45:0/4031812583 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f91e806aed0 0x7f91e806d390 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9204153510 tx=0x7f91f0009040 comp rx=0 tx=0).stop 2023-10-08T12:46:22.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.951+0000 7f920aba1700 1 -- 172.21.15.45:0/4031812583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92040c9ff0 msgr2=0x7f92040c72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:22.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.951+0000 7f920aba1700 1 --2- 172.21.15.45:0/4031812583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92040c9ff0 0x7f92040c72c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f91f8000c00 tx=0x7f91f800f710 comp rx=0 tx=0).stop 2023-10-08T12:46:22.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.951+0000 7f920aba1700 1 -- 172.21.15.45:0/4031812583 shutdown_connections 2023-10-08T12:46:22.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.951+0000 7f920aba1700 1 --2- 172.21.15.45:0/4031812583 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f91e806aed0 0x7f91e806d390 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:22.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.951+0000 7f920aba1700 1 --2- 172.21.15.45:0/4031812583 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f920415c320 0x7f92040b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:22.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.951+0000 7f920aba1700 1 --2- 172.21.15.45:0/4031812583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92040c9ff0 0x7f92040c72c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:22.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.951+0000 7f920aba1700 1 --2- 172.21.15.45:0/4031812583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9204158950 0x7f92041548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:22.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.951+0000 7f920aba1700 1 -- 172.21.15.45:0/4031812583 >> 172.21.15.45:0/4031812583 conn(0x7f92040b0430 msgr2=0x7f9204071f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:22.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.951+0000 7f920aba1700 1 -- 172.21.15.45:0/4031812583 shutdown_connections 2023-10-08T12:46:22.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:22.951+0000 7f920aba1700 1 -- 172.21.15.45:0/4031812583 wait complete. 2023-10-08T12:46:22.964 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:45:19.183651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:46:22.965 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:46:23.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.095+0000 7f06c91fb700 1 -- 172.21.15.45:0/487024648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06c4158a90 msgr2=0x7f06c40b0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:23.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.095+0000 7f06c91fb700 1 --2- 172.21.15.45:0/487024648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06c4158a90 0x7f06c40b0c20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f06bc009fd0 tx=0x7f06bc00b380 comp rx=0 tx=0).stop 2023-10-08T12:46:23.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.095+0000 7f06c91fb700 1 -- 172.21.15.45:0/487024648 shutdown_connections 2023-10-08T12:46:23.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.095+0000 7f06c91fb700 1 --2- 172.21.15.45:0/487024648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06c4158a90 0x7f06c40b0c20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:23.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.095+0000 7f06c91fb700 1 --2- 172.21.15.45:0/487024648 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06c41586b0 0x7f06c40cee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:23.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.095+0000 7f06c91fb700 1 -- 172.21.15.45:0/487024648 >> 172.21.15.45:0/487024648 conn(0x7f06c406b320 msgr2=0x7f06c406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:23.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.095+0000 7f06c91fb700 1 -- 172.21.15.45:0/487024648 shutdown_connections 2023-10-08T12:46:23.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.095+0000 7f06c91fb700 1 -- 172.21.15.45:0/487024648 wait complete. 2023-10-08T12:46:23.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.096+0000 7f06c91fb700 1 Processor -- start 2023-10-08T12:46:23.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.096+0000 7f06c91fb700 1 -- start start 2023-10-08T12:46:23.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.097+0000 7f06c91fb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06c40cc820 0x7f06c4157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:23.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.097+0000 7f06c91fb700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06c41586b0 0x7f06c4159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:23.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.097+0000 7f06c91fb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06c4158a90 0x7f06c41f2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:23.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.097+0000 7f06c91fb700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c415b350 con 0x7f06c40cc820 2023-10-08T12:46:23.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.097+0000 7f06c91fb700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c415b7e0 con 0x7f06c4158a90 2023-10-08T12:46:23.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.097+0000 7f06c91fb700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c415a740 con 0x7f06c41586b0 2023-10-08T12:46:23.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.097+0000 7f06c2d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06c40cc820 0x7f06c4157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:23.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.097+0000 7f06c2d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06c40cc820 0x7f06c4157850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36816/0 (socket says 172.21.15.45:36816) 2023-10-08T12:46:23.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.097+0000 7f06c2d9d700 1 -- 172.21.15.45:0/4163802804 learned_addr learned my addr 172.21.15.45:0/4163802804 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:23.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.097+0000 7f06c259c700 1 --2- 172.21.15.45:0/4163802804 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06c41586b0 0x7f06c4159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:23.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.097+0000 7f06c359e700 1 --2- 172.21.15.45:0/4163802804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06c4158a90 0x7f06c41f2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:23.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.097+0000 7f06c2d9d700 1 -- 172.21.15.45:0/4163802804 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06c41586b0 msgr2=0x7f06c4159ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:23.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.097+0000 7f06c2d9d700 1 --2- 172.21.15.45:0/4163802804 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06c41586b0 0x7f06c4159ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:23.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.097+0000 7f06c2d9d700 1 -- 172.21.15.45:0/4163802804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06c4158a90 msgr2=0x7f06c41f2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:23.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.097+0000 7f06c2d9d700 1 --2- 172.21.15.45:0/4163802804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06c4158a90 0x7f06c41f2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:23.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.097+0000 7f06c2d9d700 1 -- 172.21.15.45:0/4163802804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b8009520 con 0x7f06c40cc820 2023-10-08T12:46:23.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.098+0000 7f06c2d9d700 1 --2- 172.21.15.45:0/4163802804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06c40cc820 0x7f06c4157850 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f06b800eb30 tx=0x7f06b800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:23.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.098+0000 7f06ab7fe700 1 -- 172.21.15.45:0/4163802804 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b8009880 con 0x7f06c40cc820 2023-10-08T12:46:23.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.098+0000 7f06ab7fe700 1 -- 172.21.15.45:0/4163802804 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f06b800cd40 con 0x7f06c40cc820 2023-10-08T12:46:23.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.098+0000 7f06c91fb700 1 -- 172.21.15.45:0/4163802804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06bc009d00 con 0x7f06c40cc820 2023-10-08T12:46:23.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.098+0000 7f06ab7fe700 1 -- 172.21.15.45:0/4163802804 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b8004280 con 0x7f06c40cc820 2023-10-08T12:46:23.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.098+0000 7f06c91fb700 1 -- 172.21.15.45:0/4163802804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c415ad00 con 0x7f06c40cc820 2023-10-08T12:46:23.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.099+0000 7f06c91fb700 1 -- 172.21.15.45:0/4163802804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c415b630 con 0x7f06c40cc820 2023-10-08T12:46:23.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.099+0000 7f06ab7fe700 1 -- 172.21.15.45:0/4163802804 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f06b80043e0 con 0x7f06c40cc820 2023-10-08T12:46:23.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.100+0000 7f06ab7fe700 1 --2- 172.21.15.45:0/4163802804 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f06b006aed0 0x7f06b006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:23.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.100+0000 7f06ab7fe700 1 -- 172.21.15.45:0/4163802804 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f06b8014070 con 0x7f06c40cc820 2023-10-08T12:46:23.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.100+0000 7f06c259c700 1 --2- 172.21.15.45:0/4163802804 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f06b006aed0 0x7f06b006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:23.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.100+0000 7f06c259c700 1 --2- 172.21.15.45:0/4163802804 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f06b006aed0 0x7f06b006d390 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f06c40ad7f0 tx=0x7f06b4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:23.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.104+0000 7f06ab7fe700 1 -- 172.21.15.45:0/4163802804 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f06b80551d0 con 0x7f06c40cc820 2023-10-08T12:46:23.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.305+0000 7f06c91fb700 1 -- 172.21.15.45:0/4163802804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f06c40cc120 con 0x7f06c40cc820 2023-10-08T12:46:23.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.306+0000 7f06ab7fe700 1 -- 172.21.15.45:0/4163802804 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f06b80587f0 con 0x7f06c40cc820 2023-10-08T12:46:23.307 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-08T12:46:23.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.308+0000 7f06c91fb700 1 -- 172.21.15.45:0/4163802804 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f06b006aed0 msgr2=0x7f06b006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:23.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.308+0000 7f06c91fb700 1 --2- 172.21.15.45:0/4163802804 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f06b006aed0 0x7f06b006d390 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f06c40ad7f0 tx=0x7f06b4009040 comp rx=0 tx=0).stop 2023-10-08T12:46:23.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.308+0000 7f06c91fb700 1 -- 172.21.15.45:0/4163802804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06c40cc820 msgr2=0x7f06c4157850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:23.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.308+0000 7f06c91fb700 1 --2- 172.21.15.45:0/4163802804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06c40cc820 0x7f06c4157850 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f06b800eb30 tx=0x7f06b800eef0 comp rx=0 tx=0).stop 2023-10-08T12:46:23.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.308+0000 7f06c91fb700 1 -- 172.21.15.45:0/4163802804 shutdown_connections 2023-10-08T12:46:23.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.308+0000 7f06c91fb700 1 --2- 172.21.15.45:0/4163802804 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f06b006aed0 0x7f06b006d390 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:23.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.308+0000 7f06c91fb700 1 --2- 172.21.15.45:0/4163802804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06c4158a90 0x7f06c41f2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:23.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.308+0000 7f06c91fb700 1 --2- 172.21.15.45:0/4163802804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06c40cc820 0x7f06c4157850 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:23.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.308+0000 7f06c91fb700 1 --2- 172.21.15.45:0/4163802804 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06c41586b0 0x7f06c4159ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:23.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.308+0000 7f06c91fb700 1 -- 172.21.15.45:0/4163802804 >> 172.21.15.45:0/4163802804 conn(0x7f06c406b320 msgr2=0x7f06c40b1950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:23.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.308+0000 7f06c91fb700 1 -- 172.21.15.45:0/4163802804 shutdown_connections 2023-10-08T12:46:23.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.308+0000 7f06c91fb700 1 -- 172.21.15.45:0/4163802804 wait complete. 2023-10-08T12:46:23.321 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T12:46:23.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.448+0000 7fed6824d700 1 -- 172.21.15.45:0/1943214414 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fed60158950 msgr2=0x7fed600cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:23.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.448+0000 7fed6824d700 1 --2- 172.21.15.45:0/1943214414 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fed60158950 0x7fed600cdf60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fed5c0098c0 tx=0x7fed5c009bd0 comp rx=0 tx=0).stop 2023-10-08T12:46:23.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.448+0000 7fed6824d700 1 -- 172.21.15.45:0/1943214414 shutdown_connections 2023-10-08T12:46:23.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.448+0000 7fed6824d700 1 --2- 172.21.15.45:0/1943214414 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fed60158950 0x7fed600cdf60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:23.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.448+0000 7fed6824d700 1 --2- 172.21.15.45:0/1943214414 >> v2:172.21.15.78:3300/0 conn(0x7fed6015c320 0x7fed60071f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:23.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.448+0000 7fed6824d700 1 -- 172.21.15.45:0/1943214414 >> 172.21.15.45:0/1943214414 conn(0x7fed600b0430 msgr2=0x7fed600b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:23.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.448+0000 7fed6824d700 1 -- 172.21.15.45:0/1943214414 shutdown_connections 2023-10-08T12:46:23.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.448+0000 7fed6824d700 1 -- 172.21.15.45:0/1943214414 wait complete. 2023-10-08T12:46:23.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.449+0000 7fed6824d700 1 Processor -- start 2023-10-08T12:46:23.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.449+0000 7fed6824d700 1 -- start start 2023-10-08T12:46:23.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.450+0000 7fed6824d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fed600724c0 0x7fed600cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:23.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.450+0000 7fed6824d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed60158950 0x7fed601553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:23.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.450+0000 7fed6824d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed6015c320 0x7fed600c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:23.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.450+0000 7fed6824d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed600c7b80 con 0x7fed60158950 2023-10-08T12:46:23.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.450+0000 7fed6824d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed600c6f00 con 0x7fed6015c320 2023-10-08T12:46:23.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.450+0000 7fed6824d700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed600c71e0 con 0x7fed600724c0 2023-10-08T12:46:23.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.450+0000 7fed657e8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed60158950 0x7fed601553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:23.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.450+0000 7fed657e8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed60158950 0x7fed601553b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36830/0 (socket says 172.21.15.45:36830) 2023-10-08T12:46:23.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.450+0000 7fed657e8700 1 -- 172.21.15.45:0/3878415984 learned_addr learned my addr 172.21.15.45:0/3878415984 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:23.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.450+0000 7fed65fe9700 1 --2- 172.21.15.45:0/3878415984 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fed600724c0 0x7fed600cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:23.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.451+0000 7fed667ea700 1 --2- 172.21.15.45:0/3878415984 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed6015c320 0x7fed600c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:23.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.451+0000 7fed657e8700 1 -- 172.21.15.45:0/3878415984 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fed600724c0 msgr2=0x7fed600cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:23.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.451+0000 7fed657e8700 1 --2- 172.21.15.45:0/3878415984 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fed600724c0 0x7fed600cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:23.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.451+0000 7fed657e8700 1 -- 172.21.15.45:0/3878415984 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed6015c320 msgr2=0x7fed600c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:23.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.451+0000 7fed657e8700 1 --2- 172.21.15.45:0/3878415984 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed6015c320 0x7fed600c7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:23.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.451+0000 7fed657e8700 1 -- 172.21.15.45:0/3878415984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c009520 con 0x7fed60158950 2023-10-08T12:46:23.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.451+0000 7fed657e8700 1 --2- 172.21.15.45:0/3878415984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed60158950 0x7fed601553b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fed5400e9f0 tx=0x7fed5400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:23.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.451+0000 7fed527fc700 1 -- 172.21.15.45:0/3878415984 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed54009610 con 0x7fed60158950 2023-10-08T12:46:23.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.451+0000 7fed527fc700 1 -- 172.21.15.45:0/3878415984 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fed5400cab0 con 0x7fed60158950 2023-10-08T12:46:23.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.451+0000 7fed527fc700 1 -- 172.21.15.45:0/3878415984 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5400cea0 con 0x7fed60158950 2023-10-08T12:46:23.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.451+0000 7fed6824d700 1 -- 172.21.15.45:0/3878415984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed600c74c0 con 0x7fed60158950 2023-10-08T12:46:23.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.451+0000 7fed6824d700 1 -- 172.21.15.45:0/3878415984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed601558f0 con 0x7fed60158950 2023-10-08T12:46:23.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.452+0000 7fed6824d700 1 -- 172.21.15.45:0/3878415984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed600c7cc0 con 0x7fed60158950 2023-10-08T12:46:23.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.452+0000 7fed527fc700 1 -- 172.21.15.45:0/3878415984 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fed54010430 con 0x7fed60158950 2023-10-08T12:46:23.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.453+0000 7fed527fc700 1 --2- 172.21.15.45:0/3878415984 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fed4406aed0 0x7fed4406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:23.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.453+0000 7fed527fc700 1 -- 172.21.15.45:0/3878415984 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fed54014070 con 0x7fed60158950 2023-10-08T12:46:23.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.453+0000 7fed65fe9700 1 --2- 172.21.15.45:0/3878415984 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fed4406aed0 0x7fed4406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:23.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.454+0000 7fed65fe9700 1 --2- 172.21.15.45:0/3878415984 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fed4406aed0 0x7fed4406d390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fed5c000c00 tx=0x7fed5c019040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:23.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.458+0000 7fed527fc700 1 -- 172.21.15.45:0/3878415984 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fed54051ca0 con 0x7fed60158950 2023-10-08T12:46:23.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.665+0000 7fed6824d700 1 -- 172.21.15.45:0/3878415984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fed6004e4c0 con 0x7fed60158950 2023-10-08T12:46:23.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.665+0000 7fed527fc700 1 -- 172.21.15.45:0/3878415984 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+65 (secure 0 0 0) 0x7fed600c7cc0 con 0x7fed60158950 2023-10-08T12:46:23.667 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:46:23.667 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-10-08T12:46:23.667 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-08T12:46:23.667 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-10-08T12:46:23.667 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-10-08T12:46:23.667 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-08T12:46:23.667 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-10-08T12:46:23.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.668+0000 7fed6824d700 1 -- 172.21.15.45:0/3878415984 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fed4406aed0 msgr2=0x7fed4406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:23.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.668+0000 7fed6824d700 1 --2- 172.21.15.45:0/3878415984 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fed4406aed0 0x7fed4406d390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fed5c000c00 tx=0x7fed5c019040 comp rx=0 tx=0).stop 2023-10-08T12:46:23.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.668+0000 7fed6824d700 1 -- 172.21.15.45:0/3878415984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed60158950 msgr2=0x7fed601553b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:23.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.668+0000 7fed6824d700 1 --2- 172.21.15.45:0/3878415984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed60158950 0x7fed601553b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fed5400e9f0 tx=0x7fed5400ed00 comp rx=0 tx=0).stop 2023-10-08T12:46:23.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.668+0000 7fed6824d700 1 -- 172.21.15.45:0/3878415984 shutdown_connections 2023-10-08T12:46:23.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.668+0000 7fed6824d700 1 --2- 172.21.15.45:0/3878415984 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fed4406aed0 0x7fed4406d390 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:23.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.668+0000 7fed6824d700 1 --2- 172.21.15.45:0/3878415984 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed6015c320 0x7fed600c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:23.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.668+0000 7fed6824d700 1 --2- 172.21.15.45:0/3878415984 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fed600724c0 0x7fed600cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:23.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.668+0000 7fed6824d700 1 --2- 172.21.15.45:0/3878415984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed60158950 0x7fed601553b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:23.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.668+0000 7fed6824d700 1 -- 172.21.15.45:0/3878415984 >> 172.21.15.45:0/3878415984 conn(0x7fed600b0430 msgr2=0x7fed6006a210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:23.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.668+0000 7fed6824d700 1 -- 172.21.15.45:0/3878415984 shutdown_connections 2023-10-08T12:46:23.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.668+0000 7fed6824d700 1 -- 172.21.15.45:0/3878415984 wait complete. 2023-10-08T12:46:23.680 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T12:46:23.681 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T12:46:23.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.811+0000 7fcab2923700 1 -- 172.21.15.45:0/2001405328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca98005210 msgr2=0x7fca9800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:23.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.811+0000 7fcab2923700 1 --2- 172.21.15.45:0/2001405328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca98005210 0x7fca9800ba10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4009da0 tx=0x7fca98005880 comp rx=0 tx=0).stop 2023-10-08T12:46:23.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.811+0000 7fcab2923700 1 -- 172.21.15.45:0/2001405328 shutdown_connections 2023-10-08T12:46:23.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.811+0000 7fcab2923700 1 --2- 172.21.15.45:0/2001405328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca98005210 0x7fca9800ba10 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:23.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.811+0000 7fcab2923700 1 -- 172.21.15.45:0/2001405328 >> 172.21.15.45:0/2001405328 conn(0x7fcaac097a20 msgr2=0x7fcaac0ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:23.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.811+0000 7fcab2923700 1 -- 172.21.15.45:0/2001405328 shutdown_connections 2023-10-08T12:46:23.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.811+0000 7fcab2923700 1 -- 172.21.15.45:0/2001405328 wait complete. 2023-10-08T12:46:23.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.812+0000 7fcab2923700 1 Processor -- start 2023-10-08T12:46:23.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.813+0000 7fcab2923700 1 -- start start 2023-10-08T12:46:23.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.813+0000 7fcab2923700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca98005210 0x7fcaac1427c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:23.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.813+0000 7fcab2923700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaac1f1970 0x7fcaac1f1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:23.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.813+0000 7fcab2923700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcaac1589c0 0x7fcaac158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:23.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.813+0000 7fcab2923700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac159380 con 0x7fcaac1f1970 2023-10-08T12:46:23.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.813+0000 7fcab2923700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac0b3510 con 0x7fca98005210 2023-10-08T12:46:23.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.813+0000 7fcab2923700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac0b2be0 con 0x7fcaac1589c0 2023-10-08T12:46:23.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.813+0000 7fcaab7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaac1f1970 0x7fcaac1f1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:23.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.813+0000 7fcaab7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaac1f1970 0x7fcaac1f1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36850/0 (socket says 172.21.15.45:36850) 2023-10-08T12:46:23.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.813+0000 7fcaab7fe700 1 -- 172.21.15.45:0/799328468 learned_addr learned my addr 172.21.15.45:0/799328468 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:23.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.814+0000 7fcaabfff700 1 --2- 172.21.15.45:0/799328468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca98005210 0x7fcaac1427c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:23.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.814+0000 7fcab0ec0700 1 --2- 172.21.15.45:0/799328468 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcaac1589c0 0x7fcaac158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:23.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.814+0000 7fcaab7fe700 1 -- 172.21.15.45:0/799328468 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcaac1589c0 msgr2=0x7fcaac158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:23.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.814+0000 7fcaab7fe700 1 --2- 172.21.15.45:0/799328468 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcaac1589c0 0x7fcaac158e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:23.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.814+0000 7fcaab7fe700 1 -- 172.21.15.45:0/799328468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca98005210 msgr2=0x7fcaac1427c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:23.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.814+0000 7fcaab7fe700 1 --2- 172.21.15.45:0/799328468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca98005210 0x7fcaac1427c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:23.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.814+0000 7fcaab7fe700 1 -- 172.21.15.45:0/799328468 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaac0b2ec0 con 0x7fcaac1f1970 2023-10-08T12:46:23.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.814+0000 7fcaabfff700 1 --2- 172.21.15.45:0/799328468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca98005210 0x7fcaac1427c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:23.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.814+0000 7fcaab7fe700 1 --2- 172.21.15.45:0/799328468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaac1f1970 0x7fcaac1f1df0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fca9c004d40 tx=0x7fca9c001540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:23.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.814+0000 7fcaa8ff9700 1 -- 172.21.15.45:0/799328468 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c011660 con 0x7fcaac1f1970 2023-10-08T12:46:23.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.814+0000 7fcaa8ff9700 1 -- 172.21.15.45:0/799328468 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fca9c0118b0 con 0x7fcaac1f1970 2023-10-08T12:46:23.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.814+0000 7fcab2923700 1 -- 172.21.15.45:0/799328468 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaac0b31a0 con 0x7fcaac1f1970 2023-10-08T12:46:23.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.814+0000 7fcaa8ff9700 1 -- 172.21.15.45:0/799328468 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c011c60 con 0x7fcaac1f1970 2023-10-08T12:46:23.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.814+0000 7fcab2923700 1 -- 172.21.15.45:0/799328468 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaac142d00 con 0x7fcaac1f1970 2023-10-08T12:46:23.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.815+0000 7fcab2923700 1 -- 172.21.15.45:0/799328468 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaac0b36c0 con 0x7fcaac1f1970 2023-10-08T12:46:23.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.816+0000 7fcaa8ff9700 1 -- 172.21.15.45:0/799328468 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fca9c01b460 con 0x7fcaac1f1970 2023-10-08T12:46:23.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.816+0000 7fcaa8ff9700 1 --2- 172.21.15.45:0/799328468 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fca8c06aed0 0x7fca8c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:23.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.816+0000 7fcaa8ff9700 1 -- 172.21.15.45:0/799328468 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fca9c089b40 con 0x7fcaac1f1970 2023-10-08T12:46:23.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.816+0000 7fcaabfff700 1 --2- 172.21.15.45:0/799328468 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fca8c06aed0 0x7fca8c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:23.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.817+0000 7fcaabfff700 1 --2- 172.21.15.45:0/799328468 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fca8c06aed0 0x7fca8c06d390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fca94001eb0 tx=0x7fca94001e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:23.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:23.821+0000 7fcaa8ff9700 1 -- 172.21.15.45:0/799328468 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcaac0b36c0 con 0x7fcaac1f1970 2023-10-08T12:46:24.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.019+0000 7fcab2923700 1 -- 172.21.15.45:0/799328468 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fcaac0c91a0 con 0x7fcaac1f1970 2023-10-08T12:46:24.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.599+0000 7fcaa8ff9700 1 -- 172.21.15.45:0/799328468 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) v1 ==== 138+0+0 (secure 0 0 0) 0x7fca9c054f80 con 0x7fcaac1f1970 2023-10-08T12:46:24.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.602+0000 7fcab2923700 1 -- 172.21.15.45:0/799328468 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fca8c06aed0 msgr2=0x7fca8c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:24.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.602+0000 7fcab2923700 1 --2- 172.21.15.45:0/799328468 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fca8c06aed0 0x7fca8c06d390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fca94001eb0 tx=0x7fca94001e40 comp rx=0 tx=0).stop 2023-10-08T12:46:24.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.602+0000 7fcab2923700 1 -- 172.21.15.45:0/799328468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaac1f1970 msgr2=0x7fcaac1f1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:24.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.602+0000 7fcab2923700 1 --2- 172.21.15.45:0/799328468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaac1f1970 0x7fcaac1f1df0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fca9c004d40 tx=0x7fca9c001540 comp rx=0 tx=0).stop 2023-10-08T12:46:24.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.603+0000 7fcab2923700 1 -- 172.21.15.45:0/799328468 shutdown_connections 2023-10-08T12:46:24.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.603+0000 7fcab2923700 1 --2- 172.21.15.45:0/799328468 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fca8c06aed0 0x7fca8c06d390 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:24.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.603+0000 7fcab2923700 1 --2- 172.21.15.45:0/799328468 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcaac1589c0 0x7fcaac158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:24.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.603+0000 7fcab2923700 1 --2- 172.21.15.45:0/799328468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca98005210 0x7fcaac1427c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:24.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.603+0000 7fcab2923700 1 --2- 172.21.15.45:0/799328468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaac1f1970 0x7fcaac1f1df0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:24.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.603+0000 7fcab2923700 1 -- 172.21.15.45:0/799328468 >> 172.21.15.45:0/799328468 conn(0x7fcaac097a20 msgr2=0x7fcaac0b09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:24.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.603+0000 7fcab2923700 1 -- 172.21.15.45:0/799328468 shutdown_connections 2023-10-08T12:46:24.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.603+0000 7fcab2923700 1 -- 172.21.15.45:0/799328468 wait complete. 2023-10-08T12:46:24.606 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-10-08T12:46:24.622 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T12:46:24.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.762+0000 7f64c6eaf700 1 -- 172.21.15.45:0/3691308451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64b0003a00 msgr2=0x7f64b0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:24.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.762+0000 7f64c6eaf700 1 --2- 172.21.15.45:0/3691308451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64b0003a00 0x7f64b0003e20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f64b4001720 tx=0x7f64b0005880 comp rx=0 tx=0).stop 2023-10-08T12:46:24.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.762+0000 7f64c6eaf700 1 -- 172.21.15.45:0/3691308451 shutdown_connections 2023-10-08T12:46:24.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.762+0000 7f64c6eaf700 1 --2- 172.21.15.45:0/3691308451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64b0003a00 0x7f64b0003e20 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:24.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.762+0000 7f64c6eaf700 1 -- 172.21.15.45:0/3691308451 >> 172.21.15.45:0/3691308451 conn(0x7f64c006b320 msgr2=0x7f64c006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:24.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.762+0000 7f64c6eaf700 1 -- 172.21.15.45:0/3691308451 shutdown_connections 2023-10-08T12:46:24.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.762+0000 7f64c6eaf700 1 -- 172.21.15.45:0/3691308451 wait complete. 2023-10-08T12:46:24.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.764+0000 7f64c6eaf700 1 Processor -- start 2023-10-08T12:46:24.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.764+0000 7f64c6eaf700 1 -- start start 2023-10-08T12:46:24.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.765+0000 7f64c6eaf700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f64b0003a00 0x7f64c01f1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:24.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.765+0000 7f64c6eaf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64c01e2bc0 0x7f64c014d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:24.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.765+0000 7f64c6eaf700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64c01e3040 0x7f64c014d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:24.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.765+0000 7f64c6eaf700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c00ab080 con 0x7f64c01e3040 2023-10-08T12:46:24.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.765+0000 7f64c6eaf700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c014c330 con 0x7f64c01e2bc0 2023-10-08T12:46:24.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.765+0000 7f64c6eaf700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c014c610 con 0x7f64b0003a00 2023-10-08T12:46:24.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.765+0000 7f64c544c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64c01e3040 0x7f64c014d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:24.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.765+0000 7f64c544c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64c01e3040 0x7f64c014d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36872/0 (socket says 172.21.15.45:36872) 2023-10-08T12:46:24.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.765+0000 7f64c544c700 1 -- 172.21.15.45:0/2421170732 learned_addr learned my addr 172.21.15.45:0/2421170732 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:24.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.765+0000 7f64bffff700 1 --2- 172.21.15.45:0/2421170732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64c01e2bc0 0x7f64c014d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:24.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.765+0000 7f64c4c4b700 1 --2- 172.21.15.45:0/2421170732 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f64b0003a00 0x7f64c01f1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:24.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.765+0000 7f64c544c700 1 -- 172.21.15.45:0/2421170732 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f64b0003a00 msgr2=0x7f64c01f1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:24.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.765+0000 7f64c544c700 1 --2- 172.21.15.45:0/2421170732 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f64b0003a00 0x7f64c01f1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:24.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.765+0000 7f64c544c700 1 -- 172.21.15.45:0/2421170732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64c01e2bc0 msgr2=0x7f64c014d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:24.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.765+0000 7f64c544c700 1 --2- 172.21.15.45:0/2421170732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64c01e2bc0 0x7f64c014d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:24.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.765+0000 7f64c544c700 1 -- 172.21.15.45:0/2421170732 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c014c8f0 con 0x7f64c01e3040 2023-10-08T12:46:24.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.765+0000 7f64c544c700 1 --2- 172.21.15.45:0/2421170732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64c01e3040 0x7f64c014d910 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f64c00b1190 tx=0x7f64b800f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:24.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.765+0000 7f64bd7fa700 1 -- 172.21.15.45:0/2421170732 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b8019070 con 0x7f64c01e3040 2023-10-08T12:46:24.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.765+0000 7f64bd7fa700 1 -- 172.21.15.45:0/2421170732 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f64b800f040 con 0x7f64c01e3040 2023-10-08T12:46:24.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.765+0000 7f64c6eaf700 1 -- 172.21.15.45:0/2421170732 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c014cbd0 con 0x7f64c01e3040 2023-10-08T12:46:24.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.765+0000 7f64bd7fa700 1 -- 172.21.15.45:0/2421170732 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b800e040 con 0x7f64c01e3040 2023-10-08T12:46:24.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.766+0000 7f64c6eaf700 1 -- 172.21.15.45:0/2421170732 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c01f20b0 con 0x7f64c01e3040 2023-10-08T12:46:24.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.767+0000 7f64c6eaf700 1 -- 172.21.15.45:0/2421170732 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c014d0f0 con 0x7f64c01e3040 2023-10-08T12:46:24.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.767+0000 7f64bd7fa700 1 -- 172.21.15.45:0/2421170732 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f64b8009070 con 0x7f64c01e3040 2023-10-08T12:46:24.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.767+0000 7f64bd7fa700 1 --2- 172.21.15.45:0/2421170732 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f64a406aed0 0x7f64a406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:24.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.768+0000 7f64bd7fa700 1 -- 172.21.15.45:0/2421170732 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f64b80891e0 con 0x7f64c01e3040 2023-10-08T12:46:24.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.768+0000 7f64c4c4b700 1 --2- 172.21.15.45:0/2421170732 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f64a406aed0 0x7f64a406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:24.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.768+0000 7f64c4c4b700 1 --2- 172.21.15.45:0/2421170732 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f64a406aed0 0x7f64a406d390 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f64b4001720 tx=0x7f64b4001190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:24.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.772+0000 7f64bd7fa700 1 -- 172.21.15.45:0/2421170732 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f64c014d0f0 con 0x7f64c01e3040 2023-10-08T12:46:24.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:24.972+0000 7f64c6eaf700 1 -- 172.21.15.45:0/2421170732 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f64c014d0f0 con 0x7f64c01e3040 2023-10-08T12:46:25.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.602+0000 7f64bd7fa700 1 -- 172.21.15.45:0/2421170732 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) v1 ==== 170+0+0 (secure 0 0 0) 0x7f64c014d0f0 con 0x7f64c01e3040 2023-10-08T12:46:25.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.606+0000 7f64c6eaf700 1 -- 172.21.15.45:0/2421170732 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f64a406aed0 msgr2=0x7f64a406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:25.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.606+0000 7f64c6eaf700 1 --2- 172.21.15.45:0/2421170732 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f64a406aed0 0x7f64a406d390 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f64b4001720 tx=0x7f64b4001190 comp rx=0 tx=0).stop 2023-10-08T12:46:25.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.606+0000 7f64c6eaf700 1 -- 172.21.15.45:0/2421170732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64c01e3040 msgr2=0x7f64c014d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:25.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.606+0000 7f64c6eaf700 1 --2- 172.21.15.45:0/2421170732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64c01e3040 0x7f64c014d910 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f64c00b1190 tx=0x7f64b800f490 comp rx=0 tx=0).stop 2023-10-08T12:46:25.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.606+0000 7f64c6eaf700 1 -- 172.21.15.45:0/2421170732 shutdown_connections 2023-10-08T12:46:25.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.606+0000 7f64c6eaf700 1 --2- 172.21.15.45:0/2421170732 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f64a406aed0 0x7f64a406d390 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:25.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.606+0000 7f64c6eaf700 1 --2- 172.21.15.45:0/2421170732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64c01e3040 0x7f64c014d910 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:25.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.606+0000 7f64c6eaf700 1 --2- 172.21.15.45:0/2421170732 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f64b0003a00 0x7f64c01f1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:25.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.606+0000 7f64c6eaf700 1 --2- 172.21.15.45:0/2421170732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64c01e2bc0 0x7f64c014d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:25.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.606+0000 7f64c6eaf700 1 -- 172.21.15.45:0/2421170732 >> 172.21.15.45:0/2421170732 conn(0x7f64c006b320 msgr2=0x7f64c00ad730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:25.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.606+0000 7f64c6eaf700 1 -- 172.21.15.45:0/2421170732 shutdown_connections 2023-10-08T12:46:25.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.606+0000 7f64c6eaf700 1 -- 172.21.15.45:0/2421170732 wait complete. 2023-10-08T12:46:25.612 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-10-08T12:46:25.634 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T12:46:25.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.768+0000 7f3e2b2f4700 1 -- 172.21.15.45:0/2912005036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e240c9c00 msgr2=0x7f3e240cb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:25.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.768+0000 7f3e2b2f4700 1 --2- 172.21.15.45:0/2912005036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e240c9c00 0x7f3e240cb020 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3e20005fd0 tx=0x7f3e20009c70 comp rx=0 tx=0).stop 2023-10-08T12:46:25.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.768+0000 7f3e2b2f4700 1 -- 172.21.15.45:0/2912005036 shutdown_connections 2023-10-08T12:46:25.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.768+0000 7f3e2b2f4700 1 --2- 172.21.15.45:0/2912005036 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3e240cb560 0x7f3e240b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:25.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.768+0000 7f3e2b2f4700 1 --2- 172.21.15.45:0/2912005036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e240c9c00 0x7f3e240cb020 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:25.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.768+0000 7f3e2b2f4700 1 -- 172.21.15.45:0/2912005036 >> 172.21.15.45:0/2912005036 conn(0x7f3e24097a20 msgr2=0x7f3e240ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:25.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.769+0000 7f3e2b2f4700 1 -- 172.21.15.45:0/2912005036 shutdown_connections 2023-10-08T12:46:25.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.769+0000 7f3e2b2f4700 1 -- 172.21.15.45:0/2912005036 wait complete. 2023-10-08T12:46:25.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.770+0000 7f3e2b2f4700 1 Processor -- start 2023-10-08T12:46:25.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.770+0000 7f3e2b2f4700 1 -- start start 2023-10-08T12:46:25.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.771+0000 7f3e2b2f4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e240c9c00 0x7f3e24098500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:25.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.771+0000 7f3e2b2f4700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3e240cb560 0x7f3e241f3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:25.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.771+0000 7f3e2b2f4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e2415c0d0 0x7f3e2414a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:25.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.771+0000 7f3e2b2f4700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e240c30b0 con 0x7f3e2415c0d0 2023-10-08T12:46:25.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.771+0000 7f3e2b2f4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e24098a40 con 0x7f3e240c9c00 2023-10-08T12:46:25.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.771+0000 7f3e2b2f4700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e240c27c0 con 0x7f3e240cb560 2023-10-08T12:46:25.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.771+0000 7f3e29891700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e2415c0d0 0x7f3e2414a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:25.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.771+0000 7f3e29891700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e2415c0d0 0x7f3e2414a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36886/0 (socket says 172.21.15.45:36886) 2023-10-08T12:46:25.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.771+0000 7f3e29891700 1 -- 172.21.15.45:0/2466773221 learned_addr learned my addr 172.21.15.45:0/2466773221 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:25.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.771+0000 7f3e29090700 1 --2- 172.21.15.45:0/2466773221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e240c9c00 0x7f3e24098500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:25.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.771+0000 7f3e2888f700 1 --2- 172.21.15.45:0/2466773221 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3e240cb560 0x7f3e241f3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:25.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.771+0000 7f3e29891700 1 -- 172.21.15.45:0/2466773221 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3e240cb560 msgr2=0x7f3e241f3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:25.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.771+0000 7f3e29891700 1 --2- 172.21.15.45:0/2466773221 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3e240cb560 0x7f3e241f3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:25.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.771+0000 7f3e29891700 1 -- 172.21.15.45:0/2466773221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e240c9c00 msgr2=0x7f3e24098500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:25.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.771+0000 7f3e29891700 1 --2- 172.21.15.45:0/2466773221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e240c9c00 0x7f3e24098500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:25.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.771+0000 7f3e29891700 1 -- 172.21.15.45:0/2466773221 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e200095f0 con 0x7f3e2415c0d0 2023-10-08T12:46:25.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.771+0000 7f3e29891700 1 --2- 172.21.15.45:0/2466773221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e2415c0d0 0x7f3e2414a9e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c007ee0 tx=0x7f3e1c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:25.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.771+0000 7f3e19ffb700 1 -- 172.21.15.45:0/2466773221 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c017070 con 0x7f3e2415c0d0 2023-10-08T12:46:25.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.771+0000 7f3e19ffb700 1 -- 172.21.15.45:0/2466773221 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3e1c00f040 con 0x7f3e2415c0d0 2023-10-08T12:46:25.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.771+0000 7f3e19ffb700 1 -- 172.21.15.45:0/2466773221 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c004df0 con 0x7f3e2415c0d0 2023-10-08T12:46:25.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.771+0000 7f3e2b2f4700 1 -- 172.21.15.45:0/2466773221 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e24099e80 con 0x7f3e2415c0d0 2023-10-08T12:46:25.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.772+0000 7f3e2b2f4700 1 -- 172.21.15.45:0/2466773221 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e240c2a30 con 0x7f3e2415c0d0 2023-10-08T12:46:25.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.772+0000 7f3e2b2f4700 1 -- 172.21.15.45:0/2466773221 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e24066850 con 0x7f3e2415c0d0 2023-10-08T12:46:25.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.773+0000 7f3e19ffb700 1 -- 172.21.15.45:0/2466773221 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3e1c00db20 con 0x7f3e2415c0d0 2023-10-08T12:46:25.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.773+0000 7f3e19ffb700 1 --2- 172.21.15.45:0/2466773221 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3e0806aed0 0x7f3e0806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:25.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.773+0000 7f3e19ffb700 1 -- 172.21.15.45:0/2466773221 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f3e1c089330 con 0x7f3e2415c0d0 2023-10-08T12:46:25.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.773+0000 7f3e29090700 1 --2- 172.21.15.45:0/2466773221 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3e0806aed0 0x7f3e0806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:25.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.774+0000 7f3e29090700 1 --2- 172.21.15.45:0/2466773221 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3e0806aed0 0x7f3e0806d390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3e14007fd0 tx=0x7f3e14009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:25.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:25.778+0000 7f3e19ffb700 1 -- 172.21.15.45:0/2466773221 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3e1c0544d0 con 0x7f3e2415c0d0 2023-10-08T12:46:26.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.024+0000 7f3e2b2f4700 1 -- 172.21.15.45:0/2466773221 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3e240cae00 con 0x7f3e2415c0d0 2023-10-08T12:46:26.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.626+0000 7f3e19ffb700 1 -- 172.21.15.45:0/2466773221 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3e1c057af0 con 0x7f3e2415c0d0 2023-10-08T12:46:26.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.632+0000 7f3e2b2f4700 1 -- 172.21.15.45:0/2466773221 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3e0806aed0 msgr2=0x7f3e0806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:26.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.632+0000 7f3e2b2f4700 1 --2- 172.21.15.45:0/2466773221 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3e0806aed0 0x7f3e0806d390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3e14007fd0 tx=0x7f3e14009040 comp rx=0 tx=0).stop 2023-10-08T12:46:26.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.632+0000 7f3e2b2f4700 1 -- 172.21.15.45:0/2466773221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e2415c0d0 msgr2=0x7f3e2414a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:26.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.632+0000 7f3e2b2f4700 1 --2- 172.21.15.45:0/2466773221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e2415c0d0 0x7f3e2414a9e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c007ee0 tx=0x7f3e1c00d3b0 comp rx=0 tx=0).stop 2023-10-08T12:46:26.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.632+0000 7f3e2b2f4700 1 -- 172.21.15.45:0/2466773221 shutdown_connections 2023-10-08T12:46:26.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.632+0000 7f3e2b2f4700 1 --2- 172.21.15.45:0/2466773221 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3e0806aed0 0x7f3e0806d390 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:26.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.632+0000 7f3e2b2f4700 1 --2- 172.21.15.45:0/2466773221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e2415c0d0 0x7f3e2414a9e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:26.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.632+0000 7f3e2b2f4700 1 --2- 172.21.15.45:0/2466773221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e240c9c00 0x7f3e24098500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:26.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.632+0000 7f3e2b2f4700 1 --2- 172.21.15.45:0/2466773221 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3e240cb560 0x7f3e241f3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:26.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.632+0000 7f3e2b2f4700 1 -- 172.21.15.45:0/2466773221 >> 172.21.15.45:0/2466773221 conn(0x7f3e24097a20 msgr2=0x7f3e240b3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:26.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.633+0000 7f3e2b2f4700 1 -- 172.21.15.45:0/2466773221 shutdown_connections 2023-10-08T12:46:26.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.633+0000 7f3e2b2f4700 1 -- 172.21.15.45:0/2466773221 wait complete. 2023-10-08T12:46:26.656 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 4 and data pool 5 2023-10-08T12:46:26.670 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:46:26.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.799+0000 7fbf4b01c700 1 -- 172.21.15.45:0/2724077693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf4406a750 msgr2=0x7fbf440ce920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:26.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.799+0000 7fbf4b01c700 1 --2- 172.21.15.45:0/2724077693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf4406a750 0x7fbf440ce920 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c009fd0 tx=0x7fbf3c00b380 comp rx=0 tx=0).stop 2023-10-08T12:46:26.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.800+0000 7fbf4b01c700 1 -- 172.21.15.45:0/2724077693 shutdown_connections 2023-10-08T12:46:26.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.800+0000 7fbf4b01c700 1 --2- 172.21.15.45:0/2724077693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf4406a750 0x7fbf440ce920 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:26.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.800+0000 7fbf4b01c700 1 --2- 172.21.15.45:0/2724077693 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf440b1730 0x7fbf4406a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:26.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.800+0000 7fbf4b01c700 1 -- 172.21.15.45:0/2724077693 >> 172.21.15.45:0/2724077693 conn(0x7fbf440b0430 msgr2=0x7fbf440b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:26.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.800+0000 7fbf4b01c700 1 -- 172.21.15.45:0/2724077693 shutdown_connections 2023-10-08T12:46:26.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.800+0000 7fbf4b01c700 1 -- 172.21.15.45:0/2724077693 wait complete. 2023-10-08T12:46:26.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.801+0000 7fbf4b01c700 1 Processor -- start 2023-10-08T12:46:26.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.801+0000 7fbf4b01c700 1 -- start start 2023-10-08T12:46:26.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.802+0000 7fbf4b01c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf4406a750 0x7fbf441580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:26.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.802+0000 7fbf4b01c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf440b1730 0x7fbf440c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:26.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.802+0000 7fbf4b01c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf44159960 0x7fbf440c7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:26.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.802+0000 7fbf4b01c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf440c2e60 con 0x7fbf44159960 2023-10-08T12:46:26.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.802+0000 7fbf4b01c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf440c3140 con 0x7fbf4406a750 2023-10-08T12:46:26.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.802+0000 7fbf4b01c700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf440c3420 con 0x7fbf440b1730 2023-10-08T12:46:26.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.802+0000 7fbf495b9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf44159960 0x7fbf440c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:26.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.802+0000 7fbf495b9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf44159960 0x7fbf440c7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36914/0 (socket says 172.21.15.45:36914) 2023-10-08T12:46:26.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.802+0000 7fbf495b9700 1 -- 172.21.15.45:0/1271115479 learned_addr learned my addr 172.21.15.45:0/1271115479 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:26.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.802+0000 7fbf43fff700 1 --2- 172.21.15.45:0/1271115479 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf440b1730 0x7fbf440c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:26.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.802+0000 7fbf48db8700 1 --2- 172.21.15.45:0/1271115479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf4406a750 0x7fbf441580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.802+0000 7fbf495b9700 1 -- 172.21.15.45:0/1271115479 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf440b1730 msgr2=0x7fbf440c4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.802+0000 7fbf495b9700 1 --2- 172.21.15.45:0/1271115479 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf440b1730 0x7fbf440c4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.802+0000 7fbf495b9700 1 -- 172.21.15.45:0/1271115479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf4406a750 msgr2=0x7fbf441580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.802+0000 7fbf495b9700 1 --2- 172.21.15.45:0/1271115479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf4406a750 0x7fbf441580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.802+0000 7fbf495b9700 1 -- 172.21.15.45:0/1271115479 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf3c009d00 con 0x7fbf44159960 2023-10-08T12:46:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.802+0000 7fbf48db8700 1 --2- 172.21.15.45:0/1271115479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf4406a750 0x7fbf441580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.802+0000 7fbf495b9700 1 --2- 172.21.15.45:0/1271115479 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf44159960 0x7fbf440c7320 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00b780 tx=0x7fbf3c007b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:26.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.803+0000 7fbf417fa700 1 -- 172.21.15.45:0/1271115479 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c00e040 con 0x7fbf44159960 2023-10-08T12:46:26.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.803+0000 7fbf417fa700 1 -- 172.21.15.45:0/1271115479 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbf3c01d890 con 0x7fbf44159960 2023-10-08T12:46:26.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.803+0000 7fbf4b01c700 1 -- 172.21.15.45:0/1271115479 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf441e3bf0 con 0x7fbf44159960 2023-10-08T12:46:26.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.803+0000 7fbf417fa700 1 -- 172.21.15.45:0/1271115479 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c01dca0 con 0x7fbf44159960 2023-10-08T12:46:26.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.803+0000 7fbf4b01c700 1 -- 172.21.15.45:0/1271115479 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf440c2b10 con 0x7fbf44159960 2023-10-08T12:46:26.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.804+0000 7fbf4b01c700 1 -- 172.21.15.45:0/1271115479 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf441e3de0 con 0x7fbf44159960 2023-10-08T12:46:26.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.804+0000 7fbf417fa700 1 -- 172.21.15.45:0/1271115479 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbf3c01b450 con 0x7fbf44159960 2023-10-08T12:46:26.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.804+0000 7fbf417fa700 1 --2- 172.21.15.45:0/1271115479 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fbf2806aed0 0x7fbf2806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:26.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.804+0000 7fbf417fa700 1 -- 172.21.15.45:0/1271115479 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf3c08b740 con 0x7fbf44159960 2023-10-08T12:46:26.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.805+0000 7fbf48db8700 1 --2- 172.21.15.45:0/1271115479 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fbf2806aed0 0x7fbf2806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:26.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.805+0000 7fbf48db8700 1 --2- 172.21.15.45:0/1271115479 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fbf2806aed0 0x7fbf2806d390 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbf38000f60 tx=0x7fbf38009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:26.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:26.809+0000 7fbf417fa700 1 -- 172.21.15.45:0/1271115479 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbf3c056890 con 0x7fbf44159960 2023-10-08T12:46:27.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.011+0000 7fbf4b01c700 1 -- 172.21.15.45:0/1271115479 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf4404e4c0 con 0x7fbf44159960 2023-10-08T12:46:27.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.012+0000 7fbf417fa700 1 -- 172.21.15.45:0/1271115479 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16534 (secure 0 0 0) 0x7fbf3c021090 con 0x7fbf44159960 2023-10-08T12:46:27.013 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:46:27.013 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":32,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:46:26.025438+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:45:19.183651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:46:24.050213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T12:46:25.003094+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.412453+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.351925+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.428025+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.437246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.441119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.388608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.415524+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.401835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:46:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.014+0000 7fbf4b01c700 1 -- 172.21.15.45:0/1271115479 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fbf2806aed0 msgr2=0x7fbf2806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:27.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.014+0000 7fbf4b01c700 1 --2- 172.21.15.45:0/1271115479 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fbf2806aed0 0x7fbf2806d390 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbf38000f60 tx=0x7fbf38009040 comp rx=0 tx=0).stop 2023-10-08T12:46:27.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.014+0000 7fbf4b01c700 1 -- 172.21.15.45:0/1271115479 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf44159960 msgr2=0x7fbf440c7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:27.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.014+0000 7fbf4b01c700 1 --2- 172.21.15.45:0/1271115479 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf44159960 0x7fbf440c7320 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00b780 tx=0x7fbf3c007b60 comp rx=0 tx=0).stop 2023-10-08T12:46:27.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.014+0000 7fbf4b01c700 1 -- 172.21.15.45:0/1271115479 shutdown_connections 2023-10-08T12:46:27.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.014+0000 7fbf4b01c700 1 --2- 172.21.15.45:0/1271115479 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fbf2806aed0 0x7fbf2806d390 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:27.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.014+0000 7fbf4b01c700 1 --2- 172.21.15.45:0/1271115479 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf44159960 0x7fbf440c7320 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:27.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.014+0000 7fbf4b01c700 1 --2- 172.21.15.45:0/1271115479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf4406a750 0x7fbf441580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:27.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.014+0000 7fbf4b01c700 1 --2- 172.21.15.45:0/1271115479 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf440b1730 0x7fbf440c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:27.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.014+0000 7fbf4b01c700 1 -- 172.21.15.45:0/1271115479 >> 172.21.15.45:0/1271115479 conn(0x7fbf440b0430 msgr2=0x7fbf440b3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:27.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.014+0000 7fbf4b01c700 1 -- 172.21.15.45:0/1271115479 shutdown_connections 2023-10-08T12:46:27.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.014+0000 7fbf4b01c700 1 -- 172.21.15.45:0/1271115479 wait complete. 2023-10-08T12:46:27.027 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:46:27.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.154+0000 7fca4c2af700 1 -- 172.21.15.45:0/483699443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca440c9ff0 msgr2=0x7fca440ca480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:27.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.154+0000 7fca4c2af700 1 --2- 172.21.15.45:0/483699443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca440c9ff0 0x7fca440ca480 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fca3c009fd0 tx=0x7fca3c00b380 comp rx=0 tx=0).stop 2023-10-08T12:46:27.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.154+0000 7fca4c2af700 1 -- 172.21.15.45:0/483699443 shutdown_connections 2023-10-08T12:46:27.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.154+0000 7fca4c2af700 1 --2- 172.21.15.45:0/483699443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca440c9ff0 0x7fca440ca480 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:27.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.154+0000 7fca4c2af700 1 --2- 172.21.15.45:0/483699443 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca44158950 0x7fca440cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:27.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.154+0000 7fca4c2af700 1 -- 172.21.15.45:0/483699443 >> 172.21.15.45:0/483699443 conn(0x7fca440b0430 msgr2=0x7fca440b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:27.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.154+0000 7fca4c2af700 1 -- 172.21.15.45:0/483699443 shutdown_connections 2023-10-08T12:46:27.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.154+0000 7fca4c2af700 1 -- 172.21.15.45:0/483699443 wait complete. 2023-10-08T12:46:27.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.155+0000 7fca4c2af700 1 Processor -- start 2023-10-08T12:46:27.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.155+0000 7fca4c2af700 1 -- start start 2023-10-08T12:46:27.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.156+0000 7fca4c2af700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca440c9ff0 0x7fca440acc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:27.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.156+0000 7fca4c2af700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca44158950 0x7fca440cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:27.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.156+0000 7fca4c2af700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca4415c320 0x7fca44156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:27.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.156+0000 7fca4c2af700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca440ae890 con 0x7fca4415c320 2023-10-08T12:46:27.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.156+0000 7fca4c2af700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca440adf30 con 0x7fca44158950 2023-10-08T12:46:27.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.156+0000 7fca4c2af700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca440ad250 con 0x7fca440c9ff0 2023-10-08T12:46:27.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.156+0000 7fca4a84c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca4415c320 0x7fca44156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:27.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.156+0000 7fca4a84c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca4415c320 0x7fca44156aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36928/0 (socket says 172.21.15.45:36928) 2023-10-08T12:46:27.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.156+0000 7fca4a84c700 1 -- 172.21.15.45:0/4214141319 learned_addr learned my addr 172.21.15.45:0/4214141319 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:27.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.156+0000 7fca4984a700 1 --2- 172.21.15.45:0/4214141319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca44158950 0x7fca440cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:27.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.156+0000 7fca4a04b700 1 --2- 172.21.15.45:0/4214141319 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca440c9ff0 0x7fca440acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:27.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.156+0000 7fca4a84c700 1 -- 172.21.15.45:0/4214141319 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca440c9ff0 msgr2=0x7fca440acc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:27.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.156+0000 7fca4a84c700 1 --2- 172.21.15.45:0/4214141319 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca440c9ff0 0x7fca440acc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:27.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.156+0000 7fca4a84c700 1 -- 172.21.15.45:0/4214141319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca44158950 msgr2=0x7fca440cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:27.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.156+0000 7fca4a84c700 1 --2- 172.21.15.45:0/4214141319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca44158950 0x7fca440cb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:27.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.156+0000 7fca4a84c700 1 -- 172.21.15.45:0/4214141319 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca3c009d00 con 0x7fca4415c320 2023-10-08T12:46:27.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.156+0000 7fca4984a700 1 --2- 172.21.15.45:0/4214141319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca44158950 0x7fca440cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:27.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.156+0000 7fca4a84c700 1 --2- 172.21.15.45:0/4214141319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca4415c320 0x7fca44156aa0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fca3c00b780 tx=0x7fca3c007c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:27.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.157+0000 7fca36ffd700 1 -- 172.21.15.45:0/4214141319 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c00e040 con 0x7fca4415c320 2023-10-08T12:46:27.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.157+0000 7fca36ffd700 1 -- 172.21.15.45:0/4214141319 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fca3c01d890 con 0x7fca4415c320 2023-10-08T12:46:27.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.157+0000 7fca4c2af700 1 -- 172.21.15.45:0/4214141319 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca440ae1d0 con 0x7fca4415c320 2023-10-08T12:46:27.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.157+0000 7fca36ffd700 1 -- 172.21.15.45:0/4214141319 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c01dca0 con 0x7fca4415c320 2023-10-08T12:46:27.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.157+0000 7fca4c2af700 1 -- 172.21.15.45:0/4214141319 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca44156fe0 con 0x7fca4415c320 2023-10-08T12:46:27.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.158+0000 7fca4c2af700 1 -- 172.21.15.45:0/4214141319 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca440ae9d0 con 0x7fca4415c320 2023-10-08T12:46:27.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.158+0000 7fca36ffd700 1 -- 172.21.15.45:0/4214141319 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fca3c01b450 con 0x7fca4415c320 2023-10-08T12:46:27.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.159+0000 7fca36ffd700 1 --2- 172.21.15.45:0/4214141319 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fca2806aed0 0x7fca2806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:27.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.159+0000 7fca36ffd700 1 -- 172.21.15.45:0/4214141319 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca3c08b7e0 con 0x7fca4415c320 2023-10-08T12:46:27.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.159+0000 7fca4a04b700 1 --2- 172.21.15.45:0/4214141319 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fca2806aed0 0x7fca2806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:27.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.159+0000 7fca4a04b700 1 --2- 172.21.15.45:0/4214141319 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fca2806aed0 0x7fca2806d390 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fca38005950 tx=0x7fca380058e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:27.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.163+0000 7fca36ffd700 1 -- 172.21.15.45:0/4214141319 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fca440ae9d0 con 0x7fca4415c320 2023-10-08T12:46:27.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.366+0000 7fca4c2af700 1 -- 172.21.15.45:0/4214141319 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca440ae9d0 con 0x7fca4415c320 2023-10-08T12:46:27.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.368+0000 7fca36ffd700 1 -- 172.21.15.45:0/4214141319 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16534 (secure 0 0 0) 0x7fca440ae9d0 con 0x7fca4415c320 2023-10-08T12:46:27.369 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:46:27.369 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":32,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:46:26.025438+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:45:19.183651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:46:24.050213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T12:46:25.003094+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.412453+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.351925+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.428025+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.437246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.441119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.388608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.415524+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.401835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:46:27.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.370+0000 7fca4c2af700 1 -- 172.21.15.45:0/4214141319 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fca2806aed0 msgr2=0x7fca2806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:27.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.370+0000 7fca4c2af700 1 --2- 172.21.15.45:0/4214141319 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fca2806aed0 0x7fca2806d390 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fca38005950 tx=0x7fca380058e0 comp rx=0 tx=0).stop 2023-10-08T12:46:27.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.370+0000 7fca4c2af700 1 -- 172.21.15.45:0/4214141319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca4415c320 msgr2=0x7fca44156aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:27.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.370+0000 7fca4c2af700 1 --2- 172.21.15.45:0/4214141319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca4415c320 0x7fca44156aa0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fca3c00b780 tx=0x7fca3c007c10 comp rx=0 tx=0).stop 2023-10-08T12:46:27.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.370+0000 7fca4c2af700 1 -- 172.21.15.45:0/4214141319 shutdown_connections 2023-10-08T12:46:27.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.370+0000 7fca4c2af700 1 --2- 172.21.15.45:0/4214141319 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fca2806aed0 0x7fca2806d390 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:27.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.370+0000 7fca4c2af700 1 --2- 172.21.15.45:0/4214141319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca4415c320 0x7fca44156aa0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:27.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.370+0000 7fca4c2af700 1 --2- 172.21.15.45:0/4214141319 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca440c9ff0 0x7fca440acc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:27.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.370+0000 7fca4c2af700 1 --2- 172.21.15.45:0/4214141319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca44158950 0x7fca440cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:27.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.370+0000 7fca4c2af700 1 -- 172.21.15.45:0/4214141319 >> 172.21.15.45:0/4214141319 conn(0x7fca440b0430 msgr2=0x7fca440b1550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:27.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.370+0000 7fca4c2af700 1 -- 172.21.15.45:0/4214141319 shutdown_connections 2023-10-08T12:46:27.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.370+0000 7fca4c2af700 1 -- 172.21.15.45:0/4214141319 wait complete. 2023-10-08T12:46:27.383 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T12:46:27.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.514+0000 7f441be34700 1 -- 172.21.15.45:0/3998802989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4400003f80 msgr2=0x7f4400004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:27.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.514+0000 7f441be34700 1 --2- 172.21.15.45:0/3998802989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4400003f80 0x7f4400004850 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4410009be0 tx=0x7f4400005880 comp rx=0 tx=0).stop 2023-10-08T12:46:27.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.514+0000 7f441a3d1700 1 -- 172.21.15.45:0/3998802989 reap_dead start 2023-10-08T12:46:27.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.514+0000 7f441be34700 1 -- 172.21.15.45:0/3998802989 shutdown_connections 2023-10-08T12:46:27.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.514+0000 7f441be34700 1 -- 172.21.15.45:0/3998802989 >> 172.21.15.45:0/3998802989 conn(0x7f44140b0430 msgr2=0x7f44140b0840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:27.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.515+0000 7f441be34700 1 -- 172.21.15.45:0/3998802989 shutdown_connections 2023-10-08T12:46:27.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.515+0000 7f441be34700 1 -- 172.21.15.45:0/3998802989 wait complete. 2023-10-08T12:46:27.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.516+0000 7f441be34700 1 Processor -- start 2023-10-08T12:46:27.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.516+0000 7f441be34700 1 -- start start 2023-10-08T12:46:27.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.517+0000 7f441be34700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4414153370 0x7f4414155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:27.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.517+0000 7f441be34700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4414152b60 0x7f4414151a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:27.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.517+0000 7f441be34700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4414151f80 0x7f441415a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:27.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.517+0000 7f441be34700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44141515b0 con 0x7f4414151f80 2023-10-08T12:46:27.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.517+0000 7f441be34700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44141509a0 con 0x7f4414153370 2023-10-08T12:46:27.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.517+0000 7f441be34700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4414150c80 con 0x7f4414152b60 2023-10-08T12:46:27.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.517+0000 7f441a3d1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4414151f80 0x7f441415a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:27.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.517+0000 7f441a3d1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4414151f80 0x7f441415a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36948/0 (socket says 172.21.15.45:36948) 2023-10-08T12:46:27.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.517+0000 7f441a3d1700 1 -- 172.21.15.45:0/1879876317 learned_addr learned my addr 172.21.15.45:0/1879876317 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:27.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.517+0000 7f4419bd0700 1 --2- 172.21.15.45:0/1879876317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4414153370 0x7f4414155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:27.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.517+0000 7f44193cf700 1 --2- 172.21.15.45:0/1879876317 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4414152b60 0x7f4414151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:27.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.517+0000 7f441a3d1700 1 -- 172.21.15.45:0/1879876317 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4414152b60 msgr2=0x7f4414151a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:27.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.517+0000 7f441a3d1700 1 --2- 172.21.15.45:0/1879876317 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4414152b60 0x7f4414151a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:27.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.517+0000 7f441a3d1700 1 -- 172.21.15.45:0/1879876317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4414153370 msgr2=0x7f4414155ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:27.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.517+0000 7f441a3d1700 1 --2- 172.21.15.45:0/1879876317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4414153370 0x7f4414155ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:27.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.517+0000 7f441a3d1700 1 -- 172.21.15.45:0/1879876317 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4414150f60 con 0x7f4414151f80 2023-10-08T12:46:27.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.517+0000 7f441a3d1700 1 --2- 172.21.15.45:0/1879876317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4414151f80 0x7f441415a7d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f44140ccfc0 tx=0x7f440c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:27.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.517+0000 7f44067fc700 1 -- 172.21.15.45:0/1879876317 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c00e050 con 0x7f4414151f80 2023-10-08T12:46:27.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.517+0000 7f44067fc700 1 -- 172.21.15.45:0/1879876317 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f440c00f040 con 0x7f4414151f80 2023-10-08T12:46:27.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.517+0000 7f441be34700 1 -- 172.21.15.45:0/1879876317 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4414151240 con 0x7f4414151f80 2023-10-08T12:46:27.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.517+0000 7f44067fc700 1 -- 172.21.15.45:0/1879876317 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c010e20 con 0x7f4414151f80 2023-10-08T12:46:27.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.517+0000 7f441be34700 1 -- 172.21.15.45:0/1879876317 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4414153750 con 0x7f4414151f80 2023-10-08T12:46:27.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.518+0000 7f441be34700 1 -- 172.21.15.45:0/1879876317 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4414151720 con 0x7f4414151f80 2023-10-08T12:46:27.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.519+0000 7f44067fc700 1 -- 172.21.15.45:0/1879876317 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f440c021460 con 0x7f4414151f80 2023-10-08T12:46:27.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.519+0000 7f44067fc700 1 --2- 172.21.15.45:0/1879876317 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f43f806aed0 0x7f43f806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:27.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.519+0000 7f44067fc700 1 -- 172.21.15.45:0/1879876317 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f440c089fe0 con 0x7f4414151f80 2023-10-08T12:46:27.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.519+0000 7f4419bd0700 1 --2- 172.21.15.45:0/1879876317 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f43f806aed0 0x7f43f806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:27.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.520+0000 7f4419bd0700 1 --2- 172.21.15.45:0/1879876317 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f43f806aed0 0x7f43f806d390 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4408001820 tx=0x7f4408001080 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:27.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.524+0000 7f44067fc700 1 -- 172.21.15.45:0/1879876317 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f440c055010 con 0x7f4414151f80 2023-10-08T12:46:27.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:27.775+0000 7f441be34700 1 -- 172.21.15.45:0/1879876317 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f441404e4c0 con 0x7f4414151f80 2023-10-08T12:46:28.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.649+0000 7f44067fc700 1 -- 172.21.15.45:0/1879876317 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f440c058630 con 0x7f4414151f80 2023-10-08T12:46:28.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.652+0000 7f441be34700 1 -- 172.21.15.45:0/1879876317 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f43f806aed0 msgr2=0x7f43f806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:28.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.653+0000 7f441be34700 1 --2- 172.21.15.45:0/1879876317 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f43f806aed0 0x7f43f806d390 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4408001820 tx=0x7f4408001080 comp rx=0 tx=0).stop 2023-10-08T12:46:28.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.653+0000 7f441be34700 1 -- 172.21.15.45:0/1879876317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4414151f80 msgr2=0x7f441415a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:28.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.653+0000 7f441be34700 1 --2- 172.21.15.45:0/1879876317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4414151f80 0x7f441415a7d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f44140ccfc0 tx=0x7f440c007f70 comp rx=0 tx=0).stop 2023-10-08T12:46:28.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.653+0000 7f441be34700 1 -- 172.21.15.45:0/1879876317 shutdown_connections 2023-10-08T12:46:28.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.653+0000 7f441be34700 1 --2- 172.21.15.45:0/1879876317 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f43f806aed0 0x7f43f806d390 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:28.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.653+0000 7f441be34700 1 --2- 172.21.15.45:0/1879876317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4414151f80 0x7f441415a7d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:28.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.653+0000 7f441be34700 1 --2- 172.21.15.45:0/1879876317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4414153370 0x7f4414155ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:28.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.653+0000 7f441be34700 1 --2- 172.21.15.45:0/1879876317 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4414152b60 0x7f4414151a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:28.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.653+0000 7f441be34700 1 -- 172.21.15.45:0/1879876317 >> 172.21.15.45:0/1879876317 conn(0x7f44140b0430 msgr2=0x7f44140afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:28.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.653+0000 7f441be34700 1 -- 172.21.15.45:0/1879876317 shutdown_connections 2023-10-08T12:46:28.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.653+0000 7f441be34700 1 -- 172.21.15.45:0/1879876317 wait complete. 2023-10-08T12:46:28.668 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-08T12:46:28.669 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T12:46:28.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.805+0000 7ff00e2ac700 1 -- 172.21.15.45:0/996649199 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff008159a30 msgr2=0x7ff008071cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:28.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.805+0000 7ff00e2ac700 1 --2- 172.21.15.45:0/996649199 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff008159a30 0x7ff008071cf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feff80098c0 tx=0x7feff8009bd0 comp rx=0 tx=0).stop 2023-10-08T12:46:28.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.805+0000 7ff00e2ac700 1 -- 172.21.15.45:0/996649199 shutdown_connections 2023-10-08T12:46:28.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.805+0000 7ff00e2ac700 1 --2- 172.21.15.45:0/996649199 >> v2:172.21.15.78:3300/0 conn(0x7ff0080ce020 0x7ff0080cb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:28.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.805+0000 7ff00e2ac700 1 --2- 172.21.15.45:0/996649199 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff008159a30 0x7ff008071cf0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:28.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.805+0000 7ff00e2ac700 1 -- 172.21.15.45:0/996649199 >> 172.21.15.45:0/996649199 conn(0x7ff00806b320 msgr2=0x7ff00806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:28.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.805+0000 7ff00e2ac700 1 -- 172.21.15.45:0/996649199 shutdown_connections 2023-10-08T12:46:28.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.805+0000 7ff00e2ac700 1 -- 172.21.15.45:0/996649199 wait complete. 2023-10-08T12:46:28.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.806+0000 7ff00e2ac700 1 Processor -- start 2023-10-08T12:46:28.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.806+0000 7ff00e2ac700 1 -- start start 2023-10-08T12:46:28.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.807+0000 7ff00e2ac700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff008072230 0x7ff0080c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:28.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.807+0000 7ff00e2ac700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff0080ce020 0x7ff0080c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:28.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.807+0000 7ff00e2ac700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff008159a30 0x7ff008148d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:28.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.807+0000 7ff00e2ac700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0080aede0 con 0x7ff008072230 2023-10-08T12:46:28.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.807+0000 7ff00e2ac700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0080af0c0 con 0x7ff008159a30 2023-10-08T12:46:28.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.807+0000 7ff00e2ac700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0080af3a0 con 0x7ff0080ce020 2023-10-08T12:46:28.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.807+0000 7ff007fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff008072230 0x7ff0080c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:28.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.807+0000 7ff007fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff008072230 0x7ff0080c83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36958/0 (socket says 172.21.15.45:36958) 2023-10-08T12:46:28.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.807+0000 7ff007fff700 1 -- 172.21.15.45:0/698724372 learned_addr learned my addr 172.21.15.45:0/698724372 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:28.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.807+0000 7ff0077fe700 1 --2- 172.21.15.45:0/698724372 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff0080ce020 0x7ff0080c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:28.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.807+0000 7ff00c849700 1 --2- 172.21.15.45:0/698724372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff008159a30 0x7ff008148d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:28.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.808+0000 7ff007fff700 1 -- 172.21.15.45:0/698724372 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff0080ce020 msgr2=0x7ff0080c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:28.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.808+0000 7ff007fff700 1 --2- 172.21.15.45:0/698724372 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff0080ce020 0x7ff0080c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:28.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.808+0000 7ff007fff700 1 -- 172.21.15.45:0/698724372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff008159a30 msgr2=0x7ff008148d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:28.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.808+0000 7ff007fff700 1 --2- 172.21.15.45:0/698724372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff008159a30 0x7ff008148d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:28.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.808+0000 7ff007fff700 1 -- 172.21.15.45:0/698724372 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff8009520 con 0x7ff008072230 2023-10-08T12:46:28.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.808+0000 7ff007fff700 1 --2- 172.21.15.45:0/698724372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff008072230 0x7ff0080c83c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7feff8009230 tx=0x7feff800f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:28.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.808+0000 7ff004ff9700 1 -- 172.21.15.45:0/698724372 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff800fb10 con 0x7ff008072230 2023-10-08T12:46:28.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.808+0000 7ff00e2ac700 1 -- 172.21.15.45:0/698724372 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0080af680 con 0x7ff008072230 2023-10-08T12:46:28.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.808+0000 7ff004ff9700 1 -- 172.21.15.45:0/698724372 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7feff800fd80 con 0x7ff008072230 2023-10-08T12:46:28.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.808+0000 7ff004ff9700 1 -- 172.21.15.45:0/698724372 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff8020670 con 0x7ff008072230 2023-10-08T12:46:28.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.808+0000 7ff00e2ac700 1 -- 172.21.15.45:0/698724372 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0081492d0 con 0x7ff008072230 2023-10-08T12:46:28.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.809+0000 7ff00e2ac700 1 -- 172.21.15.45:0/698724372 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0080af8c0 con 0x7ff008072230 2023-10-08T12:46:28.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.810+0000 7ff004ff9700 1 -- 172.21.15.45:0/698724372 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7feff8017400 con 0x7ff008072230 2023-10-08T12:46:28.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.810+0000 7ff004ff9700 1 --2- 172.21.15.45:0/698724372 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7feff406aed0 0x7feff406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:28.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.810+0000 7ff004ff9700 1 -- 172.21.15.45:0/698724372 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feff808a650 con 0x7ff008072230 2023-10-08T12:46:28.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.810+0000 7ff0077fe700 1 --2- 172.21.15.45:0/698724372 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7feff406aed0 0x7feff406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:28.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.811+0000 7ff0077fe700 1 --2- 172.21.15.45:0/698724372 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7feff406aed0 0x7feff406d390 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff0080c9cb0 tx=0x7feffc007db0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:28.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:28.814+0000 7ff004ff9700 1 -- 172.21.15.45:0/698724372 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feff8055710 con 0x7ff008072230 2023-10-08T12:46:29.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.060+0000 7ff00e2ac700 1 -- 172.21.15.45:0/698724372 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff00806c2b0 con 0x7ff008072230 2023-10-08T12:46:29.507 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-10-08T12:46:29.506+0000 7f00eab79700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T12:46:29.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.654+0000 7ff004ff9700 1 -- 172.21.15.45:0/698724372 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7feff8058d30 con 0x7ff008072230 2023-10-08T12:46:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.657+0000 7ff00e2ac700 1 -- 172.21.15.45:0/698724372 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7feff406aed0 msgr2=0x7feff406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.657+0000 7ff00e2ac700 1 --2- 172.21.15.45:0/698724372 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7feff406aed0 0x7feff406d390 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff0080c9cb0 tx=0x7feffc007db0 comp rx=0 tx=0).stop 2023-10-08T12:46:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.657+0000 7ff00e2ac700 1 -- 172.21.15.45:0/698724372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff008072230 msgr2=0x7ff0080c83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.657+0000 7ff00e2ac700 1 --2- 172.21.15.45:0/698724372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff008072230 0x7ff0080c83c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7feff8009230 tx=0x7feff800f710 comp rx=0 tx=0).stop 2023-10-08T12:46:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.657+0000 7ff00e2ac700 1 -- 172.21.15.45:0/698724372 shutdown_connections 2023-10-08T12:46:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.657+0000 7ff00e2ac700 1 --2- 172.21.15.45:0/698724372 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7feff406aed0 0x7feff406d390 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.657+0000 7ff00e2ac700 1 --2- 172.21.15.45:0/698724372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff008159a30 0x7ff008148d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.657+0000 7ff00e2ac700 1 --2- 172.21.15.45:0/698724372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff008072230 0x7ff0080c83c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.657+0000 7ff00e2ac700 1 --2- 172.21.15.45:0/698724372 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff0080ce020 0x7ff0080c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:29.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.657+0000 7ff00e2ac700 1 -- 172.21.15.45:0/698724372 >> 172.21.15.45:0/698724372 conn(0x7ff00806b320 msgr2=0x7ff00806d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:29.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.657+0000 7ff00e2ac700 1 -- 172.21.15.45:0/698724372 shutdown_connections 2023-10-08T12:46:29.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.657+0000 7ff00e2ac700 1 -- 172.21.15.45:0/698724372 wait complete. 2023-10-08T12:46:29.673 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-08T12:46:29.674 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:46:29.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.812+0000 7fcf4be27700 1 -- 172.21.15.45:0/3311439816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf30003a00 msgr2=0x7fcf30003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:29.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.812+0000 7fcf4be27700 1 --2- 172.21.15.45:0/3311439816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf30003a00 0x7fcf30003e20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fcf34009be0 tx=0x7fcf30005880 comp rx=0 tx=0).stop 2023-10-08T12:46:29.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.812+0000 7fcf4be27700 1 -- 172.21.15.45:0/3311439816 shutdown_connections 2023-10-08T12:46:29.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.812+0000 7fcf4be27700 1 --2- 172.21.15.45:0/3311439816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf30003a00 0x7fcf30003e20 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:29.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.812+0000 7fcf4be27700 1 -- 172.21.15.45:0/3311439816 >> 172.21.15.45:0/3311439816 conn(0x7fcf440b0430 msgr2=0x7fcf440b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:29.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.812+0000 7fcf4be27700 1 -- 172.21.15.45:0/3311439816 shutdown_connections 2023-10-08T12:46:29.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.812+0000 7fcf4be27700 1 -- 172.21.15.45:0/3311439816 wait complete. 2023-10-08T12:46:29.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.813+0000 7fcf4be27700 1 Processor -- start 2023-10-08T12:46:29.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.813+0000 7fcf4be27700 1 -- start start 2023-10-08T12:46:29.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.814+0000 7fcf4be27700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcf30003a00 0x7fcf4413c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:29.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.814+0000 7fcf4be27700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf4414e850 0x7fcf4413f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:29.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.814+0000 7fcf4be27700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf440ccf60 0x7fcf440c4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:29.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.814+0000 7fcf4be27700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf440ce4a0 con 0x7fcf4414e850 2023-10-08T12:46:29.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.814+0000 7fcf4be27700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf440c7110 con 0x7fcf440ccf60 2023-10-08T12:46:29.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.814+0000 7fcf4be27700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4413cc80 con 0x7fcf30003a00 2023-10-08T12:46:29.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.814+0000 7fcf493c2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf4414e850 0x7fcf4413f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:29.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.814+0000 7fcf493c2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf4414e850 0x7fcf4413f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36980/0 (socket says 172.21.15.45:36980) 2023-10-08T12:46:29.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.814+0000 7fcf493c2700 1 -- 172.21.15.45:0/2310091676 learned_addr learned my addr 172.21.15.45:0/2310091676 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:29.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.814+0000 7fcf4a3c4700 1 --2- 172.21.15.45:0/2310091676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf440ccf60 0x7fcf440c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:29.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.814+0000 7fcf49bc3700 1 --2- 172.21.15.45:0/2310091676 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcf30003a00 0x7fcf4413c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:29.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.814+0000 7fcf493c2700 1 -- 172.21.15.45:0/2310091676 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcf30003a00 msgr2=0x7fcf4413c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:29.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.814+0000 7fcf493c2700 1 --2- 172.21.15.45:0/2310091676 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcf30003a00 0x7fcf4413c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:29.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.814+0000 7fcf493c2700 1 -- 172.21.15.45:0/2310091676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf440ccf60 msgr2=0x7fcf440c4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:29.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.814+0000 7fcf493c2700 1 --2- 172.21.15.45:0/2310091676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf440ccf60 0x7fcf440c4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:29.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.814+0000 7fcf493c2700 1 -- 172.21.15.45:0/2310091676 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4415bca0 con 0x7fcf4414e850 2023-10-08T12:46:29.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.814+0000 7fcf493c2700 1 --2- 172.21.15.45:0/2310091676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf4414e850 0x7fcf4413f180 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fcf40004df0 tx=0x7fcf40001540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:29.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.815+0000 7fcf3a7fc700 1 -- 172.21.15.45:0/2310091676 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf40011660 con 0x7fcf4414e850 2023-10-08T12:46:29.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.815+0000 7fcf3a7fc700 1 -- 172.21.15.45:0/2310091676 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcf400118b0 con 0x7fcf4414e850 2023-10-08T12:46:29.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.815+0000 7fcf4be27700 1 -- 172.21.15.45:0/2310091676 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf4415b6e0 con 0x7fcf4414e850 2023-10-08T12:46:29.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.815+0000 7fcf3a7fc700 1 -- 172.21.15.45:0/2310091676 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf40011c80 con 0x7fcf4414e850 2023-10-08T12:46:29.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.815+0000 7fcf4be27700 1 -- 172.21.15.45:0/2310091676 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf440c7340 con 0x7fcf4414e850 2023-10-08T12:46:29.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.816+0000 7fcf4be27700 1 -- 172.21.15.45:0/2310091676 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf4406c2f0 con 0x7fcf4414e850 2023-10-08T12:46:29.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.816+0000 7fcf3a7fc700 1 -- 172.21.15.45:0/2310091676 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcf4001b460 con 0x7fcf4414e850 2023-10-08T12:46:29.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.816+0000 7fcf3a7fc700 1 --2- 172.21.15.45:0/2310091676 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fcf2806aed0 0x7fcf2806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:29.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.817+0000 7fcf3a7fc700 1 -- 172.21.15.45:0/2310091676 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf40089e50 con 0x7fcf4414e850 2023-10-08T12:46:29.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.817+0000 7fcf49bc3700 1 --2- 172.21.15.45:0/2310091676 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fcf2806aed0 0x7fcf2806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:29.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.817+0000 7fcf49bc3700 1 --2- 172.21.15.45:0/2310091676 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fcf2806aed0 0x7fcf2806d390 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcf34009be0 tx=0x7fcf34004750 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:29.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:29.821+0000 7fcf3a7fc700 1 -- 172.21.15.45:0/2310091676 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcf40054f00 con 0x7fcf4414e850 2023-10-08T12:46:30.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.069+0000 7fcf4be27700 1 -- 172.21.15.45:0/2310091676 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf4404e4c0 con 0x7fcf4414e850 2023-10-08T12:46:30.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.070+0000 7fcf3a7fc700 1 -- 172.21.15.45:0/2310091676 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4907 (secure 0 0 0) 0x7fcf40058520 con 0x7fcf4414e850 2023-10-08T12:46:30.071 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:46:30.071 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4775,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/415745376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":415745376},{"type":"v1","addr":"172.21.15.78:6836","nonce":415745376}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/4017051943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":4017051943},{"type":"v1","addr":"172.21.15.78:6837","nonce":4017051943}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4784,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2071345881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2071345881},{"type":"v1","addr":"172.21.15.45:6835","nonce":2071345881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T12:46:26.025761+0000","modified":"2023-10-08T12:46:29.062189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5041},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5041":{"gid":5041,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6834/328442803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":328442803},{"type":"v1","addr":"172.21.15.45:6834","nonce":328442803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-08T12:46:30.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.072+0000 7fcf4be27700 1 -- 172.21.15.45:0/2310091676 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fcf2806aed0 msgr2=0x7fcf2806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:30.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.072+0000 7fcf4be27700 1 --2- 172.21.15.45:0/2310091676 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fcf2806aed0 0x7fcf2806d390 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcf34009be0 tx=0x7fcf34004750 comp rx=0 tx=0).stop 2023-10-08T12:46:30.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.072+0000 7fcf4be27700 1 -- 172.21.15.45:0/2310091676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf4414e850 msgr2=0x7fcf4413f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:30.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.072+0000 7fcf4be27700 1 --2- 172.21.15.45:0/2310091676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf4414e850 0x7fcf4413f180 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fcf40004df0 tx=0x7fcf40001540 comp rx=0 tx=0).stop 2023-10-08T12:46:30.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.072+0000 7fcf4be27700 1 -- 172.21.15.45:0/2310091676 shutdown_connections 2023-10-08T12:46:30.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.072+0000 7fcf4be27700 1 --2- 172.21.15.45:0/2310091676 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fcf2806aed0 0x7fcf2806d390 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:30.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.072+0000 7fcf4be27700 1 --2- 172.21.15.45:0/2310091676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf440ccf60 0x7fcf440c4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:30.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.072+0000 7fcf4be27700 1 --2- 172.21.15.45:0/2310091676 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcf30003a00 0x7fcf4413c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:30.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.072+0000 7fcf4be27700 1 --2- 172.21.15.45:0/2310091676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf4414e850 0x7fcf4413f180 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:30.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.072+0000 7fcf4be27700 1 -- 172.21.15.45:0/2310091676 >> 172.21.15.45:0/2310091676 conn(0x7fcf440b0430 msgr2=0x7fcf4406a210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:30.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.072+0000 7fcf4be27700 1 -- 172.21.15.45:0/2310091676 shutdown_connections 2023-10-08T12:46:30.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.072+0000 7fcf4be27700 1 -- 172.21.15.45:0/2310091676 wait complete. 2023-10-08T12:46:30.074 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2023-10-08T12:46:30.085 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:46:30.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.213+0000 7fec43991700 1 -- 172.21.15.45:0/199409296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec3c159960 msgr2=0x7fec3c0b1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:30.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.213+0000 7fec43991700 1 --2- 172.21.15.45:0/199409296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec3c159960 0x7fec3c0b1730 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fec38005fd0 tx=0x7fec38009c70 comp rx=0 tx=0).stop 2023-10-08T12:46:30.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.213+0000 7fec43991700 1 -- 172.21.15.45:0/199409296 shutdown_connections 2023-10-08T12:46:30.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.213+0000 7fec43991700 1 --2- 172.21.15.45:0/199409296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec3c159960 0x7fec3c0b1730 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:30.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.213+0000 7fec43991700 1 --2- 172.21.15.45:0/199409296 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fec3c0b3fb0 0x7fec3c0b4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:30.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.213+0000 7fec43991700 1 -- 172.21.15.45:0/199409296 >> 172.21.15.45:0/199409296 conn(0x7fec3c0b0430 msgr2=0x7fec3c0b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:30.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.213+0000 7fec43991700 1 -- 172.21.15.45:0/199409296 shutdown_connections 2023-10-08T12:46:30.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.213+0000 7fec43991700 1 -- 172.21.15.45:0/199409296 wait complete. 2023-10-08T12:46:30.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.214+0000 7fec43991700 1 Processor -- start 2023-10-08T12:46:30.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.214+0000 7fec43991700 1 -- start start 2023-10-08T12:46:30.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.215+0000 7fec43991700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec3c06a210 0x7fec3c1f5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:30.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.215+0000 7fec43991700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fec3c0b3fb0 0x7fec3c0ac570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:30.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.215+0000 7fec43991700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec3c159960 0x7fec3c06d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:30.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.215+0000 7fec43991700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c0aa8a0 con 0x7fec3c06a210 2023-10-08T12:46:30.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.215+0000 7fec43991700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c0cd620 con 0x7fec3c159960 2023-10-08T12:46:30.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.215+0000 7fec43991700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c1f6510 con 0x7fec3c0b3fb0 2023-10-08T12:46:30.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.215+0000 7fec4172d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec3c06a210 0x7fec3c1f5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:30.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.215+0000 7fec4172d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec3c06a210 0x7fec3c1f5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36992/0 (socket says 172.21.15.45:36992) 2023-10-08T12:46:30.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.215+0000 7fec4172d700 1 -- 172.21.15.45:0/172634801 learned_addr learned my addr 172.21.15.45:0/172634801 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:30.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.215+0000 7fec40f2c700 1 --2- 172.21.15.45:0/172634801 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fec3c0b3fb0 0x7fec3c0ac570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:30.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.215+0000 7fec41f2e700 1 --2- 172.21.15.45:0/172634801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec3c159960 0x7fec3c06d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:30.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.215+0000 7fec4172d700 1 -- 172.21.15.45:0/172634801 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fec3c0b3fb0 msgr2=0x7fec3c0ac570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:30.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.215+0000 7fec4172d700 1 --2- 172.21.15.45:0/172634801 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fec3c0b3fb0 0x7fec3c0ac570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:30.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.215+0000 7fec4172d700 1 -- 172.21.15.45:0/172634801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec3c159960 msgr2=0x7fec3c06d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:30.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.215+0000 7fec4172d700 1 --2- 172.21.15.45:0/172634801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec3c159960 0x7fec3c06d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:30.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.215+0000 7fec4172d700 1 -- 172.21.15.45:0/172634801 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec380095f0 con 0x7fec3c06a210 2023-10-08T12:46:30.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.215+0000 7fec4172d700 1 --2- 172.21.15.45:0/172634801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec3c06a210 0x7fec3c1f5fd0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fec3800b540 tx=0x7fec38004b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:30.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.215+0000 7fec2dffb700 1 -- 172.21.15.45:0/172634801 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3801c070 con 0x7fec3c06a210 2023-10-08T12:46:30.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.215+0000 7fec2dffb700 1 -- 172.21.15.45:0/172634801 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fec38004260 con 0x7fec3c06a210 2023-10-08T12:46:30.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.215+0000 7fec43991700 1 -- 172.21.15.45:0/172634801 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec3c1f2500 con 0x7fec3c06a210 2023-10-08T12:46:30.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.216+0000 7fec2dffb700 1 -- 172.21.15.45:0/172634801 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec38003680 con 0x7fec3c06a210 2023-10-08T12:46:30.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.216+0000 7fec43991700 1 -- 172.21.15.45:0/172634801 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec3c1f2ac0 con 0x7fec3c06a210 2023-10-08T12:46:30.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.217+0000 7fec43991700 1 -- 172.21.15.45:0/172634801 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec3c0aaa50 con 0x7fec3c06a210 2023-10-08T12:46:30.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.217+0000 7fec2dffb700 1 -- 172.21.15.45:0/172634801 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fec380037e0 con 0x7fec3c06a210 2023-10-08T12:46:30.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.217+0000 7fec2dffb700 1 --2- 172.21.15.45:0/172634801 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fec2006aed0 0x7fec2006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:30.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.218+0000 7fec2dffb700 1 -- 172.21.15.45:0/172634801 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec3808ab60 con 0x7fec3c06a210 2023-10-08T12:46:30.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.218+0000 7fec40f2c700 1 --2- 172.21.15.45:0/172634801 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fec2006aed0 0x7fec2006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:30.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.218+0000 7fec40f2c700 1 --2- 172.21.15.45:0/172634801 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fec2006aed0 0x7fec2006d390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fec30005fd0 tx=0x7fec3000a560 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:30.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.222+0000 7fec2dffb700 1 -- 172.21.15.45:0/172634801 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fec3c0aaa50 con 0x7fec3c06a210 2023-10-08T12:46:30.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.423+0000 7fec43991700 1 -- 172.21.15.45:0/172634801 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec3c0aaa50 con 0x7fec3c06a210 2023-10-08T12:46:30.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.424+0000 7fec2dffb700 1 -- 172.21.15.45:0/172634801 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16521 (secure 0 0 0) 0x7fec3c0aaa50 con 0x7fec3c06a210 2023-10-08T12:46:30.425 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:46:30.425 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":33,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:46:27.627861+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:45:19.183651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:46:24.050213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T12:46:25.003094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.412453+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.351925+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.428025+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.437246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.441119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.388608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.415524+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.401835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:46:30.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.426+0000 7fec43991700 1 -- 172.21.15.45:0/172634801 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fec2006aed0 msgr2=0x7fec2006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:30.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.426+0000 7fec43991700 1 --2- 172.21.15.45:0/172634801 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fec2006aed0 0x7fec2006d390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fec30005fd0 tx=0x7fec3000a560 comp rx=0 tx=0).stop 2023-10-08T12:46:30.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.426+0000 7fec43991700 1 -- 172.21.15.45:0/172634801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec3c06a210 msgr2=0x7fec3c1f5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:30.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.426+0000 7fec43991700 1 --2- 172.21.15.45:0/172634801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec3c06a210 0x7fec3c1f5fd0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fec3800b540 tx=0x7fec38004b10 comp rx=0 tx=0).stop 2023-10-08T12:46:30.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.426+0000 7fec43991700 1 -- 172.21.15.45:0/172634801 shutdown_connections 2023-10-08T12:46:30.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.426+0000 7fec43991700 1 --2- 172.21.15.45:0/172634801 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fec2006aed0 0x7fec2006d390 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:30.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.426+0000 7fec43991700 1 --2- 172.21.15.45:0/172634801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec3c159960 0x7fec3c06d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:30.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.426+0000 7fec43991700 1 --2- 172.21.15.45:0/172634801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec3c06a210 0x7fec3c1f5fd0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:30.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.426+0000 7fec43991700 1 --2- 172.21.15.45:0/172634801 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fec3c0b3fb0 0x7fec3c0ac570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:30.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.426+0000 7fec43991700 1 -- 172.21.15.45:0/172634801 >> 172.21.15.45:0/172634801 conn(0x7fec3c0b0430 msgr2=0x7fec3c0c7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:30.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.426+0000 7fec43991700 1 -- 172.21.15.45:0/172634801 shutdown_connections 2023-10-08T12:46:30.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.426+0000 7fec43991700 1 -- 172.21.15.45:0/172634801 wait complete. 2023-10-08T12:46:30.439 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T12:46:30.439 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T12:46:30.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.566+0000 7f1b72e5b700 1 -- 172.21.15.45:0/2059624779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b6c0cc990 msgr2=0x7f1b6c0d0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:30.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.566+0000 7f1b72e5b700 1 --2- 172.21.15.45:0/2059624779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b6c0cc990 0x7f1b6c0d0d80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c0b4500 tx=0x7f1b60009c70 comp rx=0 tx=0).stop 2023-10-08T12:46:30.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.566+0000 7f1b72e5b700 1 -- 172.21.15.45:0/2059624779 shutdown_connections 2023-10-08T12:46:30.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.566+0000 7f1b72e5b700 1 --2- 172.21.15.45:0/2059624779 >> v2:172.21.15.78:3300/0 conn(0x7f1b6c0b5020 0x7f1b6c0b54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:30.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.566+0000 7f1b72e5b700 1 --2- 172.21.15.45:0/2059624779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b6c0cc990 0x7f1b6c0d0d80 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:30.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.566+0000 7f1b72e5b700 1 -- 172.21.15.45:0/2059624779 >> 172.21.15.45:0/2059624779 conn(0x7f1b6c071940 msgr2=0x7f1b6c071d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:30.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.566+0000 7f1b72e5b700 1 -- 172.21.15.45:0/2059624779 shutdown_connections 2023-10-08T12:46:30.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.566+0000 7f1b72e5b700 1 -- 172.21.15.45:0/2059624779 wait complete. 2023-10-08T12:46:30.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.567+0000 7f1b72e5b700 1 Processor -- start 2023-10-08T12:46:30.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.567+0000 7f1b72e5b700 1 -- start start 2023-10-08T12:46:30.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.568+0000 7f1b72e5b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b6c0b5020 0x7f1b6c0c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:30.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.568+0000 7f1b72e5b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b6c0cc990 0x7f1b6c0c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:30.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.568+0000 7f1b72e5b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1b6c0ccd70 0x7f1b6c145810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:30.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.568+0000 7f1b72e5b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c0c9480 con 0x7f1b6c0b5020 2023-10-08T12:46:30.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.568+0000 7f1b72e5b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c0c9730 con 0x7f1b6c0cc990 2023-10-08T12:46:30.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.568+0000 7f1b72e5b700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c0c9a10 con 0x7f1b6c0ccd70 2023-10-08T12:46:30.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.568+0000 7f1b70bf7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b6c0b5020 0x7f1b6c0c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:30.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.568+0000 7f1b70bf7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b6c0b5020 0x7f1b6c0c8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37006/0 (socket says 172.21.15.45:37006) 2023-10-08T12:46:30.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.568+0000 7f1b70bf7700 1 -- 172.21.15.45:0/2536427048 learned_addr learned my addr 172.21.15.45:0/2536427048 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:30.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.568+0000 7f1b713f8700 1 --2- 172.21.15.45:0/2536427048 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1b6c0ccd70 0x7f1b6c145810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:30.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.568+0000 7f1b6bfff700 1 --2- 172.21.15.45:0/2536427048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b6c0cc990 0x7f1b6c0c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:30.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.568+0000 7f1b70bf7700 1 -- 172.21.15.45:0/2536427048 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1b6c0ccd70 msgr2=0x7f1b6c145810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:30.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.568+0000 7f1b70bf7700 1 --2- 172.21.15.45:0/2536427048 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1b6c0ccd70 0x7f1b6c145810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:30.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.568+0000 7f1b70bf7700 1 -- 172.21.15.45:0/2536427048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b6c0cc990 msgr2=0x7f1b6c0c8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:30.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.568+0000 7f1b70bf7700 1 --2- 172.21.15.45:0/2536427048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b6c0cc990 0x7f1b6c0c8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:30.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.568+0000 7f1b70bf7700 1 -- 172.21.15.45:0/2536427048 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b600095f0 con 0x7f1b6c0b5020 2023-10-08T12:46:30.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.568+0000 7f1b713f8700 1 --2- 172.21.15.45:0/2536427048 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1b6c0ccd70 0x7f1b6c145810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:46:30.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.568+0000 7f1b6bfff700 1 --2- 172.21.15.45:0/2536427048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b6c0cc990 0x7f1b6c0c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:46:30.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.569+0000 7f1b70bf7700 1 --2- 172.21.15.45:0/2536427048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b6c0b5020 0x7f1b6c0c8a00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1b600098e0 tx=0x7f1b6000be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:30.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.569+0000 7f1b697fa700 1 -- 172.21.15.45:0/2536427048 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6001d070 con 0x7f1b6c0b5020 2023-10-08T12:46:30.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.569+0000 7f1b697fa700 1 -- 172.21.15.45:0/2536427048 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1b60003910 con 0x7f1b6c0b5020 2023-10-08T12:46:30.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.569+0000 7f1b72e5b700 1 -- 172.21.15.45:0/2536427048 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b6c0c9cf0 con 0x7f1b6c0b5020 2023-10-08T12:46:30.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.569+0000 7f1b697fa700 1 -- 172.21.15.45:0/2536427048 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b60003d00 con 0x7f1b6c0b5020 2023-10-08T12:46:30.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.569+0000 7f1b72e5b700 1 -- 172.21.15.45:0/2536427048 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b6c0ca2b0 con 0x7f1b6c0b5020 2023-10-08T12:46:30.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.570+0000 7f1b72e5b700 1 -- 172.21.15.45:0/2536427048 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b6c1437c0 con 0x7f1b6c0b5020 2023-10-08T12:46:30.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.570+0000 7f1b697fa700 1 -- 172.21.15.45:0/2536427048 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1b60022470 con 0x7f1b6c0b5020 2023-10-08T12:46:30.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.571+0000 7f1b697fa700 1 --2- 172.21.15.45:0/2536427048 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f1b5006aed0 0x7f1b5006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:30.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.571+0000 7f1b697fa700 1 -- 172.21.15.45:0/2536427048 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b6008af50 con 0x7f1b6c0b5020 2023-10-08T12:46:30.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.571+0000 7f1b6bfff700 1 --2- 172.21.15.45:0/2536427048 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f1b5006aed0 0x7f1b5006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:30.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.571+0000 7f1b6bfff700 1 --2- 172.21.15.45:0/2536427048 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f1b5006aed0 0x7f1b5006d390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c0ca910 tx=0x7f1b58009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:30.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.575+0000 7f1b697fa700 1 -- 172.21.15.45:0/2536427048 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1b6c1437c0 con 0x7f1b6c0b5020 2023-10-08T12:46:30.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.773+0000 7f1b72e5b700 1 -- 172.21.15.45:0/2536427048 --> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1b6c0d1f10 con 0x7f1b5006aed0 2023-10-08T12:46:30.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.781+0000 7f1b697fa700 1 -- 172.21.15.45:0/2536427048 <== mgr.4105 v2:172.21.15.78:6832/3438117854 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274866 (secure 0 0 0) 0x7f1b58001cc0 con 0x7f1b5006aed0 2023-10-08T12:46:30.785 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:46:30.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.784+0000 7f1b72e5b700 1 -- 172.21.15.45:0/2536427048 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f1b5006aed0 msgr2=0x7f1b5006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:30.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.784+0000 7f1b72e5b700 1 --2- 172.21.15.45:0/2536427048 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f1b5006aed0 0x7f1b5006d390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c0ca910 tx=0x7f1b58009040 comp rx=0 tx=0).stop 2023-10-08T12:46:30.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.784+0000 7f1b72e5b700 1 -- 172.21.15.45:0/2536427048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b6c0b5020 msgr2=0x7f1b6c0c8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:30.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.784+0000 7f1b72e5b700 1 --2- 172.21.15.45:0/2536427048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b6c0b5020 0x7f1b6c0c8a00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1b600098e0 tx=0x7f1b6000be90 comp rx=0 tx=0).stop 2023-10-08T12:46:30.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.784+0000 7f1b72e5b700 1 -- 172.21.15.45:0/2536427048 shutdown_connections 2023-10-08T12:46:30.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.784+0000 7f1b72e5b700 1 --2- 172.21.15.45:0/2536427048 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f1b5006aed0 0x7f1b5006d390 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:30.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.785+0000 7f1b72e5b700 1 --2- 172.21.15.45:0/2536427048 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1b6c0ccd70 0x7f1b6c145810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:30.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.785+0000 7f1b72e5b700 1 --2- 172.21.15.45:0/2536427048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b6c0b5020 0x7f1b6c0c8a00 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:30.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.785+0000 7f1b72e5b700 1 --2- 172.21.15.45:0/2536427048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b6c0cc990 0x7f1b6c0c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:30.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.785+0000 7f1b72e5b700 1 -- 172.21.15.45:0/2536427048 >> 172.21.15.45:0/2536427048 conn(0x7f1b6c071940 msgr2=0x7f1b6c15df70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:30.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.785+0000 7f1b72e5b700 1 -- 172.21.15.45:0/2536427048 shutdown_connections 2023-10-08T12:46:30.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.785+0000 7f1b72e5b700 1 -- 172.21.15.45:0/2536427048 wait complete. 2023-10-08T12:46:30.788 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-08T12:46:30.797 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2023-10-08T12:46:29.142897+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219908,"kb_used_data":3688,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754812,"statfs":{"total":773094113280,"available":772868927488,"internally_reserved":0,"allocated":3776512,"data_stored":2156816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.541048"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:25.600794+0000","last_change":"2023-10-08T12:46:25.600794+0000","last_active":"2023-10-08T12:46:25.600794+0000","last_peered":"2023-10-08T12:46:25.600794+0000","last_clean":"2023-10-08T12:46:25.600794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:25.600794+0000","last_undegraded":"2023-10-08T12:46:25.600794+0000","last_fullsized":"2023-10-08T12:46:25.600794+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T12:46:24.598773+0000","last_change":"2023-10-08T12:46:24.598773+0000","last_active":"2023-10-08T12:46:24.598773+0000","last_peered":"2023-10-08T12:46:24.598773+0000","last_clean":"2023-10-08T12:46:24.598773+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T12:46:24.598773+0000","last_undegraded":"2023-10-08T12:46:24.598773+0000","last_fullsized":"2023-10-08T12:46:24.598773+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":171,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-08T12:46:18.590522+0000","last_change":"2023-10-08T12:45:21.094571+0000","last_active":"2023-10-08T12:46:18.590522+0000","last_peered":"2023-10-08T12:46:18.590522+0000","last_clean":"2023-10-08T12:46:18.590522+0000","last_became_active":"2023-10-08T12:45:21.093551+0000","last_became_peered":"2023-10-08T12:45:21.093551+0000","last_unstale":"2023-10-08T12:46:18.590522+0000","last_undegraded":"2023-10-08T12:46:18.590522+0000","last_fullsized":"2023-10-08T12:46:18.590522+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:19.842786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:19.842786+0000","last_clean_scrub_stamp":"2023-10-08T12:45:19.842786+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:25.041743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":917504,"data_stored":712378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.38900000000000001}]},{"osd":1,"last update":"Sun Oct 8 12:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.55800000000000005}]},{"osd":2,"last update":"Sun Oct 8 12:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.61099999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.499}]},{"osd":4,"last update":"Sun Oct 8 12:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.435},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.54300000000000004}]},{"osd":5,"last update":"Sun Oct 8 12:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.63}]},{"osd":6,"last update":"Sun Oct 8 12:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.57399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":122010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.64500000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.623},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.60999999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56200000000000006}]},{"osd":3,"last update":"Sun Oct 8 12:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.70999999999999996}]},{"osd":4,"last update":"Sun Oct 8 12:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.58599999999999997}]},{"osd":5,"last update":"Sun Oct 8 12:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.53500000000000003}]},{"osd":7,"last update":"Sun Oct 8 12:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.47999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27348,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":323584,"data_stored":122010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.245},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.30099999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.318}]},{"osd":3,"last update":"Sun Oct 8 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.34999999999999998}]},{"osd":4,"last update":"Sun Oct 8 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.57299999999999995}]},{"osd":5,"last update":"Sun Oct 8 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.8450000000000002,"5min":2.8450000000000002,"15min":2.8450000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.53800000000000003}]},{"osd":6,"last update":"Sun Oct 8 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.46600000000000003}]},{"osd":7,"last update":"Sun Oct 8 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.47899999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":712378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.25900000000000001}]},{"osd":2,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.433,"5min":0.433,"15min":0.433},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.34000000000000002}]},{"osd":3,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.35299999999999998}]},{"osd":4,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.505},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.46600000000000003}]},{"osd":5,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.60399999999999998}]},{"osd":6,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.496},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.56000000000000005}]},{"osd":7,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.51600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27348,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":323584,"data_stored":122010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.39400000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.42499999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.40899999999999997}]},{"osd":4,"last update":"Sun Oct 8 12:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.622},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.745}]},{"osd":5,"last update":"Sun Oct 8 12:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.68899999999999995}]},{"osd":6,"last update":"Sun Oct 8 12:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.60099999999999998}]},{"osd":7,"last update":"Sun Oct 8 12:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":2.569,"5min":2.569,"15min":2.569},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.67900000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":122010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":3.222,"5min":3.222,"15min":3.222},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":0.34799999999999998}]},{"osd":1,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":3.2629999999999999,"5min":3.2629999999999999,"15min":3.2629999999999999},"last":0.44700000000000001}]},{"osd":2,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.36499999999999999}]},{"osd":4,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":3.3130000000000002,"5min":3.3130000000000002,"15min":3.3130000000000002},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":4.5289999999999999,"5min":4.5289999999999999,"15min":4.5289999999999999},"last":0.59999999999999998}]},{"osd":5,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":3.1459999999999999,"5min":3.1459999999999999,"15min":3.1459999999999999},"last":0.628}]},{"osd":6,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":9.5589999999999993,"5min":9.5589999999999993,"15min":9.5589999999999993},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":9.5850000000000009,"5min":9.5850000000000009,"15min":9.5850000000000009},"last":0.498}]},{"osd":7,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":3.1080000000000001,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.51000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27348,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":323584,"data_stored":122010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.33800000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.46200000000000002}]},{"osd":2,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.56100000000000005}]},{"osd":3,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.58099999999999996}]},{"osd":5,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.495},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.53900000000000003}]},{"osd":6,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.624},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.61099999999999999}]},{"osd":7,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.65900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":122010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":4.8289999999999997,"5min":4.8289999999999997,"15min":4.8289999999999997},"last":0.623},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":4.8170000000000002,"5min":4.8170000000000002,"15min":4.8170000000000002},"last":0.60799999999999998}]},{"osd":1,"last update":"Sun Oct 8 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":4.4980000000000002,"5min":4.4980000000000002,"15min":4.4980000000000002},"last":0.371},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":8.4819999999999993,"5min":8.4819999999999993,"15min":8.4819999999999993},"last":0.51700000000000002}]},{"osd":2,"last update":"Sun Oct 8 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.0139999999999998,"5min":3.0139999999999998,"15min":3.0139999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":8.6219999999999999,"5min":8.6219999999999999,"15min":8.6219999999999999},"last":0.54300000000000004}]},{"osd":3,"last update":"Sun Oct 8 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":8.5800000000000001,"5min":8.5800000000000001,"15min":8.5800000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.502}]},{"osd":4,"last update":"Sun Oct 8 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.39700000000000002}]},{"osd":6,"last update":"Sun Oct 8 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.59299999999999997}]},{"osd":7,"last update":"Sun Oct 8 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.56000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:46:30.805 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T12:46:30.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.964+0000 7ff2eed2b700 1 -- 172.21.15.45:0/1259789821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2d8003a00 msgr2=0x7ff2d8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:30.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.964+0000 7ff2eed2b700 1 --2- 172.21.15.45:0/1259789821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2d8003a00 0x7ff2d8003e00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00c780 tx=0x7ff2d8005880 comp rx=0 tx=0).stop 2023-10-08T12:46:30.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.964+0000 7ff2eed2b700 1 -- 172.21.15.45:0/1259789821 shutdown_connections 2023-10-08T12:46:30.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.964+0000 7ff2eed2b700 1 --2- 172.21.15.45:0/1259789821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2d8003a00 0x7ff2d8003e00 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:30.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.964+0000 7ff2eed2b700 1 -- 172.21.15.45:0/1259789821 >> 172.21.15.45:0/1259789821 conn(0x7ff2e80b0430 msgr2=0x7ff2e80b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:30.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.964+0000 7ff2eed2b700 1 -- 172.21.15.45:0/1259789821 shutdown_connections 2023-10-08T12:46:30.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.964+0000 7ff2eed2b700 1 -- 172.21.15.45:0/1259789821 wait complete. 2023-10-08T12:46:30.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.966+0000 7ff2eed2b700 1 Processor -- start 2023-10-08T12:46:30.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.966+0000 7ff2eed2b700 1 -- start start 2023-10-08T12:46:30.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.967+0000 7ff2eed2b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2d8003a00 0x7ff2e81e2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:30.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.967+0000 7ff2eed2b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2e8150260 0x7ff2e81f1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.967+0000 7ff2eed2b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff2e81506e0 0x7ff2e81f1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.967+0000 7ff2eed2b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e814c680 con 0x7ff2d8003a00 2023-10-08T12:46:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.967+0000 7ff2eed2b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e81f22a0 con 0x7ff2e8150260 2023-10-08T12:46:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.967+0000 7ff2eed2b700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e814de30 con 0x7ff2e81506e0 2023-10-08T12:46:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.967+0000 7ff2ecac7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2d8003a00 0x7ff2e81e2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.967+0000 7ff2ecac7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2d8003a00 0x7ff2e81e2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37026/0 (socket says 172.21.15.45:37026) 2023-10-08T12:46:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.967+0000 7ff2ecac7700 1 -- 172.21.15.45:0/982554818 learned_addr learned my addr 172.21.15.45:0/982554818 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.967+0000 7ff2e7fff700 1 --2- 172.21.15.45:0/982554818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2e8150260 0x7ff2e81f1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.967+0000 7ff2ed2c8700 1 --2- 172.21.15.45:0/982554818 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff2e81506e0 0x7ff2e81f1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.967+0000 7ff2ecac7700 1 -- 172.21.15.45:0/982554818 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff2e81506e0 msgr2=0x7ff2e81f1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:30.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.967+0000 7ff2ecac7700 1 --2- 172.21.15.45:0/982554818 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff2e81506e0 0x7ff2e81f1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:30.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.967+0000 7ff2ecac7700 1 -- 172.21.15.45:0/982554818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2e8150260 msgr2=0x7ff2e81f1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:30.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.967+0000 7ff2ecac7700 1 --2- 172.21.15.45:0/982554818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2e8150260 0x7ff2e81f1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:30.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.967+0000 7ff2ecac7700 1 -- 172.21.15.45:0/982554818 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e814e8a0 con 0x7ff2d8003a00 2023-10-08T12:46:30.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.967+0000 7ff2e7fff700 1 --2- 172.21.15.45:0/982554818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2e8150260 0x7ff2e81f1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:46:30.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.968+0000 7ff2ecac7700 1 --2- 172.21.15.45:0/982554818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2d8003a00 0x7ff2e81e2180 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00cd70 tx=0x7ff2dc006640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:30.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.968+0000 7ff2e57fa700 1 -- 172.21.15.45:0/982554818 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc010890 con 0x7ff2d8003a00 2023-10-08T12:46:30.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.968+0000 7ff2e57fa700 1 -- 172.21.15.45:0/982554818 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff2dc0109f0 con 0x7ff2d8003a00 2023-10-08T12:46:30.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.968+0000 7ff2eed2b700 1 -- 172.21.15.45:0/982554818 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e81e3ff0 con 0x7ff2d8003a00 2023-10-08T12:46:30.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.968+0000 7ff2e57fa700 1 -- 172.21.15.45:0/982554818 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc010e00 con 0x7ff2d8003a00 2023-10-08T12:46:30.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.968+0000 7ff2eed2b700 1 -- 172.21.15.45:0/982554818 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e814e380 con 0x7ff2d8003a00 2023-10-08T12:46:30.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.969+0000 7ff2eed2b700 1 -- 172.21.15.45:0/982554818 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e814e540 con 0x7ff2d8003a00 2023-10-08T12:46:30.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.969+0000 7ff2e57fa700 1 -- 172.21.15.45:0/982554818 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff2dc018070 con 0x7ff2d8003a00 2023-10-08T12:46:30.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.970+0000 7ff2e57fa700 1 --2- 172.21.15.45:0/982554818 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7ff2cc06aed0 0x7ff2cc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:30.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.970+0000 7ff2e57fa700 1 -- 172.21.15.45:0/982554818 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2dc08a6c0 con 0x7ff2d8003a00 2023-10-08T12:46:30.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.970+0000 7ff2e7fff700 1 --2- 172.21.15.45:0/982554818 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7ff2cc06aed0 0x7ff2cc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:30.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.970+0000 7ff2e7fff700 1 --2- 172.21.15.45:0/982554818 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7ff2cc06aed0 0x7ff2cc06d390 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4000c00 tx=0x7ff2d40014c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:30.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:30.974+0000 7ff2e57fa700 1 -- 172.21.15.45:0/982554818 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff2dc055800 con 0x7ff2d8003a00 2023-10-08T12:46:31.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.170+0000 7ff2eed2b700 1 -- 172.21.15.45:0/982554818 --> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff2e80c9ff0 con 0x7ff2cc06aed0 2023-10-08T12:46:31.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.178+0000 7ff2e57fa700 1 -- 172.21.15.45:0/982554818 <== mgr.4105 v2:172.21.15.78:6832/3438117854 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289704 (secure 0 0 0) 0x7ff2d4006e10 con 0x7ff2cc06aed0 2023-10-08T12:46:31.182 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:46:31.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.181+0000 7ff2eed2b700 1 -- 172.21.15.45:0/982554818 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7ff2cc06aed0 msgr2=0x7ff2cc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:31.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.181+0000 7ff2eed2b700 1 --2- 172.21.15.45:0/982554818 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7ff2cc06aed0 0x7ff2cc06d390 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4000c00 tx=0x7ff2d40014c0 comp rx=0 tx=0).stop 2023-10-08T12:46:31.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.181+0000 7ff2eed2b700 1 -- 172.21.15.45:0/982554818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2d8003a00 msgr2=0x7ff2e81e2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:31.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.181+0000 7ff2eed2b700 1 --2- 172.21.15.45:0/982554818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2d8003a00 0x7ff2e81e2180 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00cd70 tx=0x7ff2dc006640 comp rx=0 tx=0).stop 2023-10-08T12:46:31.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.181+0000 7ff2eed2b700 1 -- 172.21.15.45:0/982554818 shutdown_connections 2023-10-08T12:46:31.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.181+0000 7ff2eed2b700 1 --2- 172.21.15.45:0/982554818 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7ff2cc06aed0 0x7ff2cc06d390 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:31.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.181+0000 7ff2eed2b700 1 --2- 172.21.15.45:0/982554818 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff2e81506e0 0x7ff2e81f1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:31.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.181+0000 7ff2eed2b700 1 --2- 172.21.15.45:0/982554818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2d8003a00 0x7ff2e81e2180 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:31.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.181+0000 7ff2eed2b700 1 --2- 172.21.15.45:0/982554818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2e8150260 0x7ff2e81f1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:31.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.181+0000 7ff2eed2b700 1 -- 172.21.15.45:0/982554818 >> 172.21.15.45:0/982554818 conn(0x7ff2e80b0430 msgr2=0x7ff2e80b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:31.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.182+0000 7ff2eed2b700 1 -- 172.21.15.45:0/982554818 shutdown_connections 2023-10-08T12:46:31.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.182+0000 7ff2eed2b700 1 -- 172.21.15.45:0/982554818 wait complete. 2023-10-08T12:46:31.185 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-08T12:46:31.194 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2023-10-08T12:46:31.143284+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":157,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220332,"kb_used_data":4136,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754388,"statfs":{"total":773094113280,"available":772868493312,"internally_reserved":0,"allocated":4235264,"data_stored":2362908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001181"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.195996+0000","last_change":"2023-10-08T12:46:26.655796+0000","last_active":"2023-10-08T12:46:28.195996+0000","last_peered":"2023-10-08T12:46:28.195996+0000","last_clean":"2023-10-08T12:46:28.195996+0000","last_became_active":"2023-10-08T12:46:26.655481+0000","last_became_peered":"2023-10-08T12:46:26.655481+0000","last_unstale":"2023-10-08T12:46:28.195996+0000","last_undegraded":"2023-10-08T12:46:28.195996+0000","last_fullsized":"2023-10-08T12:46:28.195996+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:48.332409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.196170+0000","last_change":"2023-10-08T12:46:26.648516+0000","last_active":"2023-10-08T12:46:28.196170+0000","last_peered":"2023-10-08T12:46:28.196170+0000","last_clean":"2023-10-08T12:46:28.196170+0000","last_became_active":"2023-10-08T12:46:26.648238+0000","last_became_peered":"2023-10-08T12:46:26.648238+0000","last_unstale":"2023-10-08T12:46:28.196170+0000","last_undegraded":"2023-10-08T12:46:28.196170+0000","last_fullsized":"2023-10-08T12:46:28.196170+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:00.952819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.634379+0000","last_change":"2023-10-08T12:46:26.647649+0000","last_active":"2023-10-08T12:46:27.634379+0000","last_peered":"2023-10-08T12:46:27.634379+0000","last_clean":"2023-10-08T12:46:27.634379+0000","last_became_active":"2023-10-08T12:46:26.647347+0000","last_became_peered":"2023-10-08T12:46:26.647347+0000","last_unstale":"2023-10-08T12:46:27.634379+0000","last_undegraded":"2023-10-08T12:46:27.634379+0000","last_fullsized":"2023-10-08T12:46:27.634379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:52:16.090427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.195338+0000","last_change":"2023-10-08T12:46:26.650023+0000","last_active":"2023-10-08T12:46:28.195338+0000","last_peered":"2023-10-08T12:46:28.195338+0000","last_clean":"2023-10-08T12:46:28.195338+0000","last_became_active":"2023-10-08T12:46:26.649546+0000","last_became_peered":"2023-10-08T12:46:26.649546+0000","last_unstale":"2023-10-08T12:46:28.195338+0000","last_undegraded":"2023-10-08T12:46:28.195338+0000","last_fullsized":"2023-10-08T12:46:28.195338+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:04:29.405403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.694490+0000","last_change":"2023-10-08T12:46:26.652702+0000","last_active":"2023-10-08T12:46:27.694490+0000","last_peered":"2023-10-08T12:46:27.694490+0000","last_clean":"2023-10-08T12:46:27.694490+0000","last_became_active":"2023-10-08T12:46:26.652188+0000","last_became_peered":"2023-10-08T12:46:26.652188+0000","last_unstale":"2023-10-08T12:46:27.694490+0000","last_undegraded":"2023-10-08T12:46:27.694490+0000","last_fullsized":"2023-10-08T12:46:27.694490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:41:06.961507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.195474+0000","last_change":"2023-10-08T12:46:26.643667+0000","last_active":"2023-10-08T12:46:28.195474+0000","last_peered":"2023-10-08T12:46:28.195474+0000","last_clean":"2023-10-08T12:46:28.195474+0000","last_became_active":"2023-10-08T12:46:26.639076+0000","last_became_peered":"2023-10-08T12:46:26.639076+0000","last_unstale":"2023-10-08T12:46:28.195474+0000","last_undegraded":"2023-10-08T12:46:28.195474+0000","last_fullsized":"2023-10-08T12:46:28.195474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:07:41.211440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.757074+0000","last_change":"2023-10-08T12:46:26.651042+0000","last_active":"2023-10-08T12:46:27.757074+0000","last_peered":"2023-10-08T12:46:27.757074+0000","last_clean":"2023-10-08T12:46:27.757074+0000","last_became_active":"2023-10-08T12:46:26.650719+0000","last_became_peered":"2023-10-08T12:46:26.650719+0000","last_unstale":"2023-10-08T12:46:27.757074+0000","last_undegraded":"2023-10-08T12:46:27.757074+0000","last_fullsized":"2023-10-08T12:46:27.757074+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:25.654810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.756786+0000","last_change":"2023-10-08T12:46:26.653048+0000","last_active":"2023-10-08T12:46:27.756786+0000","last_peered":"2023-10-08T12:46:27.756786+0000","last_clean":"2023-10-08T12:46:27.756786+0000","last_became_active":"2023-10-08T12:46:26.652335+0000","last_became_peered":"2023-10-08T12:46:26.652335+0000","last_unstale":"2023-10-08T12:46:27.756786+0000","last_undegraded":"2023-10-08T12:46:27.756786+0000","last_fullsized":"2023-10-08T12:46:27.756786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:13:20.601129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.635350+0000","last_change":"2023-10-08T12:46:26.653554+0000","last_active":"2023-10-08T12:46:27.635350+0000","last_peered":"2023-10-08T12:46:27.635350+0000","last_clean":"2023-10-08T12:46:27.635350+0000","last_became_active":"2023-10-08T12:46:26.653295+0000","last_became_peered":"2023-10-08T12:46:26.653295+0000","last_unstale":"2023-10-08T12:46:27.635350+0000","last_undegraded":"2023-10-08T12:46:27.635350+0000","last_fullsized":"2023-10-08T12:46:27.635350+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:37:10.116542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.196137+0000","last_change":"2023-10-08T12:46:26.659251+0000","last_active":"2023-10-08T12:46:28.196137+0000","last_peered":"2023-10-08T12:46:28.196137+0000","last_clean":"2023-10-08T12:46:28.196137+0000","last_became_active":"2023-10-08T12:46:26.658904+0000","last_became_peered":"2023-10-08T12:46:26.658904+0000","last_unstale":"2023-10-08T12:46:28.196137+0000","last_undegraded":"2023-10-08T12:46:28.196137+0000","last_fullsized":"2023-10-08T12:46:28.196137+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:23:39.302487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.757187+0000","last_change":"2023-10-08T12:46:26.655196+0000","last_active":"2023-10-08T12:46:27.757187+0000","last_peered":"2023-10-08T12:46:27.757187+0000","last_clean":"2023-10-08T12:46:27.757187+0000","last_became_active":"2023-10-08T12:46:26.654924+0000","last_became_peered":"2023-10-08T12:46:26.654924+0000","last_unstale":"2023-10-08T12:46:27.757187+0000","last_undegraded":"2023-10-08T12:46:27.757187+0000","last_fullsized":"2023-10-08T12:46:27.757187+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:57.451120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.634629+0000","last_change":"2023-10-08T12:46:26.651787+0000","last_active":"2023-10-08T12:46:27.634629+0000","last_peered":"2023-10-08T12:46:27.634629+0000","last_clean":"2023-10-08T12:46:27.634629+0000","last_became_active":"2023-10-08T12:46:26.651499+0000","last_became_peered":"2023-10-08T12:46:26.651499+0000","last_unstale":"2023-10-08T12:46:27.634629+0000","last_undegraded":"2023-10-08T12:46:27.634629+0000","last_fullsized":"2023-10-08T12:46:27.634629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:25.654810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.694614+0000","last_change":"2023-10-08T12:46:26.652490+0000","last_active":"2023-10-08T12:46:27.694614+0000","last_peered":"2023-10-08T12:46:27.694614+0000","last_clean":"2023-10-08T12:46:27.694614+0000","last_became_active":"2023-10-08T12:46:26.651861+0000","last_became_peered":"2023-10-08T12:46:26.651861+0000","last_unstale":"2023-10-08T12:46:27.694614+0000","last_undegraded":"2023-10-08T12:46:27.694614+0000","last_fullsized":"2023-10-08T12:46:27.694614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:33:41.952914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.195552+0000","last_change":"2023-10-08T12:46:26.652564+0000","last_active":"2023-10-08T12:46:28.195552+0000","last_peered":"2023-10-08T12:46:28.195552+0000","last_clean":"2023-10-08T12:46:28.195552+0000","last_became_active":"2023-10-08T12:46:26.652306+0000","last_became_peered":"2023-10-08T12:46:26.652306+0000","last_unstale":"2023-10-08T12:46:28.195552+0000","last_undegraded":"2023-10-08T12:46:28.195552+0000","last_fullsized":"2023-10-08T12:46:28.195552+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:57.451120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.634923+0000","last_change":"2023-10-08T12:46:26.649406+0000","last_active":"2023-10-08T12:46:27.634923+0000","last_peered":"2023-10-08T12:46:27.634923+0000","last_clean":"2023-10-08T12:46:27.634923+0000","last_became_active":"2023-10-08T12:46:26.649163+0000","last_became_peered":"2023-10-08T12:46:26.649163+0000","last_unstale":"2023-10-08T12:46:27.634923+0000","last_undegraded":"2023-10-08T12:46:27.634923+0000","last_fullsized":"2023-10-08T12:46:27.634923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:54:54.327453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.757237+0000","last_change":"2023-10-08T12:46:26.659007+0000","last_active":"2023-10-08T12:46:27.757237+0000","last_peered":"2023-10-08T12:46:27.757237+0000","last_clean":"2023-10-08T12:46:27.757237+0000","last_became_active":"2023-10-08T12:46:26.658731+0000","last_became_peered":"2023-10-08T12:46:26.658731+0000","last_unstale":"2023-10-08T12:46:27.757237+0000","last_undegraded":"2023-10-08T12:46:27.757237+0000","last_fullsized":"2023-10-08T12:46:27.757237+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:56:55.667597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.757227+0000","last_change":"2023-10-08T12:46:26.656371+0000","last_active":"2023-10-08T12:46:27.757227+0000","last_peered":"2023-10-08T12:46:27.757227+0000","last_clean":"2023-10-08T12:46:27.757227+0000","last_became_active":"2023-10-08T12:46:26.656107+0000","last_became_peered":"2023-10-08T12:46:26.656107+0000","last_unstale":"2023-10-08T12:46:27.757227+0000","last_undegraded":"2023-10-08T12:46:27.757227+0000","last_fullsized":"2023-10-08T12:46:27.757227+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:54:54.327453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.196329+0000","last_change":"2023-10-08T12:46:26.659247+0000","last_active":"2023-10-08T12:46:28.196329+0000","last_peered":"2023-10-08T12:46:28.196329+0000","last_clean":"2023-10-08T12:46:28.196329+0000","last_became_active":"2023-10-08T12:46:26.658940+0000","last_became_peered":"2023-10-08T12:46:26.658940+0000","last_unstale":"2023-10-08T12:46:28.196329+0000","last_undegraded":"2023-10-08T12:46:28.196329+0000","last_fullsized":"2023-10-08T12:46:28.196329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:54:15.833161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.196129+0000","last_change":"2023-10-08T12:46:26.659616+0000","last_active":"2023-10-08T12:46:28.196129+0000","last_peered":"2023-10-08T12:46:28.196129+0000","last_clean":"2023-10-08T12:46:28.196129+0000","last_became_active":"2023-10-08T12:46:26.659335+0000","last_became_peered":"2023-10-08T12:46:26.659335+0000","last_unstale":"2023-10-08T12:46:28.196129+0000","last_undegraded":"2023-10-08T12:46:28.196129+0000","last_fullsized":"2023-10-08T12:46:28.196129+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:56:55.667597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.694612+0000","last_change":"2023-10-08T12:46:26.643021+0000","last_active":"2023-10-08T12:46:27.694612+0000","last_peered":"2023-10-08T12:46:27.694612+0000","last_clean":"2023-10-08T12:46:27.694612+0000","last_became_active":"2023-10-08T12:46:26.642099+0000","last_became_peered":"2023-10-08T12:46:26.642099+0000","last_unstale":"2023-10-08T12:46:27.694612+0000","last_undegraded":"2023-10-08T12:46:27.694612+0000","last_fullsized":"2023-10-08T12:46:27.694612+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:56:23.817290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.634846+0000","last_change":"2023-10-08T12:46:26.647226+0000","last_active":"2023-10-08T12:46:27.634846+0000","last_peered":"2023-10-08T12:46:27.634846+0000","last_clean":"2023-10-08T12:46:27.634846+0000","last_became_active":"2023-10-08T12:46:26.646800+0000","last_became_peered":"2023-10-08T12:46:26.646800+0000","last_unstale":"2023-10-08T12:46:27.634846+0000","last_undegraded":"2023-10-08T12:46:27.634846+0000","last_fullsized":"2023-10-08T12:46:27.634846+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:17:38.409486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.635037+0000","last_change":"2023-10-08T12:46:26.641074+0000","last_active":"2023-10-08T12:46:27.635037+0000","last_peered":"2023-10-08T12:46:27.635037+0000","last_clean":"2023-10-08T12:46:27.635037+0000","last_became_active":"2023-10-08T12:46:26.640815+0000","last_became_peered":"2023-10-08T12:46:26.640815+0000","last_unstale":"2023-10-08T12:46:27.635037+0000","last_undegraded":"2023-10-08T12:46:27.635037+0000","last_fullsized":"2023-10-08T12:46:27.635037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:32.523981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.631002+0000","last_change":"2023-10-08T12:46:26.648183+0000","last_active":"2023-10-08T12:46:27.631002+0000","last_peered":"2023-10-08T12:46:27.631002+0000","last_clean":"2023-10-08T12:46:27.631002+0000","last_became_active":"2023-10-08T12:46:26.647898+0000","last_became_peered":"2023-10-08T12:46:26.647898+0000","last_unstale":"2023-10-08T12:46:27.631002+0000","last_undegraded":"2023-10-08T12:46:27.631002+0000","last_fullsized":"2023-10-08T12:46:27.631002+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:04:16.468247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.634255+0000","last_change":"2023-10-08T12:46:26.640383+0000","last_active":"2023-10-08T12:46:27.634255+0000","last_peered":"2023-10-08T12:46:27.634255+0000","last_clean":"2023-10-08T12:46:27.634255+0000","last_became_active":"2023-10-08T12:46:26.640014+0000","last_became_peered":"2023-10-08T12:46:26.640014+0000","last_unstale":"2023-10-08T12:46:27.634255+0000","last_undegraded":"2023-10-08T12:46:27.634255+0000","last_fullsized":"2023-10-08T12:46:27.634255+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:23:39.302487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.195831+0000","last_change":"2023-10-08T12:46:26.647661+0000","last_active":"2023-10-08T12:46:28.195831+0000","last_peered":"2023-10-08T12:46:28.195831+0000","last_clean":"2023-10-08T12:46:28.195831+0000","last_became_active":"2023-10-08T12:46:26.647382+0000","last_became_peered":"2023-10-08T12:46:26.647382+0000","last_unstale":"2023-10-08T12:46:28.195831+0000","last_undegraded":"2023-10-08T12:46:28.195831+0000","last_fullsized":"2023-10-08T12:46:28.195831+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:18.028817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.196353+0000","last_change":"2023-10-08T12:46:26.652710+0000","last_active":"2023-10-08T12:46:28.196353+0000","last_peered":"2023-10-08T12:46:28.196353+0000","last_clean":"2023-10-08T12:46:28.196353+0000","last_became_active":"2023-10-08T12:46:26.649384+0000","last_became_peered":"2023-10-08T12:46:26.649384+0000","last_unstale":"2023-10-08T12:46:28.196353+0000","last_undegraded":"2023-10-08T12:46:28.196353+0000","last_fullsized":"2023-10-08T12:46:28.196353+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:29:31.429041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.195878+0000","last_change":"2023-10-08T12:46:26.652449+0000","last_active":"2023-10-08T12:46:28.195878+0000","last_peered":"2023-10-08T12:46:28.195878+0000","last_clean":"2023-10-08T12:46:28.195878+0000","last_became_active":"2023-10-08T12:46:26.652103+0000","last_became_peered":"2023-10-08T12:46:26.652103+0000","last_unstale":"2023-10-08T12:46:28.195878+0000","last_undegraded":"2023-10-08T12:46:28.195878+0000","last_fullsized":"2023-10-08T12:46:28.195878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:13:20.601129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.634787+0000","last_change":"2023-10-08T12:46:26.654632+0000","last_active":"2023-10-08T12:46:27.634787+0000","last_peered":"2023-10-08T12:46:27.634787+0000","last_clean":"2023-10-08T12:46:27.634787+0000","last_became_active":"2023-10-08T12:46:26.654357+0000","last_became_peered":"2023-10-08T12:46:26.654357+0000","last_unstale":"2023-10-08T12:46:27.634787+0000","last_undegraded":"2023-10-08T12:46:27.634787+0000","last_fullsized":"2023-10-08T12:46:27.634787+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:57.451120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.635225+0000","last_change":"2023-10-08T12:46:26.649703+0000","last_active":"2023-10-08T12:46:27.635225+0000","last_peered":"2023-10-08T12:46:27.635225+0000","last_clean":"2023-10-08T12:46:27.635225+0000","last_became_active":"2023-10-08T12:46:26.649431+0000","last_became_peered":"2023-10-08T12:46:26.649431+0000","last_unstale":"2023-10-08T12:46:27.635225+0000","last_undegraded":"2023-10-08T12:46:27.635225+0000","last_fullsized":"2023-10-08T12:46:27.635225+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:04:16.468247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.756943+0000","last_change":"2023-10-08T12:46:26.651700+0000","last_active":"2023-10-08T12:46:27.756943+0000","last_peered":"2023-10-08T12:46:27.756943+0000","last_clean":"2023-10-08T12:46:27.756943+0000","last_became_active":"2023-10-08T12:46:26.651413+0000","last_became_peered":"2023-10-08T12:46:26.651413+0000","last_unstale":"2023-10-08T12:46:27.756943+0000","last_undegraded":"2023-10-08T12:46:27.756943+0000","last_fullsized":"2023-10-08T12:46:27.756943+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:33.270714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.195922+0000","last_change":"2023-10-08T12:46:26.654591+0000","last_active":"2023-10-08T12:46:28.195922+0000","last_peered":"2023-10-08T12:46:28.195922+0000","last_clean":"2023-10-08T12:46:28.195922+0000","last_became_active":"2023-10-08T12:46:26.654283+0000","last_became_peered":"2023-10-08T12:46:26.654283+0000","last_unstale":"2023-10-08T12:46:28.195922+0000","last_undegraded":"2023-10-08T12:46:28.195922+0000","last_fullsized":"2023-10-08T12:46:28.195922+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:04:16.468247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.757284+0000","last_change":"2023-10-08T12:46:26.653823+0000","last_active":"2023-10-08T12:46:27.757284+0000","last_peered":"2023-10-08T12:46:27.757284+0000","last_clean":"2023-10-08T12:46:27.757284+0000","last_became_active":"2023-10-08T12:46:26.653323+0000","last_became_peered":"2023-10-08T12:46:26.653323+0000","last_unstale":"2023-10-08T12:46:27.757284+0000","last_undegraded":"2023-10-08T12:46:27.757284+0000","last_fullsized":"2023-10-08T12:46:27.757284+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:00.952819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.631148+0000","last_change":"2023-10-08T12:46:26.650993+0000","last_active":"2023-10-08T12:46:27.631148+0000","last_peered":"2023-10-08T12:46:27.631148+0000","last_clean":"2023-10-08T12:46:27.631148+0000","last_became_active":"2023-10-08T12:46:26.650249+0000","last_became_peered":"2023-10-08T12:46:26.650249+0000","last_unstale":"2023-10-08T12:46:27.631148+0000","last_undegraded":"2023-10-08T12:46:27.631148+0000","last_fullsized":"2023-10-08T12:46:27.631148+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:37:10.116542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.196053+0000","last_change":"2023-10-08T12:46:25.623370+0000","last_active":"2023-10-08T12:46:28.196053+0000","last_peered":"2023-10-08T12:46:28.196053+0000","last_clean":"2023-10-08T12:46:28.196053+0000","last_became_active":"2023-10-08T12:46:25.623072+0000","last_became_peered":"2023-10-08T12:46:25.623072+0000","last_unstale":"2023-10-08T12:46:28.196053+0000","last_undegraded":"2023-10-08T12:46:28.196053+0000","last_fullsized":"2023-10-08T12:46:28.196053+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:31.521960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.196020+0000","last_change":"2023-10-08T12:46:26.657300+0000","last_active":"2023-10-08T12:46:28.196020+0000","last_peered":"2023-10-08T12:46:28.196020+0000","last_clean":"2023-10-08T12:46:28.196020+0000","last_became_active":"2023-10-08T12:46:26.656944+0000","last_became_peered":"2023-10-08T12:46:26.656944+0000","last_unstale":"2023-10-08T12:46:28.196020+0000","last_undegraded":"2023-10-08T12:46:28.196020+0000","last_fullsized":"2023-10-08T12:46:28.196020+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:08:42.366550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.631186+0000","last_change":"2023-10-08T12:46:25.621590+0000","last_active":"2023-10-08T12:46:27.631186+0000","last_peered":"2023-10-08T12:46:27.631186+0000","last_clean":"2023-10-08T12:46:27.631186+0000","last_became_active":"2023-10-08T12:46:25.621262+0000","last_became_peered":"2023-10-08T12:46:25.621262+0000","last_unstale":"2023-10-08T12:46:27.631186+0000","last_undegraded":"2023-10-08T12:46:27.631186+0000","last_fullsized":"2023-10-08T12:46:27.631186+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:13:31.907685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.634806+0000","last_change":"2023-10-08T12:46:26.652842+0000","last_active":"2023-10-08T12:46:27.634806+0000","last_peered":"2023-10-08T12:46:27.634806+0000","last_clean":"2023-10-08T12:46:27.634806+0000","last_became_active":"2023-10-08T12:46:26.652544+0000","last_became_peered":"2023-10-08T12:46:26.652544+0000","last_unstale":"2023-10-08T12:46:27.634806+0000","last_undegraded":"2023-10-08T12:46:27.634806+0000","last_fullsized":"2023-10-08T12:46:27.634806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:05.370405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.196433+0000","last_change":"2023-10-08T12:46:25.628064+0000","last_active":"2023-10-08T12:46:28.196433+0000","last_peered":"2023-10-08T12:46:28.196433+0000","last_clean":"2023-10-08T12:46:28.196433+0000","last_became_active":"2023-10-08T12:46:25.627750+0000","last_became_peered":"2023-10-08T12:46:25.627750+0000","last_unstale":"2023-10-08T12:46:28.196433+0000","last_undegraded":"2023-10-08T12:46:28.196433+0000","last_fullsized":"2023-10-08T12:46:28.196433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:24.766642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.195879+0000","last_change":"2023-10-08T12:46:26.651167+0000","last_active":"2023-10-08T12:46:28.195879+0000","last_peered":"2023-10-08T12:46:28.195879+0000","last_clean":"2023-10-08T12:46:28.195879+0000","last_became_active":"2023-10-08T12:46:26.650799+0000","last_became_peered":"2023-10-08T12:46:26.650799+0000","last_unstale":"2023-10-08T12:46:28.195879+0000","last_undegraded":"2023-10-08T12:46:28.195879+0000","last_fullsized":"2023-10-08T12:46:28.195879+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:33.270714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.694567+0000","last_change":"2023-10-08T12:46:25.628324+0000","last_active":"2023-10-08T12:46:27.694567+0000","last_peered":"2023-10-08T12:46:27.694567+0000","last_clean":"2023-10-08T12:46:27.694567+0000","last_became_active":"2023-10-08T12:46:25.627768+0000","last_became_peered":"2023-10-08T12:46:25.627768+0000","last_unstale":"2023-10-08T12:46:27.694567+0000","last_undegraded":"2023-10-08T12:46:27.694567+0000","last_fullsized":"2023-10-08T12:46:27.694567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:42.051280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.756993+0000","last_change":"2023-10-08T12:46:26.656251+0000","last_active":"2023-10-08T12:46:27.756993+0000","last_peered":"2023-10-08T12:46:27.756993+0000","last_clean":"2023-10-08T12:46:27.756993+0000","last_became_active":"2023-10-08T12:46:26.655977+0000","last_became_peered":"2023-10-08T12:46:26.655977+0000","last_unstale":"2023-10-08T12:46:27.756993+0000","last_undegraded":"2023-10-08T12:46:27.756993+0000","last_fullsized":"2023-10-08T12:46:27.756993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:23:39.302487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.634963+0000","last_change":"2023-10-08T12:46:25.622670+0000","last_active":"2023-10-08T12:46:27.634963+0000","last_peered":"2023-10-08T12:46:27.634963+0000","last_clean":"2023-10-08T12:46:27.634963+0000","last_became_active":"2023-10-08T12:46:25.622093+0000","last_became_peered":"2023-10-08T12:46:25.622093+0000","last_unstale":"2023-10-08T12:46:27.634963+0000","last_undegraded":"2023-10-08T12:46:27.634963+0000","last_fullsized":"2023-10-08T12:46:27.634963+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:54:01.731385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.635464+0000","last_change":"2023-10-08T12:46:26.654519+0000","last_active":"2023-10-08T12:46:27.635464+0000","last_peered":"2023-10-08T12:46:27.635464+0000","last_clean":"2023-10-08T12:46:27.635464+0000","last_became_active":"2023-10-08T12:46:26.654240+0000","last_became_peered":"2023-10-08T12:46:26.654240+0000","last_unstale":"2023-10-08T12:46:27.635464+0000","last_undegraded":"2023-10-08T12:46:27.635464+0000","last_fullsized":"2023-10-08T12:46:27.635464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:02:31.460066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.635191+0000","last_change":"2023-10-08T12:46:25.622241+0000","last_active":"2023-10-08T12:46:27.635191+0000","last_peered":"2023-10-08T12:46:27.635191+0000","last_clean":"2023-10-08T12:46:27.635191+0000","last_became_active":"2023-10-08T12:46:25.621964+0000","last_became_peered":"2023-10-08T12:46:25.621964+0000","last_unstale":"2023-10-08T12:46:27.635191+0000","last_undegraded":"2023-10-08T12:46:27.635191+0000","last_fullsized":"2023-10-08T12:46:27.635191+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:30:26.507726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.634697+0000","last_change":"2023-10-08T12:46:26.653053+0000","last_active":"2023-10-08T12:46:27.634697+0000","last_peered":"2023-10-08T12:46:27.634697+0000","last_clean":"2023-10-08T12:46:27.634697+0000","last_became_active":"2023-10-08T12:46:26.652602+0000","last_became_peered":"2023-10-08T12:46:26.652602+0000","last_unstale":"2023-10-08T12:46:27.634697+0000","last_undegraded":"2023-10-08T12:46:27.634697+0000","last_fullsized":"2023-10-08T12:46:27.634697+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:45:40.814731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.195156+0000","last_change":"2023-10-08T12:46:25.624266+0000","last_active":"2023-10-08T12:46:28.195156+0000","last_peered":"2023-10-08T12:46:28.195156+0000","last_clean":"2023-10-08T12:46:28.195156+0000","last_became_active":"2023-10-08T12:46:25.623956+0000","last_became_peered":"2023-10-08T12:46:25.623956+0000","last_unstale":"2023-10-08T12:46:28.195156+0000","last_undegraded":"2023-10-08T12:46:28.195156+0000","last_fullsized":"2023-10-08T12:46:28.195156+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:37:09.114521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.195294+0000","last_change":"2023-10-08T12:46:26.647978+0000","last_active":"2023-10-08T12:46:28.195294+0000","last_peered":"2023-10-08T12:46:28.195294+0000","last_clean":"2023-10-08T12:46:28.195294+0000","last_became_active":"2023-10-08T12:46:26.647700+0000","last_became_peered":"2023-10-08T12:46:26.647700+0000","last_unstale":"2023-10-08T12:46:28.195294+0000","last_undegraded":"2023-10-08T12:46:28.195294+0000","last_fullsized":"2023-10-08T12:46:28.195294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:13:08.316176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.634537+0000","last_change":"2023-10-08T12:46:25.621168+0000","last_active":"2023-10-08T12:46:27.634537+0000","last_peered":"2023-10-08T12:46:27.634537+0000","last_clean":"2023-10-08T12:46:27.634537+0000","last_became_active":"2023-10-08T12:46:25.620683+0000","last_became_peered":"2023-10-08T12:46:25.620683+0000","last_unstale":"2023-10-08T12:46:27.634537+0000","last_undegraded":"2023-10-08T12:46:27.634537+0000","last_fullsized":"2023-10-08T12:46:27.634537+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:21:11.328283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.634814+0000","last_change":"2023-10-08T12:46:26.653548+0000","last_active":"2023-10-08T12:46:27.634814+0000","last_peered":"2023-10-08T12:46:27.634814+0000","last_clean":"2023-10-08T12:46:27.634814+0000","last_became_active":"2023-10-08T12:46:26.653268+0000","last_became_peered":"2023-10-08T12:46:26.653268+0000","last_unstale":"2023-10-08T12:46:27.634814+0000","last_undegraded":"2023-10-08T12:46:27.634814+0000","last_fullsized":"2023-10-08T12:46:27.634814+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:49:42.006910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.196032+0000","last_change":"2023-10-08T12:46:25.622296+0000","last_active":"2023-10-08T12:46:28.196032+0000","last_peered":"2023-10-08T12:46:28.196032+0000","last_clean":"2023-10-08T12:46:28.196032+0000","last_became_active":"2023-10-08T12:46:25.622031+0000","last_became_peered":"2023-10-08T12:46:25.622031+0000","last_unstale":"2023-10-08T12:46:28.196032+0000","last_undegraded":"2023-10-08T12:46:28.196032+0000","last_fullsized":"2023-10-08T12:46:28.196032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:45:03.386898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.196236+0000","last_change":"2023-10-08T12:46:26.649662+0000","last_active":"2023-10-08T12:46:28.196236+0000","last_peered":"2023-10-08T12:46:28.196236+0000","last_clean":"2023-10-08T12:46:28.196236+0000","last_became_active":"2023-10-08T12:46:26.649423+0000","last_became_peered":"2023-10-08T12:46:26.649423+0000","last_unstale":"2023-10-08T12:46:28.196236+0000","last_undegraded":"2023-10-08T12:46:28.196236+0000","last_fullsized":"2023-10-08T12:46:28.196236+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:02:31.460066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.631235+0000","last_change":"2023-10-08T12:46:25.624428+0000","last_active":"2023-10-08T12:46:27.631235+0000","last_peered":"2023-10-08T12:46:27.631235+0000","last_clean":"2023-10-08T12:46:27.631235+0000","last_became_active":"2023-10-08T12:46:25.624127+0000","last_became_peered":"2023-10-08T12:46:25.624127+0000","last_unstale":"2023-10-08T12:46:27.631235+0000","last_undegraded":"2023-10-08T12:46:27.631235+0000","last_fullsized":"2023-10-08T12:46:27.631235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:17:23.249897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.196117+0000","last_change":"2023-10-08T12:46:26.646080+0000","last_active":"2023-10-08T12:46:28.196117+0000","last_peered":"2023-10-08T12:46:28.196117+0000","last_clean":"2023-10-08T12:46:28.196117+0000","last_became_active":"2023-10-08T12:46:26.645792+0000","last_became_peered":"2023-10-08T12:46:26.645792+0000","last_unstale":"2023-10-08T12:46:28.196117+0000","last_undegraded":"2023-10-08T12:46:28.196117+0000","last_fullsized":"2023-10-08T12:46:28.196117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:54:54.327453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.634606+0000","last_change":"2023-10-08T12:46:25.624324+0000","last_active":"2023-10-08T12:46:27.634606+0000","last_peered":"2023-10-08T12:46:27.634606+0000","last_clean":"2023-10-08T12:46:27.634606+0000","last_became_active":"2023-10-08T12:46:25.623905+0000","last_became_peered":"2023-10-08T12:46:25.623905+0000","last_unstale":"2023-10-08T12:46:27.634606+0000","last_undegraded":"2023-10-08T12:46:27.634606+0000","last_fullsized":"2023-10-08T12:46:27.634606+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:13:19.599108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.634709+0000","last_change":"2023-10-08T12:46:26.653630+0000","last_active":"2023-10-08T12:46:27.634709+0000","last_peered":"2023-10-08T12:46:27.634709+0000","last_clean":"2023-10-08T12:46:27.634709+0000","last_became_active":"2023-10-08T12:46:26.653358+0000","last_became_peered":"2023-10-08T12:46:26.653358+0000","last_unstale":"2023-10-08T12:46:27.634709+0000","last_undegraded":"2023-10-08T12:46:27.634709+0000","last_fullsized":"2023-10-08T12:46:27.634709+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:07:41.211440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.196207+0000","last_change":"2023-10-08T12:46:25.628726+0000","last_active":"2023-10-08T12:46:28.196207+0000","last_peered":"2023-10-08T12:46:28.196207+0000","last_clean":"2023-10-08T12:46:28.196207+0000","last_became_active":"2023-10-08T12:46:25.628468+0000","last_became_peered":"2023-10-08T12:46:25.628468+0000","last_unstale":"2023-10-08T12:46:28.196207+0000","last_undegraded":"2023-10-08T12:46:28.196207+0000","last_fullsized":"2023-10-08T12:46:28.196207+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:47.330387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.195332+0000","last_change":"2023-10-08T12:46:26.651421+0000","last_active":"2023-10-08T12:46:28.195332+0000","last_peered":"2023-10-08T12:46:28.195332+0000","last_clean":"2023-10-08T12:46:28.195332+0000","last_became_active":"2023-10-08T12:46:26.650825+0000","last_became_peered":"2023-10-08T12:46:26.650825+0000","last_unstale":"2023-10-08T12:46:28.195332+0000","last_undegraded":"2023-10-08T12:46:28.195332+0000","last_fullsized":"2023-10-08T12:46:28.195332+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:33.871618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.635086+0000","last_change":"2023-10-08T12:46:25.621262+0000","last_active":"2023-10-08T12:46:27.635086+0000","last_peered":"2023-10-08T12:46:27.635086+0000","last_clean":"2023-10-08T12:46:27.635086+0000","last_became_active":"2023-10-08T12:46:25.620739+0000","last_became_peered":"2023-10-08T12:46:25.620739+0000","last_unstale":"2023-10-08T12:46:27.635086+0000","last_undegraded":"2023-10-08T12:46:27.635086+0000","last_fullsized":"2023-10-08T12:46:27.635086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:17:55.074994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.195918+0000","last_change":"2023-10-08T12:46:26.647902+0000","last_active":"2023-10-08T12:46:28.195918+0000","last_peered":"2023-10-08T12:46:28.195918+0000","last_clean":"2023-10-08T12:46:28.195918+0000","last_became_active":"2023-10-08T12:46:26.647578+0000","last_became_peered":"2023-10-08T12:46:26.647578+0000","last_unstale":"2023-10-08T12:46:28.195918+0000","last_undegraded":"2023-10-08T12:46:28.195918+0000","last_fullsized":"2023-10-08T12:46:28.195918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:49:42.006910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.195501+0000","last_change":"2023-10-08T12:46:25.625331+0000","last_active":"2023-10-08T12:46:28.195501+0000","last_peered":"2023-10-08T12:46:28.195501+0000","last_clean":"2023-10-08T12:46:28.195501+0000","last_became_active":"2023-10-08T12:46:25.624825+0000","last_became_peered":"2023-10-08T12:46:25.624825+0000","last_unstale":"2023-10-08T12:46:28.195501+0000","last_undegraded":"2023-10-08T12:46:28.195501+0000","last_fullsized":"2023-10-08T12:46:28.195501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:08:41.364529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.757155+0000","last_change":"2023-10-08T12:46:26.653590+0000","last_active":"2023-10-08T12:46:27.757155+0000","last_peered":"2023-10-08T12:46:27.757155+0000","last_clean":"2023-10-08T12:46:27.757155+0000","last_became_active":"2023-10-08T12:46:26.652723+0000","last_became_peered":"2023-10-08T12:46:26.652723+0000","last_unstale":"2023-10-08T12:46:27.757155+0000","last_undegraded":"2023-10-08T12:46:27.757155+0000","last_fullsized":"2023-10-08T12:46:27.757155+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:07:41.211440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.195385+0000","last_change":"2023-10-08T12:46:25.624278+0000","last_active":"2023-10-08T12:46:28.195385+0000","last_peered":"2023-10-08T12:46:28.195385+0000","last_clean":"2023-10-08T12:46:28.195385+0000","last_became_active":"2023-10-08T12:46:25.623971+0000","last_became_peered":"2023-10-08T12:46:25.623971+0000","last_unstale":"2023-10-08T12:46:28.195385+0000","last_undegraded":"2023-10-08T12:46:28.195385+0000","last_fullsized":"2023-10-08T12:46:28.195385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:08:41.364529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.196080+0000","last_change":"2023-10-08T12:46:26.657314+0000","last_active":"2023-10-08T12:46:28.196080+0000","last_peered":"2023-10-08T12:46:28.196080+0000","last_clean":"2023-10-08T12:46:28.196080+0000","last_became_active":"2023-10-08T12:46:26.656764+0000","last_became_peered":"2023-10-08T12:46:26.656764+0000","last_unstale":"2023-10-08T12:46:28.196080+0000","last_undegraded":"2023-10-08T12:46:28.196080+0000","last_fullsized":"2023-10-08T12:46:28.196080+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:41:32.766060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.195087+0000","last_change":"2023-10-08T12:46:25.628097+0000","last_active":"2023-10-08T12:46:28.195087+0000","last_peered":"2023-10-08T12:46:28.195087+0000","last_clean":"2023-10-08T12:46:28.195087+0000","last_became_active":"2023-10-08T12:46:25.627772+0000","last_became_peered":"2023-10-08T12:46:25.627772+0000","last_unstale":"2023-10-08T12:46:28.195087+0000","last_undegraded":"2023-10-08T12:46:28.195087+0000","last_fullsized":"2023-10-08T12:46:28.195087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:41:31.764038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.635107+0000","last_change":"2023-10-08T12:46:26.636356+0000","last_active":"2023-10-08T12:46:27.635107+0000","last_peered":"2023-10-08T12:46:27.635107+0000","last_clean":"2023-10-08T12:46:27.635107+0000","last_became_active":"2023-10-08T12:46:26.636088+0000","last_became_peered":"2023-10-08T12:46:26.636088+0000","last_unstale":"2023-10-08T12:46:27.635107+0000","last_undegraded":"2023-10-08T12:46:27.635107+0000","last_fullsized":"2023-10-08T12:46:27.635107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:17:24.251918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.195931+0000","last_change":"2023-10-08T12:46:25.627468+0000","last_active":"2023-10-08T12:46:28.195931+0000","last_peered":"2023-10-08T12:46:28.195931+0000","last_clean":"2023-10-08T12:46:28.195931+0000","last_became_active":"2023-10-08T12:46:25.627137+0000","last_became_peered":"2023-10-08T12:46:25.627137+0000","last_unstale":"2023-10-08T12:46:28.195931+0000","last_undegraded":"2023-10-08T12:46:28.195931+0000","last_fullsized":"2023-10-08T12:46:28.195931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:45:03.386898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.635332+0000","last_change":"2023-10-08T12:46:26.637742+0000","last_active":"2023-10-08T12:46:27.635332+0000","last_peered":"2023-10-08T12:46:27.635332+0000","last_clean":"2023-10-08T12:46:27.635332+0000","last_became_active":"2023-10-08T12:46:26.637406+0000","last_became_peered":"2023-10-08T12:46:26.637406+0000","last_unstale":"2023-10-08T12:46:27.635332+0000","last_undegraded":"2023-10-08T12:46:27.635332+0000","last_fullsized":"2023-10-08T12:46:27.635332+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:00.952819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.635220+0000","last_change":"2023-10-08T12:46:25.621101+0000","last_active":"2023-10-08T12:46:27.635220+0000","last_peered":"2023-10-08T12:46:27.635220+0000","last_clean":"2023-10-08T12:46:27.635220+0000","last_became_active":"2023-10-08T12:46:25.620773+0000","last_became_peered":"2023-10-08T12:46:25.620773+0000","last_unstale":"2023-10-08T12:46:27.635220+0000","last_undegraded":"2023-10-08T12:46:27.635220+0000","last_fullsized":"2023-10-08T12:46:27.635220+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:13:31.907685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.195529+0000","last_change":"2023-10-08T12:46:26.649820+0000","last_active":"2023-10-08T12:46:28.195529+0000","last_peered":"2023-10-08T12:46:28.195529+0000","last_clean":"2023-10-08T12:46:28.195529+0000","last_became_active":"2023-10-08T12:46:26.649211+0000","last_became_peered":"2023-10-08T12:46:26.649211+0000","last_unstale":"2023-10-08T12:46:28.195529+0000","last_undegraded":"2023-10-08T12:46:28.195529+0000","last_fullsized":"2023-10-08T12:46:28.195529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:25.768663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.635106+0000","last_change":"2023-10-08T12:46:25.621747+0000","last_active":"2023-10-08T12:46:27.635106+0000","last_peered":"2023-10-08T12:46:27.635106+0000","last_clean":"2023-10-08T12:46:27.635106+0000","last_became_active":"2023-10-08T12:46:25.621465+0000","last_became_peered":"2023-10-08T12:46:25.621465+0000","last_unstale":"2023-10-08T12:46:27.635106+0000","last_undegraded":"2023-10-08T12:46:27.635106+0000","last_fullsized":"2023-10-08T12:46:27.635106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:20:13.222166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.694661+0000","last_change":"2023-10-08T12:46:26.642594+0000","last_active":"2023-10-08T12:46:27.694661+0000","last_peered":"2023-10-08T12:46:27.694661+0000","last_clean":"2023-10-08T12:46:27.694661+0000","last_became_active":"2023-10-08T12:46:26.642237+0000","last_became_peered":"2023-10-08T12:46:26.642237+0000","last_unstale":"2023-10-08T12:46:27.694661+0000","last_undegraded":"2023-10-08T12:46:27.694661+0000","last_fullsized":"2023-10-08T12:46:27.694661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:54:44.546683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.635104+0000","last_change":"2023-10-08T12:46:25.622351+0000","last_active":"2023-10-08T12:46:27.635104+0000","last_peered":"2023-10-08T12:46:27.635104+0000","last_clean":"2023-10-08T12:46:27.635104+0000","last_became_active":"2023-10-08T12:46:25.621982+0000","last_became_peered":"2023-10-08T12:46:25.621982+0000","last_unstale":"2023-10-08T12:46:27.635104+0000","last_undegraded":"2023-10-08T12:46:27.635104+0000","last_fullsized":"2023-10-08T12:46:27.635104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:41:05.959486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.694420+0000","last_change":"2023-10-08T12:46:26.648626+0000","last_active":"2023-10-08T12:46:27.694420+0000","last_peered":"2023-10-08T12:46:27.694420+0000","last_clean":"2023-10-08T12:46:27.694420+0000","last_became_active":"2023-10-08T12:46:26.648311+0000","last_became_peered":"2023-10-08T12:46:26.648311+0000","last_unstale":"2023-10-08T12:46:27.694420+0000","last_undegraded":"2023-10-08T12:46:27.694420+0000","last_fullsized":"2023-10-08T12:46:27.694420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:40:17.984910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.631194+0000","last_change":"2023-10-08T12:46:25.628366+0000","last_active":"2023-10-08T12:46:27.631194+0000","last_peered":"2023-10-08T12:46:27.631194+0000","last_clean":"2023-10-08T12:46:27.631194+0000","last_became_active":"2023-10-08T12:46:25.628015+0000","last_became_peered":"2023-10-08T12:46:25.628015+0000","last_unstale":"2023-10-08T12:46:27.631194+0000","last_undegraded":"2023-10-08T12:46:27.631194+0000","last_fullsized":"2023-10-08T12:46:27.631194+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:31.521960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.694468+0000","last_change":"2023-10-08T12:46:26.653821+0000","last_active":"2023-10-08T12:46:27.694468+0000","last_peered":"2023-10-08T12:46:27.694468+0000","last_clean":"2023-10-08T12:46:27.694468+0000","last_became_active":"2023-10-08T12:46:26.653483+0000","last_became_peered":"2023-10-08T12:46:26.653483+0000","last_unstale":"2023-10-08T12:46:27.694468+0000","last_undegraded":"2023-10-08T12:46:27.694468+0000","last_fullsized":"2023-10-08T12:46:27.694468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:30:27.509747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.195824+0000","last_change":"2023-10-08T12:46:25.628339+0000","last_active":"2023-10-08T12:46:28.195824+0000","last_peered":"2023-10-08T12:46:28.195824+0000","last_clean":"2023-10-08T12:46:28.195824+0000","last_became_active":"2023-10-08T12:46:25.628077+0000","last_became_peered":"2023-10-08T12:46:25.628077+0000","last_unstale":"2023-10-08T12:46:28.195824+0000","last_undegraded":"2023-10-08T12:46:28.195824+0000","last_fullsized":"2023-10-08T12:46:28.195824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:13:31.907685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.694366+0000","last_change":"2023-10-08T12:46:26.655779+0000","last_active":"2023-10-08T12:46:27.694366+0000","last_peered":"2023-10-08T12:46:27.694366+0000","last_clean":"2023-10-08T12:46:27.694366+0000","last_became_active":"2023-10-08T12:46:26.655418+0000","last_became_peered":"2023-10-08T12:46:26.655418+0000","last_unstale":"2023-10-08T12:46:27.694366+0000","last_undegraded":"2023-10-08T12:46:27.694366+0000","last_fullsized":"2023-10-08T12:46:27.694366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:21.090092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.635492+0000","last_change":"2023-10-08T12:46:25.628254+0000","last_active":"2023-10-08T12:46:27.635492+0000","last_peered":"2023-10-08T12:46:27.635492+0000","last_clean":"2023-10-08T12:46:27.635492+0000","last_became_active":"2023-10-08T12:46:25.627931+0000","last_became_peered":"2023-10-08T12:46:25.627931+0000","last_unstale":"2023-10-08T12:46:27.635492+0000","last_undegraded":"2023-10-08T12:46:27.635492+0000","last_fullsized":"2023-10-08T12:46:27.635492+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:33:37.714806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.757089+0000","last_change":"2023-10-08T12:46:26.650734+0000","last_active":"2023-10-08T12:46:27.757089+0000","last_peered":"2023-10-08T12:46:27.757089+0000","last_clean":"2023-10-08T12:46:27.757089+0000","last_became_active":"2023-10-08T12:46:26.650427+0000","last_became_peered":"2023-10-08T12:46:26.650427+0000","last_unstale":"2023-10-08T12:46:27.757089+0000","last_undegraded":"2023-10-08T12:46:27.757089+0000","last_fullsized":"2023-10-08T12:46:27.757089+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:52:16.090427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.634179+0000","last_change":"2023-10-08T12:46:25.624218+0000","last_active":"2023-10-08T12:46:27.634179+0000","last_peered":"2023-10-08T12:46:27.634179+0000","last_clean":"2023-10-08T12:46:27.634179+0000","last_became_active":"2023-10-08T12:46:25.623910+0000","last_became_peered":"2023-10-08T12:46:25.623910+0000","last_unstale":"2023-10-08T12:46:27.634179+0000","last_undegraded":"2023-10-08T12:46:27.634179+0000","last_fullsized":"2023-10-08T12:46:27.634179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:32.869597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.694605+0000","last_change":"2023-10-08T12:46:26.647409+0000","last_active":"2023-10-08T12:46:27.694605+0000","last_peered":"2023-10-08T12:46:27.694605+0000","last_clean":"2023-10-08T12:46:27.694605+0000","last_became_active":"2023-10-08T12:46:26.647078+0000","last_became_peered":"2023-10-08T12:46:26.647078+0000","last_unstale":"2023-10-08T12:46:27.694605+0000","last_undegraded":"2023-10-08T12:46:27.694605+0000","last_fullsized":"2023-10-08T12:46:27.694605+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:33:38.716827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.195820+0000","last_change":"2023-10-08T12:46:25.629193+0000","last_active":"2023-10-08T12:46:28.195820+0000","last_peered":"2023-10-08T12:46:28.195820+0000","last_clean":"2023-10-08T12:46:28.195820+0000","last_became_active":"2023-10-08T12:46:25.628771+0000","last_became_peered":"2023-10-08T12:46:25.628771+0000","last_unstale":"2023-10-08T12:46:28.195820+0000","last_undegraded":"2023-10-08T12:46:28.195820+0000","last_fullsized":"2023-10-08T12:46:28.195820+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:47.330387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.635111+0000","last_change":"2023-10-08T12:46:26.653433+0000","last_active":"2023-10-08T12:46:27.635111+0000","last_peered":"2023-10-08T12:46:27.635111+0000","last_clean":"2023-10-08T12:46:27.635111+0000","last_became_active":"2023-10-08T12:46:26.653131+0000","last_became_peered":"2023-10-08T12:46:26.653131+0000","last_unstale":"2023-10-08T12:46:27.635111+0000","last_undegraded":"2023-10-08T12:46:27.635111+0000","last_fullsized":"2023-10-08T12:46:27.635111+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:56:55.667597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.670926+0000","last_change":"2023-10-08T12:46:25.625977+0000","last_active":"2023-10-08T12:46:28.670926+0000","last_peered":"2023-10-08T12:46:28.670926+0000","last_clean":"2023-10-08T12:46:28.670926+0000","last_became_active":"2023-10-08T12:46:25.625696+0000","last_became_peered":"2023-10-08T12:46:25.625696+0000","last_unstale":"2023-10-08T12:46:28.670926+0000","last_undegraded":"2023-10-08T12:46:28.670926+0000","last_fullsized":"2023-10-08T12:46:28.670926+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:04.368384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.631152+0000","last_change":"2023-10-08T12:46:26.655375+0000","last_active":"2023-10-08T12:46:27.631152+0000","last_peered":"2023-10-08T12:46:27.631152+0000","last_clean":"2023-10-08T12:46:27.631152+0000","last_became_active":"2023-10-08T12:46:26.655049+0000","last_became_peered":"2023-10-08T12:46:26.655049+0000","last_unstale":"2023-10-08T12:46:27.631152+0000","last_undegraded":"2023-10-08T12:46:27.631152+0000","last_fullsized":"2023-10-08T12:46:27.631152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:48.332409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.196131+0000","last_change":"2023-10-08T12:46:25.625607+0000","last_active":"2023-10-08T12:46:28.196131+0000","last_peered":"2023-10-08T12:46:28.196131+0000","last_clean":"2023-10-08T12:46:28.196131+0000","last_became_active":"2023-10-08T12:46:25.625220+0000","last_became_peered":"2023-10-08T12:46:25.625220+0000","last_unstale":"2023-10-08T12:46:28.196131+0000","last_undegraded":"2023-10-08T12:46:28.196131+0000","last_fullsized":"2023-10-08T12:46:28.196131+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:37:09.114521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.195934+0000","last_change":"2023-10-08T12:46:26.654566+0000","last_active":"2023-10-08T12:46:28.195934+0000","last_peered":"2023-10-08T12:46:28.195934+0000","last_clean":"2023-10-08T12:46:28.195934+0000","last_became_active":"2023-10-08T12:46:26.654282+0000","last_became_peered":"2023-10-08T12:46:26.654282+0000","last_unstale":"2023-10-08T12:46:28.195934+0000","last_undegraded":"2023-10-08T12:46:28.195934+0000","last_fullsized":"2023-10-08T12:46:28.195934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:37:10.116542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.631096+0000","last_change":"2023-10-08T12:46:25.613681+0000","last_active":"2023-10-08T12:46:27.631096+0000","last_peered":"2023-10-08T12:46:27.631096+0000","last_clean":"2023-10-08T12:46:27.631096+0000","last_became_active":"2023-10-08T12:46:25.612887+0000","last_became_peered":"2023-10-08T12:46:25.612887+0000","last_unstale":"2023-10-08T12:46:27.631096+0000","last_undegraded":"2023-10-08T12:46:27.631096+0000","last_fullsized":"2023-10-08T12:46:27.631096+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:45:39.812710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.631382+0000","last_change":"2023-10-08T12:46:26.650672+0000","last_active":"2023-10-08T12:46:27.631382+0000","last_peered":"2023-10-08T12:46:27.631382+0000","last_clean":"2023-10-08T12:46:27.631382+0000","last_became_active":"2023-10-08T12:46:26.650409+0000","last_became_peered":"2023-10-08T12:46:26.650409+0000","last_unstale":"2023-10-08T12:46:27.631382+0000","last_undegraded":"2023-10-08T12:46:27.631382+0000","last_fullsized":"2023-10-08T12:46:27.631382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:08:42.366550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.195491+0000","last_change":"2023-10-08T12:46:25.629340+0000","last_active":"2023-10-08T12:46:28.195491+0000","last_peered":"2023-10-08T12:46:28.195491+0000","last_clean":"2023-10-08T12:46:28.195491+0000","last_became_active":"2023-10-08T12:46:25.628559+0000","last_became_peered":"2023-10-08T12:46:25.628559+0000","last_unstale":"2023-10-08T12:46:28.195491+0000","last_undegraded":"2023-10-08T12:46:28.195491+0000","last_fullsized":"2023-10-08T12:46:28.195491+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:41:31.764038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.195150+0000","last_change":"2023-10-08T12:46:26.653229+0000","last_active":"2023-10-08T12:46:28.195150+0000","last_peered":"2023-10-08T12:46:28.195150+0000","last_clean":"2023-10-08T12:46:28.195150+0000","last_became_active":"2023-10-08T12:46:26.649558+0000","last_became_peered":"2023-10-08T12:46:26.649558+0000","last_unstale":"2023-10-08T12:46:28.195150+0000","last_undegraded":"2023-10-08T12:46:28.195150+0000","last_fullsized":"2023-10-08T12:46:28.195150+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:25.654810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.635574+0000","last_change":"2023-10-08T12:46:25.613425+0000","last_active":"2023-10-08T12:46:27.635574+0000","last_peered":"2023-10-08T12:46:27.635574+0000","last_clean":"2023-10-08T12:46:27.635574+0000","last_became_active":"2023-10-08T12:46:25.613156+0000","last_became_peered":"2023-10-08T12:46:25.613156+0000","last_unstale":"2023-10-08T12:46:27.635574+0000","last_undegraded":"2023-10-08T12:46:27.635574+0000","last_fullsized":"2023-10-08T12:46:27.635574+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:56:22.815269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.635403+0000","last_change":"2023-10-08T12:46:26.641309+0000","last_active":"2023-10-08T12:46:27.635403+0000","last_peered":"2023-10-08T12:46:27.635403+0000","last_clean":"2023-10-08T12:46:27.635403+0000","last_became_active":"2023-10-08T12:46:26.641016+0000","last_became_peered":"2023-10-08T12:46:26.641016+0000","last_unstale":"2023-10-08T12:46:27.635403+0000","last_undegraded":"2023-10-08T12:46:27.635403+0000","last_fullsized":"2023-10-08T12:46:27.635403+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:48.332409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.195234+0000","last_change":"2023-10-08T12:46:25.624596+0000","last_active":"2023-10-08T12:46:28.195234+0000","last_peered":"2023-10-08T12:46:28.195234+0000","last_clean":"2023-10-08T12:46:28.195234+0000","last_became_active":"2023-10-08T12:46:25.624289+0000","last_became_peered":"2023-10-08T12:46:25.624289+0000","last_unstale":"2023-10-08T12:46:28.195234+0000","last_undegraded":"2023-10-08T12:46:28.195234+0000","last_fullsized":"2023-10-08T12:46:28.195234+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:13:19.599108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:27.757208+0000","last_change":"2023-10-08T12:46:26.654467+0000","last_active":"2023-10-08T12:46:27.757208+0000","last_peered":"2023-10-08T12:46:27.757208+0000","last_clean":"2023-10-08T12:46:27.757208+0000","last_became_active":"2023-10-08T12:46:26.654203+0000","last_became_peered":"2023-10-08T12:46:26.654203+0000","last_unstale":"2023-10-08T12:46:27.757208+0000","last_undegraded":"2023-10-08T12:46:27.757208+0000","last_fullsized":"2023-10-08T12:46:27.757208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:25.600794+0000","last_clean_scrub_stamp":"2023-10-08T12:46:25.600794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:49:42.006910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T12:46:28.195911+0000","last_change":"2023-10-08T12:46:25.623376+0000","last_active":"2023-10-08T12:46:28.195911+0000","last_peered":"2023-10-08T12:46:28.195911+0000","last_clean":"2023-10-08T12:46:28.195911+0000","last_became_active":"2023-10-08T12:46:25.623083+0000","last_became_peered":"2023-10-08T12:46:25.623083+0000","last_unstale":"2023-10-08T12:46:28.195911+0000","last_undegraded":"2023-10-08T12:46:28.195911+0000","last_fullsized":"2023-10-08T12:46:28.195911+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:46:24.598773+0000","last_clean_scrub_stamp":"2023-10-08T12:46:24.598773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:17:55.074994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":175,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-08T12:46:26.639459+0000","last_change":"2023-10-08T12:45:21.094571+0000","last_active":"2023-10-08T12:46:26.639459+0000","last_peered":"2023-10-08T12:46:26.639459+0000","last_clean":"2023-10-08T12:46:26.639459+0000","last_became_active":"2023-10-08T12:45:21.093551+0000","last_became_peered":"2023-10-08T12:45:21.093551+0000","last_unstale":"2023-10-08T12:46:26.639459+0000","last_undegraded":"2023-10-08T12:46:26.639459+0000","last_fullsized":"2023-10-08T12:46:26.639459+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:19.842786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:19.842786+0000","last_clean_scrub_stamp":"2023-10-08T12:45:19.842786+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:25.041743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":970752,"data_stored":737627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.625}]},{"osd":1,"last update":"Sun Oct 8 12:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.71999999999999997}]},{"osd":2,"last update":"Sun Oct 8 12:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.52600000000000002}]},{"osd":3,"last update":"Sun Oct 8 12:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.499},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.63700000000000001}]},{"osd":4,"last update":"Sun Oct 8 12:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.55700000000000005}]},{"osd":5,"last update":"Sun Oct 8 12:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.75700000000000001}]},{"osd":6,"last update":"Sun Oct 8 12:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.70999999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":147785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.57599999999999996}]},{"osd":1,"last update":"Sun Oct 8 12:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.63700000000000001}]},{"osd":2,"last update":"Sun Oct 8 12:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.55800000000000005}]},{"osd":3,"last update":"Sun Oct 8 12:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.61899999999999999}]},{"osd":4,"last update":"Sun Oct 8 12:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.51900000000000002}]},{"osd":5,"last update":"Sun Oct 8 12:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.441}]},{"osd":7,"last update":"Sun Oct 8 12:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.495}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":148803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.40699999999999997}]},{"osd":2,"last update":"Sun Oct 8 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.38400000000000001}]},{"osd":3,"last update":"Sun Oct 8 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.44600000000000001}]},{"osd":4,"last update":"Sun Oct 8 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.65500000000000003}]},{"osd":5,"last update":"Sun Oct 8 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.8450000000000002,"5min":2.8450000000000002,"15min":2.8450000000000002},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.59699999999999998}]},{"osd":6,"last update":"Sun Oct 8 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.60899999999999999}]},{"osd":7,"last update":"Sun Oct 8 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.623},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.71099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":966656,"data_stored":737537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.44500000000000001}]},{"osd":2,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.433,"5min":0.433,"15min":0.433},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.497}]},{"osd":3,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.53500000000000003}]},{"osd":4,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.82499999999999996}]},{"osd":5,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.75700000000000001}]},{"osd":6,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.81499999999999995}]},{"osd":7,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.80100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":147239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.443},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.39600000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.47899999999999998}]},{"osd":3,"last update":"Sun Oct 8 12:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.56499999999999995}]},{"osd":4,"last update":"Sun Oct 8 12:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.80700000000000005}]},{"osd":5,"last update":"Sun Oct 8 12:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.85199999999999998}]},{"osd":6,"last update":"Sun Oct 8 12:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.72499999999999998}]},{"osd":7,"last update":"Sun Oct 8 12:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":2.569,"5min":2.569,"15min":2.569},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.83099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":148803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":3.222,"5min":3.222,"15min":3.222},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":0.372}]},{"osd":1,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":3.2629999999999999,"5min":3.2629999999999999,"15min":3.2629999999999999},"last":0.35499999999999998}]},{"osd":2,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.38500000000000001}]},{"osd":4,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":3.3130000000000002,"5min":3.3130000000000002,"15min":3.3130000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":4.5289999999999999,"5min":4.5289999999999999,"15min":4.5289999999999999},"last":0.59499999999999997}]},{"osd":5,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":3.1459999999999999,"5min":3.1459999999999999,"15min":3.1459999999999999},"last":0.51300000000000001}]},{"osd":6,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":9.5589999999999993,"5min":9.5589999999999993,"15min":9.5589999999999993},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":9.5850000000000009,"5min":9.5850000000000009,"15min":9.5850000000000009},"last":0.45700000000000002}]},{"osd":7,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.504},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":3.1080000000000001,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.56100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":147273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.33800000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.46200000000000002}]},{"osd":2,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.56100000000000005}]},{"osd":3,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.58099999999999996}]},{"osd":5,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.495},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.53900000000000003}]},{"osd":6,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.624},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.61099999999999999}]},{"osd":7,"last update":"Sun Oct 8 12:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.65900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":147841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":4.8289999999999997,"5min":4.8289999999999997,"15min":4.8289999999999997},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":4.8170000000000002,"5min":4.8170000000000002,"15min":4.8170000000000002},"last":0.627}]},{"osd":1,"last update":"Sun Oct 8 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":4.4980000000000002,"5min":4.4980000000000002,"15min":4.4980000000000002},"last":0.441},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":8.4819999999999993,"5min":8.4819999999999993,"15min":8.4819999999999993},"last":0.68700000000000006}]},{"osd":2,"last update":"Sun Oct 8 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.0139999999999998,"5min":3.0139999999999998,"15min":3.0139999999999998},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":8.6219999999999999,"5min":8.6219999999999999,"15min":8.6219999999999999},"last":0.53800000000000003}]},{"osd":3,"last update":"Sun Oct 8 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":8.5800000000000001,"5min":8.5800000000000001,"15min":8.5800000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.51000000000000001}]},{"osd":4,"last update":"Sun Oct 8 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.60199999999999998}]},{"osd":6,"last update":"Sun Oct 8 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.64600000000000002}]},{"osd":7,"last update":"Sun Oct 8 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.71099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:46:31.200 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T12:46:31.200 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T12:46:31.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.368+0000 7fb08a5aa700 1 -- 172.21.15.45:0/1941375322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb08415e090 msgr2=0x7fb0840cf4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:31.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.368+0000 7fb08a5aa700 1 --2- 172.21.15.45:0/1941375322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb08415e090 0x7fb0840cf4d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb074005fd0 tx=0x7fb074009c70 comp rx=0 tx=0).stop 2023-10-08T12:46:31.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.368+0000 7fb08a5aa700 1 -- 172.21.15.45:0/1941375322 shutdown_connections 2023-10-08T12:46:31.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.368+0000 7fb08a5aa700 1 --2- 172.21.15.45:0/1941375322 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb0840cfa10 0x7fb0840af740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:31.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.368+0000 7fb08a5aa700 1 --2- 172.21.15.45:0/1941375322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb08415e090 0x7fb0840cf4d0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:31.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.368+0000 7fb08a5aa700 1 -- 172.21.15.45:0/1941375322 >> 172.21.15.45:0/1941375322 conn(0x7fb084088fb0 msgr2=0x7fb0840893c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:31.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.368+0000 7fb08a5aa700 1 -- 172.21.15.45:0/1941375322 shutdown_connections 2023-10-08T12:46:31.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.368+0000 7fb08a5aa700 1 -- 172.21.15.45:0/1941375322 wait complete. 2023-10-08T12:46:31.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.369+0000 7fb08a5aa700 1 Processor -- start 2023-10-08T12:46:31.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.370+0000 7fb08a5aa700 1 -- start start 2023-10-08T12:46:31.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.370+0000 7fb08a5aa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0840cfa10 0x7fb0840c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:31.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.370+0000 7fb08a5aa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb084159900 0x7fb08414dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:31.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.370+0000 7fb08a5aa700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb08415e090 0x7fb08406fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:31.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.370+0000 7fb08a5aa700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840c5cf0 con 0x7fb084159900 2023-10-08T12:46:31.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.370+0000 7fb08a5aa700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840c41e0 con 0x7fb0840cfa10 2023-10-08T12:46:31.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.370+0000 7fb08a5aa700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840c50e0 con 0x7fb08415e090 2023-10-08T12:46:31.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.370+0000 7fb0837fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb084159900 0x7fb08414dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:31.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.370+0000 7fb0837fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb084159900 0x7fb08414dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37042/0 (socket says 172.21.15.45:37042) 2023-10-08T12:46:31.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.370+0000 7fb0837fe700 1 -- 172.21.15.45:0/2464590638 learned_addr learned my addr 172.21.15.45:0/2464590638 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:31.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.371+0000 7fb088b47700 1 --2- 172.21.15.45:0/2464590638 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb08415e090 0x7fb08406fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:31.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.371+0000 7fb083fff700 1 --2- 172.21.15.45:0/2464590638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0840cfa10 0x7fb0840c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:31.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.371+0000 7fb0837fe700 1 -- 172.21.15.45:0/2464590638 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb08415e090 msgr2=0x7fb08406fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:31.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.371+0000 7fb0837fe700 1 --2- 172.21.15.45:0/2464590638 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb08415e090 0x7fb08406fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:31.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.371+0000 7fb0837fe700 1 -- 172.21.15.45:0/2464590638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0840cfa10 msgr2=0x7fb0840c3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:31.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.371+0000 7fb0837fe700 1 --2- 172.21.15.45:0/2464590638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0840cfa10 0x7fb0840c3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:31.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.371+0000 7fb0837fe700 1 -- 172.21.15.45:0/2464590638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0740095f0 con 0x7fb084159900 2023-10-08T12:46:31.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.371+0000 7fb088b47700 1 --2- 172.21.15.45:0/2464590638 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb08415e090 0x7fb08406fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:46:31.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.371+0000 7fb0837fe700 1 --2- 172.21.15.45:0/2464590638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb084159900 0x7fb08414dc00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb084073d90 tx=0x7fb074004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:31.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.371+0000 7fb080ff9700 1 -- 172.21.15.45:0/2464590638 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07401c070 con 0x7fb084159900 2023-10-08T12:46:31.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.371+0000 7fb080ff9700 1 -- 172.21.15.45:0/2464590638 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb074003890 con 0x7fb084159900 2023-10-08T12:46:31.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.371+0000 7fb08a5aa700 1 -- 172.21.15.45:0/2464590638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0840c53c0 con 0x7fb084159900 2023-10-08T12:46:31.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.371+0000 7fb080ff9700 1 -- 172.21.15.45:0/2464590638 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0740045f0 con 0x7fb084159900 2023-10-08T12:46:31.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.371+0000 7fb08a5aa700 1 -- 172.21.15.45:0/2464590638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0840c5980 con 0x7fb084159900 2023-10-08T12:46:31.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.372+0000 7fb08a5aa700 1 -- 172.21.15.45:0/2464590638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb08415d8b0 con 0x7fb084159900 2023-10-08T12:46:31.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.373+0000 7fb080ff9700 1 -- 172.21.15.45:0/2464590638 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb074003ca0 con 0x7fb084159900 2023-10-08T12:46:31.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.373+0000 7fb080ff9700 1 --2- 172.21.15.45:0/2464590638 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb06406aed0 0x7fb06406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:31.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.373+0000 7fb080ff9700 1 -- 172.21.15.45:0/2464590638 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb07408a860 con 0x7fb084159900 2023-10-08T12:46:31.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.373+0000 7fb083fff700 1 --2- 172.21.15.45:0/2464590638 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb06406aed0 0x7fb06406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:31.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.374+0000 7fb083fff700 1 --2- 172.21.15.45:0/2464590638 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb06406aed0 0x7fb06406d390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb06c007fd0 tx=0x7fb06c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:31.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.378+0000 7fb080ff9700 1 -- 172.21.15.45:0/2464590638 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb0740559a0 con 0x7fb084159900 2023-10-08T12:46:31.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.659+0000 7fb08a5aa700 1 -- 172.21.15.45:0/2464590638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb0840c5e30 con 0x7fb084159900 2023-10-08T12:46:31.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.668+0000 7fb080ff9700 1 -- 172.21.15.45:0/2464590638 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7fb074058fc0 con 0x7fb084159900 2023-10-08T12:46:31.669 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2023-10-08T12:46:31.669 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAzpCJli2jsKBAA5aEs8srGibREq3jyZkPnvA== 2023-10-08T12:46:31.669 INFO:teuthology.orchestra.run.smithi045.stdout: caps mds = "allow" 2023-10-08T12:46:31.669 INFO:teuthology.orchestra.run.smithi045.stdout: caps mon = "allow r" 2023-10-08T12:46:31.670 INFO:teuthology.orchestra.run.smithi045.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-10-08T12:46:31.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.670+0000 7fb08a5aa700 1 -- 172.21.15.45:0/2464590638 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb06406aed0 msgr2=0x7fb06406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:31.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.670+0000 7fb08a5aa700 1 --2- 172.21.15.45:0/2464590638 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb06406aed0 0x7fb06406d390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb06c007fd0 tx=0x7fb06c009040 comp rx=0 tx=0).stop 2023-10-08T12:46:31.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.670+0000 7fb08a5aa700 1 -- 172.21.15.45:0/2464590638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb084159900 msgr2=0x7fb08414dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:31.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.670+0000 7fb08a5aa700 1 --2- 172.21.15.45:0/2464590638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb084159900 0x7fb08414dc00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb084073d90 tx=0x7fb074004260 comp rx=0 tx=0).stop 2023-10-08T12:46:31.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.670+0000 7fb08a5aa700 1 -- 172.21.15.45:0/2464590638 shutdown_connections 2023-10-08T12:46:31.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.670+0000 7fb08a5aa700 1 --2- 172.21.15.45:0/2464590638 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb06406aed0 0x7fb06406d390 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:31.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.670+0000 7fb08a5aa700 1 --2- 172.21.15.45:0/2464590638 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb08415e090 0x7fb08406fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:31.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.670+0000 7fb08a5aa700 1 --2- 172.21.15.45:0/2464590638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0840cfa10 0x7fb0840c3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:31.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.670+0000 7fb08a5aa700 1 --2- 172.21.15.45:0/2464590638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb084159900 0x7fb08414dc00 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:31.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.670+0000 7fb08a5aa700 1 -- 172.21.15.45:0/2464590638 >> 172.21.15.45:0/2464590638 conn(0x7fb084088fb0 msgr2=0x7fb084151f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:31.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.671+0000 7fb08a5aa700 1 -- 172.21.15.45:0/2464590638 shutdown_connections 2023-10-08T12:46:31.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.671+0000 7fb08a5aa700 1 -- 172.21.15.45:0/2464590638 wait complete. 2023-10-08T12:46:31.673 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-10-08T12:46:31.683 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:46:31.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.809+0000 7fe10769a700 1 -- 172.21.15.45:0/3254820907 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe10006f3d0 msgr2=0x7fe1000cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:31.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.809+0000 7fe10769a700 1 --2- 172.21.15.45:0/3254820907 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe10006f3d0 0x7fe1000cc160 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe0f0009990 tx=0x7fe0f0009ca0 comp rx=0 tx=0).stop 2023-10-08T12:46:31.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.809+0000 7fe10769a700 1 -- 172.21.15.45:0/3254820907 shutdown_connections 2023-10-08T12:46:31.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.809+0000 7fe10769a700 1 --2- 172.21.15.45:0/3254820907 >> v2:172.21.15.78:3300/0 conn(0x7fe1001599f0 0x7fe10006ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:31.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.809+0000 7fe10769a700 1 --2- 172.21.15.45:0/3254820907 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe10006f3d0 0x7fe1000cc160 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:31.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.809+0000 7fe10769a700 1 -- 172.21.15.45:0/3254820907 >> 172.21.15.45:0/3254820907 conn(0x7fe1000cf750 msgr2=0x7fe1000cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:31.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.809+0000 7fe10769a700 1 -- 172.21.15.45:0/3254820907 shutdown_connections 2023-10-08T12:46:31.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.810+0000 7fe10769a700 1 -- 172.21.15.45:0/3254820907 wait complete. 2023-10-08T12:46:31.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.811+0000 7fe10769a700 1 Processor -- start 2023-10-08T12:46:31.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.811+0000 7fe10769a700 1 -- start start 2023-10-08T12:46:31.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.811+0000 7fe10769a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe10006f3d0 0x7fe1001539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:31.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.811+0000 7fe10769a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1000cc6a0 0x7fe100155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:31.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.811+0000 7fe10769a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1001599f0 0x7fe100153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:31.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.811+0000 7fe10769a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe100156590 con 0x7fe1001599f0 2023-10-08T12:46:31.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.811+0000 7fe10769a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe100156870 con 0x7fe1000cc6a0 2023-10-08T12:46:31.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.811+0000 7fe10769a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe100156b50 con 0x7fe10006f3d0 2023-10-08T12:46:31.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.812+0000 7fe105c37700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1001599f0 0x7fe100153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:31.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.812+0000 7fe105c37700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1001599f0 0x7fe100153170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37058/0 (socket says 172.21.15.45:37058) 2023-10-08T12:46:31.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.812+0000 7fe105c37700 1 -- 172.21.15.45:0/3933391237 learned_addr learned my addr 172.21.15.45:0/3933391237 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:31.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.812+0000 7fe105436700 1 --2- 172.21.15.45:0/3933391237 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe10006f3d0 0x7fe1001539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:31.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.812+0000 7fe104c35700 1 --2- 172.21.15.45:0/3933391237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1000cc6a0 0x7fe100155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:31.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.812+0000 7fe105c37700 1 -- 172.21.15.45:0/3933391237 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe10006f3d0 msgr2=0x7fe1001539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:31.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.812+0000 7fe105c37700 1 --2- 172.21.15.45:0/3933391237 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe10006f3d0 0x7fe1001539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:31.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.812+0000 7fe105c37700 1 -- 172.21.15.45:0/3933391237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1000cc6a0 msgr2=0x7fe100155f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:31.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.812+0000 7fe105c37700 1 --2- 172.21.15.45:0/3933391237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1000cc6a0 0x7fe100155f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:31.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.812+0000 7fe105c37700 1 -- 172.21.15.45:0/3933391237 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0fc009520 con 0x7fe1001599f0 2023-10-08T12:46:31.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.812+0000 7fe105c37700 1 --2- 172.21.15.45:0/3933391237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1001599f0 0x7fe100153170 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe0f800cc50 tx=0x7fe0f800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:31.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.812+0000 7fe0f5ffb700 1 -- 172.21.15.45:0/3933391237 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f8003c00 con 0x7fe1001599f0 2023-10-08T12:46:31.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.812+0000 7fe0f5ffb700 1 -- 172.21.15.45:0/3933391237 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe0f8003d60 con 0x7fe1001599f0 2023-10-08T12:46:31.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.812+0000 7fe10769a700 1 -- 172.21.15.45:0/3933391237 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0f00095f0 con 0x7fe1001599f0 2023-10-08T12:46:31.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.812+0000 7fe0f5ffb700 1 -- 172.21.15.45:0/3933391237 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f800aad0 con 0x7fe1001599f0 2023-10-08T12:46:31.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.813+0000 7fe10769a700 1 -- 172.21.15.45:0/3933391237 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe100157110 con 0x7fe1001599f0 2023-10-08T12:46:31.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.813+0000 7fe10769a700 1 -- 172.21.15.45:0/3933391237 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe100070420 con 0x7fe1001599f0 2023-10-08T12:46:31.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.814+0000 7fe0f5ffb700 1 -- 172.21.15.45:0/3933391237 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe0f800ac30 con 0x7fe1001599f0 2023-10-08T12:46:31.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.814+0000 7fe0f5ffb700 1 --2- 172.21.15.45:0/3933391237 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe0e406aed0 0x7fe0e406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:31.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.814+0000 7fe0f5ffb700 1 -- 172.21.15.45:0/3933391237 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0f80897d0 con 0x7fe1001599f0 2023-10-08T12:46:31.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.815+0000 7fe105436700 1 --2- 172.21.15.45:0/3933391237 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe0e406aed0 0x7fe0e406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:31.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.815+0000 7fe105436700 1 --2- 172.21.15.45:0/3933391237 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe0e406aed0 0x7fe0e406d390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc009d50 tx=0x7fe0fc009260 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:31.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:31.819+0000 7fe0f5ffb700 1 -- 172.21.15.45:0/3933391237 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe0f80547e0 con 0x7fe1001599f0 2023-10-08T12:46:32.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.065+0000 7fe10769a700 1 -- 172.21.15.45:0/3933391237 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe100157300 con 0x7fe1001599f0 2023-10-08T12:46:32.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.066+0000 7fe0f5ffb700 1 -- 172.21.15.45:0/3933391237 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4907 (secure 0 0 0) 0x7fe0f8057e00 con 0x7fe1001599f0 2023-10-08T12:46:32.067 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:46:32.067 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4775,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/415745376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":415745376},{"type":"v1","addr":"172.21.15.78:6836","nonce":415745376}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/4017051943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":4017051943},{"type":"v1","addr":"172.21.15.78:6837","nonce":4017051943}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4784,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2071345881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2071345881},{"type":"v1","addr":"172.21.15.45:6835","nonce":2071345881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T12:46:26.025761+0000","modified":"2023-10-08T12:46:29.062189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5041},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5041":{"gid":5041,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6834/328442803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":328442803},{"type":"v1","addr":"172.21.15.45:6834","nonce":328442803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-08T12:46:32.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.068+0000 7fe10769a700 1 -- 172.21.15.45:0/3933391237 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe0e406aed0 msgr2=0x7fe0e406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:32.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.068+0000 7fe10769a700 1 --2- 172.21.15.45:0/3933391237 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe0e406aed0 0x7fe0e406d390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc009d50 tx=0x7fe0fc009260 comp rx=0 tx=0).stop 2023-10-08T12:46:32.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.068+0000 7fe10769a700 1 -- 172.21.15.45:0/3933391237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1001599f0 msgr2=0x7fe100153170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:32.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.068+0000 7fe10769a700 1 --2- 172.21.15.45:0/3933391237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1001599f0 0x7fe100153170 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe0f800cc50 tx=0x7fe0f800cf60 comp rx=0 tx=0).stop 2023-10-08T12:46:32.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.068+0000 7fe10769a700 1 -- 172.21.15.45:0/3933391237 shutdown_connections 2023-10-08T12:46:32.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.068+0000 7fe10769a700 1 --2- 172.21.15.45:0/3933391237 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fe0e406aed0 0x7fe0e406d390 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.068+0000 7fe10769a700 1 --2- 172.21.15.45:0/3933391237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1001599f0 0x7fe100153170 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.068+0000 7fe10769a700 1 --2- 172.21.15.45:0/3933391237 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe10006f3d0 0x7fe1001539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.068+0000 7fe10769a700 1 --2- 172.21.15.45:0/3933391237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1000cc6a0 0x7fe100155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.068+0000 7fe10769a700 1 -- 172.21.15.45:0/3933391237 >> 172.21.15.45:0/3933391237 conn(0x7fe1000cf750 msgr2=0x7fe100158c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:32.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.068+0000 7fe10769a700 1 -- 172.21.15.45:0/3933391237 shutdown_connections 2023-10-08T12:46:32.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.068+0000 7fe10769a700 1 -- 172.21.15.45:0/3933391237 wait complete. 2023-10-08T12:46:32.070 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2023-10-08T12:46:32.483 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T12:46:26.025761+0000', 'modified': '2023-10-08T12:46:29.062189+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5041}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5041': {'gid': 5041, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6834/328442803', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6832', 'nonce': 328442803}, {'type': 'v1', 'addr': '172.21.15.45:6834', 'nonce': 328442803}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-08T12:46:32.483 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T12:46:32.484 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-08T12:46:32.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.614+0000 7f6e6f4cd700 1 -- 172.21.15.45:0/940776880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e54004850 msgr2=0x7f6e54004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:32.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.614+0000 7f6e6f4cd700 1 --2- 172.21.15.45:0/940776880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e54004850 0x7f6e54004cd0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c009be0 tx=0x7f6e54005880 comp rx=0 tx=0).stop 2023-10-08T12:46:32.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.614+0000 7f6e6f4cd700 1 -- 172.21.15.45:0/940776880 shutdown_connections 2023-10-08T12:46:32.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.614+0000 7f6e6f4cd700 1 --2- 172.21.15.45:0/940776880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e54004850 0x7f6e54004cd0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.614+0000 7f6e6f4cd700 1 -- 172.21.15.45:0/940776880 >> 172.21.15.45:0/940776880 conn(0x7f6e680cf750 msgr2=0x7f6e680cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:32.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.615+0000 7f6e6f4cd700 1 -- 172.21.15.45:0/940776880 shutdown_connections 2023-10-08T12:46:32.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.615+0000 7f6e6f4cd700 1 -- 172.21.15.45:0/940776880 wait complete. 2023-10-08T12:46:32.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.616+0000 7f6e6f4cd700 1 Processor -- start 2023-10-08T12:46:32.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.616+0000 7f6e6f4cd700 1 -- start start 2023-10-08T12:46:32.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.616+0000 7f6e6f4cd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e54004850 0x7f6e680c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:32.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.616+0000 7f6e6f4cd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e6809c950 0x7f6e68157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:32.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.616+0000 7f6e6f4cd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6e6815a160 0x7f6e6815a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:32.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.616+0000 7f6e6f4cd700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6815ab50 con 0x7f6e54004850 2023-10-08T12:46:32.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.616+0000 7f6e6f4cd700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e680c82b0 con 0x7f6e6809c950 2023-10-08T12:46:32.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.616+0000 7f6e6f4cd700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6815b130 con 0x7f6e6815a160 2023-10-08T12:46:32.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.617+0000 7f6e6d269700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e54004850 0x7f6e680c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:32.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.617+0000 7f6e6d269700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e54004850 0x7f6e680c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37074/0 (socket says 172.21.15.45:37074) 2023-10-08T12:46:32.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.617+0000 7f6e6d269700 1 -- 172.21.15.45:0/4182360998 learned_addr learned my addr 172.21.15.45:0/4182360998 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:32.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.617+0000 7f6e6da6a700 1 --2- 172.21.15.45:0/4182360998 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6e6815a160 0x7f6e6815a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:32.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.617+0000 7f6e6ca68700 1 --2- 172.21.15.45:0/4182360998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e6809c950 0x7f6e68157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:32.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.617+0000 7f6e6d269700 1 -- 172.21.15.45:0/4182360998 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6e6815a160 msgr2=0x7f6e6815a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:32.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.617+0000 7f6e6d269700 1 --2- 172.21.15.45:0/4182360998 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6e6815a160 0x7f6e6815a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.617+0000 7f6e6d269700 1 -- 172.21.15.45:0/4182360998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e6809c950 msgr2=0x7f6e68157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:32.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.617+0000 7f6e6d269700 1 --2- 172.21.15.45:0/4182360998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e6809c950 0x7f6e68157f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.617+0000 7f6e6d269700 1 -- 172.21.15.45:0/4182360998 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e68158460 con 0x7f6e54004850 2023-10-08T12:46:32.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.617+0000 7f6e6da6a700 1 --2- 172.21.15.45:0/4182360998 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6e6815a160 0x7f6e6815a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:32.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.617+0000 7f6e6ca68700 1 --2- 172.21.15.45:0/4182360998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e6809c950 0x7f6e68157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:32.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.617+0000 7f6e6d269700 1 --2- 172.21.15.45:0/4182360998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e54004850 0x7f6e680c7bb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6e64003f30 tx=0x7f6e640015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:32.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.617+0000 7f6e59ffb700 1 -- 172.21.15.45:0/4182360998 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e64011430 con 0x7f6e54004850 2023-10-08T12:46:32.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.617+0000 7f6e59ffb700 1 -- 172.21.15.45:0/4182360998 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6e64011590 con 0x7f6e54004850 2023-10-08T12:46:32.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.617+0000 7f6e6f4cd700 1 -- 172.21.15.45:0/4182360998 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e6809d3f0 con 0x7f6e54004850 2023-10-08T12:46:32.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.617+0000 7f6e59ffb700 1 -- 172.21.15.45:0/4182360998 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e64011980 con 0x7f6e54004850 2023-10-08T12:46:32.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.617+0000 7f6e6f4cd700 1 -- 172.21.15.45:0/4182360998 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e6806b450 con 0x7f6e54004850 2023-10-08T12:46:32.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.619+0000 7f6e59ffb700 1 -- 172.21.15.45:0/4182360998 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6e64011ae0 con 0x7f6e54004850 2023-10-08T12:46:32.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.619+0000 7f6e59ffb700 1 --2- 172.21.15.45:0/4182360998 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f6e4c06aed0 0x7f6e4c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:32.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.619+0000 7f6e59ffb700 1 -- 172.21.15.45:0/4182360998 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e6408a130 con 0x7f6e54004850 2023-10-08T12:46:32.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.619+0000 7f6e6ca68700 1 --2- 172.21.15.45:0/4182360998 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f6e4c06aed0 0x7f6e4c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:32.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.620+0000 7f6e6ca68700 1 --2- 172.21.15.45:0/4182360998 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f6e4c06aed0 0x7f6e4c06d390 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c009be0 tx=0x7f6e5c004750 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:32.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.621+0000 7f6e7b6b6b80 1 Processor -- start 2023-10-08T12:46:32.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.621+0000 7f6e7b6b6b80 1 -- start start 2023-10-08T12:46:32.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.622+0000 7f6e7b6b6b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559a6416d150 0x559a6416d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:32.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.622+0000 7f6e7b6b6b80 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x559a64189eb0 0x559a64142cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:32.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.622+0000 7f6e7b6b6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559a641404e0 0x559a641431f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:32.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.622+0000 7f6e7b6b6b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a640aa410 con 0x559a6416d150 2023-10-08T12:46:32.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.622+0000 7f6e7b6b6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a6409bbd0 con 0x559a641404e0 2023-10-08T12:46:32.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.622+0000 7f6e7b6b6b80 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x559a640994f0 con 0x559a64189eb0 2023-10-08T12:46:32.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.622+0000 7f6e6d269700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559a6416d150 0x559a6416d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:32.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.622+0000 7f6e6d269700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559a6416d150 0x559a6416d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37082/0 (socket says 172.21.15.45:37082) 2023-10-08T12:46:32.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.622+0000 7f6e6d269700 1 -- 172.21.15.45:0/2824577262 learned_addr learned my addr 172.21.15.45:0/2824577262 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:32.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.622+0000 7f6e6da6a700 1 --2- 172.21.15.45:0/2824577262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559a641404e0 0x559a641431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:32.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.622+0000 7f6e6ca68700 1 --2- 172.21.15.45:0/2824577262 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x559a64189eb0 0x559a64142cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:32.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.622+0000 7f6e6d269700 1 -- 172.21.15.45:0/2824577262 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x559a64189eb0 msgr2=0x559a64142cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:32.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.622+0000 7f6e6d269700 1 --2- 172.21.15.45:0/2824577262 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x559a64189eb0 0x559a64142cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.622+0000 7f6e6d269700 1 -- 172.21.15.45:0/2824577262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559a641404e0 msgr2=0x559a641431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:32.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.622+0000 7f6e6d269700 1 --2- 172.21.15.45:0/2824577262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559a641404e0 0x559a641431f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.622+0000 7f6e6d269700 1 -- 172.21.15.45:0/2824577262 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a640f7950 con 0x559a6416d150 2023-10-08T12:46:32.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.622+0000 7f6e6ca68700 1 --2- 172.21.15.45:0/2824577262 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x559a64189eb0 0x559a64142cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:32.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.622+0000 7f6e6da6a700 1 --2- 172.21.15.45:0/2824577262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559a641404e0 0x559a641431f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:32.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.623+0000 7f6e6d269700 1 --2- 172.21.15.45:0/2824577262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559a6416d150 0x559a6416d530 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6e64060d00 tx=0x7f6e64058910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d608abad4e5ed4b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:32.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.623+0000 7f6e52ffd700 1 -- 172.21.15.45:0/2824577262 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e64070030 con 0x559a6416d150 2023-10-08T12:46:32.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.623+0000 7f6e52ffd700 1 -- 172.21.15.45:0/2824577262 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6e64058f30 con 0x559a6416d150 2023-10-08T12:46:32.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.623+0000 7f6e52ffd700 1 -- 172.21.15.45:0/2824577262 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6405d080 con 0x559a6416d150 2023-10-08T12:46:32.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.623+0000 7f6e7b6b6b80 1 -- 172.21.15.45:0/2824577262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559a6416d150 msgr2=0x559a6416d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:32.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.623+0000 7f6e7b6b6b80 1 --2- 172.21.15.45:0/2824577262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559a6416d150 0x559a6416d530 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6e64060d00 tx=0x7f6e64058910 comp rx=0 tx=0).stop 2023-10-08T12:46:32.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.623+0000 7f6e7b6b6b80 1 -- 172.21.15.45:0/2824577262 shutdown_connections 2023-10-08T12:46:32.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.623+0000 7f6e7b6b6b80 1 --2- 172.21.15.45:0/2824577262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559a641404e0 0x559a641431f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.623+0000 7f6e7b6b6b80 1 --2- 172.21.15.45:0/2824577262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559a6416d150 0x559a6416d530 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.623+0000 7f6e7b6b6b80 1 --2- 172.21.15.45:0/2824577262 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x559a64189eb0 0x559a64142cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.623+0000 7f6e7b6b6b80 1 -- 172.21.15.45:0/2824577262 >> 172.21.15.45:0/2824577262 conn(0x559a640b6210 msgr2=0x559a64187f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:32.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.623+0000 7f6e7b6b6b80 1 -- 172.21.15.45:0/2824577262 shutdown_connections 2023-10-08T12:46:32.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.623+0000 7f6e7b6b6b80 1 -- 172.21.15.45:0/2824577262 wait complete. 2023-10-08T12:46:32.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.624+0000 7f6e7b6b6b80 1 -- start start 2023-10-08T12:46:32.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.624+0000 7f6e7b6b6b80 1 Processor -- start 2023-10-08T12:46:32.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.625+0000 7f6e7b6b6b80 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x559a641404e0 0x559a64170970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:32.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.626+0000 7f6e7b6b6b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559a6416d150 0x559a64158780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:32.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.626+0000 7f6e7b6b6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559a64189eb0 0x559a64159690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:32.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.626+0000 7f6e7b6b6b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a64094de0 con 0x559a6416d150 2023-10-08T12:46:32.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.626+0000 7f6e7b6b6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a640316c0 con 0x559a64189eb0 2023-10-08T12:46:32.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.626+0000 7f6e7b6b6b80 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x559a64031360 con 0x559a641404e0 2023-10-08T12:46:32.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.626+0000 7f6e7b6b6b80 10 client.0 _ll_register_callbacks cb 0x559a63e8e7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:46:32.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.626+0000 7f6e6ca68700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559a6416d150 0x559a64158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:32.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.626+0000 7f6e6ca68700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559a6416d150 0x559a64158780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37090/0 (socket says 172.21.15.45:37090) 2023-10-08T12:46:32.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.626+0000 7f6e6ca68700 1 -- 172.21.15.45:0/3831529489 learned_addr learned my addr 172.21.15.45:0/3831529489 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:32.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.626+0000 7f6e6da6a700 1 --2- 172.21.15.45:0/3831529489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559a64189eb0 0x559a64159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:32.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.626+0000 7f6e6d269700 1 --2- 172.21.15.45:0/3831529489 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x559a641404e0 0x559a64170970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:32.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.626+0000 7f6e6ca68700 1 -- 172.21.15.45:0/3831529489 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x559a641404e0 msgr2=0x559a64170970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:32.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.626+0000 7f6e6ca68700 1 --2- 172.21.15.45:0/3831529489 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x559a641404e0 0x559a64170970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.626+0000 7f6e6ca68700 1 -- 172.21.15.45:0/3831529489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559a64189eb0 msgr2=0x559a64159690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:32.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.626+0000 7f6e6ca68700 1 --2- 172.21.15.45:0/3831529489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559a64189eb0 0x559a64159690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.626+0000 7f6e6ca68700 1 -- 172.21.15.45:0/3831529489 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e6806b450 con 0x559a6416d150 2023-10-08T12:46:32.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.626+0000 7f6e6ca68700 1 --2- 172.21.15.45:0/3831529489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559a6416d150 0x559a64158780 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6e5400c080 tx=0x7f6e5c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae257f1c86e5138f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:32.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.626+0000 7f6e47fff700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-10-08T12:46:32.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.626+0000 7f6e47fff700 1 -- 172.21.15.45:0/3831529489 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c003a90 con 0x559a6416d150 2023-10-08T12:46:32.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.626+0000 7f6e47fff700 1 -- 172.21.15.45:0/3831529489 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e5c014070 con 0x559a6416d150 2023-10-08T12:46:32.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.626+0000 7f6e7b6b6b80 1 -- 172.21.15.45:0/3831529489 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559a64135170 con 0x559a6416d150 2023-10-08T12:46:32.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.626+0000 7f6e47fff700 1 -- 172.21.15.45:0/3831529489 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e5c004580 con 0x559a6416d150 2023-10-08T12:46:32.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.626+0000 7f6e7b6b6b80 10 client.5361 fetch_fsmap learned FSMap version 16 2023-10-08T12:46:32.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.626+0000 7f6e7b6b6b80 1 -- 172.21.15.45:0/3831529489 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x559a63ebfd90 con 0x559a6416d150 2023-10-08T12:46:32.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.627+0000 7f6e47fff700 1 -- 172.21.15.45:0/3831529489 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x559a64135170 con 0x559a6416d150 2023-10-08T12:46:32.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.627+0000 7f6e47fff700 1 -- 172.21.15.45:0/3831529489 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6e5c003bf0 con 0x559a6416d150 2023-10-08T12:46:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.627+0000 7f6e7b6b6b80 10 client.5361 fetch_fsmap finished waiting for FSMap version 16 2023-10-08T12:46:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.627+0000 7f6e7b6b6b80 10 client.5361 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T12:46:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.627+0000 7f6e7b6b6b80 20 client.5361 populate_metadata read hostname 'smithi045' 2023-10-08T12:46:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.627+0000 7f6e7b6b6b80 1 --2- 172.21.15.45:0/3831529489 >> [v2:172.21.15.45:6832/328442803,v1:172.21.15.45:6834/328442803] conn(0x559a64185ff0 0x559a6416eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.627+0000 7f6e7b6b6b80 4 client.5361 mds_command: new command op to 5041 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:46:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.627+0000 7f6e7b6b6b80 1 -- 172.21.15.45:0/3831529489 --> [v2:172.21.15.45:6832/328442803,v1:172.21.15.45:6834/328442803] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559a6408ddc0 con 0x559a64185ff0 2023-10-08T12:46:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.627+0000 7f6e6d269700 1 --2- 172.21.15.45:0/3831529489 >> [v2:172.21.15.45:6832/328442803,v1:172.21.15.45:6834/328442803] conn(0x559a64185ff0 0x559a6416eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.627+0000 7f6e6d269700 1 --2- 172.21.15.45:0/3831529489 >> [v2:172.21.15.45:6832/328442803,v1:172.21.15.45:6834/328442803] conn(0x559a64185ff0 0x559a6416eb70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f089a813f8cfd5c server_cookie=5dc70042f0a9c328 in_seq=0 out_seq=0 2023-10-08T12:46:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.627+0000 7f6e47fff700 10 client.5361 ms_handle_connect on v2:172.21.15.45:6832/328442803 2023-10-08T12:46:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.628+0000 7f6e47fff700 1 -- 172.21.15.45:0/3831529489 <== mds.0 v2:172.21.15.45:6832/328442803 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559a6408ddc0 con 0x559a64185ff0 2023-10-08T12:46:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.628+0000 7f6e47fff700 10 client.5361 handle_command_reply: tid=0 2023-10-08T12:46:32.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.628+0000 7f6e7b6b6b80 1 client.5361 shutdown 2023-10-08T12:46:32.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.628+0000 7f6e7b6b6b80 1 -- 172.21.15.45:0/3831529489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559a6416d150 msgr2=0x559a64158780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:32.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.628+0000 7f6e7b6b6b80 1 --2- 172.21.15.45:0/3831529489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559a6416d150 0x559a64158780 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6e5400c080 tx=0x7f6e5c009260 comp rx=0 tx=0).stop 2023-10-08T12:46:32.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.628+0000 7f6e7b6b6b80 1 -- 172.21.15.45:0/3831529489 shutdown_connections 2023-10-08T12:46:32.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.628+0000 7f6e7b6b6b80 1 --2- 172.21.15.45:0/3831529489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559a64189eb0 0x559a64159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.628+0000 7f6e7b6b6b80 1 --2- 172.21.15.45:0/3831529489 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x559a641404e0 0x559a64170970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.628+0000 7f6e7b6b6b80 1 --2- 172.21.15.45:0/3831529489 >> [v2:172.21.15.45:6832/328442803,v1:172.21.15.45:6834/328442803] conn(0x559a64185ff0 0x559a6416eb70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.628+0000 7f6e7b6b6b80 1 --2- 172.21.15.45:0/3831529489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559a6416d150 0x559a64158780 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.628+0000 7f6e47fff700 0 client.5361 ms_handle_reset on v2:172.21.15.45:6832/328442803 2023-10-08T12:46:32.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.628+0000 7f6e7b6b6b80 1 -- 172.21.15.45:0/3831529489 >> 172.21.15.45:0/3831529489 conn(0x559a640b6210 msgr2=0x559a64186f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:32.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.628+0000 7f6e7b6b6b80 1 -- 172.21.15.45:0/3831529489 shutdown_connections 2023-10-08T12:46:32.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.628+0000 7f6e7b6b6b80 1 -- 172.21.15.45:0/3831529489 wait complete. 2023-10-08T12:46:32.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.628+0000 7f6e7b6b6b80 20 client.5361 trim_cache size 0 max 16384 2023-10-08T12:46:32.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.646+0000 7f6e7b6b6b80 1 Processor -- start 2023-10-08T12:46:32.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.646+0000 7f6e7b6b6b80 1 -- start start 2023-10-08T12:46:32.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.647+0000 7f6e7b6b6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559a641404e0 0x559a6413bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:32.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.647+0000 7f6e7b6b6b80 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x559a6416d150 0x559a6413f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:32.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.647+0000 7f6e7b6b6b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559a64189eb0 0x559a6413f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:32.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.647+0000 7f6e7b6b6b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a63f158d0 con 0x559a64189eb0 2023-10-08T12:46:32.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.647+0000 7f6e7b6b6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a64186fb0 con 0x559a641404e0 2023-10-08T12:46:32.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.647+0000 7f6e7b6b6b80 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x559a64117c90 con 0x559a6416d150 2023-10-08T12:46:32.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.647+0000 7f6e6da6a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559a64189eb0 0x559a6413f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:32.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.647+0000 7f6e6da6a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559a64189eb0 0x559a6413f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37100/0 (socket says 172.21.15.45:37100) 2023-10-08T12:46:32.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.647+0000 7f6e6da6a700 1 -- 172.21.15.45:0/3702170500 learned_addr learned my addr 172.21.15.45:0/3702170500 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:32.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.647+0000 7f6e6ca68700 1 --2- 172.21.15.45:0/3702170500 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x559a6416d150 0x559a6413f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:32.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.647+0000 7f6e6da6a700 1 -- 172.21.15.45:0/3702170500 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x559a6416d150 msgr2=0x559a6413f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:32.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.647+0000 7f6e6da6a700 1 --2- 172.21.15.45:0/3702170500 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x559a6416d150 0x559a6413f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.647+0000 7f6e6d269700 1 --2- 172.21.15.45:0/3702170500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559a641404e0 0x559a6413bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:32.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.647+0000 7f6e6da6a700 1 -- 172.21.15.45:0/3702170500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559a641404e0 msgr2=0x559a6413bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:32.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.647+0000 7f6e6da6a700 1 --2- 172.21.15.45:0/3702170500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559a641404e0 0x559a6413bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.647+0000 7f6e6da6a700 1 -- 172.21.15.45:0/3702170500 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a63ea8c10 con 0x559a64189eb0 2023-10-08T12:46:32.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.647+0000 7f6e6ca68700 1 --2- 172.21.15.45:0/3702170500 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x559a6416d150 0x559a6413f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:46:32.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.647+0000 7f6e6da6a700 1 --2- 172.21.15.45:0/3702170500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559a64189eb0 0x559a6413f580 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6e68071b20 tx=0x7f6e60003d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b84d3ff4d1834a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:32.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.647+0000 7f6e537fe700 1 -- 172.21.15.45:0/3702170500 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e60012a20 con 0x559a64189eb0 2023-10-08T12:46:32.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.647+0000 7f6e537fe700 1 -- 172.21.15.45:0/3702170500 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6e60017070 con 0x559a64189eb0 2023-10-08T12:46:32.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.647+0000 7f6e537fe700 1 -- 172.21.15.45:0/3702170500 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e60013450 con 0x559a64189eb0 2023-10-08T12:46:32.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.648+0000 7f6e7b6b6b80 1 -- 172.21.15.45:0/3702170500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559a64189eb0 msgr2=0x559a6413f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:32.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.648+0000 7f6e7b6b6b80 1 --2- 172.21.15.45:0/3702170500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559a64189eb0 0x559a6413f580 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6e68071b20 tx=0x7f6e60003d90 comp rx=0 tx=0).stop 2023-10-08T12:46:32.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.648+0000 7f6e7b6b6b80 1 -- 172.21.15.45:0/3702170500 shutdown_connections 2023-10-08T12:46:32.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.648+0000 7f6e7b6b6b80 1 --2- 172.21.15.45:0/3702170500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559a64189eb0 0x559a6413f580 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.648+0000 7f6e7b6b6b80 1 --2- 172.21.15.45:0/3702170500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559a641404e0 0x559a6413bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.648+0000 7f6e7b6b6b80 1 --2- 172.21.15.45:0/3702170500 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x559a6416d150 0x559a6413f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.648+0000 7f6e7b6b6b80 1 -- 172.21.15.45:0/3702170500 >> 172.21.15.45:0/3702170500 conn(0x559a640b6210 msgr2=0x559a64196680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:32.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.648+0000 7f6e7b6b6b80 1 -- 172.21.15.45:0/3702170500 shutdown_connections 2023-10-08T12:46:32.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.648+0000 7f6e7b6b6b80 1 -- 172.21.15.45:0/3702170500 wait complete. 2023-10-08T12:46:32.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.649+0000 7f6e7b6b6b80 1 -- start start 2023-10-08T12:46:32.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.649+0000 7f6e7b6b6b80 1 Processor -- start 2023-10-08T12:46:32.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.650+0000 7f6e7b6b6b80 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x559a641404e0 0x559a64184c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:32.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.650+0000 7f6e7b6b6b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559a6416d150 0x559a641ee860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:32.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.650+0000 7f6e7b6b6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559a64189eb0 0x559a641a1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:32.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.650+0000 7f6e7b6b6b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a641f3040 con 0x559a6416d150 2023-10-08T12:46:32.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.650+0000 7f6e7b6b6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a64142fc0 con 0x559a64189eb0 2023-10-08T12:46:32.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.650+0000 7f6e7b6b6b80 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x559a641a0c00 con 0x559a641404e0 2023-10-08T12:46:32.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.650+0000 7f6e7b6b6b80 10 client.0 _ll_register_callbacks cb 0x7f6e5c009a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:46:32.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.650+0000 7f6e6ca68700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559a6416d150 0x559a641ee860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:32.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.650+0000 7f6e6ca68700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559a6416d150 0x559a641ee860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37104/0 (socket says 172.21.15.45:37104) 2023-10-08T12:46:32.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.650+0000 7f6e6ca68700 1 -- 172.21.15.45:0/1921939355 learned_addr learned my addr 172.21.15.45:0/1921939355 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:32.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.650+0000 7f6e6d269700 1 --2- 172.21.15.45:0/1921939355 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x559a641404e0 0x559a64184c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:32.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.650+0000 7f6e6da6a700 1 --2- 172.21.15.45:0/1921939355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559a64189eb0 0x559a641a1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:32.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.650+0000 7f6e6ca68700 1 -- 172.21.15.45:0/1921939355 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x559a641404e0 msgr2=0x559a64184c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:32.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.650+0000 7f6e6ca68700 1 --2- 172.21.15.45:0/1921939355 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x559a641404e0 0x559a64184c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.650+0000 7f6e6ca68700 1 -- 172.21.15.45:0/1921939355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559a64189eb0 msgr2=0x559a641a1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:32.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.650+0000 7f6e6ca68700 1 --2- 172.21.15.45:0/1921939355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559a64189eb0 0x559a641a1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.650+0000 7f6e6ca68700 1 -- 172.21.15.45:0/1921939355 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e6806fcd0 con 0x559a6416d150 2023-10-08T12:46:32.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.650+0000 7f6e6d269700 1 --2- 172.21.15.45:0/1921939355 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x559a641404e0 0x559a64184c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:32.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.650+0000 7f6e6da6a700 1 --2- 172.21.15.45:0/1921939355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559a64189eb0 0x559a641a1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:32.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.650+0000 7f6e6ca68700 1 --2- 172.21.15.45:0/1921939355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559a6416d150 0x559a641ee860 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c00ec30 tx=0x7f6e5c03b620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a718599dc3021f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:32.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.650+0000 7f6e47fff700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-10-08T12:46:32.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.650+0000 7f6e47fff700 1 -- 172.21.15.45:0/1921939355 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c03bc50 con 0x559a6416d150 2023-10-08T12:46:32.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.650+0000 7f6e47fff700 1 -- 172.21.15.45:0/1921939355 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e5c014070 con 0x559a6416d150 2023-10-08T12:46:32.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.650+0000 7f6e7b6b6b80 1 -- 172.21.15.45:0/1921939355 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6e64058f30 con 0x559a6416d150 2023-10-08T12:46:32.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.650+0000 7f6e47fff700 1 -- 172.21.15.45:0/1921939355 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e5c040070 con 0x559a6416d150 2023-10-08T12:46:32.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.650+0000 7f6e7b6b6b80 10 client.5367 fetch_fsmap learned FSMap version 16 2023-10-08T12:46:32.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.651+0000 7f6e7b6b6b80 1 -- 172.21.15.45:0/1921939355 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x559a63ee6200 con 0x559a6416d150 2023-10-08T12:46:32.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.651+0000 7f6e47fff700 1 -- 172.21.15.45:0/1921939355 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6e64058f30 con 0x559a6416d150 2023-10-08T12:46:32.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.651+0000 7f6e47fff700 1 -- 172.21.15.45:0/1921939355 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6e5c004830 con 0x559a6416d150 2023-10-08T12:46:32.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.651+0000 7f6e7b6b6b80 10 client.5367 fetch_fsmap finished waiting for FSMap version 16 2023-10-08T12:46:32.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.651+0000 7f6e7b6b6b80 10 client.5367 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T12:46:32.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.651+0000 7f6e7b6b6b80 20 client.5367 populate_metadata read hostname 'smithi045' 2023-10-08T12:46:32.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.651+0000 7f6e7b6b6b80 1 --2- 172.21.15.45:0/1921939355 >> [v2:172.21.15.45:6832/328442803,v1:172.21.15.45:6834/328442803] conn(0x559a6413f040 0x559a6413f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:32.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.651+0000 7f6e7b6b6b80 4 client.5367 mds_command: new command op to 5041 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T12:46:32.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.651+0000 7f6e7b6b6b80 1 -- 172.21.15.45:0/1921939355 --> [v2:172.21.15.45:6832/328442803,v1:172.21.15.45:6834/328442803] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559a6408dae0 con 0x559a6413f040 2023-10-08T12:46:32.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.651+0000 7f6e6d269700 1 --2- 172.21.15.45:0/1921939355 >> [v2:172.21.15.45:6832/328442803,v1:172.21.15.45:6834/328442803] conn(0x559a6413f040 0x559a6413f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:32.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.651+0000 7f6e47fff700 10 client.5367 ms_handle_connect on v2:172.21.15.45:6832/328442803 2023-10-08T12:46:32.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.651+0000 7f6e6d269700 1 --2- 172.21.15.45:0/1921939355 >> [v2:172.21.15.45:6832/328442803,v1:172.21.15.45:6834/328442803] conn(0x559a6413f040 0x559a6413f420 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9408803c241628bb server_cookie=a5d0e6a3546acb64 in_seq=0 out_seq=0 2023-10-08T12:46:32.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.651+0000 7f6e47fff700 1 -- 172.21.15.45:0/1921939355 <== mds.0 v2:172.21.15.45:6832/328442803 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x559a6408dae0 con 0x559a6413f040 2023-10-08T12:46:32.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.651+0000 7f6e47fff700 10 client.5367 handle_command_reply: tid=0 2023-10-08T12:46:32.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.651+0000 7f6e7b6b6b80 1 client.5367 shutdown 2023-10-08T12:46:32.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.652+0000 7f6e7b6b6b80 1 -- 172.21.15.45:0/1921939355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559a6416d150 msgr2=0x559a641ee860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:32.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.652+0000 7f6e7b6b6b80 1 --2- 172.21.15.45:0/1921939355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559a6416d150 0x559a641ee860 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c00ec30 tx=0x7f6e5c03b620 comp rx=0 tx=0).stop 2023-10-08T12:46:32.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.652+0000 7f6e7b6b6b80 1 -- 172.21.15.45:0/1921939355 shutdown_connections 2023-10-08T12:46:32.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.652+0000 7f6e7b6b6b80 1 --2- 172.21.15.45:0/1921939355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559a64189eb0 0x559a641a1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.652+0000 7f6e7b6b6b80 1 --2- 172.21.15.45:0/1921939355 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x559a641404e0 0x559a64184c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.652+0000 7f6e7b6b6b80 1 --2- 172.21.15.45:0/1921939355 >> [v2:172.21.15.45:6832/328442803,v1:172.21.15.45:6834/328442803] conn(0x559a6413f040 0x559a6413f420 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.652+0000 7f6e7b6b6b80 1 --2- 172.21.15.45:0/1921939355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559a6416d150 0x559a641ee860 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.652+0000 7f6e47fff700 0 client.5367 ms_handle_reset on v2:172.21.15.45:6832/328442803 2023-10-08T12:46:32.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.652+0000 7f6e7b6b6b80 1 -- 172.21.15.45:0/1921939355 >> 172.21.15.45:0/1921939355 conn(0x559a640b6210 msgr2=0x559a6413cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:32.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.652+0000 7f6e7b6b6b80 1 -- 172.21.15.45:0/1921939355 shutdown_connections 2023-10-08T12:46:32.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.652+0000 7f6e7b6b6b80 1 -- 172.21.15.45:0/1921939355 wait complete. 2023-10-08T12:46:32.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.652+0000 7f6e7b6b6b80 20 client.5367 trim_cache size 0 max 16384 2023-10-08T12:46:32.664 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-08T12:46:32.664 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "3c5c3516-8181-4382-8205-f21bea7ad4b3", 2023-10-08T12:46:32.664 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-10-08T12:46:32.664 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 5041, 2023-10-08T12:46:32.664 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-10-08T12:46:32.665 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-10-08T12:46:32.665 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-10-08T12:46:32.665 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 6.023981225, 2023-10-08T12:46:32.665 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 16, 2023-10-08T12:46:32.665 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 33, 2023-10-08T12:46:32.665 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 33, 2023-10-08T12:46:32.665 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 13.985655949 2023-10-08T12:46:32.665 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-08T12:46:32.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.652+0000 7f6e6f4cd700 1 -- 172.21.15.45:0/4182360998 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f6e4c06aed0 msgr2=0x7f6e4c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:32.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.652+0000 7f6e6f4cd700 1 --2- 172.21.15.45:0/4182360998 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f6e4c06aed0 0x7f6e4c06d390 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c009be0 tx=0x7f6e5c004750 comp rx=0 tx=0).stop 2023-10-08T12:46:32.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.652+0000 7f6e6f4cd700 1 -- 172.21.15.45:0/4182360998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e54004850 msgr2=0x7f6e680c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:32.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.652+0000 7f6e6f4cd700 1 --2- 172.21.15.45:0/4182360998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e54004850 0x7f6e680c7bb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6e64003f30 tx=0x7f6e640015f0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.652+0000 7f6e6f4cd700 1 -- 172.21.15.45:0/4182360998 shutdown_connections 2023-10-08T12:46:32.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.652+0000 7f6e6f4cd700 1 --2- 172.21.15.45:0/4182360998 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f6e4c06aed0 0x7f6e4c06d390 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.652+0000 7f6e6f4cd700 1 --2- 172.21.15.45:0/4182360998 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6e6815a160 0x7f6e6815a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.652+0000 7f6e6f4cd700 1 --2- 172.21.15.45:0/4182360998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e54004850 0x7f6e680c7bb0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.652+0000 7f6e6f4cd700 1 --2- 172.21.15.45:0/4182360998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e6809c950 0x7f6e68157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.652+0000 7f6e6f4cd700 1 -- 172.21.15.45:0/4182360998 >> 172.21.15.45:0/4182360998 conn(0x7f6e680cf750 msgr2=0x7f6e680af9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:32.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.652+0000 7f6e6f4cd700 1 -- 172.21.15.45:0/4182360998 shutdown_connections 2023-10-08T12:46:32.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.653+0000 7f6e6f4cd700 1 -- 172.21.15.45:0/4182360998 wait complete. 2023-10-08T12:46:32.668 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T12:46:32.687 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:46:32.714 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:46:32.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.797+0000 7f1af73c8700 1 -- 172.21.15.45:0/2066996310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1af00c9ff0 msgr2=0x7f1af00ca480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:32.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.797+0000 7f1af73c8700 1 --2- 172.21.15.45:0/2066996310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1af00c9ff0 0x7f1af00ca480 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8009f60 tx=0x7f1ae8009f90 comp rx=0 tx=0).stop 2023-10-08T12:46:32.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.797+0000 7f1af73c8700 1 -- 172.21.15.45:0/2066996310 shutdown_connections 2023-10-08T12:46:32.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.797+0000 7f1af73c8700 1 --2- 172.21.15.45:0/2066996310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1af00c9ff0 0x7f1af00ca480 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.797+0000 7f1af73c8700 1 --2- 172.21.15.45:0/2066996310 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1af00cdf60 0x7f1af015c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.797+0000 7f1af73c8700 1 -- 172.21.15.45:0/2066996310 >> 172.21.15.45:0/2066996310 conn(0x7f1af00b0430 msgr2=0x7f1af00b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:32.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.797+0000 7f1af73c8700 1 -- 172.21.15.45:0/2066996310 shutdown_connections 2023-10-08T12:46:32.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.797+0000 7f1af73c8700 1 -- 172.21.15.45:0/2066996310 wait complete. 2023-10-08T12:46:32.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.798+0000 7f1af73c8700 1 Processor -- start 2023-10-08T12:46:32.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.798+0000 7f1af73c8700 1 -- start start 2023-10-08T12:46:32.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.799+0000 7f1af73c8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1af00c9ff0 0x7f1af00ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:32.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.799+0000 7f1af73c8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1af00cdf60 0x7f1af00c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:32.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.799+0000 7f1af73c8700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1af0158950 0x7f1af00cc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:32.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.799+0000 7f1af73c8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af00a6750 con 0x7f1af00cdf60 2023-10-08T12:46:32.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.799+0000 7f1af73c8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af00add20 con 0x7f1af00c9ff0 2023-10-08T12:46:32.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.799+0000 7f1af73c8700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af00cd1e0 con 0x7f1af0158950 2023-10-08T12:46:32.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.799+0000 7f1af4963700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1af00cdf60 0x7f1af00c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:32.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.799+0000 7f1af4963700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1af00cdf60 0x7f1af00c7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37118/0 (socket says 172.21.15.45:37118) 2023-10-08T12:46:32.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.799+0000 7f1af4963700 1 -- 172.21.15.45:0/1619875386 learned_addr learned my addr 172.21.15.45:0/1619875386 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:32.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.799+0000 7f1af5965700 1 --2- 172.21.15.45:0/1619875386 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1af0158950 0x7f1af00cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:32.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.799+0000 7f1af5164700 1 --2- 172.21.15.45:0/1619875386 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1af00c9ff0 0x7f1af00ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:32.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.799+0000 7f1af4963700 1 -- 172.21.15.45:0/1619875386 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1af0158950 msgr2=0x7f1af00cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:32.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.799+0000 7f1af4963700 1 --2- 172.21.15.45:0/1619875386 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1af0158950 0x7f1af00cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.799+0000 7f1af4963700 1 -- 172.21.15.45:0/1619875386 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1af00c9ff0 msgr2=0x7f1af00ae7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:32.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.799+0000 7f1af4963700 1 --2- 172.21.15.45:0/1619875386 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1af00c9ff0 0x7f1af00ae7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:32.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.799+0000 7f1af4963700 1 -- 172.21.15.45:0/1619875386 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae0009520 con 0x7f1af00cdf60 2023-10-08T12:46:32.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.799+0000 7f1af4963700 1 --2- 172.21.15.45:0/1619875386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1af00cdf60 0x7f1af00c7db0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1ae000eb30 tx=0x7f1ae000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:32.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.799+0000 7f1ae5ffb700 1 -- 172.21.15.45:0/1619875386 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0009880 con 0x7f1af00cdf60 2023-10-08T12:46:32.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.799+0000 7f1ae5ffb700 1 -- 172.21.15.45:0/1619875386 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1ae000cbd0 con 0x7f1af00cdf60 2023-10-08T12:46:32.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.800+0000 7f1af73c8700 1 -- 172.21.15.45:0/1619875386 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae8009c40 con 0x7f1af00cdf60 2023-10-08T12:46:32.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.800+0000 7f1ae5ffb700 1 -- 172.21.15.45:0/1619875386 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0004020 con 0x7f1af00cdf60 2023-10-08T12:46:32.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.800+0000 7f1af73c8700 1 -- 172.21.15.45:0/1619875386 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af00adfc0 con 0x7f1af00cdf60 2023-10-08T12:46:32.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.801+0000 7f1af73c8700 1 -- 172.21.15.45:0/1619875386 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af004e4c0 con 0x7f1af00cdf60 2023-10-08T12:46:32.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.801+0000 7f1ae5ffb700 1 -- 172.21.15.45:0/1619875386 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1ae0004180 con 0x7f1af00cdf60 2023-10-08T12:46:32.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.801+0000 7f1ae5ffb700 1 --2- 172.21.15.45:0/1619875386 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f1ad406aed0 0x7f1ad406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:32.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.802+0000 7f1ae5ffb700 1 -- 172.21.15.45:0/1619875386 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ae0014070 con 0x7f1af00cdf60 2023-10-08T12:46:32.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.802+0000 7f1af5164700 1 --2- 172.21.15.45:0/1619875386 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f1ad406aed0 0x7f1ad406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:32.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.802+0000 7f1af5164700 1 --2- 172.21.15.45:0/1619875386 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f1ad406aed0 0x7f1ad406d390 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1af00cc600 tx=0x7f1aec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:32.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:32.806+0000 7f1ae5ffb700 1 -- 172.21.15.45:0/1619875386 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1ae0055180 con 0x7f1af00cdf60 2023-10-08T12:46:33.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:33.051+0000 7f1af73c8700 1 -- 172.21.15.45:0/1619875386 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1af00b12a0 con 0x7f1af00cdf60 2023-10-08T12:46:33.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:33.051+0000 7f1ae5ffb700 1 -- 172.21.15.45:0/1619875386 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1ae00587a0 con 0x7f1af00cdf60 2023-10-08T12:46:33.052 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T12:46:33.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:33.054+0000 7f1af73c8700 1 -- 172.21.15.45:0/1619875386 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f1ad406aed0 msgr2=0x7f1ad406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:33.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:33.054+0000 7f1af73c8700 1 --2- 172.21.15.45:0/1619875386 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f1ad406aed0 0x7f1ad406d390 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1af00cc600 tx=0x7f1aec009040 comp rx=0 tx=0).stop 2023-10-08T12:46:33.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:33.054+0000 7f1af73c8700 1 -- 172.21.15.45:0/1619875386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1af00cdf60 msgr2=0x7f1af00c7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:33.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:33.054+0000 7f1af73c8700 1 --2- 172.21.15.45:0/1619875386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1af00cdf60 0x7f1af00c7db0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1ae000eb30 tx=0x7f1ae000ee40 comp rx=0 tx=0).stop 2023-10-08T12:46:33.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:33.054+0000 7f1af73c8700 1 -- 172.21.15.45:0/1619875386 shutdown_connections 2023-10-08T12:46:33.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:33.054+0000 7f1af73c8700 1 --2- 172.21.15.45:0/1619875386 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f1ad406aed0 0x7f1ad406d390 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:33.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:33.054+0000 7f1af73c8700 1 --2- 172.21.15.45:0/1619875386 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1af0158950 0x7f1af00cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:33.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:33.054+0000 7f1af73c8700 1 --2- 172.21.15.45:0/1619875386 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1af00c9ff0 0x7f1af00ae7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:33.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:33.054+0000 7f1af73c8700 1 --2- 172.21.15.45:0/1619875386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1af00cdf60 0x7f1af00c7db0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:33.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:33.054+0000 7f1af73c8700 1 -- 172.21.15.45:0/1619875386 >> 172.21.15.45:0/1619875386 conn(0x7f1af00b0430 msgr2=0x7f1af0156c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:33.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:33.054+0000 7f1af73c8700 1 -- 172.21.15.45:0/1619875386 shutdown_connections 2023-10-08T12:46:33.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:33.054+0000 7f1af73c8700 1 -- 172.21.15.45:0/1619875386 wait complete. 2023-10-08T12:46:33.067 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T12:46:33.067 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T12:46:33.067 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-10-08T12:46:33.068 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T12:46:33.068 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T12:46:33.068 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T12:46:33.069 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T12:46:33.069 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T12:46:33.069 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T12:46:33.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:46:33.070 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-10-08T12:46:33.125 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T12:46:33.125 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T12:46:33.126 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T12:46:33.126 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:46:33.126 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-10-08T12:46:33.126 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:46:33.126 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T12:46:33.126 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-10-08T12:46:33.126 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T12:46:33.126 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-10-08T12:46:33.126 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T12:46:33.127 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-10-08T12:46:33.127 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T12:46:33.127 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42306sec preferred_lft 42306sec 2023-10-08T12:46:33.127 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-10-08T12:46:33.127 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:46:33.127 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T12:46:33.127 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-10-08T12:46:33.127 INFO:teuthology.orchestra.run.smithi045.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T12:46:33.127 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 3a:a0:6d:b0:68:09 brd ff:ff:ff:ff:ff:ff 2023-10-08T12:46:33.127 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T12:46:33.127 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:46:33.128 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::50f2:2cff:fed6:8f10/64 scope link 2023-10-08T12:46:33.128 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:46:33.128 INFO:teuthology.orchestra.run.smithi045.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T12:46:33.128 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether e6:29:a4:72:20:8b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T12:46:33.128 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::e429:a4ff:fe72:208b/64 scope link 2023-10-08T12:46:33.128 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:46:33.128 INFO:teuthology.orchestra.run.smithi045.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T12:46:33.128 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 3a:a0:6d:b0:68:09 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T12:46:33.128 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::38a0:6dff:feb0:6809/64 scope link 2023-10-08T12:46:33.128 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:46:33.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:46:33.129 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T12:46:33.191 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-10-08T12:46:33.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:46:33.193 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-10-08T12:46:33.252 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-10-08T12:46:33.252 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T12:46:33.253 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T12:46:33.253 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T12:46:33.253 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T12:46:33.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:46:33.253 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-10-08T12:46:33.253 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-10-08T12:46:33.253 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T12:46:33.253 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T12:46:33.253 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T12:46:33.254 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-10-08T12:46:33.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:46:33.359 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-10-08T12:46:33.378 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T12:46:33.378 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T12:46:33.379 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T12:46:33.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:46:33.379 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-10-08T12:46:33.446 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T12:46:33.446 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T12:46:33.503 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T12:46:33.504 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T12:46:33.504 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T12:46:33.560 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T12:46:33.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:46:33.560 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T12:46:33.648 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T12:46:33.648 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T12:46:33.679 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T12:46:33.679 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T12:46:33.680 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.78:3300,172.21.15.78:3301" 2023-10-08T12:46:33.680 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with new device syntax: 0@3c5c3516-8181-4382-8205-f21bea7ad4b3.cephfs=/ 2023-10-08T12:46:33.680 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.45:3300/172.21.15.78:3300/172.21.15.78:3301" will pass to kernel 2023-10-08T12:46:33.680 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T12:46:33.680 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T12:46:33.680 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T12:46:33.716 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T12:46:33.716 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T12:46:33.716 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.78:3300,172.21.15.78:3301" 2023-10-08T12:46:33.716 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with new device syntax: 0@3c5c3516-8181-4382-8205-f21bea7ad4b3.cephfs=/ 2023-10-08T12:46:33.717 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.45:3300/172.21.15.78:3300/172.21.15.78:3301" will pass to kernel 2023-10-08T12:46:33.717 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T12:46:33.717 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T12:46:33.717 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T12:46:33.717 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:6789,172.21.15.78:6789,172.21.15.78:6790" 2023-10-08T12:46:33.717 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.45:6789,172.21.15.78:6789,172.21.15.78:6790:/ 2023-10-08T12:46:33.717 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=3c5c3516-8181-4382-8205-f21bea7ad4b3" will pass to kernel 2023-10-08T12:46:33.722 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T12:46:33.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:46:33.723 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T12:46:33.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:46:33.760 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T12:46:33.844 INFO:teuthology.orchestra.run.smithi045.stdout:client5376 2023-10-08T12:46:33.844 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:46:33.844 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T12:46:33.902 DEBUG:teuthology.orchestra.run.smithi045:> mktemp -d --suffix=xfstests-dev 2023-10-08T12:46:33.958 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.UxcFNZjwoAxfstests-dev 2023-10-08T12:46:33.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:46:33.959 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.UxcFNZjwoAxfstests-dev) 2023-10-08T12:46:34.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:46:34.027 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.UxcFNZjwoAxfstests-dev) 2023-10-08T12:46:34.087 INFO:teuthology.orchestra.run.smithi045.stderr:Cloning into '/tmp/tmp.UxcFNZjwoAxfstests-dev'... 2023-10-08T12:46:34.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:46:34.774 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-10-08T12:46:34.837 DEBUG:teuthology.orchestra.run.smithi045:> mktemp -d --suffix=test 2023-10-08T12:46:34.894 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.lmDbLrXMb9test 2023-10-08T12:46:34.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:46:34.894 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-10-08T12:46:34.952 DEBUG:teuthology.orchestra.run.smithi045:> mktemp -d --suffix=scratch 2023-10-08T12:46:35.010 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:46:35.010 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "rhel" and "8.6". 2023-10-08T12:46:35.011 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python3 sqlite xfsprogs-qa-devel 2023-10-08T12:46:35.426 INFO:teuthology.orchestra.run.smithi045.stdout:Updating Subscription Management repositories. 2023-10-08T12:46:36.821 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:04:15 ago on Sun 08 Oct 2023 12:42:21 PM UTC. 2023-10-08T12:46:38.268 INFO:teuthology.orchestra.run.smithi045.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-10-08T12:46:38.269 INFO:teuthology.orchestra.run.smithi045.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-10-08T12:46:38.270 INFO:teuthology.orchestra.run.smithi045.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-10-08T12:46:38.271 INFO:teuthology.orchestra.run.smithi045.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-10-08T12:46:38.272 INFO:teuthology.orchestra.run.smithi045.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-10-08T12:46:38.275 INFO:teuthology.orchestra.run.smithi045.stdout:Package e2fsprogs-1.45.6-4.el8.x86_64 is already installed. 2023-10-08T12:46:38.277 INFO:teuthology.orchestra.run.smithi045.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-10-08T12:46:38.278 INFO:teuthology.orchestra.run.smithi045.stdout:Package gcc-8.5.0-10.1.el8_6.x86_64 is already installed. 2023-10-08T12:46:38.280 INFO:teuthology.orchestra.run.smithi045.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-10-08T12:46:38.281 INFO:teuthology.orchestra.run.smithi045.stdout:Package lvm2-8:2.03.14-3.el8_6.2.x86_64 is already installed. 2023-10-08T12:46:38.283 INFO:teuthology.orchestra.run.smithi045.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-10-08T12:46:38.284 INFO:teuthology.orchestra.run.smithi045.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-10-08T12:46:38.285 INFO:teuthology.orchestra.run.smithi045.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-10-08T12:46:38.286 INFO:teuthology.orchestra.run.smithi045.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-10-08T12:46:38.287 INFO:teuthology.orchestra.run.smithi045.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-08T12:46:38.289 INFO:teuthology.orchestra.run.smithi045.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-08T12:46:38.290 INFO:teuthology.orchestra.run.smithi045.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-08T12:46:38.291 INFO:teuthology.orchestra.run.smithi045.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-08T12:46:38.292 INFO:teuthology.orchestra.run.smithi045.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-10-08T12:46:38.293 INFO:teuthology.orchestra.run.smithi045.stdout:Package libuuid-devel-2.32.1-35.el8.x86_64 is already installed. 2023-10-08T12:46:38.295 INFO:teuthology.orchestra.run.smithi045.stdout:Package xfsprogs-devel-5.0.0-10.el8.x86_64 is already installed. 2023-10-08T12:46:38.299 INFO:teuthology.orchestra.run.smithi045.stdout:Package python36-3.6.8-38.module+el8.5.0+12207+5c5719bc.x86_64 is already installed. 2023-10-08T12:46:38.301 INFO:teuthology.orchestra.run.smithi045.stdout:Package sqlite-3.26.0-15.el8.x86_64 is already installed. 2023-10-08T12:46:38.305 INFO:teuthology.orchestra.run.smithi045.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-08T12:46:38.427 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2023-10-08T12:46:38.428 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2023-10-08T12:46:38.428 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2023-10-08T12:46:38.428 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2023-10-08T12:46:38.429 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2023-10-08T12:46:38.429 INFO:teuthology.orchestra.run.smithi045.stdout: dump x86_64 1:0.4-0.36.b46.el8 rhel-8-for-x86_64-baseos-rpms 164 k 2023-10-08T12:46:38.429 INFO:teuthology.orchestra.run.smithi045.stdout: fio x86_64 3.19-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T12:46:38.429 INFO:teuthology.orchestra.run.smithi045.stdout: indent x86_64 2.2.13-4.el8 epel 187 k 2023-10-08T12:46:38.429 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrading: 2023-10-08T12:46:38.429 INFO:teuthology.orchestra.run.smithi045.stdout: sqlite x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 668 k 2023-10-08T12:46:38.429 INFO:teuthology.orchestra.run.smithi045.stdout: sqlite-libs x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 581 k 2023-10-08T12:46:38.429 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2023-10-08T12:46:38.429 INFO:teuthology.orchestra.run.smithi045.stdout: daxctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 42 k 2023-10-08T12:46:38.429 INFO:teuthology.orchestra.run.smithi045.stdout: libpmemblk x86_64 1.6.1-1.el8 rhel-8-for-x86_64-appstream-rpms 92 k 2023-10-08T12:46:38.429 INFO:teuthology.orchestra.run.smithi045.stdout: ndctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 79 k 2023-10-08T12:46:38.430 INFO:teuthology.orchestra.run.smithi045.stdout: rmt x86_64 2:1.5.3-13.el8 rhel-8-for-x86_64-baseos-rpms 51 k 2023-10-08T12:46:38.430 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:46:38.430 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2023-10-08T12:46:38.430 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2023-10-08T12:46:38.430 INFO:teuthology.orchestra.run.smithi045.stdout:Install 7 Packages 2023-10-08T12:46:38.430 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrade 2 Packages 2023-10-08T12:46:38.430 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:46:38.431 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 2.3 M 2023-10-08T12:46:38.431 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2023-10-08T12:46:38.646 INFO:teuthology.orchestra.run.smithi045.stdout:(1/9): indent-2.2.13-4.el8.x86_64.rpm 1.0 MB/s | 187 kB 00:00 2023-10-08T12:46:38.721 INFO:teuthology.orchestra.run.smithi045.stdout:(2/9): libpmemblk-1.6.1-1.el8.x86_64.rpm 351 kB/s | 92 kB 00:00 2023-10-08T12:46:38.763 INFO:teuthology.orchestra.run.smithi045.stdout:(3/9): fio-3.19-3.el8.x86_64.rpm 1.7 MB/s | 538 kB 00:00 2023-10-08T12:46:38.972 INFO:teuthology.orchestra.run.smithi045.stdout:(4/9): dump-0.4-0.36.b46.el8.x86_64.rpm 503 kB/s | 164 kB 00:00 2023-10-08T12:46:39.014 INFO:teuthology.orchestra.run.smithi045.stdout:(5/9): rmt-1.5.3-13.el8.x86_64.rpm 176 kB/s | 51 kB 00:00 2023-10-08T12:46:39.097 INFO:teuthology.orchestra.run.smithi045.stdout:(6/9): daxctl-libs-71.1-3.el8.x86_64.rpm 125 kB/s | 42 kB 00:00 2023-10-08T12:46:39.198 INFO:teuthology.orchestra.run.smithi045.stdout:(7/9): ndctl-libs-71.1-3.el8.x86_64.rpm 349 kB/s | 79 kB 00:00 2023-10-08T12:46:39.298 INFO:teuthology.orchestra.run.smithi045.stdout:(8/9): sqlite-3.26.0-16.el8_6.x86_64.rpm 2.3 MB/s | 668 kB 00:00 2023-10-08T12:46:39.331 INFO:teuthology.orchestra.run.smithi045.stdout:(9/9): sqlite-libs-3.26.0-16.el8_6.x86_64.rpm 2.4 MB/s | 581 kB 00:00 2023-10-08T12:46:39.332 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2023-10-08T12:46:39.332 INFO:teuthology.orchestra.run.smithi045.stdout:Total 2.6 MB/s | 2.3 MB 00:00 2023-10-08T12:46:39.430 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2023-10-08T12:46:39.466 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2023-10-08T12:46:39.466 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2023-10-08T12:46:39.561 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2023-10-08T12:46:39.566 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2023-10-08T12:46:39.987 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2023-10-08T12:46:40.115 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : daxctl-libs-71.1-3.el8.x86_64 1/11 2023-10-08T12:46:40.213 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: daxctl-libs-71.1-3.el8.x86_64 1/11 2023-10-08T12:46:40.390 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ndctl-libs-71.1-3.el8.x86_64 2/11 2023-10-08T12:46:40.465 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ndctl-libs-71.1-3.el8.x86_64 2/11 2023-10-08T12:46:40.649 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 3/11 2023-10-08T12:46:40.793 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 3/11 2023-10-08T12:46:40.991 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : sqlite-libs-3.26.0-16.el8_6.x86_64 4/11 2023-10-08T12:46:41.134 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 5/11 2023-10-08T12:46:41.417 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 6/11 2023-10-08T12:46:41.711 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : sqlite-3.26.0-16.el8_6.x86_64 7/11 2023-10-08T12:46:41.980 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : fio-3.19-3.el8.x86_64 8/11 2023-10-08T12:46:42.141 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : indent-2.2.13-4.el8.x86_64 9/11 2023-10-08T12:46:42.288 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : sqlite-3.26.0-15.el8.x86_64 10/11 2023-10-08T12:46:42.430 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : sqlite-libs-3.26.0-15.el8.x86_64 11/11 2023-10-08T12:46:42.717 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: sqlite-libs-3.26.0-15.el8.x86_64 11/11 2023-10-08T12:46:42.717 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : indent-2.2.13-4.el8.x86_64 1/11 2023-10-08T12:46:42.717 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : fio-3.19-3.el8.x86_64 2/11 2023-10-08T12:46:42.717 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 3/11 2023-10-08T12:46:42.718 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 4/11 2023-10-08T12:46:42.718 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 5/11 2023-10-08T12:46:42.718 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : daxctl-libs-71.1-3.el8.x86_64 6/11 2023-10-08T12:46:42.718 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ndctl-libs-71.1-3.el8.x86_64 7/11 2023-10-08T12:46:42.718 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : sqlite-3.26.0-16.el8_6.x86_64 8/11 2023-10-08T12:46:42.718 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : sqlite-3.26.0-15.el8.x86_64 9/11 2023-10-08T12:46:42.718 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : sqlite-libs-3.26.0-16.el8_6.x86_64 10/11 2023-10-08T12:46:44.043 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : sqlite-libs-3.26.0-15.el8.x86_64 11/11 2023-10-08T12:46:44.043 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:04:23 ago on Sun 08 Oct 2023 12:42:21 PM UTC. 2023-10-08T12:46:49.365 INFO:teuthology.orchestra.run.smithi045.stdout:Installed products updated. 2023-10-08T12:46:49.575 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:46:49.575 INFO:teuthology.orchestra.run.smithi045.stdout:Upgraded: 2023-10-08T12:46:49.576 INFO:teuthology.orchestra.run.smithi045.stdout: sqlite-3.26.0-16.el8_6.x86_64 sqlite-libs-3.26.0-16.el8_6.x86_64 2023-10-08T12:46:49.576 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2023-10-08T12:46:49.576 INFO:teuthology.orchestra.run.smithi045.stdout: daxctl-libs-71.1-3.el8.x86_64 dump-1:0.4-0.36.b46.el8.x86_64 2023-10-08T12:46:49.576 INFO:teuthology.orchestra.run.smithi045.stdout: fio-3.19-3.el8.x86_64 indent-2.2.13-4.el8.x86_64 2023-10-08T12:46:49.576 INFO:teuthology.orchestra.run.smithi045.stdout: libpmemblk-1.6.1-1.el8.x86_64 ndctl-libs-71.1-3.el8.x86_64 2023-10-08T12:46:49.576 INFO:teuthology.orchestra.run.smithi045.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-10-08T12:46:49.577 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:46:49.577 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2023-10-08T12:46:49.742 DEBUG:teuthology.orchestra.run.smithi045:> sudo useradd -m fsgqa 2023-10-08T12:46:49.771 INFO:teuthology.orchestra.run.smithi045.stderr:useradd: user 'fsgqa' already exists 2023-10-08T12:46:49.772 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-10-08T12:46:49.773 DEBUG:teuthology.orchestra.run.smithi045:> sudo groupadd fsgqa 2023-10-08T12:46:49.840 INFO:teuthology.orchestra.run.smithi045.stderr:groupadd: group 'fsgqa' already exists 2023-10-08T12:46:49.841 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-10-08T12:46:49.841 DEBUG:teuthology.orchestra.run.smithi045:> sudo useradd fsgqa2 2023-10-08T12:46:50.934 DEBUG:teuthology.orchestra.run.smithi045:> sudo useradd 123456-fsgqa 2023-10-08T12:46:53.752 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-10-08T12:46:54.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.338+0000 7f0dd19b3700 1 -- 172.21.15.45:0/207090444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dcc0cb490 msgr2=0x7f0dcc06c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:54.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.338+0000 7f0dd19b3700 1 --2- 172.21.15.45:0/207090444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dcc0cb490 0x7f0dcc06c820 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc070dd0 tx=0x7f0dbc009c70 comp rx=0 tx=0).stop 2023-10-08T12:46:54.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.338+0000 7f0dd19b3700 1 -- 172.21.15.45:0/207090444 shutdown_connections 2023-10-08T12:46:54.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.338+0000 7f0dd19b3700 1 --2- 172.21.15.45:0/207090444 >> v2:172.21.15.78:3300/0 conn(0x7f0dcc0cb910 0x7f0dcc06cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:54.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.338+0000 7f0dd19b3700 1 --2- 172.21.15.45:0/207090444 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0dcc0b2b30 0x7f0dcc0b2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:54.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.338+0000 7f0dd19b3700 1 --2- 172.21.15.45:0/207090444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dcc0cb490 0x7f0dcc06c820 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:54.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.338+0000 7f0dd19b3700 1 -- 172.21.15.45:0/207090444 >> 172.21.15.45:0/207090444 conn(0x7f0dcc06a210 msgr2=0x7f0dcc06a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:54.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.338+0000 7f0dd19b3700 1 -- 172.21.15.45:0/207090444 shutdown_connections 2023-10-08T12:46:54.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.338+0000 7f0dd19b3700 1 -- 172.21.15.45:0/207090444 wait complete. 2023-10-08T12:46:54.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.339+0000 7f0dd19b3700 1 Processor -- start 2023-10-08T12:46:54.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.339+0000 7f0dd19b3700 1 -- start start 2023-10-08T12:46:54.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.340+0000 7f0dd19b3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dcc0b2b30 0x7f0dcc159250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:54.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.340+0000 7f0dd19b3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dcc0cb490 0x7f0dcc141cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:54.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.340+0000 7f0dd19b3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0dcc0cb910 0x7f0dcc1421f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:54.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.340+0000 7f0dd19b3700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc12e2b0 con 0x7f0dcc0cb490 2023-10-08T12:46:54.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.340+0000 7f0dd19b3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc12dc80 con 0x7f0dcc0b2b30 2023-10-08T12:46:54.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.340+0000 7f0dd19b3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc0a7600 con 0x7f0dcc0cb910 2023-10-08T12:46:54.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.340+0000 7f0dca7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dcc0cb490 0x7f0dcc141cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:54.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.340+0000 7f0dca7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dcc0cb490 0x7f0dcc141cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37156/0 (socket says 172.21.15.45:37156) 2023-10-08T12:46:54.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.340+0000 7f0dca7fc700 1 -- 172.21.15.45:0/2471585847 learned_addr learned my addr 172.21.15.45:0/2471585847 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:54.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.340+0000 7f0dcaffd700 1 --2- 172.21.15.45:0/2471585847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dcc0b2b30 0x7f0dcc159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:54.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.340+0000 7f0dcb7fe700 1 --2- 172.21.15.45:0/2471585847 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0dcc0cb910 0x7f0dcc1421f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:54.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.341+0000 7f0dca7fc700 1 -- 172.21.15.45:0/2471585847 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0dcc0cb910 msgr2=0x7f0dcc1421f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:54.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.341+0000 7f0dca7fc700 1 --2- 172.21.15.45:0/2471585847 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0dcc0cb910 0x7f0dcc1421f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:54.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.341+0000 7f0dca7fc700 1 -- 172.21.15.45:0/2471585847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dcc0b2b30 msgr2=0x7f0dcc159250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:54.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.341+0000 7f0dca7fc700 1 --2- 172.21.15.45:0/2471585847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dcc0b2b30 0x7f0dcc159250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:54.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.341+0000 7f0dca7fc700 1 -- 172.21.15.45:0/2471585847 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dbc0095f0 con 0x7f0dcc0cb490 2023-10-08T12:46:54.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.341+0000 7f0dcaffd700 1 --2- 172.21.15.45:0/2471585847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dcc0b2b30 0x7f0dcc159250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:54.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.341+0000 7f0dca7fc700 1 --2- 172.21.15.45:0/2471585847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dcc0cb490 0x7f0dcc141cb0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc06eb40 tx=0x7f0dbc004240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:54.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.341+0000 7f0db3fff700 1 -- 172.21.15.45:0/2471585847 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc01d070 con 0x7f0dcc0cb490 2023-10-08T12:46:54.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.341+0000 7f0db3fff700 1 -- 172.21.15.45:0/2471585847 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0dbc003890 con 0x7f0dcc0cb490 2023-10-08T12:46:54.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.341+0000 7f0dd19b3700 1 -- 172.21.15.45:0/2471585847 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dcc12df40 con 0x7f0dcc0cb490 2023-10-08T12:46:54.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.341+0000 7f0db3fff700 1 -- 172.21.15.45:0/2471585847 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc0045f0 con 0x7f0dcc0cb490 2023-10-08T12:46:54.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.341+0000 7f0dd19b3700 1 -- 172.21.15.45:0/2471585847 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dcc159790 con 0x7f0dcc0cb490 2023-10-08T12:46:54.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.342+0000 7f0dd19b3700 1 -- 172.21.15.45:0/2471585847 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dcc0ac9f0 con 0x7f0dcc0cb490 2023-10-08T12:46:54.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.342+0000 7f0db3fff700 1 -- 172.21.15.45:0/2471585847 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0dbc003c80 con 0x7f0dcc0cb490 2023-10-08T12:46:54.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.343+0000 7f0db3fff700 1 --2- 172.21.15.45:0/2471585847 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0db806aed0 0x7f0db806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:54.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.343+0000 7f0db3fff700 1 -- 172.21.15.45:0/2471585847 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0dbc08ae60 con 0x7f0dcc0cb490 2023-10-08T12:46:54.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.343+0000 7f0dcaffd700 1 --2- 172.21.15.45:0/2471585847 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0db806aed0 0x7f0db806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:54.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.344+0000 7f0dcaffd700 1 --2- 172.21.15.45:0/2471585847 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0db806aed0 0x7f0db806d390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0dc000bc70 tx=0x7f0dc000b2c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:54.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.348+0000 7f0db3fff700 1 -- 172.21.15.45:0/2471585847 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0dbc056040 con 0x7f0dcc0cb490 2023-10-08T12:46:54.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.632+0000 7f0dd19b3700 1 -- 172.21.15.45:0/2471585847 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0dcc04e4c0 con 0x7f0dcc0cb490 2023-10-08T12:46:54.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.632+0000 7f0db3fff700 1 -- 172.21.15.45:0/2471585847 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1268 (secure 0 0 0) 0x7f0dbc027090 con 0x7f0dcc0cb490 2023-10-08T12:46:54.632 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:46:54.633 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":1,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","modified":"2023-10-08T12:44:34.390746Z","created":"2023-10-08T12:44:34.390746Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3301","nonce":0},{"type":"v1","addr":"172.21.15.78:6790","nonce":0}]},"addr":"172.21.15.78:6790/0","public_addr":"172.21.15.78:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-10-08T12:46:54.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.634+0000 7f0dd19b3700 1 -- 172.21.15.45:0/2471585847 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0db806aed0 msgr2=0x7f0db806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.634+0000 7f0dd19b3700 1 --2- 172.21.15.45:0/2471585847 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0db806aed0 0x7f0db806d390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0dc000bc70 tx=0x7f0dc000b2c0 comp rx=0 tx=0).stop 2023-10-08T12:46:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.634+0000 7f0dd19b3700 1 -- 172.21.15.45:0/2471585847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dcc0cb490 msgr2=0x7f0dcc141cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.634+0000 7f0dd19b3700 1 --2- 172.21.15.45:0/2471585847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dcc0cb490 0x7f0dcc141cb0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc06eb40 tx=0x7f0dbc004240 comp rx=0 tx=0).stop 2023-10-08T12:46:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.634+0000 7f0dd19b3700 1 -- 172.21.15.45:0/2471585847 shutdown_connections 2023-10-08T12:46:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.634+0000 7f0dd19b3700 1 --2- 172.21.15.45:0/2471585847 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f0db806aed0 0x7f0db806d390 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.634+0000 7f0dd19b3700 1 --2- 172.21.15.45:0/2471585847 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0dcc0cb910 0x7f0dcc1421f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.634+0000 7f0dd19b3700 1 --2- 172.21.15.45:0/2471585847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dcc0b2b30 0x7f0dcc159250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.634+0000 7f0dd19b3700 1 --2- 172.21.15.45:0/2471585847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dcc0cb490 0x7f0dcc141cb0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.634+0000 7f0dd19b3700 1 -- 172.21.15.45:0/2471585847 >> 172.21.15.45:0/2471585847 conn(0x7f0dcc06a210 msgr2=0x7f0dcc15c200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.635+0000 7f0dd19b3700 1 -- 172.21.15.45:0/2471585847 shutdown_connections 2023-10-08T12:46:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.635+0000 7f0dd19b3700 1 -- 172.21.15.45:0/2471585847 wait complete. 2023-10-08T12:46:54.636 INFO:teuthology.orchestra.run.smithi045.stderr:dumped monmap epoch 1 2023-10-08T12:46:54.647 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-10-08T12:46:54.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.777+0000 7f12086b1700 1 -- 172.21.15.45:0/3644750337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1200159960 msgr2=0x7f12000b1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:54.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.777+0000 7f12086b1700 1 --2- 172.21.15.45:0/3644750337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1200159960 0x7f12000b1730 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f11fc0098c0 tx=0x7f11fc009bd0 comp rx=0 tx=0).stop 2023-10-08T12:46:54.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.777+0000 7f12086b1700 1 -- 172.21.15.45:0/3644750337 shutdown_connections 2023-10-08T12:46:54.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.777+0000 7f12086b1700 1 --2- 172.21.15.45:0/3644750337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1200159960 0x7f12000b1730 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:54.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.777+0000 7f12086b1700 1 --2- 172.21.15.45:0/3644750337 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12000b3fb0 0x7f12000b4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:54.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.777+0000 7f12086b1700 1 -- 172.21.15.45:0/3644750337 >> 172.21.15.45:0/3644750337 conn(0x7f12000b0430 msgr2=0x7f12000b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:54.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.777+0000 7f12086b1700 1 -- 172.21.15.45:0/3644750337 shutdown_connections 2023-10-08T12:46:54.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.777+0000 7f12086b1700 1 -- 172.21.15.45:0/3644750337 wait complete. 2023-10-08T12:46:54.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.778+0000 7f12086b1700 1 Processor -- start 2023-10-08T12:46:54.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.778+0000 7f12086b1700 1 -- start start 2023-10-08T12:46:54.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.779+0000 7f12086b1700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f120006a210 0x7f120015a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:54.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.779+0000 7f12086b1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12000b3fb0 0x7f120015b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:54.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.779+0000 7f12086b1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1200159960 0x7f120015caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:54.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.779+0000 7f12086b1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120015c870 con 0x7f1200159960 2023-10-08T12:46:54.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.779+0000 7f12086b1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120015a690 con 0x7f12000b3fb0 2023-10-08T12:46:54.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.779+0000 7f12086b1700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f120015a970 con 0x7f120006a210 2023-10-08T12:46:54.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.779+0000 7f1206c4e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1200159960 0x7f120015caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:54.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.779+0000 7f1206c4e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1200159960 0x7f120015caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37172/0 (socket says 172.21.15.45:37172) 2023-10-08T12:46:54.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.779+0000 7f1206c4e700 1 -- 172.21.15.45:0/3807253158 learned_addr learned my addr 172.21.15.45:0/3807253158 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T12:46:54.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.780+0000 7f1205c4c700 1 --2- 172.21.15.45:0/3807253158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12000b3fb0 0x7f120015b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:54.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.780+0000 7f120644d700 1 --2- 172.21.15.45:0/3807253158 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f120006a210 0x7f120015a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:54.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.780+0000 7f1206c4e700 1 -- 172.21.15.45:0/3807253158 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f120006a210 msgr2=0x7f120015a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:54.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.780+0000 7f1206c4e700 1 --2- 172.21.15.45:0/3807253158 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f120006a210 0x7f120015a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:54.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.780+0000 7f1206c4e700 1 -- 172.21.15.45:0/3807253158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12000b3fb0 msgr2=0x7f120015b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:54.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.780+0000 7f1206c4e700 1 --2- 172.21.15.45:0/3807253158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12000b3fb0 0x7f120015b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:54.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.780+0000 7f1206c4e700 1 -- 172.21.15.45:0/3807253158 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc009520 con 0x7f1200159960 2023-10-08T12:46:54.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.780+0000 7f1205c4c700 1 --2- 172.21.15.45:0/3807253158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12000b3fb0 0x7f120015b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:54.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.780+0000 7f120644d700 1 --2- 172.21.15.45:0/3807253158 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f120006a210 0x7f120015a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:54.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.780+0000 7f1206c4e700 1 --2- 172.21.15.45:0/3807253158 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1200159960 0x7f120015caf0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f11f800cbc0 tx=0x7f11f800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:54.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.780+0000 7f11f2ffd700 1 -- 172.21.15.45:0/3807253158 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f800abb0 con 0x7f1200159960 2023-10-08T12:46:54.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.780+0000 7f11f2ffd700 1 -- 172.21.15.45:0/3807253158 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f11f800ae00 con 0x7f1200159960 2023-10-08T12:46:54.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.780+0000 7f11f2ffd700 1 -- 172.21.15.45:0/3807253158 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f8012680 con 0x7f1200159960 2023-10-08T12:46:54.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.780+0000 7f12086b1700 1 -- 172.21.15.45:0/3807253158 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f120015ac50 con 0x7f1200159960 2023-10-08T12:46:54.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.780+0000 7f12086b1700 1 -- 172.21.15.45:0/3807253158 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f120015b210 con 0x7f1200159960 2023-10-08T12:46:54.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.781+0000 7f12086b1700 1 -- 172.21.15.45:0/3807253158 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f120015b430 con 0x7f1200159960 2023-10-08T12:46:54.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.781+0000 7f11f2ffd700 1 -- 172.21.15.45:0/3807253158 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f11f801a3b0 con 0x7f1200159960 2023-10-08T12:46:54.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.782+0000 7f11f2ffd700 1 --2- 172.21.15.45:0/3807253158 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f11e406aed0 0x7f11e406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:54.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.782+0000 7f11f2ffd700 1 -- 172.21.15.45:0/3807253158 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11f8089c40 con 0x7f1200159960 2023-10-08T12:46:54.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.782+0000 7f120644d700 1 --2- 172.21.15.45:0/3807253158 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f11e406aed0 0x7f11e406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:54.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.783+0000 7f120644d700 1 --2- 172.21.15.45:0/3807253158 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f11e406aed0 0x7f11e406d390 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f11fc000c00 tx=0x7f11fc019040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:54.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:54.786+0000 7f11f2ffd700 1 -- 172.21.15.45:0/3807253158 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f11f8054d00 con 0x7f1200159960 2023-10-08T12:46:55.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:55.068+0000 7f12086b1700 1 -- 172.21.15.45:0/3807253158 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f120004e4c0 con 0x7f1200159960 2023-10-08T12:46:55.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:55.069+0000 7f11f2ffd700 1 -- 172.21.15.45:0/3807253158 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v15) v1 ==== 92+0+63 (secure 0 0 0) 0x7f11f8058320 con 0x7f1200159960 2023-10-08T12:46:55.070 INFO:teuthology.orchestra.run.smithi045.stdout:[client.admin] 2023-10-08T12:46:55.070 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== 2023-10-08T12:46:55.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:55.071+0000 7f12086b1700 1 -- 172.21.15.45:0/3807253158 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f11e406aed0 msgr2=0x7f11e406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:55.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:55.071+0000 7f12086b1700 1 --2- 172.21.15.45:0/3807253158 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f11e406aed0 0x7f11e406d390 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f11fc000c00 tx=0x7f11fc019040 comp rx=0 tx=0).stop 2023-10-08T12:46:55.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:55.071+0000 7f12086b1700 1 -- 172.21.15.45:0/3807253158 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1200159960 msgr2=0x7f120015caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:55.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:55.071+0000 7f12086b1700 1 --2- 172.21.15.45:0/3807253158 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1200159960 0x7f120015caf0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f11f800cbc0 tx=0x7f11f800cf80 comp rx=0 tx=0).stop 2023-10-08T12:46:55.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:55.071+0000 7f12086b1700 1 -- 172.21.15.45:0/3807253158 shutdown_connections 2023-10-08T12:46:55.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:55.071+0000 7f12086b1700 1 --2- 172.21.15.45:0/3807253158 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f11e406aed0 0x7f11e406d390 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:55.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:55.071+0000 7f12086b1700 1 --2- 172.21.15.45:0/3807253158 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1200159960 0x7f120015caf0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:55.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:55.071+0000 7f12086b1700 1 --2- 172.21.15.45:0/3807253158 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f120006a210 0x7f120015a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:55.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:55.071+0000 7f12086b1700 1 --2- 172.21.15.45:0/3807253158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12000b3fb0 0x7f120015b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:55.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:55.071+0000 7f12086b1700 1 -- 172.21.15.45:0/3807253158 >> 172.21.15.45:0/3807253158 conn(0x7f12000b0430 msgr2=0x7f12000c7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:55.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:55.071+0000 7f12086b1700 1 -- 172.21.15.45:0/3807253158 shutdown_connections 2023-10-08T12:46:55.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T12:46:55.071+0000 7f12086b1700 1 -- 172.21.15.45:0/3807253158 wait complete. 2023-10-08T12:46:55.084 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:46:55.084 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/tmp/tmp.UxcFNZjwoAxfstests-dev/local.config 2023-10-08T12:46:55.112 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.45:6789:/test export TEST_DIR=/tmp/tmp.lmDbLrXMb9test export SCRATCH_DEV=172.21.15.45:6789:/scratch export SCRATCH_MNT=/tmp/tmp.f1V86IqBIQscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA==" 2023-10-08T12:46:55.112 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T12:46:55.112 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/tmp/tmp.UxcFNZjwoAxfstests-dev/ceph.exclude 2023-10-08T12:46:55.178 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo make) 2023-10-08T12:46:55.262 INFO:teuthology.orchestra.run.smithi045.stdout:libtoolize -cfi 2023-10-08T12:46:55.609 INFO:teuthology.orchestra.run.smithi045.stdout:libtoolize: putting auxiliary files in '.'. 2023-10-08T12:46:55.609 INFO:teuthology.orchestra.run.smithi045.stdout:libtoolize: copying file './config.guess' 2023-10-08T12:46:55.612 INFO:teuthology.orchestra.run.smithi045.stdout:libtoolize: copying file './config.sub' 2023-10-08T12:46:55.616 INFO:teuthology.orchestra.run.smithi045.stdout:libtoolize: copying file './install-sh' 2023-10-08T12:46:55.620 INFO:teuthology.orchestra.run.smithi045.stdout:libtoolize: copying file './ltmain.sh' 2023-10-08T12:46:55.641 INFO:teuthology.orchestra.run.smithi045.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-10-08T12:46:55.641 INFO:teuthology.orchestra.run.smithi045.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-10-08T12:46:55.645 INFO:teuthology.orchestra.run.smithi045.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-10-08T12:46:55.649 INFO:teuthology.orchestra.run.smithi045.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-10-08T12:46:55.654 INFO:teuthology.orchestra.run.smithi045.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-10-08T12:46:55.658 INFO:teuthology.orchestra.run.smithi045.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-10-08T12:46:55.664 INFO:teuthology.orchestra.run.smithi045.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-10-08T12:46:55.665 INFO:teuthology.orchestra.run.smithi045.stdout:cp include/install-sh . 2023-10-08T12:46:55.667 INFO:teuthology.orchestra.run.smithi045.stdout:aclocal -I m4 2023-10-08T12:46:56.862 INFO:teuthology.orchestra.run.smithi045.stdout:autoheader 2023-10-08T12:46:57.172 INFO:teuthology.orchestra.run.smithi045.stdout:autoconf 2023-10-08T12:46:57.341 INFO:teuthology.orchestra.run.smithi045.stdout:./configure \ 2023-10-08T12:46:57.341 INFO:teuthology.orchestra.run.smithi045.stdout: --libexecdir=/usr/lib \ 2023-10-08T12:46:57.341 INFO:teuthology.orchestra.run.smithi045.stdout: --exec_prefix=/var/lib 2023-10-08T12:46:57.812 INFO:teuthology.orchestra.run.smithi045.stdout:checking build system type... x86_64-pc-linux-gnu 2023-10-08T12:46:57.812 INFO:teuthology.orchestra.run.smithi045.stdout:checking host system type... x86_64-pc-linux-gnu 2023-10-08T12:46:57.813 INFO:teuthology.orchestra.run.smithi045.stdout:checking how to print strings... printf 2023-10-08T12:46:57.813 INFO:teuthology.orchestra.run.smithi045.stdout:checking for gcc... gcc 2023-10-08T12:46:57.932 INFO:teuthology.orchestra.run.smithi045.stdout:checking whether the C compiler works... yes 2023-10-08T12:46:57.932 INFO:teuthology.orchestra.run.smithi045.stdout:checking for C compiler default output file name... a.out 2023-10-08T12:46:57.961 INFO:teuthology.orchestra.run.smithi045.stdout:checking for suffix of executables... 2023-10-08T12:46:58.006 INFO:teuthology.orchestra.run.smithi045.stdout:checking whether we are cross compiling... no 2023-10-08T12:46:58.025 INFO:teuthology.orchestra.run.smithi045.stdout:checking for suffix of object files... o 2023-10-08T12:46:58.045 INFO:teuthology.orchestra.run.smithi045.stdout:checking whether we are using the GNU C compiler... yes 2023-10-08T12:46:58.064 INFO:teuthology.orchestra.run.smithi045.stdout:checking whether gcc accepts -g... yes 2023-10-08T12:46:58.099 INFO:teuthology.orchestra.run.smithi045.stdout:checking for gcc option to accept ISO C89... none needed 2023-10-08T12:46:58.101 INFO:teuthology.orchestra.run.smithi045.stdout:checking for a sed that does not truncate output... /bin/sed 2023-10-08T12:46:58.103 INFO:teuthology.orchestra.run.smithi045.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-10-08T12:46:58.104 INFO:teuthology.orchestra.run.smithi045.stdout:checking for egrep... /bin/grep -E 2023-10-08T12:46:58.106 INFO:teuthology.orchestra.run.smithi045.stdout:checking for fgrep... /bin/grep -F 2023-10-08T12:46:58.109 INFO:teuthology.orchestra.run.smithi045.stdout:checking for ld used by gcc... /bin/ld 2023-10-08T12:46:58.110 INFO:teuthology.orchestra.run.smithi045.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-10-08T12:46:58.124 INFO:teuthology.orchestra.run.smithi045.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-10-08T12:46:58.141 INFO:teuthology.orchestra.run.smithi045.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-10-08T12:46:58.141 INFO:teuthology.orchestra.run.smithi045.stdout:checking whether ln -s works... yes 2023-10-08T12:46:58.152 INFO:teuthology.orchestra.run.smithi045.stdout:checking the maximum length of command line arguments... 1572864 2023-10-08T12:46:58.154 INFO:teuthology.orchestra.run.smithi045.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-10-08T12:46:58.154 INFO:teuthology.orchestra.run.smithi045.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-10-08T12:46:58.154 INFO:teuthology.orchestra.run.smithi045.stdout:checking for /bin/ld option to reload object files... -r 2023-10-08T12:46:58.155 INFO:teuthology.orchestra.run.smithi045.stdout:checking for objdump... objdump 2023-10-08T12:46:58.156 INFO:teuthology.orchestra.run.smithi045.stdout:checking how to recognize dependent libraries... pass_all 2023-10-08T12:46:58.156 INFO:teuthology.orchestra.run.smithi045.stdout:checking for dlltool... no 2023-10-08T12:46:58.156 INFO:teuthology.orchestra.run.smithi045.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-10-08T12:46:58.156 INFO:teuthology.orchestra.run.smithi045.stdout:checking for ar... ar 2023-10-08T12:46:58.179 INFO:teuthology.orchestra.run.smithi045.stdout:checking for archiver @FILE support... @ 2023-10-08T12:46:58.179 INFO:teuthology.orchestra.run.smithi045.stdout:checking for strip... strip 2023-10-08T12:46:58.179 INFO:teuthology.orchestra.run.smithi045.stdout:checking for ranlib... ranlib 2023-10-08T12:46:58.179 INFO:teuthology.orchestra.run.smithi045.stdout:checking for gawk... gawk 2023-10-08T12:46:58.232 INFO:teuthology.orchestra.run.smithi045.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-10-08T12:46:58.233 INFO:teuthology.orchestra.run.smithi045.stdout:checking for sysroot... no 2023-10-08T12:46:58.235 INFO:teuthology.orchestra.run.smithi045.stdout:checking for a working dd... /bin/dd 2023-10-08T12:46:58.238 INFO:teuthology.orchestra.run.smithi045.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-10-08T12:46:58.251 INFO:teuthology.orchestra.run.smithi045.stdout:checking for mt... no 2023-10-08T12:46:58.253 INFO:teuthology.orchestra.run.smithi045.stdout:checking if : is a manifest tool... no 2023-10-08T12:46:58.295 INFO:teuthology.orchestra.run.smithi045.stdout:checking how to run the C preprocessor... gcc -E 2023-10-08T12:46:58.421 INFO:teuthology.orchestra.run.smithi045.stdout:checking for ANSI C header files... yes 2023-10-08T12:46:58.442 INFO:teuthology.orchestra.run.smithi045.stdout:checking for sys/types.h... yes 2023-10-08T12:46:58.466 INFO:teuthology.orchestra.run.smithi045.stdout:checking for sys/stat.h... yes 2023-10-08T12:46:58.490 INFO:teuthology.orchestra.run.smithi045.stdout:checking for stdlib.h... yes 2023-10-08T12:46:58.515 INFO:teuthology.orchestra.run.smithi045.stdout:checking for string.h... yes 2023-10-08T12:46:58.540 INFO:teuthology.orchestra.run.smithi045.stdout:checking for memory.h... yes 2023-10-08T12:46:58.565 INFO:teuthology.orchestra.run.smithi045.stdout:checking for strings.h... yes 2023-10-08T12:46:58.592 INFO:teuthology.orchestra.run.smithi045.stdout:checking for inttypes.h... yes 2023-10-08T12:46:58.617 INFO:teuthology.orchestra.run.smithi045.stdout:checking for stdint.h... yes 2023-10-08T12:46:58.645 INFO:teuthology.orchestra.run.smithi045.stdout:checking for unistd.h... yes 2023-10-08T12:46:58.673 INFO:teuthology.orchestra.run.smithi045.stdout:checking for dlfcn.h... yes 2023-10-08T12:46:58.676 INFO:teuthology.orchestra.run.smithi045.stdout:checking for objdir... .libs 2023-10-08T12:46:58.743 INFO:teuthology.orchestra.run.smithi045.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-10-08T12:46:58.744 INFO:teuthology.orchestra.run.smithi045.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-10-08T12:46:58.759 INFO:teuthology.orchestra.run.smithi045.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-10-08T12:46:58.780 INFO:teuthology.orchestra.run.smithi045.stdout:checking if gcc static flag -static works... no 2023-10-08T12:46:58.801 INFO:teuthology.orchestra.run.smithi045.stdout:checking if gcc supports -c -o file.o... yes 2023-10-08T12:46:58.802 INFO:teuthology.orchestra.run.smithi045.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-10-08T12:46:58.806 INFO:teuthology.orchestra.run.smithi045.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-10-08T12:46:58.831 INFO:teuthology.orchestra.run.smithi045.stdout:checking whether -lc should be explicitly linked in... no 2023-10-08T12:46:58.875 INFO:teuthology.orchestra.run.smithi045.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-10-08T12:46:58.875 INFO:teuthology.orchestra.run.smithi045.stdout:checking how to hardcode library paths into programs... immediate 2023-10-08T12:46:58.878 INFO:teuthology.orchestra.run.smithi045.stdout:checking whether stripping libraries is possible... yes 2023-10-08T12:46:58.878 INFO:teuthology.orchestra.run.smithi045.stdout:checking if libtool supports shared libraries... yes 2023-10-08T12:46:58.878 INFO:teuthology.orchestra.run.smithi045.stdout:checking whether to build shared libraries... yes 2023-10-08T12:46:58.879 INFO:teuthology.orchestra.run.smithi045.stdout:checking whether to build static libraries... yes 2023-10-08T12:46:58.882 INFO:teuthology.orchestra.run.smithi045.stdout:checking for gcc... (cached) gcc 2023-10-08T12:46:58.899 INFO:teuthology.orchestra.run.smithi045.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-10-08T12:46:58.899 INFO:teuthology.orchestra.run.smithi045.stdout:checking whether gcc accepts -g... (cached) yes 2023-10-08T12:46:58.899 INFO:teuthology.orchestra.run.smithi045.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-10-08T12:46:58.899 INFO:teuthology.orchestra.run.smithi045.stdout:checking for gmake... /usr/bin/gmake 2023-10-08T12:46:58.899 INFO:teuthology.orchestra.run.smithi045.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-10-08T12:46:58.900 INFO:teuthology.orchestra.run.smithi045.stdout:checking for tar... /bin/tar 2023-10-08T12:46:58.900 INFO:teuthology.orchestra.run.smithi045.stdout:checking for gzip... /bin/gzip 2023-10-08T12:46:58.906 INFO:teuthology.orchestra.run.smithi045.stdout:checking whether gcc -MM is supported... yes 2023-10-08T12:46:58.907 INFO:teuthology.orchestra.run.smithi045.stdout:checking for sort... /bin/sort 2023-10-08T12:46:58.907 INFO:teuthology.orchestra.run.smithi045.stdout:checking whether ln -s works... yes 2023-10-08T12:46:58.907 INFO:teuthology.orchestra.run.smithi045.stdout:checking for rpm... /bin/rpm 2023-10-08T12:46:58.910 INFO:teuthology.orchestra.run.smithi045.stdout:checking for rpmbuild... no 2023-10-08T12:46:58.935 INFO:teuthology.orchestra.run.smithi045.stdout:checking assert.h usability... yes 2023-10-08T12:46:58.942 INFO:teuthology.orchestra.run.smithi045.stdout:checking assert.h presence... yes 2023-10-08T12:46:58.942 INFO:teuthology.orchestra.run.smithi045.stdout:checking for assert.h... yes 2023-10-08T12:46:58.969 INFO:teuthology.orchestra.run.smithi045.stdout:checking bstring.h usability... no 2023-10-08T12:46:58.978 INFO:teuthology.orchestra.run.smithi045.stdout:checking bstring.h presence... no 2023-10-08T12:46:58.978 INFO:teuthology.orchestra.run.smithi045.stdout:checking for bstring.h... no 2023-10-08T12:46:59.003 INFO:teuthology.orchestra.run.smithi045.stdout:checking libgen.h usability... yes 2023-10-08T12:46:59.010 INFO:teuthology.orchestra.run.smithi045.stdout:checking libgen.h presence... yes 2023-10-08T12:46:59.010 INFO:teuthology.orchestra.run.smithi045.stdout:checking for libgen.h... yes 2023-10-08T12:46:59.038 INFO:teuthology.orchestra.run.smithi045.stdout:checking dirent.h usability... yes 2023-10-08T12:46:59.046 INFO:teuthology.orchestra.run.smithi045.stdout:checking dirent.h presence... yes 2023-10-08T12:46:59.047 INFO:teuthology.orchestra.run.smithi045.stdout:checking for dirent.h... yes 2023-10-08T12:46:59.098 INFO:teuthology.orchestra.run.smithi045.stdout:checking errno.h usability... yes 2023-10-08T12:46:59.105 INFO:teuthology.orchestra.run.smithi045.stdout:checking errno.h presence... yes 2023-10-08T12:46:59.105 INFO:teuthology.orchestra.run.smithi045.stdout:checking for errno.h... yes 2023-10-08T12:46:59.133 INFO:teuthology.orchestra.run.smithi045.stdout:checking malloc.h usability... yes 2023-10-08T12:46:59.142 INFO:teuthology.orchestra.run.smithi045.stdout:checking malloc.h presence... yes 2023-10-08T12:46:59.142 INFO:teuthology.orchestra.run.smithi045.stdout:checking for malloc.h... yes 2023-10-08T12:46:59.168 INFO:teuthology.orchestra.run.smithi045.stdout:checking uuid.h usability... no 2023-10-08T12:46:59.178 INFO:teuthology.orchestra.run.smithi045.stdout:checking uuid.h presence... no 2023-10-08T12:46:59.178 INFO:teuthology.orchestra.run.smithi045.stdout:checking for uuid.h... no 2023-10-08T12:46:59.205 INFO:teuthology.orchestra.run.smithi045.stdout:checking uuid/uuid.h usability... yes 2023-10-08T12:46:59.213 INFO:teuthology.orchestra.run.smithi045.stdout:checking uuid/uuid.h presence... yes 2023-10-08T12:46:59.213 INFO:teuthology.orchestra.run.smithi045.stdout:checking for uuid/uuid.h... yes 2023-10-08T12:46:59.240 INFO:teuthology.orchestra.run.smithi045.stdout:checking sys/uuid.h usability... no 2023-10-08T12:46:59.249 INFO:teuthology.orchestra.run.smithi045.stdout:checking sys/uuid.h presence... no 2023-10-08T12:46:59.249 INFO:teuthology.orchestra.run.smithi045.stdout:checking for sys/uuid.h... no 2023-10-08T12:46:59.276 INFO:teuthology.orchestra.run.smithi045.stdout:checking sys/file.h usability... yes 2023-10-08T12:46:59.283 INFO:teuthology.orchestra.run.smithi045.stdout:checking sys/file.h presence... yes 2023-10-08T12:46:59.283 INFO:teuthology.orchestra.run.smithi045.stdout:checking for sys/file.h... yes 2023-10-08T12:46:59.311 INFO:teuthology.orchestra.run.smithi045.stdout:checking sys/fcntl.h usability... yes 2023-10-08T12:46:59.319 INFO:teuthology.orchestra.run.smithi045.stdout:checking sys/fcntl.h presence... yes 2023-10-08T12:46:59.319 INFO:teuthology.orchestra.run.smithi045.stdout:checking for sys/fcntl.h... yes 2023-10-08T12:46:59.345 INFO:teuthology.orchestra.run.smithi045.stdout:checking sys/syssgi.h usability... no 2023-10-08T12:46:59.355 INFO:teuthology.orchestra.run.smithi045.stdout:checking sys/syssgi.h presence... no 2023-10-08T12:46:59.355 INFO:teuthology.orchestra.run.smithi045.stdout:checking for sys/syssgi.h... no 2023-10-08T12:46:59.391 INFO:teuthology.orchestra.run.smithi045.stdout:checking sys/param.h usability... yes 2023-10-08T12:46:59.402 INFO:teuthology.orchestra.run.smithi045.stdout:checking sys/param.h presence... yes 2023-10-08T12:46:59.402 INFO:teuthology.orchestra.run.smithi045.stdout:checking for sys/param.h... yes 2023-10-08T12:46:59.406 INFO:teuthology.orchestra.run.smithi045.stdout:checking for sys/stat.h... (cached) yes 2023-10-08T12:46:59.433 INFO:teuthology.orchestra.run.smithi045.stdout:checking sys/statvfs.h usability... yes 2023-10-08T12:46:59.441 INFO:teuthology.orchestra.run.smithi045.stdout:checking sys/statvfs.h presence... yes 2023-10-08T12:46:59.441 INFO:teuthology.orchestra.run.smithi045.stdout:checking for sys/statvfs.h... yes 2023-10-08T12:46:59.468 INFO:teuthology.orchestra.run.smithi045.stdout:checking sys/time.h usability... yes 2023-10-08T12:46:59.476 INFO:teuthology.orchestra.run.smithi045.stdout:checking sys/time.h presence... yes 2023-10-08T12:46:59.476 INFO:teuthology.orchestra.run.smithi045.stdout:checking for sys/time.h... yes 2023-10-08T12:46:59.515 INFO:teuthology.orchestra.run.smithi045.stdout:checking sys/ioctl.h usability... yes 2023-10-08T12:46:59.522 INFO:teuthology.orchestra.run.smithi045.stdout:checking sys/ioctl.h presence... yes 2023-10-08T12:46:59.522 INFO:teuthology.orchestra.run.smithi045.stdout:checking for sys/ioctl.h... yes 2023-10-08T12:46:59.551 INFO:teuthology.orchestra.run.smithi045.stdout:checking sys/wait.h usability... yes 2023-10-08T12:46:59.560 INFO:teuthology.orchestra.run.smithi045.stdout:checking sys/wait.h presence... yes 2023-10-08T12:46:59.560 INFO:teuthology.orchestra.run.smithi045.stdout:checking for sys/wait.h... yes 2023-10-08T12:46:59.565 INFO:teuthology.orchestra.run.smithi045.stdout:checking for sys/types.h... (cached) yes 2023-10-08T12:46:59.570 INFO:teuthology.orchestra.run.smithi045.stdout:checking for strings.h... (cached) yes 2023-10-08T12:46:59.598 INFO:teuthology.orchestra.run.smithi045.stdout:checking err.h usability... yes 2023-10-08T12:46:59.606 INFO:teuthology.orchestra.run.smithi045.stdout:checking err.h presence... yes 2023-10-08T12:46:59.606 INFO:teuthology.orchestra.run.smithi045.stdout:checking for err.h... yes 2023-10-08T12:46:59.632 INFO:teuthology.orchestra.run.smithi045.stdout:checking linux/falloc.h usability... yes 2023-10-08T12:46:59.639 INFO:teuthology.orchestra.run.smithi045.stdout:checking linux/falloc.h presence... yes 2023-10-08T12:46:59.639 INFO:teuthology.orchestra.run.smithi045.stdout:checking for linux/falloc.h... yes 2023-10-08T12:46:59.681 INFO:teuthology.orchestra.run.smithi045.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-10-08T12:46:59.691 INFO:teuthology.orchestra.run.smithi045.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-10-08T12:46:59.691 INFO:teuthology.orchestra.run.smithi045.stdout:checking for sys/fs/xfs_fsops.h... no 2023-10-08T12:46:59.714 INFO:teuthology.orchestra.run.smithi045.stdout:checking sys/fs/xfs_itable.h usability... no 2023-10-08T12:46:59.724 INFO:teuthology.orchestra.run.smithi045.stdout:checking sys/fs/xfs_itable.h presence... no 2023-10-08T12:46:59.724 INFO:teuthology.orchestra.run.smithi045.stdout:checking for sys/fs/xfs_itable.h... no 2023-10-08T12:46:59.747 INFO:teuthology.orchestra.run.smithi045.stdout:checking xfs/platform_defs.h usability... no 2023-10-08T12:46:59.757 INFO:teuthology.orchestra.run.smithi045.stdout:checking xfs/platform_defs.h presence... no 2023-10-08T12:46:59.757 INFO:teuthology.orchestra.run.smithi045.stdout:checking for xfs/platform_defs.h... no 2023-10-08T12:46:59.781 INFO:teuthology.orchestra.run.smithi045.stdout:checking btrfs/ioctl.h usability... no 2023-10-08T12:46:59.790 INFO:teuthology.orchestra.run.smithi045.stdout:checking btrfs/ioctl.h presence... no 2023-10-08T12:46:59.791 INFO:teuthology.orchestra.run.smithi045.stdout:checking for btrfs/ioctl.h... no 2023-10-08T12:46:59.815 INFO:teuthology.orchestra.run.smithi045.stdout:checking cifs/ioctl.h usability... no 2023-10-08T12:46:59.824 INFO:teuthology.orchestra.run.smithi045.stdout:checking cifs/ioctl.h presence... no 2023-10-08T12:46:59.824 INFO:teuthology.orchestra.run.smithi045.stdout:checking for cifs/ioctl.h... no 2023-10-08T12:46:59.849 INFO:teuthology.orchestra.run.smithi045.stdout:checking sys/mman.h usability... yes 2023-10-08T12:46:59.857 INFO:teuthology.orchestra.run.smithi045.stdout:checking sys/mman.h presence... yes 2023-10-08T12:46:59.857 INFO:teuthology.orchestra.run.smithi045.stdout:checking for sys/mman.h... yes 2023-10-08T12:46:59.872 INFO:teuthology.orchestra.run.smithi045.stdout:checking for xfs/xfs_log_format.h... no 2023-10-08T12:46:59.907 INFO:teuthology.orchestra.run.smithi045.stdout:checking for uuid_compare... no 2023-10-08T12:46:59.937 INFO:teuthology.orchestra.run.smithi045.stdout:checking for uuid_compare in -luuid... yes 2023-10-08T12:46:59.985 INFO:teuthology.orchestra.run.smithi045.stdout:checking for xfs/xfs.h... yes 2023-10-08T12:46:59.999 INFO:teuthology.orchestra.run.smithi045.stdout:checking for xfs/libxfs.h... no 2023-10-08T12:47:00.015 INFO:teuthology.orchestra.run.smithi045.stdout:checking whether xlog_assign_lsn is declared... no 2023-10-08T12:47:00.042 INFO:teuthology.orchestra.run.smithi045.stdout:checking for xfs/xqm.h... yes 2023-10-08T12:47:00.088 INFO:teuthology.orchestra.run.smithi045.stdout:checking xfsctl from xfs/xfs.h... ok 2023-10-08T12:47:00.111 INFO:teuthology.orchestra.run.smithi045.stdout:checking xfs/handle.h usability... yes 2023-10-08T12:47:00.118 INFO:teuthology.orchestra.run.smithi045.stdout:checking xfs/handle.h presence... yes 2023-10-08T12:47:00.118 INFO:teuthology.orchestra.run.smithi045.stdout:checking for xfs/handle.h... yes 2023-10-08T12:47:00.153 INFO:teuthology.orchestra.run.smithi045.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-10-08T12:47:00.186 INFO:teuthology.orchestra.run.smithi045.stdout:checking sys/acl.h usability... yes 2023-10-08T12:47:00.195 INFO:teuthology.orchestra.run.smithi045.stdout:checking sys/acl.h presence... yes 2023-10-08T12:47:00.195 INFO:teuthology.orchestra.run.smithi045.stdout:checking for sys/acl.h... yes 2023-10-08T12:47:00.228 INFO:teuthology.orchestra.run.smithi045.stdout:checking acl/libacl.h usability... yes 2023-10-08T12:47:00.236 INFO:teuthology.orchestra.run.smithi045.stdout:checking acl/libacl.h presence... yes 2023-10-08T12:47:00.236 INFO:teuthology.orchestra.run.smithi045.stdout:checking for acl/libacl.h... yes 2023-10-08T12:47:00.269 INFO:teuthology.orchestra.run.smithi045.stdout:checking for acl_init in -lacl... yes 2023-10-08T12:47:00.292 INFO:teuthology.orchestra.run.smithi045.stdout:checking gdbm-ndbm.h usability... no 2023-10-08T12:47:00.301 INFO:teuthology.orchestra.run.smithi045.stdout:checking gdbm-ndbm.h presence... no 2023-10-08T12:47:00.301 INFO:teuthology.orchestra.run.smithi045.stdout:checking for gdbm-ndbm.h... no 2023-10-08T12:47:00.322 INFO:teuthology.orchestra.run.smithi045.stdout:checking gdbm/ndbm.h usability... no 2023-10-08T12:47:00.332 INFO:teuthology.orchestra.run.smithi045.stdout:checking gdbm/ndbm.h presence... no 2023-10-08T12:47:00.332 INFO:teuthology.orchestra.run.smithi045.stdout:checking for gdbm/ndbm.h... no 2023-10-08T12:47:00.353 INFO:teuthology.orchestra.run.smithi045.stdout:checking ndbm.h usability... no 2023-10-08T12:47:00.363 INFO:teuthology.orchestra.run.smithi045.stdout:checking ndbm.h presence... no 2023-10-08T12:47:00.363 INFO:teuthology.orchestra.run.smithi045.stdout:checking for ndbm.h... no 2023-10-08T12:47:00.389 INFO:teuthology.orchestra.run.smithi045.stdout:checking libaio.h usability... yes 2023-10-08T12:47:00.399 INFO:teuthology.orchestra.run.smithi045.stdout:checking libaio.h presence... yes 2023-10-08T12:47:00.399 INFO:teuthology.orchestra.run.smithi045.stdout:checking for libaio.h... yes 2023-10-08T12:47:00.422 INFO:teuthology.orchestra.run.smithi045.stdout:checking liburing.h usability... no 2023-10-08T12:47:00.431 INFO:teuthology.orchestra.run.smithi045.stdout:checking liburing.h presence... no 2023-10-08T12:47:00.431 INFO:teuthology.orchestra.run.smithi045.stdout:checking for liburing.h... no 2023-10-08T12:47:00.453 INFO:teuthology.orchestra.run.smithi045.stdout:checking sys/capability.h usability... no 2023-10-08T12:47:00.462 INFO:teuthology.orchestra.run.smithi045.stdout:checking sys/capability.h presence... no 2023-10-08T12:47:00.462 INFO:teuthology.orchestra.run.smithi045.stdout:checking for sys/capability.h... no 2023-10-08T12:47:00.485 INFO:teuthology.orchestra.run.smithi045.stdout:checking linux/fiemap.h usability... yes 2023-10-08T12:47:00.492 INFO:teuthology.orchestra.run.smithi045.stdout:checking linux/fiemap.h presence... yes 2023-10-08T12:47:00.492 INFO:teuthology.orchestra.run.smithi045.stdout:checking for linux/fiemap.h... yes 2023-10-08T12:47:00.525 INFO:teuthology.orchestra.run.smithi045.stdout:checking for fallocate... yes 2023-10-08T12:47:00.559 INFO:teuthology.orchestra.run.smithi045.stdout:checking for open_by_handle_at... yes 2023-10-08T12:47:00.583 INFO:teuthology.orchestra.run.smithi045.stdout:checking sys/prctl.h usability... yes 2023-10-08T12:47:00.591 INFO:teuthology.orchestra.run.smithi045.stdout:checking sys/prctl.h presence... yes 2023-10-08T12:47:00.591 INFO:teuthology.orchestra.run.smithi045.stdout:checking for sys/prctl.h... yes 2023-10-08T12:47:00.615 INFO:teuthology.orchestra.run.smithi045.stdout:checking linux/fs.h usability... yes 2023-10-08T12:47:00.622 INFO:teuthology.orchestra.run.smithi045.stdout:checking linux/fs.h presence... yes 2023-10-08T12:47:00.623 INFO:teuthology.orchestra.run.smithi045.stdout:checking for linux/fs.h... yes 2023-10-08T12:47:00.643 INFO:teuthology.orchestra.run.smithi045.stdout:checking btrfsutil.h usability... no 2023-10-08T12:47:00.653 INFO:teuthology.orchestra.run.smithi045.stdout:checking btrfsutil.h presence... no 2023-10-08T12:47:00.653 INFO:teuthology.orchestra.run.smithi045.stdout:checking for btrfsutil.h... no 2023-10-08T12:47:00.689 INFO:teuthology.orchestra.run.smithi045.stdout:checking for copy_file_range... yes 2023-10-08T12:47:00.723 INFO:teuthology.orchestra.run.smithi045.stdout:checking for SEEK_DATA... yes 2023-10-08T12:47:00.769 INFO:teuthology.orchestra.run.smithi045.stdout:checking for BMV_OF_SHARED... yes 2023-10-08T12:47:00.805 INFO:teuthology.orchestra.run.smithi045.stdout:checking for nftw... yes 2023-10-08T12:47:00.839 INFO:teuthology.orchestra.run.smithi045.stdout:checking for RLIMIT_NOFILE... yes 2023-10-08T12:47:00.857 INFO:teuthology.orchestra.run.smithi045.stdout:checking for FIEXCHANGE_RANGE... no 2023-10-08T12:47:00.889 INFO:teuthology.orchestra.run.smithi045.stdout:checking for renameat2... yes 2023-10-08T12:47:00.922 INFO:teuthology.orchestra.run.smithi045.stdout:checking for reallocarray... yes 2023-10-08T12:47:00.936 INFO:teuthology.orchestra.run.smithi045.stdout:checking for struct mount_attr... no 2023-10-08T12:47:00.984 INFO:teuthology.orchestra.run.smithi045.stdout:checking for struct btrfs_qgroup_limit... yes 2023-10-08T12:47:01.019 INFO:teuthology.orchestra.run.smithi045.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-10-08T12:47:01.053 INFO:teuthology.orchestra.run.smithi045.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-10-08T12:47:01.087 INFO:teuthology.orchestra.run.smithi045.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-10-08T12:47:01.122 INFO:teuthology.orchestra.run.smithi045.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-10-08T12:47:01.157 INFO:teuthology.orchestra.run.smithi045.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-10-08T12:47:01.191 INFO:teuthology.orchestra.run.smithi045.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-10-08T12:47:01.218 INFO:teuthology.orchestra.run.smithi045.stdout:checking linux/btrfs.h usability... yes 2023-10-08T12:47:01.225 INFO:teuthology.orchestra.run.smithi045.stdout:checking linux/btrfs.h presence... yes 2023-10-08T12:47:01.226 INFO:teuthology.orchestra.run.smithi045.stdout:checking for linux/btrfs.h... yes 2023-10-08T12:47:01.255 INFO:teuthology.orchestra.run.smithi045.stdout:checking linux/btrfs_tree.h usability... yes 2023-10-08T12:47:01.263 INFO:teuthology.orchestra.run.smithi045.stdout:checking linux/btrfs_tree.h presence... yes 2023-10-08T12:47:01.263 INFO:teuthology.orchestra.run.smithi045.stdout:checking for linux/btrfs_tree.h... yes 2023-10-08T12:47:01.294 INFO:teuthology.orchestra.run.smithi045.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-10-08T12:47:01.311 INFO:teuthology.orchestra.run.smithi045.stdout:configure: creating ./config.status 2023-10-08T12:47:01.616 INFO:teuthology.orchestra.run.smithi045.stdout:config.status: creating include/builddefs 2023-10-08T12:47:01.627 INFO:teuthology.orchestra.run.smithi045.stdout:config.status: creating include/config.h 2023-10-08T12:47:01.635 INFO:teuthology.orchestra.run.smithi045.stdout:config.status: executing libtool commands 2023-10-08T12:47:01.673 INFO:teuthology.orchestra.run.smithi045.stdout:Building include 2023-10-08T12:47:01.676 INFO:teuthology.orchestra.run.smithi045.stdout:Building lib 2023-10-08T12:47:01.679 INFO:teuthology.orchestra.run.smithi045.stdout: [LTDEP] 2023-10-08T12:47:01.783 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] dataascii.lo 2023-10-08T12:47:01.898 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] databin.lo 2023-10-08T12:47:02.040 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] datapid.lo 2023-10-08T12:47:02.140 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] file_lock.lo 2023-10-08T12:47:02.282 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] forker.lo 2023-10-08T12:47:02.409 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] pattern.lo 2023-10-08T12:47:02.526 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] open_flags.lo 2023-10-08T12:47:02.661 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] random_range.lo 2023-10-08T12:47:02.780 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:47:02.783 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:47:02.876 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] string_to_tokens.lo 2023-10-08T12:47:02.977 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] str_to_bytes.lo 2023-10-08T12:47:03.101 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] tlibio.lo 2023-10-08T12:47:03.321 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] write_log.lo 2023-10-08T12:47:03.549 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] random.lo 2023-10-08T12:47:03.661 INFO:teuthology.orchestra.run.smithi045.stdout: [LD] 2023-10-08T12:47:03.732 INFO:teuthology.orchestra.run.smithi045.stdout:Building ltp 2023-10-08T12:47:03.735 INFO:teuthology.orchestra.run.smithi045.stdout: [DEP] 2023-10-08T12:47:03.848 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] doio 2023-10-08T12:47:04.463 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] fsstress 2023-10-08T12:47:05.710 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] fsx 2023-10-08T12:47:06.527 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] growfiles 2023-10-08T12:47:07.006 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] iogen 2023-10-08T12:47:07.338 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] aio-stress 2023-10-08T12:47:07.731 INFO:teuthology.orchestra.run.smithi045.stdout:Building src 2023-10-08T12:47:07.736 INFO:teuthology.orchestra.run.smithi045.stdout: [DEP] 2023-10-08T12:47:09.128 INFO:teuthology.orchestra.run.smithi045.stdout: [DEP] 2023-10-08T12:47:09.154 INFO:teuthology.orchestra.run.smithi045.stdout: [DEP] 2023-10-08T12:47:09.161 INFO:teuthology.orchestra.run.smithi045.stdout: [DEP] 2023-10-08T12:47:09.351 INFO:teuthology.orchestra.run.smithi045.stdout: [DEP] 2023-10-08T12:47:09.372 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] dirstress 2023-10-08T12:47:09.591 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] fill 2023-10-08T12:47:09.735 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] fill2 2023-10-08T12:47:09.947 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] getpagesize 2023-10-08T12:47:10.076 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] holes 2023-10-08T12:47:10.258 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] lstat64 2023-10-08T12:47:10.429 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] nametest 2023-10-08T12:47:10.651 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] permname 2023-10-08T12:47:10.835 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] randholes 2023-10-08T12:47:11.066 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] runas 2023-10-08T12:47:11.230 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] truncfile 2023-10-08T12:47:11.398 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] usemem 2023-10-08T12:47:11.539 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] mmapcat 2023-10-08T12:47:11.681 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] append_reader 2023-10-08T12:47:11.822 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] append_writer 2023-10-08T12:47:11.963 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] dirperf 2023-10-08T12:47:12.169 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] metaperf 2023-10-08T12:47:12.406 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] devzero 2023-10-08T12:47:12.570 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] feature 2023-10-08T12:47:12.772 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] alloc 2023-10-08T12:47:12.968 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] fault 2023-10-08T12:47:13.121 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] fstest 2023-10-08T12:47:13.345 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_access_root 2023-10-08T12:47:13.490 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] godown 2023-10-08T12:47:13.648 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] resvtest 2023-10-08T12:47:13.821 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] writemod 2023-10-08T12:47:13.960 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] writev_on_pagefault 2023-10-08T12:47:14.111 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] makeextents 2023-10-08T12:47:14.277 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] itrash 2023-10-08T12:47:14.424 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] rename 2023-10-08T12:47:14.557 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] multi_open_unlink 2023-10-08T12:47:14.713 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] unwritten_sync 2023-10-08T12:47:14.880 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] genhashnames 2023-10-08T12:47:15.056 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_holes 2023-10-08T12:47:15.195 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_mmap_writev 2023-10-08T12:47:15.335 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_truncate_cmtime 2023-10-08T12:47:15.484 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] dirhash_collide 2023-10-08T12:47:15.655 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_rename_overwrite 2023-10-08T12:47:15.789 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] holetest 2023-10-08T12:47:15.993 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_truncate_self 2023-10-08T12:47:16.126 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] af_unix 2023-10-08T12:47:16.269 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_mmap_stale_pmd 2023-10-08T12:47:16.413 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_mmap_cow_race 2023-10-08T12:47:16.567 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_mmap_fallocate 2023-10-08T12:47:16.709 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] fsync-err 2023-10-08T12:47:16.884 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_mmap_write_ro 2023-10-08T12:47:17.027 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_ext4_dax_journal_corruption 2023-10-08T12:47:17.175 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_ext4_dax_inline_corruption 2023-10-08T12:47:17.322 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_ofd_locks 2023-10-08T12:47:17.505 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_mmap_collision 2023-10-08T12:47:17.689 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] mmap-write-concurrent 2023-10-08T12:47:17.851 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_get_file_time 2023-10-08T12:47:17.990 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_create_short_dirs 2023-10-08T12:47:18.146 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_create_long_dirs 2023-10-08T12:47:18.300 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_enospc 2023-10-08T12:47:18.475 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_mmap_writev_overlap 2023-10-08T12:47:18.635 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] checkpoint_journal 2023-10-08T12:47:18.780 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] mmap-rw-fault 2023-10-08T12:47:18.953 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] allocstale 2023-10-08T12:47:19.111 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_mmap_cow_memory_failure 2023-10-08T12:47:19.271 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] fake-dump-rootino 2023-10-08T12:47:19.412 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] dio-buf-fault 2023-10-08T12:47:19.558 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] rewinddir-test 2023-10-08T12:47:19.717 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] xfsctl 2023-10-08T12:47:19.893 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] bstat 2023-10-08T12:47:20.083 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_mtab 2023-10-08T12:47:20.254 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] getdevicesize 2023-10-08T12:47:20.391 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] preallo_rw_pattern_reader 2023-10-08T12:47:20.540 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] preallo_rw_pattern_writer 2023-10-08T12:47:20.689 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] ftrunc 2023-10-08T12:47:20.829 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] trunc 2023-10-08T12:47:20.981 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] fs_perms 2023-10-08T12:47:21.135 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] testx 2023-10-08T12:47:21.261 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] looptest 2023-10-08T12:47:21.442 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] locktest 2023-10-08T12:47:21.730 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] unwritten_mmap 2023-10-08T12:47:21.882 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] bulkstat_unlink_test 2023-10-08T12:47:22.070 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] deduperace 2023-10-08T12:47:22.254 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] bulkstat_unlink_test_modified 2023-10-08T12:47:22.437 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_dir_offset 2023-10-08T12:47:22.577 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_futimens 2023-10-08T12:47:22.713 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_immutable 2023-10-08T12:47:23.279 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] stale_handle 2023-10-08T12:47:23.438 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] pwrite_mmap_blocked 2023-10-08T12:47:23.581 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_dir_offset2 2023-10-08T12:47:23.897 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] seek_sanity_test 2023-10-08T12:47:24.287 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] seek_copy_test 2023-10-08T12:47:24.453 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_readdir_1 2023-10-08T12:47:24.593 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_readdir_2 2023-10-08T12:47:24.735 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] fsync-tester 2023-10-08T12:47:24.969 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] nsexec 2023-10-08T12:47:25.135 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] cloner 2023-10-08T12:47:25.302 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] renameat2 2023-10-08T12:47:25.457 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_getcwd 2023-10-08T12:47:25.605 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] e4compact 2023-10-08T12:47:25.793 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] test-nextquota 2023-10-08T12:47:25.952 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] punch-alternating 2023-10-08T12:47:26.113 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] attr-list-by-handle-cursor-test 2023-10-08T12:47:26.270 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] listxattr 2023-10-08T12:47:26.409 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] dio-interleaved 2023-10-08T12:47:26.561 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_dir_type 2023-10-08T12:47:26.708 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] dio-invalidate-cache 2023-10-08T12:47:26.899 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] stat_test 2023-10-08T12:47:27.176 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_encrypted_d_revalidate 2023-10-08T12:47:27.332 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] attr_replace_test 2023-10-08T12:47:27.484 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] swapon 2023-10-08T12:47:27.640 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] mkswap 2023-10-08T12:47:27.784 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_attr_corruption 2023-10-08T12:47:27.927 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_open_tmpfiles 2023-10-08T12:47:28.094 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] fscrypt-crypt-util 2023-10-08T12:47:28.692 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] bulkstat_null_ocount 2023-10-08T12:47:28.841 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] splice-test 2023-10-08T12:47:29.011 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] chprojid_fail 2023-10-08T12:47:29.164 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] detached_mounts_propagation 2023-10-08T12:47:29.336 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] ext4_resize 2023-10-08T12:47:29.477 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_readdir_3 2023-10-08T12:47:29.662 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] splice2pipe 2023-10-08T12:47:29.816 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] uuid_ioctl 2023-10-08T12:47:29.962 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] fiemap-tester 2023-10-08T12:47:30.212 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_stripealign 2023-10-08T12:47:30.358 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] open_by_handle 2023-10-08T12:47:30.597 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] t_mmap_dio 2023-10-08T12:47:30.752 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] xfsfind 2023-10-08T12:47:30.933 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] fssum 2023-10-08T12:47:31.339 INFO:teuthology.orchestra.run.smithi045.stdout:Building log-writes 2023-10-08T12:47:31.343 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] replay-log 2023-10-08T12:47:31.634 INFO:teuthology.orchestra.run.smithi045.stdout:Building perf 2023-10-08T12:47:31.637 INFO:teuthology.orchestra.run.smithi045.stdout:Building aio-dio-regress 2023-10-08T12:47:31.643 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] aio-dio-append-write-fallocate-race 2023-10-08T12:47:31.808 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] aio-dio-fcntl-race 2023-10-08T12:47:31.964 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] aio-dio-subblock-eof-read 2023-10-08T12:47:32.103 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] aio-dio-append-write-read-race 2023-10-08T12:47:32.272 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] aio-dio-invalidate-readahead 2023-10-08T12:47:32.429 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] aio-dio-write-verify 2023-10-08T12:47:32.616 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-10-08T12:47:32.748 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] aio-last-ref-held-by-io 2023-10-08T12:47:32.852 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:47:32.854 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:47:32.926 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] aio-dio-cycle-write 2023-10-08T12:47:33.104 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] aio-dio-extend-stat 2023-10-08T12:47:33.263 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-10-08T12:47:33.392 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] aio-dio-hole-filling-race 2023-10-08T12:47:33.537 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] aio-dio-invalidate-failure 2023-10-08T12:47:33.690 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] aiodio_sparse2 2023-10-08T12:47:33.894 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] aiocp 2023-10-08T12:47:34.106 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] aio-dio-cow-race 2023-10-08T12:47:34.254 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] aio-dio-eof-race 2023-10-08T12:47:34.432 INFO:teuthology.orchestra.run.smithi045.stdout:Building vfs 2023-10-08T12:47:34.437 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] vfstest 2023-10-08T12:47:36.186 INFO:teuthology.orchestra.run.smithi045.stdout: [CC] mount-idmapped 2023-10-08T12:47:36.647 INFO:teuthology.orchestra.run.smithi045.stdout:Building m4 2023-10-08T12:47:36.650 INFO:teuthology.orchestra.run.smithi045.stdout:Building common 2023-10-08T12:47:36.653 INFO:teuthology.orchestra.run.smithi045.stdout:Building tests 2023-10-08T12:47:36.658 INFO:teuthology.orchestra.run.smithi045.stdout:Building perf 2023-10-08T12:47:36.664 INFO:teuthology.orchestra.run.smithi045.stdout: [GROUP] /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/perf/group.list 2023-10-08T12:47:36.674 INFO:teuthology.orchestra.run.smithi045.stdout:Building ext4 2023-10-08T12:47:36.679 INFO:teuthology.orchestra.run.smithi045.stdout: [GROUP] /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/ext4/group.list 2023-10-08T12:47:36.714 INFO:teuthology.orchestra.run.smithi045.stdout:Building ocfs2 2023-10-08T12:47:36.719 INFO:teuthology.orchestra.run.smithi045.stdout: [GROUP] /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/ocfs2/group.list 2023-10-08T12:47:36.731 INFO:teuthology.orchestra.run.smithi045.stdout:Building overlay 2023-10-08T12:47:36.736 INFO:teuthology.orchestra.run.smithi045.stdout: [GROUP] /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/overlay/group.list 2023-10-08T12:47:36.773 INFO:teuthology.orchestra.run.smithi045.stdout:Building cifs 2023-10-08T12:47:36.778 INFO:teuthology.orchestra.run.smithi045.stdout: [GROUP] /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/cifs/group.list 2023-10-08T12:47:36.789 INFO:teuthology.orchestra.run.smithi045.stdout:Building generic 2023-10-08T12:47:36.796 INFO:teuthology.orchestra.run.smithi045.stdout: [GROUP] /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/generic/group.list 2023-10-08T12:47:36.889 INFO:teuthology.orchestra.run.smithi045.stdout:Building shared 2023-10-08T12:47:36.894 INFO:teuthology.orchestra.run.smithi045.stdout: [GROUP] /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/shared/group.list 2023-10-08T12:47:36.909 INFO:teuthology.orchestra.run.smithi045.stdout:Building nfs 2023-10-08T12:47:36.914 INFO:teuthology.orchestra.run.smithi045.stdout: [GROUP] /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/nfs/group.list 2023-10-08T12:47:36.927 INFO:teuthology.orchestra.run.smithi045.stdout:Building f2fs 2023-10-08T12:47:36.932 INFO:teuthology.orchestra.run.smithi045.stdout: [GROUP] /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/f2fs/group.list 2023-10-08T12:47:36.948 INFO:teuthology.orchestra.run.smithi045.stdout:Building udf 2023-10-08T12:47:36.953 INFO:teuthology.orchestra.run.smithi045.stdout: [GROUP] /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/udf/group.list 2023-10-08T12:47:36.963 INFO:teuthology.orchestra.run.smithi045.stdout:Building ceph 2023-10-08T12:47:36.968 INFO:teuthology.orchestra.run.smithi045.stdout: [GROUP] /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/ceph/group.list 2023-10-08T12:47:36.981 INFO:teuthology.orchestra.run.smithi045.stdout:Building xfs 2023-10-08T12:47:36.988 INFO:teuthology.orchestra.run.smithi045.stdout: [GROUP] /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/xfs/group.list 2023-10-08T12:47:37.081 INFO:teuthology.orchestra.run.smithi045.stdout:Building btrfs 2023-10-08T12:47:37.087 INFO:teuthology.orchestra.run.smithi045.stdout: [GROUP] /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/btrfs/group.list 2023-10-08T12:47:37.142 INFO:teuthology.orchestra.run.smithi045.stdout:Building tmpfs 2023-10-08T12:47:37.147 INFO:teuthology.orchestra.run.smithi045.stdout: [GROUP] /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/tmpfs/group.list 2023-10-08T12:47:37.160 INFO:teuthology.orchestra.run.smithi045.stdout:Building selftest 2023-10-08T12:47:37.165 INFO:teuthology.orchestra.run.smithi045.stdout: [GROUP] /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/selftest/group.list 2023-10-08T12:47:37.178 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo make install) 2023-10-08T12:47:37.255 INFO:teuthology.orchestra.run.smithi045.stdout:Building include 2023-10-08T12:47:37.258 INFO:teuthology.orchestra.run.smithi045.stdout:Building lib 2023-10-08T12:47:37.262 INFO:teuthology.orchestra.run.smithi045.stdout:Building ltp 2023-10-08T12:47:37.266 INFO:teuthology.orchestra.run.smithi045.stdout:Building src 2023-10-08T12:47:37.299 INFO:teuthology.orchestra.run.smithi045.stdout:Building log-writes 2023-10-08T12:47:37.303 INFO:teuthology.orchestra.run.smithi045.stdout:Building perf 2023-10-08T12:47:37.306 INFO:teuthology.orchestra.run.smithi045.stdout:Building aio-dio-regress 2023-10-08T12:47:37.310 INFO:teuthology.orchestra.run.smithi045.stdout:Building vfs 2023-10-08T12:47:37.314 INFO:teuthology.orchestra.run.smithi045.stdout:Building m4 2023-10-08T12:47:37.317 INFO:teuthology.orchestra.run.smithi045.stdout:Building common 2023-10-08T12:47:37.321 INFO:teuthology.orchestra.run.smithi045.stdout:Building tests 2023-10-08T12:47:37.326 INFO:teuthology.orchestra.run.smithi045.stdout:Building perf 2023-10-08T12:47:37.331 INFO:teuthology.orchestra.run.smithi045.stdout: [GROUP] /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/perf/group.list 2023-10-08T12:47:37.341 INFO:teuthology.orchestra.run.smithi045.stdout:Building ext4 2023-10-08T12:47:37.347 INFO:teuthology.orchestra.run.smithi045.stdout: [GROUP] /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/ext4/group.list 2023-10-08T12:47:37.380 INFO:teuthology.orchestra.run.smithi045.stdout:Building ocfs2 2023-10-08T12:47:37.385 INFO:teuthology.orchestra.run.smithi045.stdout: [GROUP] /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/ocfs2/group.list 2023-10-08T12:47:37.398 INFO:teuthology.orchestra.run.smithi045.stdout:Building overlay 2023-10-08T12:47:37.403 INFO:teuthology.orchestra.run.smithi045.stdout: [GROUP] /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/overlay/group.list 2023-10-08T12:47:37.440 INFO:teuthology.orchestra.run.smithi045.stdout:Building cifs 2023-10-08T12:47:37.445 INFO:teuthology.orchestra.run.smithi045.stdout: [GROUP] /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/cifs/group.list 2023-10-08T12:47:37.457 INFO:teuthology.orchestra.run.smithi045.stdout:Building generic 2023-10-08T12:47:37.462 INFO:teuthology.orchestra.run.smithi045.stdout: [GROUP] /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/generic/group.list 2023-10-08T12:47:37.554 INFO:teuthology.orchestra.run.smithi045.stdout:Building shared 2023-10-08T12:47:37.559 INFO:teuthology.orchestra.run.smithi045.stdout: [GROUP] /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/shared/group.list 2023-10-08T12:47:37.575 INFO:teuthology.orchestra.run.smithi045.stdout:Building nfs 2023-10-08T12:47:37.579 INFO:teuthology.orchestra.run.smithi045.stdout: [GROUP] /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/nfs/group.list 2023-10-08T12:47:37.593 INFO:teuthology.orchestra.run.smithi045.stdout:Building f2fs 2023-10-08T12:47:37.597 INFO:teuthology.orchestra.run.smithi045.stdout: [GROUP] /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/f2fs/group.list 2023-10-08T12:47:37.613 INFO:teuthology.orchestra.run.smithi045.stdout:Building udf 2023-10-08T12:47:37.618 INFO:teuthology.orchestra.run.smithi045.stdout: [GROUP] /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/udf/group.list 2023-10-08T12:47:37.630 INFO:teuthology.orchestra.run.smithi045.stdout:Building ceph 2023-10-08T12:47:37.634 INFO:teuthology.orchestra.run.smithi045.stdout: [GROUP] /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/ceph/group.list 2023-10-08T12:47:37.648 INFO:teuthology.orchestra.run.smithi045.stdout:Building xfs 2023-10-08T12:47:37.654 INFO:teuthology.orchestra.run.smithi045.stdout: [GROUP] /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/xfs/group.list 2023-10-08T12:47:37.746 INFO:teuthology.orchestra.run.smithi045.stdout:Building btrfs 2023-10-08T12:47:37.752 INFO:teuthology.orchestra.run.smithi045.stdout: [GROUP] /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/btrfs/group.list 2023-10-08T12:47:37.807 INFO:teuthology.orchestra.run.smithi045.stdout:Building tmpfs 2023-10-08T12:47:37.812 INFO:teuthology.orchestra.run.smithi045.stdout: [GROUP] /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/tmpfs/group.list 2023-10-08T12:47:37.824 INFO:teuthology.orchestra.run.smithi045.stdout:Building selftest 2023-10-08T12:47:37.829 INFO:teuthology.orchestra.run.smithi045.stdout: [GROUP] /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/selftest/group.list 2023-10-08T12:47:37.840 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-10-08T12:47:37.842 INFO:teuthology.orchestra.run.smithi045.stdout:gmake[1]: Nothing to be done for 'install'. 2023-10-08T12:47:37.842 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-10-08T12:47:37.844 INFO:teuthology.orchestra.run.smithi045.stdout:gmake[1]: Nothing to be done for 'install'. 2023-10-08T12:47:37.844 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-10-08T12:47:37.846 INFO:teuthology.orchestra.run.smithi045.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-10-08T12:47:37.855 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-10-08T12:47:37.933 INFO:teuthology.orchestra.run.smithi045.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-10-08T12:47:37.942 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-10-08T12:47:37.959 INFO:teuthology.orchestra.run.smithi045.stdout:Building log-writes 2023-10-08T12:47:37.962 INFO:teuthology.orchestra.run.smithi045.stdout:Building perf 2023-10-08T12:47:37.965 INFO:teuthology.orchestra.run.smithi045.stdout:Building aio-dio-regress 2023-10-08T12:47:37.969 INFO:teuthology.orchestra.run.smithi045.stdout:Building vfs 2023-10-08T12:47:37.972 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/gmake -C log-writes install 2023-10-08T12:47:37.974 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-10-08T12:47:37.983 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-10-08T12:47:37.992 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/gmake -C perf install 2023-10-08T12:47:37.993 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-10-08T12:47:38.002 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-10-08T12:47:38.025 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-10-08T12:47:38.027 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-10-08T12:47:38.036 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 aio-dio-append-write-fallocate-race aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-hole-filling-race aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-10-08T12:47:38.091 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/gmake -C vfs install 2023-10-08T12:47:38.092 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-10-08T12:47:38.101 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-10-08T12:47:38.113 INFO:teuthology.orchestra.run.smithi045.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-10-08T12:47:38.122 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-10-08T12:47:39.358 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-10-08T12:47:39.463 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-10-08T12:47:39.494 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-10-08T12:47:39.496 INFO:teuthology.orchestra.run.smithi045.stdout:gmake[1]: Nothing to be done for 'install'. 2023-10-08T12:47:39.496 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-10-08T12:47:39.497 INFO:teuthology.orchestra.run.smithi045.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-10-08T12:47:39.506 INFO:teuthology.orchestra.run.smithi045.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-10-08T12:47:39.643 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-10-08T12:47:39.645 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/btrfs/ install 2023-10-08T12:47:39.647 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-10-08T12:47:39.656 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 299 300 /var/lib/xfstests/tests/btrfs 2023-10-08T12:47:40.495 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-10-08T12:47:40.504 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 644 175.out 186.out 240.out 092.out 077.out 140.out 265.out 236.out 108.out 204.out 233.out 194.out 234.out 295.out 109.out 033.out 082.out 252.out 270.out 040.out 176.out 202.out 137.out 034.out 125.out 014.out 165.out 181.out 152.out 024.out 192.out 148.out 282.out 267.out 052.out 256.out 228.out 183.out 273.out 251.out 110.out 043.out 069.out 151.out 206.out 195.out 274.out 215.out 115.out 015.out 275.out 250.out 191.out 281.out 046.out 051.out 131.out 244.out 219.out 119.out 019.out 128.out 177.out 232.out 189.out 220.out 120.out 020.out 102.out 263.out 171.out 261.out 045.out 217.out 117.out 017.out 072.out 068.out 048.out 062.out 038.out 084.out 129.out 066.out 029.out 229.out 103.out 111.out 011.out 243.out 134.out 170.out 260.out 157.out 143.out 133.out 286.out 161.out 246.out 216.out 116.out 016.out 155.out 296.out 118.out 287.out 067.out 010.out 238.out 141.out 114.out 138.out 095.out 297.out 160.out 091.out 081.out 071.out 061.out 085.out 037.out 300.out 200.out 100.out 025.out 258.out 185.out 269.out 208.out 039.out 173.out 222.out 035.out 169.out 098.out 290.out 080.out 070.out 060.out 207.out 106.out 009.out 167.out 211.out 158.out 182.out 146.out 188.out 293.out 104.out 089.out 086.out 254.out 279.out 225.out 174.out 156.out 268.out 135.out 257.out 124.out 172.out 063.out 058.out 113.out 262.out 036.out 042.out 047.out 193.out 097.out 271.out 283.out 083.out 199.out 099.out 278.out 007.out 209.out 053.out 164.out 154.out 239.out 241.out 002.out 178.out 190.out 214.out 074.out 056.out 041.out 057.out 005.out 223.out 150.out 123.out 179.out 144.out 032.out 277.out 205.out 136.out 096.out 198.out 008.out 280.out 050.out 105.out 027.out 187.out 153.out 088.out 285.out 044.out 201.out 101.out 001.out 266.out 237.out 065.out 231.out 227.out 075.out 028.out 213.out 142.out 013.out 031.out 272.out 078.out 184.out 259.out 210.out 132.out 093.out 235.out 127.out 230.out 166.out 292.out 130.out 023.out 073.out 030.out 203.out 003.out 055.out 291.out 245.out 145.out 159.out 249.out 122.out 076.out 022.out 289.out 006.out 284.out 299.out 224.out 276.out 149.out 064.out 264.out 218.out 018.out 168.out 021.out 079.out 054.out 059.out 049.out 226.out 163.out 126.out 121.out 026.out 180.out 253.out 255.out 139.out 090.out 221.out 087.out 294.out 212.out 112.out 094.out 012.out 247.out 107.out 248.out 162.out 147.out 288.out 197.out 196.out 242.out 004.out /var/lib/xfstests/tests/btrfs 2023-10-08T12:47:41.364 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/ceph/ install 2023-10-08T12:47:41.366 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-10-08T12:47:41.375 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-10-08T12:47:41.395 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-10-08T12:47:41.403 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-10-08T12:47:41.424 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/cifs/ install 2023-10-08T12:47:41.425 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-10-08T12:47:41.434 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-10-08T12:47:41.443 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-10-08T12:47:41.452 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-10-08T12:47:41.461 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/ext4/ install 2023-10-08T12:47:41.463 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-10-08T12:47:41.472 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-10-08T12:47:41.668 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-10-08T12:47:41.677 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 305.out 005.out 008.out 035.out 036.out 308.out 050.out 040.out 306.out 007.out 021.out 046.out 012.out 009.out 033.out 045.out 034.out 056.out 047.out 018.out 023.out 302.out 020.out 002.out 014.out 024.out 013.out 031.out 015.out 304.out 004.out 048.out 038.out 052.out 303.out 029.out 011.out 027.out 042.out 044.out 055.out 030.out 058.out 003.out 017.out 043.out 053.out 016.out 059.out 037.out 301.out 010.out 022.out 006.out 057.out 025.out 026.out 271.out 051.out 041.out 307.out 019.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-10-08T12:47:41.881 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/f2fs/ install 2023-10-08T12:47:41.882 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-10-08T12:47:41.891 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-10-08T12:47:41.903 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-10-08T12:47:41.912 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-10-08T12:47:41.924 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/generic/ install 2023-10-08T12:47:41.928 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-10-08T12:47:41.937 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 /var/lib/xfstests/tests/generic 2023-10-08T12:47:44.004 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-10-08T12:47:44.013 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 644 050.out.xfsquota 035.out.nfs 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 208.out 433.out 670.out 040.out 104.out 575.out 537.out 683.out 497.out 337.out 702.out 460.out 149.out 088.out 366.out 202.out 137.out 034.out 110.out 389.out 403.out 593.out 571.out 243.out 592.out 282.out 472.out 468.out 628.out 528.out 607.out 428.out 659.out 407.out 228.out 128.out 171.out 028.out 620.out 273.out 474.out 492.out 609.out 707.out 693.out 595.out 506.out 268.out 632.out 532.out 591.out 281.out 471.out 619.out 519.out 013.out 419.out 319.out 177.out 523.out 119.out 019.out 727.out 372.out 686.out 312.out 718.out 143.out 716.out 161.out 516.out 518.out 538.out 655.out 216.out 116.out 016.out 155.out 338.out 238.out 500.out 138.out 189.out 263.out 277.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 457.out 333.out 258.out 362.out 379.out 691.out 039.out 173.out 498.out 665.out 098.out 711.out 290.out 480.out 706.out 060.out 406.out 306.out 106.out 642.out 447.out 217.out 120.out 191.out 411.out 357.out 481.out 211.out 158.out 014.out 182.out 370.out 188.out 030.out 099.out 585.out 724.out 721.out 624.out 524.out 174.out 156.out 324.out 224.out 313.out 355.out 124.out 382.out 672.out 278.out 063.out 058.out 384.out 296.out 042.out 193.out 271.out 465.out 473.out 335.out 247.out 509.out 568.out 441.out 440.out 475.out 548.out 356.out 341.out 094.out 241.out 600.out 089.out 714.out 614.out 514.out 414.out 314.out 416.out 214.out 381.out 056.out 041.out 057.out 340.out 358.out 572.out 586.out 521.out 240.out 549.out 095.out 633.out 434.out 140.out 708.out 533.out 508.out 408.out 308.out 476.out 087.out 199.out 458.out 233.out 639.out 443.out 540.out 397.out 053.out 279.out 276.out 448.out 164.out 376.out 589.out 587.out 339.out 294.out 352.out 484.out 489.out 139.out 317.out 399.out 220.out 552.out 695.out 017.out 677.out 097.out 175.out 315.out 295.out 580.out 186.out 452.out 679.out 292.out 252.out 077.out 167.out 688.out 206.out 348.out 394.out 651.out 184.out 466.out 697.out 495.out 725.out 109.out 482.out 625.out 283.out 525.out 488.out 496.out 325.out 551.out 225.out 322.out 636.out 125.out 715.out 192.out 544.out 515.out 650.out 152.out 658.out 563.out 393.out 578.out 015.out 392.out 682.out 684.out 550.out 052.out 652.out 534.out 351.out 583.out 451.out 450.out 463.out 251.out 267.out 176.out 069.out 644.out 065.out 487.out 615.out 395.out 676.out 415.out 344.out 215.out 115.out 444.out 027.out 250.out 391.out 674.out 464.out 705.out 536.out 577.out 439.out 244.out 336.out 144.out 505.out 405.out 667.out 205.out 136.out 598.out 363.out 036.out 198.out 723.out 008.out 390.out 680.out 605.out 305.out 105.out 005.out 367.out 291.out 719.out 323.out 685.out 562.out 570.out 388.out 527.out 237.out 151.out 227.out 163.out 332.out 661.out 582.out 232.out 478.out 584.out 462.out 597.out 412.out 132.out 179.out 037.out 293.out 499.out 638.out 353.out 020.out 660.out 561.out 141.out 076.out 668.out 044.out 648.out 387.out 594.out 438.out 265.out 289.out 574.out 006.out 690.out 284.out 567.out 299.out 456.out 461.out 477.out 307.out 647.out 493.out 107.out 007.out 380.out 526.out 479.out 426.out 150.out 326.out 082.out 226.out 413.out 126.out 025.out 121.out 026.out 021.out 485.out 694.out 347.out 275.out 090.out 361.out 564.out 302.out 432.out 002.out 558.out 162.out 147.out 288.out 197.out 033.out 396.out 051.out 350.out 547.out 047.out 024.out 360.out 543.out 261.out 045.out 692.out 255.out 726.out 729.out 378.out 346.out 048.out 062.out 626.out 529.out 231.out 343.out 662.out 425.out 329.out 165.out 334.out 103.out 003.out 129.out 423.out 371.out 234.out 183.out 671.out 645.out 673.out 190.out 486.out 223.out 123.out 262.out 669.out 023.out 459.out 616.out 032.out 266.out 146.out 398.out 728.out 696.out 427.out 590.out 280.out 470.out 455.out 187.out 091.out 046.out 731.out 374.out 631.out 256.out 328.out 260.out 654.out 359.out 531.out 649.out 301.out 101.out 635.out 623.out 385.out 331.out 556.out 713.out 613.out 513.out 622.out 131.out 213.out 730.out 634.out 031.out 565.out 630.out 675.out 272.out 530.out 510.out 627.out 573.out 576.out 430.out 310.out 569.out 454.out 259.out 210.out 449.out 327.out 330.out 067.out 093.out 604.out 287.out 127.out 699.out 166.out 130.out 219.out 073.out 603.out 503.out 303.out 203.out 354.out 157.out 386.out 349.out 055.out 245.out 709.out 522.out 422.out 222.out 159.out 539.out 249.out 122.out 689.out 022.out 681.out 424.out 321.out 066.out 490.out 435.out 375.out 134.out 154.out 566.out 618.out 501.out 418.out 318.out 542.out 218.out 118.out 018.out 377.out 172.out 168.out 079.out 469.out 054.out 059.out 049.out 442.out 657.out 621.out 180.out 270.out 253.out 421.out 712.out 612.out 075.out 512.out 494.out 221.out 212.out 112.out 342.out 012.out 029.out 195.out 554.out 148.out 185.out 596.out 720.out 248.out 196.out 520.out 242.out 420.out 285.out 320.out 629.out 230.out 602.out 502.out 402.out 102.out 717.out 617.out 517.out 429.out 417.out 365.out 092.out 117.out 664.out 072.out 068.out 229.out 038.out 084.out 369.out 611.out 511.out 311.out 368.out 637.out 111.out 011.out 257.out 194.out 170.out 606.out 133.out 286.out 043.out 437.out 545.out 559.out 710.out 610.out 687.out 410.out 701.out 601.out 401.out 201.out 010.out 001.out 096.out 114.out 113.out 074.out 581.out 145.out 641.out 491.out 081.out 071.out 083.out 653.out 700.out 064.out 400.out 300.out 200.out 100.out 646.out 541.out 445.out 269.out 546.out 656.out 698.out 553.out 178.out 298.out 446.out 080.out 070.out 608.out 507.out 409.out 309.out 209.out 108.out 009.out 643.out 004.out 557.out 453.out 666.out 236.out 078.out 364.out 555.out 383.out 085.out 704.out 588.out 504.out 404.out 304.out 204.out 535.out 345.out 246.out 467.out 086.out 254.out 207.out 142.out 235.out 436.out 703.out 135.out 264.out 431.out 678.out 373.out 316.out 169.out 640.out 579.out 297.out 153.out 560.out 663.out 599.out /var/lib/xfstests/tests/generic 2023-10-08T12:47:46.106 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/nfs/ install 2023-10-08T12:47:46.108 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-10-08T12:47:46.116 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-10-08T12:47:46.125 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-10-08T12:47:46.134 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-10-08T12:47:46.143 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/ocfs2/ install 2023-10-08T12:47:46.145 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-10-08T12:47:46.153 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-10-08T12:47:46.162 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-10-08T12:47:46.171 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-10-08T12:47:46.180 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/overlay/ install 2023-10-08T12:47:46.182 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-10-08T12:47:46.191 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-10-08T12:47:46.476 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-10-08T12:47:46.485 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 644 003.out 018.out 024.out 077.out 069.out 020.out 102.out 014.out 023.out 013.out 031.out 015.out 117.out 082.out 072.out 068.out 063.out 048.out 062.out 038.out 052.out 042.out 075.out 110.out 067.out 029.out 111.out 055.out 112.out 066.out 073.out 078.out 030.out 058.out 104.out 017.out 002.out 043.out 053.out 036.out 116.out 016.out 101.out 010.out 001.out 022.out 074.out 004.out 103.out 115.out 057.out 113.out 114.out 081.out 026.out 071.out 061.out 025.out 051.out 011.out 041.out 047.out 100.out 064.out 007.out 028.out 076.out 079.out 054.out 059.out 008.out 049.out 032.out 039.out 046.out 021.out 105.out 005.out 107.out 065.out 108.out 080.out 070.out 060.out 050.out 027.out 106.out 009.out 006.out 037.out 044.out 012.out 109.out 033.out 045.out 040.out 056.out 035.out 019.out 034.out /var/lib/xfstests/tests/overlay 2023-10-08T12:47:46.773 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/perf/ install 2023-10-08T12:47:46.774 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-10-08T12:47:46.783 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-10-08T12:47:46.792 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-10-08T12:47:46.800 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-10-08T12:47:46.810 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/selftest/ install 2023-10-08T12:47:46.811 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-10-08T12:47:46.820 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-10-08T12:47:46.843 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-10-08T12:47:46.852 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-10-08T12:47:46.875 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/shared/ install 2023-10-08T12:47:46.877 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-10-08T12:47:46.886 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-10-08T12:47:46.900 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-10-08T12:47:46.909 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-10-08T12:47:46.924 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/tmpfs/ install 2023-10-08T12:47:46.925 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-10-08T12:47:46.934 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-10-08T12:47:46.943 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-10-08T12:47:46.952 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-10-08T12:47:46.961 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/udf/ install 2023-10-08T12:47:46.963 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-10-08T12:47:46.971 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-10-08T12:47:46.980 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-10-08T12:47:46.989 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-10-08T12:47:46.998 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.UxcFNZjwoAxfstests-dev/tests/xfs/ install 2023-10-08T12:47:47.002 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-10-08T12:47:47.011 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-10-08T12:47:48.976 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-10-08T12:47:48.985 INFO:teuthology.orchestra.run.smithi045.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 295.out 497.out 337.out 385.out 082.out 270.out 460.out 149.out 759.out 502.out 088.out 366.out 202.out 137.out 034.out 110.out 389.out 018.out 593.out 571.out 243.out 592.out 282.out 267.out 728.out 468.out 799.out 284.out 528.out 769.out 428.out 507.out 407.out 228.out 128.out 171.out 183.out 273.out 017.out 492.out 109.out 559.out 506.out 195.out 732.out 268.out 275.out 600.out 113.out 532.out 591.out 281.out 471.out 723.out 255.out 013.out 371.out 319.out 467.out 523.out 119.out 775.out 727.out 372.out 165.out 229.out 103.out 003.out 129.out 131.out 383.out 738.out 260.out 718.out 143.out 716.out 161.out 516.out 518.out 416.out 026.out 116.out 043.out 155.out 338.out 238.out 500.out 138.out 189.out 263.out 184.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 047.out 772.out 258.out 379.out 322.out 039.out 430.out 173.out 222.out 742.out 098.out 426.out 290.out 480.out 060.out 406.out 306.out 141.out 106.out 006.out 167.out 191.out 542.out 211.out 442.out 188.out 099.out 177.out 721.out 174.out 156.out 771.out 324.out 224.out 313.out 124.out 278.out 058.out 741.out 384.out 042.out 193.out 392.out 768.out 399.out 473.out 770.out 709.out 247.out 568.out 364.out 209.out 441.out 440.out 009.out 740.out 356.out 197.out 341.out 094.out 241.out 501.out 089.out 540.out 514.out 414.out 314.out 214.out 381.out 147.out 041.out 340.out 793.out 358.out 572.out 586.out 240.out 549.out 092.out 439.out 434.out 140.out 708.out 766.out 508.out 408.out 308.out 208.out 737.out 040.out 304.out 349.out 254.out 537.out 059.out 086.out 249.out 335.out 142.out 235.out 436.out 575.out 253.out 715.out 533.out 264.out 431.out 784.out 433.out 036.out 316.out 169.out 035.out 579.out 457.out 297.out 393.out 333.out 599.out 476.out 087.out 199.out 739.out 233.out 752.out 736.out 443.out 773.out 053.out 749.out 279.out 133.out 711.out 458.out 164.out 589.out 587.out 339.out 577.out 294.out 352.out 484.out 498.out 489.out 139.out 774.out 790.out 552.out 781.out 357.out 065.out 097.out 175.out 186.out 452.out 069.out 252.out 751.out 376.out 724.out 206.out 778.out 190.out 794.out 348.out 466.out 248.out 725.out 785.out 750.out 525.out 496.out 325.out 257.out 225.out 125.out 789.out 192.out 296.out 152.out 563.out 246.out 551.out 015.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 534.out 351.out 276.out 451.out 425.out 450.out 744.out 251.out 444.out 487.out 762.out 395.out 515.out 415.out 315.out 215.out 115.out 597.out 027.out 250.out 344.out 051.out 536.out 030.out 244.out 336.out 028.out 150.out 144.out 505.out 342.out 136.out 598.out 005.out 176.out 198.out 008.out 390.out 178.out 405.out 305.out 205.out 105.out 367.out 291.out 437.out 044.out 719.out 323.out 519.out 363.out 562.out 382.out 570.out 388.out 527.out 158.out 019.out 237.out 151.out 760.out 227.out 163.out 332.out 796.out 582.out 232.out 584.out 462.out 220.out 412.out 132.out 179.out 037.out 293.out 499.out 112.out 748.out 020.out 786.out 063.out 561.out 076.out 465.out 014.out 758.out 387.out 594.out 438.out 265.out 289.out 574.out 755.out 548.out 299.out 419.out 521.out 581.out 595.out 461.out 477.out 307.out 726.out 107.out 007.out 448.out 262.out 380.out 093.out 479.out 547.out 326.out 226.out 747.out 126.out 025.out 121.out 447.out 761.out 580.out 021.out 485.out 347.out 077.out 090.out 361.out 564.out 788.out 066.out 455.out 432.out 002.out 585.out 162.out 288.out 050.out 396.out 446.out 350.out 354.out 429.out 187.out 360.out 543.out 261.out 734.out 045.out 292.out 482.out 729.out 104.out 048.out 062.out 529.out 231.out 343.out 503.out 526.out 329.out 486.out 223.out 123.out 023.out 459.out 032.out 798.out 277.out 373.out 146.out 398.out 168.out 427.out 590.out 280.out 470.out 491.out 767.out 016.out 046.out 488.out 731.out 782.out 374.out 583.out 285.out 127.out 328.out 359.out 531.out 301.out 101.out 266.out 331.out 791.out 743.out 556.out 713.out 081.out 024.out 513.out 213.out 730.out 095.out 031.out 565.out 182.out 272.out 530.out 754.out 573.out 576.out 569.out 454.out 259.out 449.out 327.out 330.out 067.out 493.out 010.out 287.out 230.out 166.out 130.out 219.out 073.out 370.out 135.out 303.out 203.out 345.out 355.out 386.out 560.out 055.out 334.out 245.out 522.out 787.out 745.out 422.out 394.out 539.out 524.out 122.out 234.out 022.out 424.out 779.out 490.out 435.out 353.out 423.out 134.out 154.out 271.out 064.out 418.out 318.out 218.out 118.out 757.out 377.out 172.out 079.out 469.out 054.out 049.out 765.out 776.out 456.out 180.out 378.out 421.out 712.out 403.out 321.out 057.out 512.out 494.out 221.out 312.out 212.out 538.out 256.out 012.out 764.out 283.out 554.out 397.out 185.out 596.out 720.out 481.out 196.out 520.out 242.out 420.out 478.out 320.out 555.out 120.out 153.out 402.out 302.out 102.out 717.out 517.out 417.out 317.out 365.out 217.out 117.out 475.out 072.out 068.out 474.out 038.out 084.out 056.out 369.out 511.out 148.out 411.out 029.out 311.out 368.out 111.out 011.out 783.out 194.out 170.out 286.out 756.out 545.out 714.out 157.out 710.out 510.out 413.out 410.out 310.out 210.out 401.out 201.out 001.out 495.out 362.out 114.out 753.out 074.out 145.out 797.out 464.out 091.out 746.out 083.out 800.out 777.out 400.out 300.out 200.out 100.out 375.out 541.out 445.out 269.out 546.out 780.out 553.out 763.out 298.out 567.out 080.out 070.out 509.out 409.out 309.out 207.out 108.out 346.out 391.out 004.out 557.out 453.out 236.out 078.out 159.out 566.out 735.out 085.out 588.out 504.out 404.out 558.out 204.out 535.out 795.out 733.out 544.out /var/lib/xfstests/tests/xfs 2023-10-08T12:47:50.978 INFO:teuthology.orchestra.run.smithi045.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-10-08T12:47:50.987 INFO:teuthology.orchestra.run.smithi045.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-10-08T12:47:50.996 INFO:teuthology.orchestra.run.smithi045.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-10-08T12:47:51.005 INFO:teuthology.orchestra.run.smithi045.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-10-08T12:47:51.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:47:51.016 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec ls tests/generic) 2023-10-08T12:47:51.074 INFO:teuthology.orchestra.run.smithi045.stdout:001 2023-10-08T12:47:51.074 INFO:teuthology.orchestra.run.smithi045.stdout:001.out 2023-10-08T12:47:51.074 INFO:teuthology.orchestra.run.smithi045.stdout:002 2023-10-08T12:47:51.074 INFO:teuthology.orchestra.run.smithi045.stdout:002.out 2023-10-08T12:47:51.074 INFO:teuthology.orchestra.run.smithi045.stdout:003 2023-10-08T12:47:51.075 INFO:teuthology.orchestra.run.smithi045.stdout:003.out 2023-10-08T12:47:51.075 INFO:teuthology.orchestra.run.smithi045.stdout:004 2023-10-08T12:47:51.075 INFO:teuthology.orchestra.run.smithi045.stdout:004.out 2023-10-08T12:47:51.075 INFO:teuthology.orchestra.run.smithi045.stdout:005 2023-10-08T12:47:51.075 INFO:teuthology.orchestra.run.smithi045.stdout:005.out 2023-10-08T12:47:51.075 INFO:teuthology.orchestra.run.smithi045.stdout:006 2023-10-08T12:47:51.075 INFO:teuthology.orchestra.run.smithi045.stdout:006.out 2023-10-08T12:47:51.075 INFO:teuthology.orchestra.run.smithi045.stdout:007 2023-10-08T12:47:51.075 INFO:teuthology.orchestra.run.smithi045.stdout:007.out 2023-10-08T12:47:51.075 INFO:teuthology.orchestra.run.smithi045.stdout:008 2023-10-08T12:47:51.075 INFO:teuthology.orchestra.run.smithi045.stdout:008.out 2023-10-08T12:47:51.075 INFO:teuthology.orchestra.run.smithi045.stdout:009 2023-10-08T12:47:51.076 INFO:teuthology.orchestra.run.smithi045.stdout:009.out 2023-10-08T12:47:51.076 INFO:teuthology.orchestra.run.smithi045.stdout:010 2023-10-08T12:47:51.076 INFO:teuthology.orchestra.run.smithi045.stdout:010.out 2023-10-08T12:47:51.076 INFO:teuthology.orchestra.run.smithi045.stdout:011 2023-10-08T12:47:51.076 INFO:teuthology.orchestra.run.smithi045.stdout:011.out 2023-10-08T12:47:51.076 INFO:teuthology.orchestra.run.smithi045.stdout:012 2023-10-08T12:47:51.076 INFO:teuthology.orchestra.run.smithi045.stdout:012.out 2023-10-08T12:47:51.076 INFO:teuthology.orchestra.run.smithi045.stdout:013 2023-10-08T12:47:51.076 INFO:teuthology.orchestra.run.smithi045.stdout:013.out 2023-10-08T12:47:51.076 INFO:teuthology.orchestra.run.smithi045.stdout:014 2023-10-08T12:47:51.076 INFO:teuthology.orchestra.run.smithi045.stdout:014.out 2023-10-08T12:47:51.076 INFO:teuthology.orchestra.run.smithi045.stdout:015 2023-10-08T12:47:51.076 INFO:teuthology.orchestra.run.smithi045.stdout:015.out 2023-10-08T12:47:51.077 INFO:teuthology.orchestra.run.smithi045.stdout:016 2023-10-08T12:47:51.077 INFO:teuthology.orchestra.run.smithi045.stdout:016.out 2023-10-08T12:47:51.077 INFO:teuthology.orchestra.run.smithi045.stdout:017 2023-10-08T12:47:51.077 INFO:teuthology.orchestra.run.smithi045.stdout:017.out 2023-10-08T12:47:51.077 INFO:teuthology.orchestra.run.smithi045.stdout:018 2023-10-08T12:47:51.077 INFO:teuthology.orchestra.run.smithi045.stdout:018.out 2023-10-08T12:47:51.077 INFO:teuthology.orchestra.run.smithi045.stdout:019 2023-10-08T12:47:51.077 INFO:teuthology.orchestra.run.smithi045.stdout:019.out 2023-10-08T12:47:51.077 INFO:teuthology.orchestra.run.smithi045.stdout:020 2023-10-08T12:47:51.077 INFO:teuthology.orchestra.run.smithi045.stdout:020.out 2023-10-08T12:47:51.077 INFO:teuthology.orchestra.run.smithi045.stdout:021 2023-10-08T12:47:51.077 INFO:teuthology.orchestra.run.smithi045.stdout:021.out 2023-10-08T12:47:51.078 INFO:teuthology.orchestra.run.smithi045.stdout:022 2023-10-08T12:47:51.078 INFO:teuthology.orchestra.run.smithi045.stdout:022.out 2023-10-08T12:47:51.078 INFO:teuthology.orchestra.run.smithi045.stdout:023 2023-10-08T12:47:51.078 INFO:teuthology.orchestra.run.smithi045.stdout:023.out 2023-10-08T12:47:51.078 INFO:teuthology.orchestra.run.smithi045.stdout:024 2023-10-08T12:47:51.078 INFO:teuthology.orchestra.run.smithi045.stdout:024.out 2023-10-08T12:47:51.078 INFO:teuthology.orchestra.run.smithi045.stdout:025 2023-10-08T12:47:51.078 INFO:teuthology.orchestra.run.smithi045.stdout:025.out 2023-10-08T12:47:51.078 INFO:teuthology.orchestra.run.smithi045.stdout:026 2023-10-08T12:47:51.078 INFO:teuthology.orchestra.run.smithi045.stdout:026.out 2023-10-08T12:47:51.078 INFO:teuthology.orchestra.run.smithi045.stdout:027 2023-10-08T12:47:51.078 INFO:teuthology.orchestra.run.smithi045.stdout:027.out 2023-10-08T12:47:51.079 INFO:teuthology.orchestra.run.smithi045.stdout:028 2023-10-08T12:47:51.079 INFO:teuthology.orchestra.run.smithi045.stdout:028.out 2023-10-08T12:47:51.079 INFO:teuthology.orchestra.run.smithi045.stdout:029 2023-10-08T12:47:51.079 INFO:teuthology.orchestra.run.smithi045.stdout:029.out 2023-10-08T12:47:51.079 INFO:teuthology.orchestra.run.smithi045.stdout:030 2023-10-08T12:47:51.079 INFO:teuthology.orchestra.run.smithi045.stdout:030.out 2023-10-08T12:47:51.079 INFO:teuthology.orchestra.run.smithi045.stdout:031 2023-10-08T12:47:51.079 INFO:teuthology.orchestra.run.smithi045.stdout:031.out 2023-10-08T12:47:51.079 INFO:teuthology.orchestra.run.smithi045.stdout:032 2023-10-08T12:47:51.079 INFO:teuthology.orchestra.run.smithi045.stdout:032.out 2023-10-08T12:47:51.079 INFO:teuthology.orchestra.run.smithi045.stdout:033 2023-10-08T12:47:51.079 INFO:teuthology.orchestra.run.smithi045.stdout:033.out 2023-10-08T12:47:51.080 INFO:teuthology.orchestra.run.smithi045.stdout:034 2023-10-08T12:47:51.080 INFO:teuthology.orchestra.run.smithi045.stdout:034.out 2023-10-08T12:47:51.080 INFO:teuthology.orchestra.run.smithi045.stdout:035 2023-10-08T12:47:51.080 INFO:teuthology.orchestra.run.smithi045.stdout:035.cfg 2023-10-08T12:47:51.080 INFO:teuthology.orchestra.run.smithi045.stdout:035.out.default 2023-10-08T12:47:51.080 INFO:teuthology.orchestra.run.smithi045.stdout:035.out.nfs 2023-10-08T12:47:51.080 INFO:teuthology.orchestra.run.smithi045.stdout:036 2023-10-08T12:47:51.080 INFO:teuthology.orchestra.run.smithi045.stdout:036.out 2023-10-08T12:47:51.080 INFO:teuthology.orchestra.run.smithi045.stdout:037 2023-10-08T12:47:51.080 INFO:teuthology.orchestra.run.smithi045.stdout:037.out 2023-10-08T12:47:51.080 INFO:teuthology.orchestra.run.smithi045.stdout:038 2023-10-08T12:47:51.080 INFO:teuthology.orchestra.run.smithi045.stdout:038.out 2023-10-08T12:47:51.081 INFO:teuthology.orchestra.run.smithi045.stdout:039 2023-10-08T12:47:51.081 INFO:teuthology.orchestra.run.smithi045.stdout:039.out 2023-10-08T12:47:51.081 INFO:teuthology.orchestra.run.smithi045.stdout:040 2023-10-08T12:47:51.081 INFO:teuthology.orchestra.run.smithi045.stdout:040.out 2023-10-08T12:47:51.081 INFO:teuthology.orchestra.run.smithi045.stdout:041 2023-10-08T12:47:51.081 INFO:teuthology.orchestra.run.smithi045.stdout:041.out 2023-10-08T12:47:51.081 INFO:teuthology.orchestra.run.smithi045.stdout:042 2023-10-08T12:47:51.081 INFO:teuthology.orchestra.run.smithi045.stdout:042.out 2023-10-08T12:47:51.081 INFO:teuthology.orchestra.run.smithi045.stdout:043 2023-10-08T12:47:51.081 INFO:teuthology.orchestra.run.smithi045.stdout:043.out 2023-10-08T12:47:51.081 INFO:teuthology.orchestra.run.smithi045.stdout:044 2023-10-08T12:47:51.081 INFO:teuthology.orchestra.run.smithi045.stdout:044.out 2023-10-08T12:47:51.081 INFO:teuthology.orchestra.run.smithi045.stdout:045 2023-10-08T12:47:51.082 INFO:teuthology.orchestra.run.smithi045.stdout:045.out 2023-10-08T12:47:51.082 INFO:teuthology.orchestra.run.smithi045.stdout:046 2023-10-08T12:47:51.082 INFO:teuthology.orchestra.run.smithi045.stdout:046.out 2023-10-08T12:47:51.082 INFO:teuthology.orchestra.run.smithi045.stdout:047 2023-10-08T12:47:51.082 INFO:teuthology.orchestra.run.smithi045.stdout:047.out 2023-10-08T12:47:51.082 INFO:teuthology.orchestra.run.smithi045.stdout:048 2023-10-08T12:47:51.082 INFO:teuthology.orchestra.run.smithi045.stdout:048.out 2023-10-08T12:47:51.082 INFO:teuthology.orchestra.run.smithi045.stdout:049 2023-10-08T12:47:51.082 INFO:teuthology.orchestra.run.smithi045.stdout:049.out 2023-10-08T12:47:51.082 INFO:teuthology.orchestra.run.smithi045.stdout:050 2023-10-08T12:47:51.082 INFO:teuthology.orchestra.run.smithi045.stdout:050.cfg 2023-10-08T12:47:51.082 INFO:teuthology.orchestra.run.smithi045.stdout:050.out.default 2023-10-08T12:47:51.083 INFO:teuthology.orchestra.run.smithi045.stdout:050.out.nojournal 2023-10-08T12:47:51.083 INFO:teuthology.orchestra.run.smithi045.stdout:050.out.xfsquota 2023-10-08T12:47:51.083 INFO:teuthology.orchestra.run.smithi045.stdout:051 2023-10-08T12:47:51.083 INFO:teuthology.orchestra.run.smithi045.stdout:051.out 2023-10-08T12:47:51.083 INFO:teuthology.orchestra.run.smithi045.stdout:052 2023-10-08T12:47:51.083 INFO:teuthology.orchestra.run.smithi045.stdout:052.out 2023-10-08T12:47:51.083 INFO:teuthology.orchestra.run.smithi045.stdout:053 2023-10-08T12:47:51.083 INFO:teuthology.orchestra.run.smithi045.stdout:053.out 2023-10-08T12:47:51.083 INFO:teuthology.orchestra.run.smithi045.stdout:054 2023-10-08T12:47:51.083 INFO:teuthology.orchestra.run.smithi045.stdout:054.out 2023-10-08T12:47:51.083 INFO:teuthology.orchestra.run.smithi045.stdout:055 2023-10-08T12:47:51.083 INFO:teuthology.orchestra.run.smithi045.stdout:055.out 2023-10-08T12:47:51.084 INFO:teuthology.orchestra.run.smithi045.stdout:056 2023-10-08T12:47:51.084 INFO:teuthology.orchestra.run.smithi045.stdout:056.out 2023-10-08T12:47:51.084 INFO:teuthology.orchestra.run.smithi045.stdout:057 2023-10-08T12:47:51.084 INFO:teuthology.orchestra.run.smithi045.stdout:057.out 2023-10-08T12:47:51.084 INFO:teuthology.orchestra.run.smithi045.stdout:058 2023-10-08T12:47:51.084 INFO:teuthology.orchestra.run.smithi045.stdout:058.out 2023-10-08T12:47:51.084 INFO:teuthology.orchestra.run.smithi045.stdout:059 2023-10-08T12:47:51.084 INFO:teuthology.orchestra.run.smithi045.stdout:059.out 2023-10-08T12:47:51.084 INFO:teuthology.orchestra.run.smithi045.stdout:060 2023-10-08T12:47:51.084 INFO:teuthology.orchestra.run.smithi045.stdout:060.out 2023-10-08T12:47:51.084 INFO:teuthology.orchestra.run.smithi045.stdout:061 2023-10-08T12:47:51.084 INFO:teuthology.orchestra.run.smithi045.stdout:061.out 2023-10-08T12:47:51.085 INFO:teuthology.orchestra.run.smithi045.stdout:062 2023-10-08T12:47:51.085 INFO:teuthology.orchestra.run.smithi045.stdout:062.out 2023-10-08T12:47:51.085 INFO:teuthology.orchestra.run.smithi045.stdout:063 2023-10-08T12:47:51.085 INFO:teuthology.orchestra.run.smithi045.stdout:063.out 2023-10-08T12:47:51.085 INFO:teuthology.orchestra.run.smithi045.stdout:064 2023-10-08T12:47:51.085 INFO:teuthology.orchestra.run.smithi045.stdout:064.out 2023-10-08T12:47:51.085 INFO:teuthology.orchestra.run.smithi045.stdout:065 2023-10-08T12:47:51.085 INFO:teuthology.orchestra.run.smithi045.stdout:065.out 2023-10-08T12:47:51.085 INFO:teuthology.orchestra.run.smithi045.stdout:066 2023-10-08T12:47:51.085 INFO:teuthology.orchestra.run.smithi045.stdout:066.out 2023-10-08T12:47:51.085 INFO:teuthology.orchestra.run.smithi045.stdout:067 2023-10-08T12:47:51.085 INFO:teuthology.orchestra.run.smithi045.stdout:067.out 2023-10-08T12:47:51.086 INFO:teuthology.orchestra.run.smithi045.stdout:068 2023-10-08T12:47:51.086 INFO:teuthology.orchestra.run.smithi045.stdout:068.out 2023-10-08T12:47:51.086 INFO:teuthology.orchestra.run.smithi045.stdout:069 2023-10-08T12:47:51.086 INFO:teuthology.orchestra.run.smithi045.stdout:069.out 2023-10-08T12:47:51.086 INFO:teuthology.orchestra.run.smithi045.stdout:070 2023-10-08T12:47:51.086 INFO:teuthology.orchestra.run.smithi045.stdout:070.out 2023-10-08T12:47:51.086 INFO:teuthology.orchestra.run.smithi045.stdout:071 2023-10-08T12:47:51.086 INFO:teuthology.orchestra.run.smithi045.stdout:071.out 2023-10-08T12:47:51.086 INFO:teuthology.orchestra.run.smithi045.stdout:072 2023-10-08T12:47:51.086 INFO:teuthology.orchestra.run.smithi045.stdout:072.out 2023-10-08T12:47:51.086 INFO:teuthology.orchestra.run.smithi045.stdout:073 2023-10-08T12:47:51.086 INFO:teuthology.orchestra.run.smithi045.stdout:073.out 2023-10-08T12:47:51.087 INFO:teuthology.orchestra.run.smithi045.stdout:074 2023-10-08T12:47:51.087 INFO:teuthology.orchestra.run.smithi045.stdout:074.out 2023-10-08T12:47:51.087 INFO:teuthology.orchestra.run.smithi045.stdout:075 2023-10-08T12:47:51.087 INFO:teuthology.orchestra.run.smithi045.stdout:075.out 2023-10-08T12:47:51.087 INFO:teuthology.orchestra.run.smithi045.stdout:076 2023-10-08T12:47:51.087 INFO:teuthology.orchestra.run.smithi045.stdout:076.out 2023-10-08T12:47:51.087 INFO:teuthology.orchestra.run.smithi045.stdout:077 2023-10-08T12:47:51.087 INFO:teuthology.orchestra.run.smithi045.stdout:077.out 2023-10-08T12:47:51.087 INFO:teuthology.orchestra.run.smithi045.stdout:078 2023-10-08T12:47:51.087 INFO:teuthology.orchestra.run.smithi045.stdout:078.out 2023-10-08T12:47:51.087 INFO:teuthology.orchestra.run.smithi045.stdout:079 2023-10-08T12:47:51.087 INFO:teuthology.orchestra.run.smithi045.stdout:079.out 2023-10-08T12:47:51.087 INFO:teuthology.orchestra.run.smithi045.stdout:080 2023-10-08T12:47:51.088 INFO:teuthology.orchestra.run.smithi045.stdout:080.out 2023-10-08T12:47:51.088 INFO:teuthology.orchestra.run.smithi045.stdout:081 2023-10-08T12:47:51.088 INFO:teuthology.orchestra.run.smithi045.stdout:081.out 2023-10-08T12:47:51.088 INFO:teuthology.orchestra.run.smithi045.stdout:082 2023-10-08T12:47:51.088 INFO:teuthology.orchestra.run.smithi045.stdout:082.out 2023-10-08T12:47:51.088 INFO:teuthology.orchestra.run.smithi045.stdout:083 2023-10-08T12:47:51.088 INFO:teuthology.orchestra.run.smithi045.stdout:083.out 2023-10-08T12:47:51.088 INFO:teuthology.orchestra.run.smithi045.stdout:084 2023-10-08T12:47:51.088 INFO:teuthology.orchestra.run.smithi045.stdout:084.out 2023-10-08T12:47:51.088 INFO:teuthology.orchestra.run.smithi045.stdout:085 2023-10-08T12:47:51.088 INFO:teuthology.orchestra.run.smithi045.stdout:085.out 2023-10-08T12:47:51.088 INFO:teuthology.orchestra.run.smithi045.stdout:086 2023-10-08T12:47:51.089 INFO:teuthology.orchestra.run.smithi045.stdout:086.out 2023-10-08T12:47:51.089 INFO:teuthology.orchestra.run.smithi045.stdout:087 2023-10-08T12:47:51.089 INFO:teuthology.orchestra.run.smithi045.stdout:087.out 2023-10-08T12:47:51.089 INFO:teuthology.orchestra.run.smithi045.stdout:088 2023-10-08T12:47:51.089 INFO:teuthology.orchestra.run.smithi045.stdout:088.out 2023-10-08T12:47:51.089 INFO:teuthology.orchestra.run.smithi045.stdout:089 2023-10-08T12:47:51.089 INFO:teuthology.orchestra.run.smithi045.stdout:089.out 2023-10-08T12:47:51.089 INFO:teuthology.orchestra.run.smithi045.stdout:090 2023-10-08T12:47:51.089 INFO:teuthology.orchestra.run.smithi045.stdout:090.out 2023-10-08T12:47:51.089 INFO:teuthology.orchestra.run.smithi045.stdout:091 2023-10-08T12:47:51.089 INFO:teuthology.orchestra.run.smithi045.stdout:091.out 2023-10-08T12:47:51.089 INFO:teuthology.orchestra.run.smithi045.stdout:092 2023-10-08T12:47:51.089 INFO:teuthology.orchestra.run.smithi045.stdout:092.out 2023-10-08T12:47:51.090 INFO:teuthology.orchestra.run.smithi045.stdout:093 2023-10-08T12:47:51.090 INFO:teuthology.orchestra.run.smithi045.stdout:093.out 2023-10-08T12:47:51.090 INFO:teuthology.orchestra.run.smithi045.stdout:094 2023-10-08T12:47:51.090 INFO:teuthology.orchestra.run.smithi045.stdout:094.out 2023-10-08T12:47:51.090 INFO:teuthology.orchestra.run.smithi045.stdout:095 2023-10-08T12:47:51.090 INFO:teuthology.orchestra.run.smithi045.stdout:095.out 2023-10-08T12:47:51.090 INFO:teuthology.orchestra.run.smithi045.stdout:096 2023-10-08T12:47:51.090 INFO:teuthology.orchestra.run.smithi045.stdout:096.out 2023-10-08T12:47:51.090 INFO:teuthology.orchestra.run.smithi045.stdout:097 2023-10-08T12:47:51.090 INFO:teuthology.orchestra.run.smithi045.stdout:097.out 2023-10-08T12:47:51.090 INFO:teuthology.orchestra.run.smithi045.stdout:098 2023-10-08T12:47:51.090 INFO:teuthology.orchestra.run.smithi045.stdout:098.out 2023-10-08T12:47:51.091 INFO:teuthology.orchestra.run.smithi045.stdout:099 2023-10-08T12:47:51.091 INFO:teuthology.orchestra.run.smithi045.stdout:099.out 2023-10-08T12:47:51.091 INFO:teuthology.orchestra.run.smithi045.stdout:100 2023-10-08T12:47:51.091 INFO:teuthology.orchestra.run.smithi045.stdout:100.out 2023-10-08T12:47:51.091 INFO:teuthology.orchestra.run.smithi045.stdout:101 2023-10-08T12:47:51.091 INFO:teuthology.orchestra.run.smithi045.stdout:101.out 2023-10-08T12:47:51.091 INFO:teuthology.orchestra.run.smithi045.stdout:102 2023-10-08T12:47:51.091 INFO:teuthology.orchestra.run.smithi045.stdout:102.out 2023-10-08T12:47:51.091 INFO:teuthology.orchestra.run.smithi045.stdout:103 2023-10-08T12:47:51.091 INFO:teuthology.orchestra.run.smithi045.stdout:103.out 2023-10-08T12:47:51.091 INFO:teuthology.orchestra.run.smithi045.stdout:104 2023-10-08T12:47:51.091 INFO:teuthology.orchestra.run.smithi045.stdout:104.out 2023-10-08T12:47:51.092 INFO:teuthology.orchestra.run.smithi045.stdout:105 2023-10-08T12:47:51.092 INFO:teuthology.orchestra.run.smithi045.stdout:105.out 2023-10-08T12:47:51.092 INFO:teuthology.orchestra.run.smithi045.stdout:106 2023-10-08T12:47:51.092 INFO:teuthology.orchestra.run.smithi045.stdout:106.out 2023-10-08T12:47:51.092 INFO:teuthology.orchestra.run.smithi045.stdout:107 2023-10-08T12:47:51.092 INFO:teuthology.orchestra.run.smithi045.stdout:107.out 2023-10-08T12:47:51.092 INFO:teuthology.orchestra.run.smithi045.stdout:108 2023-10-08T12:47:51.092 INFO:teuthology.orchestra.run.smithi045.stdout:108.out 2023-10-08T12:47:51.092 INFO:teuthology.orchestra.run.smithi045.stdout:109 2023-10-08T12:47:51.092 INFO:teuthology.orchestra.run.smithi045.stdout:109.out 2023-10-08T12:47:51.092 INFO:teuthology.orchestra.run.smithi045.stdout:110 2023-10-08T12:47:51.092 INFO:teuthology.orchestra.run.smithi045.stdout:110.out 2023-10-08T12:47:51.092 INFO:teuthology.orchestra.run.smithi045.stdout:111 2023-10-08T12:47:51.093 INFO:teuthology.orchestra.run.smithi045.stdout:111.out 2023-10-08T12:47:51.093 INFO:teuthology.orchestra.run.smithi045.stdout:112 2023-10-08T12:47:51.093 INFO:teuthology.orchestra.run.smithi045.stdout:112.out 2023-10-08T12:47:51.093 INFO:teuthology.orchestra.run.smithi045.stdout:113 2023-10-08T12:47:51.093 INFO:teuthology.orchestra.run.smithi045.stdout:113.out 2023-10-08T12:47:51.093 INFO:teuthology.orchestra.run.smithi045.stdout:114 2023-10-08T12:47:51.093 INFO:teuthology.orchestra.run.smithi045.stdout:114.out 2023-10-08T12:47:51.093 INFO:teuthology.orchestra.run.smithi045.stdout:115 2023-10-08T12:47:51.093 INFO:teuthology.orchestra.run.smithi045.stdout:115.out 2023-10-08T12:47:51.093 INFO:teuthology.orchestra.run.smithi045.stdout:116 2023-10-08T12:47:51.093 INFO:teuthology.orchestra.run.smithi045.stdout:116.out 2023-10-08T12:47:51.093 INFO:teuthology.orchestra.run.smithi045.stdout:117 2023-10-08T12:47:51.094 INFO:teuthology.orchestra.run.smithi045.stdout:117.out 2023-10-08T12:47:51.094 INFO:teuthology.orchestra.run.smithi045.stdout:118 2023-10-08T12:47:51.094 INFO:teuthology.orchestra.run.smithi045.stdout:118.out 2023-10-08T12:47:51.094 INFO:teuthology.orchestra.run.smithi045.stdout:119 2023-10-08T12:47:51.094 INFO:teuthology.orchestra.run.smithi045.stdout:119.out 2023-10-08T12:47:51.094 INFO:teuthology.orchestra.run.smithi045.stdout:120 2023-10-08T12:47:51.094 INFO:teuthology.orchestra.run.smithi045.stdout:120.out 2023-10-08T12:47:51.094 INFO:teuthology.orchestra.run.smithi045.stdout:121 2023-10-08T12:47:51.094 INFO:teuthology.orchestra.run.smithi045.stdout:121.out 2023-10-08T12:47:51.094 INFO:teuthology.orchestra.run.smithi045.stdout:122 2023-10-08T12:47:51.094 INFO:teuthology.orchestra.run.smithi045.stdout:122.out 2023-10-08T12:47:51.094 INFO:teuthology.orchestra.run.smithi045.stdout:123 2023-10-08T12:47:51.095 INFO:teuthology.orchestra.run.smithi045.stdout:123.out 2023-10-08T12:47:51.095 INFO:teuthology.orchestra.run.smithi045.stdout:124 2023-10-08T12:47:51.095 INFO:teuthology.orchestra.run.smithi045.stdout:124.out 2023-10-08T12:47:51.095 INFO:teuthology.orchestra.run.smithi045.stdout:125 2023-10-08T12:47:51.095 INFO:teuthology.orchestra.run.smithi045.stdout:125.out 2023-10-08T12:47:51.095 INFO:teuthology.orchestra.run.smithi045.stdout:126 2023-10-08T12:47:51.095 INFO:teuthology.orchestra.run.smithi045.stdout:126.out 2023-10-08T12:47:51.095 INFO:teuthology.orchestra.run.smithi045.stdout:127 2023-10-08T12:47:51.095 INFO:teuthology.orchestra.run.smithi045.stdout:127.out 2023-10-08T12:47:51.095 INFO:teuthology.orchestra.run.smithi045.stdout:128 2023-10-08T12:47:51.095 INFO:teuthology.orchestra.run.smithi045.stdout:128.out 2023-10-08T12:47:51.096 INFO:teuthology.orchestra.run.smithi045.stdout:129 2023-10-08T12:47:51.096 INFO:teuthology.orchestra.run.smithi045.stdout:129.out 2023-10-08T12:47:51.096 INFO:teuthology.orchestra.run.smithi045.stdout:130 2023-10-08T12:47:51.096 INFO:teuthology.orchestra.run.smithi045.stdout:130.out 2023-10-08T12:47:51.096 INFO:teuthology.orchestra.run.smithi045.stdout:131 2023-10-08T12:47:51.096 INFO:teuthology.orchestra.run.smithi045.stdout:131.out 2023-10-08T12:47:51.096 INFO:teuthology.orchestra.run.smithi045.stdout:132 2023-10-08T12:47:51.096 INFO:teuthology.orchestra.run.smithi045.stdout:132.out 2023-10-08T12:47:51.096 INFO:teuthology.orchestra.run.smithi045.stdout:133 2023-10-08T12:47:51.096 INFO:teuthology.orchestra.run.smithi045.stdout:133.out 2023-10-08T12:47:51.096 INFO:teuthology.orchestra.run.smithi045.stdout:134 2023-10-08T12:47:51.096 INFO:teuthology.orchestra.run.smithi045.stdout:134.out 2023-10-08T12:47:51.097 INFO:teuthology.orchestra.run.smithi045.stdout:135 2023-10-08T12:47:51.097 INFO:teuthology.orchestra.run.smithi045.stdout:135.out 2023-10-08T12:47:51.097 INFO:teuthology.orchestra.run.smithi045.stdout:136 2023-10-08T12:47:51.097 INFO:teuthology.orchestra.run.smithi045.stdout:136.out 2023-10-08T12:47:51.097 INFO:teuthology.orchestra.run.smithi045.stdout:137 2023-10-08T12:47:51.097 INFO:teuthology.orchestra.run.smithi045.stdout:137.out 2023-10-08T12:47:51.097 INFO:teuthology.orchestra.run.smithi045.stdout:138 2023-10-08T12:47:51.097 INFO:teuthology.orchestra.run.smithi045.stdout:138.out 2023-10-08T12:47:51.097 INFO:teuthology.orchestra.run.smithi045.stdout:139 2023-10-08T12:47:51.097 INFO:teuthology.orchestra.run.smithi045.stdout:139.out 2023-10-08T12:47:51.097 INFO:teuthology.orchestra.run.smithi045.stdout:140 2023-10-08T12:47:51.097 INFO:teuthology.orchestra.run.smithi045.stdout:140.out 2023-10-08T12:47:51.098 INFO:teuthology.orchestra.run.smithi045.stdout:141 2023-10-08T12:47:51.098 INFO:teuthology.orchestra.run.smithi045.stdout:141.out 2023-10-08T12:47:51.098 INFO:teuthology.orchestra.run.smithi045.stdout:142 2023-10-08T12:47:51.098 INFO:teuthology.orchestra.run.smithi045.stdout:142.out 2023-10-08T12:47:51.098 INFO:teuthology.orchestra.run.smithi045.stdout:143 2023-10-08T12:47:51.098 INFO:teuthology.orchestra.run.smithi045.stdout:143.out 2023-10-08T12:47:51.098 INFO:teuthology.orchestra.run.smithi045.stdout:144 2023-10-08T12:47:51.098 INFO:teuthology.orchestra.run.smithi045.stdout:144.out 2023-10-08T12:47:51.098 INFO:teuthology.orchestra.run.smithi045.stdout:145 2023-10-08T12:47:51.098 INFO:teuthology.orchestra.run.smithi045.stdout:145.out 2023-10-08T12:47:51.098 INFO:teuthology.orchestra.run.smithi045.stdout:146 2023-10-08T12:47:51.098 INFO:teuthology.orchestra.run.smithi045.stdout:146.out 2023-10-08T12:47:51.098 INFO:teuthology.orchestra.run.smithi045.stdout:147 2023-10-08T12:47:51.099 INFO:teuthology.orchestra.run.smithi045.stdout:147.out 2023-10-08T12:47:51.099 INFO:teuthology.orchestra.run.smithi045.stdout:148 2023-10-08T12:47:51.099 INFO:teuthology.orchestra.run.smithi045.stdout:148.out 2023-10-08T12:47:51.099 INFO:teuthology.orchestra.run.smithi045.stdout:149 2023-10-08T12:47:51.099 INFO:teuthology.orchestra.run.smithi045.stdout:149.out 2023-10-08T12:47:51.099 INFO:teuthology.orchestra.run.smithi045.stdout:150 2023-10-08T12:47:51.099 INFO:teuthology.orchestra.run.smithi045.stdout:150.out 2023-10-08T12:47:51.099 INFO:teuthology.orchestra.run.smithi045.stdout:151 2023-10-08T12:47:51.099 INFO:teuthology.orchestra.run.smithi045.stdout:151.out 2023-10-08T12:47:51.099 INFO:teuthology.orchestra.run.smithi045.stdout:152 2023-10-08T12:47:51.099 INFO:teuthology.orchestra.run.smithi045.stdout:152.out 2023-10-08T12:47:51.099 INFO:teuthology.orchestra.run.smithi045.stdout:153 2023-10-08T12:47:51.100 INFO:teuthology.orchestra.run.smithi045.stdout:153.out 2023-10-08T12:47:51.100 INFO:teuthology.orchestra.run.smithi045.stdout:154 2023-10-08T12:47:51.100 INFO:teuthology.orchestra.run.smithi045.stdout:154.out 2023-10-08T12:47:51.100 INFO:teuthology.orchestra.run.smithi045.stdout:155 2023-10-08T12:47:51.100 INFO:teuthology.orchestra.run.smithi045.stdout:155.out 2023-10-08T12:47:51.100 INFO:teuthology.orchestra.run.smithi045.stdout:156 2023-10-08T12:47:51.100 INFO:teuthology.orchestra.run.smithi045.stdout:156.out 2023-10-08T12:47:51.100 INFO:teuthology.orchestra.run.smithi045.stdout:157 2023-10-08T12:47:51.100 INFO:teuthology.orchestra.run.smithi045.stdout:157.out 2023-10-08T12:47:51.100 INFO:teuthology.orchestra.run.smithi045.stdout:158 2023-10-08T12:47:51.100 INFO:teuthology.orchestra.run.smithi045.stdout:158.out 2023-10-08T12:47:51.100 INFO:teuthology.orchestra.run.smithi045.stdout:159 2023-10-08T12:47:51.101 INFO:teuthology.orchestra.run.smithi045.stdout:159.out 2023-10-08T12:47:51.101 INFO:teuthology.orchestra.run.smithi045.stdout:160 2023-10-08T12:47:51.101 INFO:teuthology.orchestra.run.smithi045.stdout:160.out 2023-10-08T12:47:51.101 INFO:teuthology.orchestra.run.smithi045.stdout:161 2023-10-08T12:47:51.101 INFO:teuthology.orchestra.run.smithi045.stdout:161.out 2023-10-08T12:47:51.101 INFO:teuthology.orchestra.run.smithi045.stdout:162 2023-10-08T12:47:51.101 INFO:teuthology.orchestra.run.smithi045.stdout:162.out 2023-10-08T12:47:51.101 INFO:teuthology.orchestra.run.smithi045.stdout:163 2023-10-08T12:47:51.101 INFO:teuthology.orchestra.run.smithi045.stdout:163.out 2023-10-08T12:47:51.101 INFO:teuthology.orchestra.run.smithi045.stdout:164 2023-10-08T12:47:51.101 INFO:teuthology.orchestra.run.smithi045.stdout:164.out 2023-10-08T12:47:51.101 INFO:teuthology.orchestra.run.smithi045.stdout:165 2023-10-08T12:47:51.102 INFO:teuthology.orchestra.run.smithi045.stdout:165.out 2023-10-08T12:47:51.102 INFO:teuthology.orchestra.run.smithi045.stdout:166 2023-10-08T12:47:51.102 INFO:teuthology.orchestra.run.smithi045.stdout:166.out 2023-10-08T12:47:51.102 INFO:teuthology.orchestra.run.smithi045.stdout:167 2023-10-08T12:47:51.102 INFO:teuthology.orchestra.run.smithi045.stdout:167.out 2023-10-08T12:47:51.102 INFO:teuthology.orchestra.run.smithi045.stdout:168 2023-10-08T12:47:51.102 INFO:teuthology.orchestra.run.smithi045.stdout:168.out 2023-10-08T12:47:51.102 INFO:teuthology.orchestra.run.smithi045.stdout:169 2023-10-08T12:47:51.102 INFO:teuthology.orchestra.run.smithi045.stdout:169.out 2023-10-08T12:47:51.102 INFO:teuthology.orchestra.run.smithi045.stdout:170 2023-10-08T12:47:51.102 INFO:teuthology.orchestra.run.smithi045.stdout:170.out 2023-10-08T12:47:51.102 INFO:teuthology.orchestra.run.smithi045.stdout:171 2023-10-08T12:47:51.102 INFO:teuthology.orchestra.run.smithi045.stdout:171.out 2023-10-08T12:47:51.103 INFO:teuthology.orchestra.run.smithi045.stdout:172 2023-10-08T12:47:51.103 INFO:teuthology.orchestra.run.smithi045.stdout:172.out 2023-10-08T12:47:51.103 INFO:teuthology.orchestra.run.smithi045.stdout:173 2023-10-08T12:47:51.103 INFO:teuthology.orchestra.run.smithi045.stdout:173.out 2023-10-08T12:47:51.103 INFO:teuthology.orchestra.run.smithi045.stdout:174 2023-10-08T12:47:51.103 INFO:teuthology.orchestra.run.smithi045.stdout:174.out 2023-10-08T12:47:51.103 INFO:teuthology.orchestra.run.smithi045.stdout:175 2023-10-08T12:47:51.103 INFO:teuthology.orchestra.run.smithi045.stdout:175.out 2023-10-08T12:47:51.103 INFO:teuthology.orchestra.run.smithi045.stdout:176 2023-10-08T12:47:51.103 INFO:teuthology.orchestra.run.smithi045.stdout:176.out 2023-10-08T12:47:51.103 INFO:teuthology.orchestra.run.smithi045.stdout:177 2023-10-08T12:47:51.103 INFO:teuthology.orchestra.run.smithi045.stdout:177.out 2023-10-08T12:47:51.104 INFO:teuthology.orchestra.run.smithi045.stdout:178 2023-10-08T12:47:51.104 INFO:teuthology.orchestra.run.smithi045.stdout:178.out 2023-10-08T12:47:51.104 INFO:teuthology.orchestra.run.smithi045.stdout:179 2023-10-08T12:47:51.104 INFO:teuthology.orchestra.run.smithi045.stdout:179.out 2023-10-08T12:47:51.104 INFO:teuthology.orchestra.run.smithi045.stdout:180 2023-10-08T12:47:51.104 INFO:teuthology.orchestra.run.smithi045.stdout:180.out 2023-10-08T12:47:51.104 INFO:teuthology.orchestra.run.smithi045.stdout:181 2023-10-08T12:47:51.104 INFO:teuthology.orchestra.run.smithi045.stdout:181.out 2023-10-08T12:47:51.104 INFO:teuthology.orchestra.run.smithi045.stdout:182 2023-10-08T12:47:51.104 INFO:teuthology.orchestra.run.smithi045.stdout:182.out 2023-10-08T12:47:51.104 INFO:teuthology.orchestra.run.smithi045.stdout:183 2023-10-08T12:47:51.104 INFO:teuthology.orchestra.run.smithi045.stdout:183.out 2023-10-08T12:47:51.105 INFO:teuthology.orchestra.run.smithi045.stdout:184 2023-10-08T12:47:51.105 INFO:teuthology.orchestra.run.smithi045.stdout:184.out 2023-10-08T12:47:51.105 INFO:teuthology.orchestra.run.smithi045.stdout:185 2023-10-08T12:47:51.105 INFO:teuthology.orchestra.run.smithi045.stdout:185.out 2023-10-08T12:47:51.105 INFO:teuthology.orchestra.run.smithi045.stdout:186 2023-10-08T12:47:51.105 INFO:teuthology.orchestra.run.smithi045.stdout:186.out 2023-10-08T12:47:51.105 INFO:teuthology.orchestra.run.smithi045.stdout:187 2023-10-08T12:47:51.105 INFO:teuthology.orchestra.run.smithi045.stdout:187.out 2023-10-08T12:47:51.105 INFO:teuthology.orchestra.run.smithi045.stdout:188 2023-10-08T12:47:51.105 INFO:teuthology.orchestra.run.smithi045.stdout:188.out 2023-10-08T12:47:51.105 INFO:teuthology.orchestra.run.smithi045.stdout:189 2023-10-08T12:47:51.105 INFO:teuthology.orchestra.run.smithi045.stdout:189.out 2023-10-08T12:47:51.105 INFO:teuthology.orchestra.run.smithi045.stdout:190 2023-10-08T12:47:51.106 INFO:teuthology.orchestra.run.smithi045.stdout:190.out 2023-10-08T12:47:51.106 INFO:teuthology.orchestra.run.smithi045.stdout:191 2023-10-08T12:47:51.106 INFO:teuthology.orchestra.run.smithi045.stdout:191.out 2023-10-08T12:47:51.106 INFO:teuthology.orchestra.run.smithi045.stdout:192 2023-10-08T12:47:51.106 INFO:teuthology.orchestra.run.smithi045.stdout:192.out 2023-10-08T12:47:51.106 INFO:teuthology.orchestra.run.smithi045.stdout:193 2023-10-08T12:47:51.106 INFO:teuthology.orchestra.run.smithi045.stdout:193.out 2023-10-08T12:47:51.106 INFO:teuthology.orchestra.run.smithi045.stdout:194 2023-10-08T12:47:51.106 INFO:teuthology.orchestra.run.smithi045.stdout:194.out 2023-10-08T12:47:51.106 INFO:teuthology.orchestra.run.smithi045.stdout:195 2023-10-08T12:47:51.106 INFO:teuthology.orchestra.run.smithi045.stdout:195.out 2023-10-08T12:47:51.107 INFO:teuthology.orchestra.run.smithi045.stdout:196 2023-10-08T12:47:51.107 INFO:teuthology.orchestra.run.smithi045.stdout:196.out 2023-10-08T12:47:51.107 INFO:teuthology.orchestra.run.smithi045.stdout:197 2023-10-08T12:47:51.107 INFO:teuthology.orchestra.run.smithi045.stdout:197.out 2023-10-08T12:47:51.107 INFO:teuthology.orchestra.run.smithi045.stdout:198 2023-10-08T12:47:51.107 INFO:teuthology.orchestra.run.smithi045.stdout:198.out 2023-10-08T12:47:51.107 INFO:teuthology.orchestra.run.smithi045.stdout:199 2023-10-08T12:47:51.107 INFO:teuthology.orchestra.run.smithi045.stdout:199.out 2023-10-08T12:47:51.107 INFO:teuthology.orchestra.run.smithi045.stdout:200 2023-10-08T12:47:51.107 INFO:teuthology.orchestra.run.smithi045.stdout:200.out 2023-10-08T12:47:51.107 INFO:teuthology.orchestra.run.smithi045.stdout:201 2023-10-08T12:47:51.107 INFO:teuthology.orchestra.run.smithi045.stdout:201.out 2023-10-08T12:47:51.108 INFO:teuthology.orchestra.run.smithi045.stdout:202 2023-10-08T12:47:51.108 INFO:teuthology.orchestra.run.smithi045.stdout:202.out 2023-10-08T12:47:51.108 INFO:teuthology.orchestra.run.smithi045.stdout:203 2023-10-08T12:47:51.108 INFO:teuthology.orchestra.run.smithi045.stdout:203.out 2023-10-08T12:47:51.108 INFO:teuthology.orchestra.run.smithi045.stdout:204 2023-10-08T12:47:51.108 INFO:teuthology.orchestra.run.smithi045.stdout:204.out 2023-10-08T12:47:51.108 INFO:teuthology.orchestra.run.smithi045.stdout:205 2023-10-08T12:47:51.108 INFO:teuthology.orchestra.run.smithi045.stdout:205.out 2023-10-08T12:47:51.108 INFO:teuthology.orchestra.run.smithi045.stdout:206 2023-10-08T12:47:51.108 INFO:teuthology.orchestra.run.smithi045.stdout:206.out 2023-10-08T12:47:51.108 INFO:teuthology.orchestra.run.smithi045.stdout:207 2023-10-08T12:47:51.108 INFO:teuthology.orchestra.run.smithi045.stdout:207.out 2023-10-08T12:47:51.108 INFO:teuthology.orchestra.run.smithi045.stdout:208 2023-10-08T12:47:51.109 INFO:teuthology.orchestra.run.smithi045.stdout:208.out 2023-10-08T12:47:51.109 INFO:teuthology.orchestra.run.smithi045.stdout:209 2023-10-08T12:47:51.109 INFO:teuthology.orchestra.run.smithi045.stdout:209.out 2023-10-08T12:47:51.109 INFO:teuthology.orchestra.run.smithi045.stdout:210 2023-10-08T12:47:51.109 INFO:teuthology.orchestra.run.smithi045.stdout:210.out 2023-10-08T12:47:51.109 INFO:teuthology.orchestra.run.smithi045.stdout:211 2023-10-08T12:47:51.109 INFO:teuthology.orchestra.run.smithi045.stdout:211.out 2023-10-08T12:47:51.109 INFO:teuthology.orchestra.run.smithi045.stdout:212 2023-10-08T12:47:51.109 INFO:teuthology.orchestra.run.smithi045.stdout:212.out 2023-10-08T12:47:51.109 INFO:teuthology.orchestra.run.smithi045.stdout:213 2023-10-08T12:47:51.109 INFO:teuthology.orchestra.run.smithi045.stdout:213.out 2023-10-08T12:47:51.110 INFO:teuthology.orchestra.run.smithi045.stdout:214 2023-10-08T12:47:51.110 INFO:teuthology.orchestra.run.smithi045.stdout:214.out 2023-10-08T12:47:51.110 INFO:teuthology.orchestra.run.smithi045.stdout:215 2023-10-08T12:47:51.110 INFO:teuthology.orchestra.run.smithi045.stdout:215.out 2023-10-08T12:47:51.110 INFO:teuthology.orchestra.run.smithi045.stdout:216 2023-10-08T12:47:51.110 INFO:teuthology.orchestra.run.smithi045.stdout:216.out 2023-10-08T12:47:51.110 INFO:teuthology.orchestra.run.smithi045.stdout:217 2023-10-08T12:47:51.110 INFO:teuthology.orchestra.run.smithi045.stdout:217.out 2023-10-08T12:47:51.110 INFO:teuthology.orchestra.run.smithi045.stdout:218 2023-10-08T12:47:51.110 INFO:teuthology.orchestra.run.smithi045.stdout:218.out 2023-10-08T12:47:51.110 INFO:teuthology.orchestra.run.smithi045.stdout:219 2023-10-08T12:47:51.110 INFO:teuthology.orchestra.run.smithi045.stdout:219.out 2023-10-08T12:47:51.111 INFO:teuthology.orchestra.run.smithi045.stdout:220 2023-10-08T12:47:51.111 INFO:teuthology.orchestra.run.smithi045.stdout:220.out 2023-10-08T12:47:51.111 INFO:teuthology.orchestra.run.smithi045.stdout:221 2023-10-08T12:47:51.111 INFO:teuthology.orchestra.run.smithi045.stdout:221.out 2023-10-08T12:47:51.111 INFO:teuthology.orchestra.run.smithi045.stdout:222 2023-10-08T12:47:51.111 INFO:teuthology.orchestra.run.smithi045.stdout:222.out 2023-10-08T12:47:51.111 INFO:teuthology.orchestra.run.smithi045.stdout:223 2023-10-08T12:47:51.111 INFO:teuthology.orchestra.run.smithi045.stdout:223.out 2023-10-08T12:47:51.111 INFO:teuthology.orchestra.run.smithi045.stdout:224 2023-10-08T12:47:51.111 INFO:teuthology.orchestra.run.smithi045.stdout:224.out 2023-10-08T12:47:51.111 INFO:teuthology.orchestra.run.smithi045.stdout:225 2023-10-08T12:47:51.111 INFO:teuthology.orchestra.run.smithi045.stdout:225.out 2023-10-08T12:47:51.112 INFO:teuthology.orchestra.run.smithi045.stdout:226 2023-10-08T12:47:51.112 INFO:teuthology.orchestra.run.smithi045.stdout:226.out 2023-10-08T12:47:51.112 INFO:teuthology.orchestra.run.smithi045.stdout:227 2023-10-08T12:47:51.112 INFO:teuthology.orchestra.run.smithi045.stdout:227.out 2023-10-08T12:47:51.112 INFO:teuthology.orchestra.run.smithi045.stdout:228 2023-10-08T12:47:51.112 INFO:teuthology.orchestra.run.smithi045.stdout:228.out 2023-10-08T12:47:51.112 INFO:teuthology.orchestra.run.smithi045.stdout:229 2023-10-08T12:47:51.112 INFO:teuthology.orchestra.run.smithi045.stdout:229.out 2023-10-08T12:47:51.112 INFO:teuthology.orchestra.run.smithi045.stdout:230 2023-10-08T12:47:51.113 INFO:teuthology.orchestra.run.smithi045.stdout:230.out 2023-10-08T12:47:51.113 INFO:teuthology.orchestra.run.smithi045.stdout:231 2023-10-08T12:47:51.113 INFO:teuthology.orchestra.run.smithi045.stdout:231.out 2023-10-08T12:47:51.113 INFO:teuthology.orchestra.run.smithi045.stdout:232 2023-10-08T12:47:51.113 INFO:teuthology.orchestra.run.smithi045.stdout:232.out 2023-10-08T12:47:51.113 INFO:teuthology.orchestra.run.smithi045.stdout:233 2023-10-08T12:47:51.113 INFO:teuthology.orchestra.run.smithi045.stdout:233.out 2023-10-08T12:47:51.113 INFO:teuthology.orchestra.run.smithi045.stdout:234 2023-10-08T12:47:51.113 INFO:teuthology.orchestra.run.smithi045.stdout:234.out 2023-10-08T12:47:51.113 INFO:teuthology.orchestra.run.smithi045.stdout:235 2023-10-08T12:47:51.113 INFO:teuthology.orchestra.run.smithi045.stdout:235.out 2023-10-08T12:47:51.113 INFO:teuthology.orchestra.run.smithi045.stdout:236 2023-10-08T12:47:51.114 INFO:teuthology.orchestra.run.smithi045.stdout:236.out 2023-10-08T12:47:51.114 INFO:teuthology.orchestra.run.smithi045.stdout:237 2023-10-08T12:47:51.114 INFO:teuthology.orchestra.run.smithi045.stdout:237.out 2023-10-08T12:47:51.114 INFO:teuthology.orchestra.run.smithi045.stdout:238 2023-10-08T12:47:51.114 INFO:teuthology.orchestra.run.smithi045.stdout:238.out 2023-10-08T12:47:51.114 INFO:teuthology.orchestra.run.smithi045.stdout:239 2023-10-08T12:47:51.114 INFO:teuthology.orchestra.run.smithi045.stdout:239.out 2023-10-08T12:47:51.114 INFO:teuthology.orchestra.run.smithi045.stdout:240 2023-10-08T12:47:51.114 INFO:teuthology.orchestra.run.smithi045.stdout:240.out 2023-10-08T12:47:51.114 INFO:teuthology.orchestra.run.smithi045.stdout:241 2023-10-08T12:47:51.114 INFO:teuthology.orchestra.run.smithi045.stdout:241.out 2023-10-08T12:47:51.115 INFO:teuthology.orchestra.run.smithi045.stdout:242 2023-10-08T12:47:51.115 INFO:teuthology.orchestra.run.smithi045.stdout:242.out 2023-10-08T12:47:51.115 INFO:teuthology.orchestra.run.smithi045.stdout:243 2023-10-08T12:47:51.115 INFO:teuthology.orchestra.run.smithi045.stdout:243.out 2023-10-08T12:47:51.115 INFO:teuthology.orchestra.run.smithi045.stdout:244 2023-10-08T12:47:51.115 INFO:teuthology.orchestra.run.smithi045.stdout:244.out 2023-10-08T12:47:51.115 INFO:teuthology.orchestra.run.smithi045.stdout:245 2023-10-08T12:47:51.115 INFO:teuthology.orchestra.run.smithi045.stdout:245.out 2023-10-08T12:47:51.115 INFO:teuthology.orchestra.run.smithi045.stdout:246 2023-10-08T12:47:51.115 INFO:teuthology.orchestra.run.smithi045.stdout:246.out 2023-10-08T12:47:51.115 INFO:teuthology.orchestra.run.smithi045.stdout:247 2023-10-08T12:47:51.115 INFO:teuthology.orchestra.run.smithi045.stdout:247.out 2023-10-08T12:47:51.116 INFO:teuthology.orchestra.run.smithi045.stdout:248 2023-10-08T12:47:51.116 INFO:teuthology.orchestra.run.smithi045.stdout:248.out 2023-10-08T12:47:51.116 INFO:teuthology.orchestra.run.smithi045.stdout:249 2023-10-08T12:47:51.116 INFO:teuthology.orchestra.run.smithi045.stdout:249.out 2023-10-08T12:47:51.116 INFO:teuthology.orchestra.run.smithi045.stdout:250 2023-10-08T12:47:51.116 INFO:teuthology.orchestra.run.smithi045.stdout:250.out 2023-10-08T12:47:51.116 INFO:teuthology.orchestra.run.smithi045.stdout:251 2023-10-08T12:47:51.116 INFO:teuthology.orchestra.run.smithi045.stdout:251.out 2023-10-08T12:47:51.116 INFO:teuthology.orchestra.run.smithi045.stdout:252 2023-10-08T12:47:51.116 INFO:teuthology.orchestra.run.smithi045.stdout:252.out 2023-10-08T12:47:51.116 INFO:teuthology.orchestra.run.smithi045.stdout:253 2023-10-08T12:47:51.116 INFO:teuthology.orchestra.run.smithi045.stdout:253.out 2023-10-08T12:47:51.117 INFO:teuthology.orchestra.run.smithi045.stdout:254 2023-10-08T12:47:51.117 INFO:teuthology.orchestra.run.smithi045.stdout:254.out 2023-10-08T12:47:51.117 INFO:teuthology.orchestra.run.smithi045.stdout:255 2023-10-08T12:47:51.117 INFO:teuthology.orchestra.run.smithi045.stdout:255.out 2023-10-08T12:47:51.117 INFO:teuthology.orchestra.run.smithi045.stdout:256 2023-10-08T12:47:51.117 INFO:teuthology.orchestra.run.smithi045.stdout:256.out 2023-10-08T12:47:51.117 INFO:teuthology.orchestra.run.smithi045.stdout:257 2023-10-08T12:47:51.117 INFO:teuthology.orchestra.run.smithi045.stdout:257.out 2023-10-08T12:47:51.117 INFO:teuthology.orchestra.run.smithi045.stdout:258 2023-10-08T12:47:51.117 INFO:teuthology.orchestra.run.smithi045.stdout:258.out 2023-10-08T12:47:51.117 INFO:teuthology.orchestra.run.smithi045.stdout:259 2023-10-08T12:47:51.117 INFO:teuthology.orchestra.run.smithi045.stdout:259.out 2023-10-08T12:47:51.118 INFO:teuthology.orchestra.run.smithi045.stdout:260 2023-10-08T12:47:51.118 INFO:teuthology.orchestra.run.smithi045.stdout:260.out 2023-10-08T12:47:51.118 INFO:teuthology.orchestra.run.smithi045.stdout:261 2023-10-08T12:47:51.118 INFO:teuthology.orchestra.run.smithi045.stdout:261.out 2023-10-08T12:47:51.118 INFO:teuthology.orchestra.run.smithi045.stdout:262 2023-10-08T12:47:51.118 INFO:teuthology.orchestra.run.smithi045.stdout:262.out 2023-10-08T12:47:51.118 INFO:teuthology.orchestra.run.smithi045.stdout:263 2023-10-08T12:47:51.118 INFO:teuthology.orchestra.run.smithi045.stdout:263.out 2023-10-08T12:47:51.118 INFO:teuthology.orchestra.run.smithi045.stdout:264 2023-10-08T12:47:51.118 INFO:teuthology.orchestra.run.smithi045.stdout:264.out 2023-10-08T12:47:51.118 INFO:teuthology.orchestra.run.smithi045.stdout:265 2023-10-08T12:47:51.118 INFO:teuthology.orchestra.run.smithi045.stdout:265.out 2023-10-08T12:47:51.118 INFO:teuthology.orchestra.run.smithi045.stdout:266 2023-10-08T12:47:51.119 INFO:teuthology.orchestra.run.smithi045.stdout:266.out 2023-10-08T12:47:51.119 INFO:teuthology.orchestra.run.smithi045.stdout:267 2023-10-08T12:47:51.119 INFO:teuthology.orchestra.run.smithi045.stdout:267.out 2023-10-08T12:47:51.119 INFO:teuthology.orchestra.run.smithi045.stdout:268 2023-10-08T12:47:51.119 INFO:teuthology.orchestra.run.smithi045.stdout:268.out 2023-10-08T12:47:51.119 INFO:teuthology.orchestra.run.smithi045.stdout:269 2023-10-08T12:47:51.119 INFO:teuthology.orchestra.run.smithi045.stdout:269.out 2023-10-08T12:47:51.119 INFO:teuthology.orchestra.run.smithi045.stdout:270 2023-10-08T12:47:51.119 INFO:teuthology.orchestra.run.smithi045.stdout:270.out 2023-10-08T12:47:51.119 INFO:teuthology.orchestra.run.smithi045.stdout:271 2023-10-08T12:47:51.119 INFO:teuthology.orchestra.run.smithi045.stdout:271.out 2023-10-08T12:47:51.119 INFO:teuthology.orchestra.run.smithi045.stdout:272 2023-10-08T12:47:51.120 INFO:teuthology.orchestra.run.smithi045.stdout:272.out 2023-10-08T12:47:51.120 INFO:teuthology.orchestra.run.smithi045.stdout:273 2023-10-08T12:47:51.120 INFO:teuthology.orchestra.run.smithi045.stdout:273.out 2023-10-08T12:47:51.120 INFO:teuthology.orchestra.run.smithi045.stdout:274 2023-10-08T12:47:51.120 INFO:teuthology.orchestra.run.smithi045.stdout:274.out 2023-10-08T12:47:51.120 INFO:teuthology.orchestra.run.smithi045.stdout:275 2023-10-08T12:47:51.120 INFO:teuthology.orchestra.run.smithi045.stdout:275.out 2023-10-08T12:47:51.120 INFO:teuthology.orchestra.run.smithi045.stdout:276 2023-10-08T12:47:51.120 INFO:teuthology.orchestra.run.smithi045.stdout:276.out 2023-10-08T12:47:51.120 INFO:teuthology.orchestra.run.smithi045.stdout:277 2023-10-08T12:47:51.120 INFO:teuthology.orchestra.run.smithi045.stdout:277.out 2023-10-08T12:47:51.120 INFO:teuthology.orchestra.run.smithi045.stdout:278 2023-10-08T12:47:51.120 INFO:teuthology.orchestra.run.smithi045.stdout:278.out 2023-10-08T12:47:51.121 INFO:teuthology.orchestra.run.smithi045.stdout:279 2023-10-08T12:47:51.121 INFO:teuthology.orchestra.run.smithi045.stdout:279.out 2023-10-08T12:47:51.121 INFO:teuthology.orchestra.run.smithi045.stdout:280 2023-10-08T12:47:51.121 INFO:teuthology.orchestra.run.smithi045.stdout:280.out 2023-10-08T12:47:51.121 INFO:teuthology.orchestra.run.smithi045.stdout:281 2023-10-08T12:47:51.121 INFO:teuthology.orchestra.run.smithi045.stdout:281.out 2023-10-08T12:47:51.121 INFO:teuthology.orchestra.run.smithi045.stdout:282 2023-10-08T12:47:51.121 INFO:teuthology.orchestra.run.smithi045.stdout:282.out 2023-10-08T12:47:51.121 INFO:teuthology.orchestra.run.smithi045.stdout:283 2023-10-08T12:47:51.121 INFO:teuthology.orchestra.run.smithi045.stdout:283.out 2023-10-08T12:47:51.121 INFO:teuthology.orchestra.run.smithi045.stdout:284 2023-10-08T12:47:51.121 INFO:teuthology.orchestra.run.smithi045.stdout:284.out 2023-10-08T12:47:51.122 INFO:teuthology.orchestra.run.smithi045.stdout:285 2023-10-08T12:47:51.122 INFO:teuthology.orchestra.run.smithi045.stdout:285.out 2023-10-08T12:47:51.122 INFO:teuthology.orchestra.run.smithi045.stdout:286 2023-10-08T12:47:51.122 INFO:teuthology.orchestra.run.smithi045.stdout:286.out 2023-10-08T12:47:51.122 INFO:teuthology.orchestra.run.smithi045.stdout:287 2023-10-08T12:47:51.122 INFO:teuthology.orchestra.run.smithi045.stdout:287.out 2023-10-08T12:47:51.122 INFO:teuthology.orchestra.run.smithi045.stdout:288 2023-10-08T12:47:51.122 INFO:teuthology.orchestra.run.smithi045.stdout:288.out 2023-10-08T12:47:51.122 INFO:teuthology.orchestra.run.smithi045.stdout:289 2023-10-08T12:47:51.122 INFO:teuthology.orchestra.run.smithi045.stdout:289.out 2023-10-08T12:47:51.122 INFO:teuthology.orchestra.run.smithi045.stdout:290 2023-10-08T12:47:51.123 INFO:teuthology.orchestra.run.smithi045.stdout:290.out 2023-10-08T12:47:51.123 INFO:teuthology.orchestra.run.smithi045.stdout:291 2023-10-08T12:47:51.123 INFO:teuthology.orchestra.run.smithi045.stdout:291.out 2023-10-08T12:47:51.123 INFO:teuthology.orchestra.run.smithi045.stdout:292 2023-10-08T12:47:51.123 INFO:teuthology.orchestra.run.smithi045.stdout:292.out 2023-10-08T12:47:51.123 INFO:teuthology.orchestra.run.smithi045.stdout:293 2023-10-08T12:47:51.123 INFO:teuthology.orchestra.run.smithi045.stdout:293.out 2023-10-08T12:47:51.123 INFO:teuthology.orchestra.run.smithi045.stdout:294 2023-10-08T12:47:51.123 INFO:teuthology.orchestra.run.smithi045.stdout:294.out 2023-10-08T12:47:51.123 INFO:teuthology.orchestra.run.smithi045.stdout:295 2023-10-08T12:47:51.123 INFO:teuthology.orchestra.run.smithi045.stdout:295.out 2023-10-08T12:47:51.123 INFO:teuthology.orchestra.run.smithi045.stdout:296 2023-10-08T12:47:51.124 INFO:teuthology.orchestra.run.smithi045.stdout:296.out 2023-10-08T12:47:51.124 INFO:teuthology.orchestra.run.smithi045.stdout:297 2023-10-08T12:47:51.124 INFO:teuthology.orchestra.run.smithi045.stdout:297.out 2023-10-08T12:47:51.124 INFO:teuthology.orchestra.run.smithi045.stdout:298 2023-10-08T12:47:51.124 INFO:teuthology.orchestra.run.smithi045.stdout:298.out 2023-10-08T12:47:51.124 INFO:teuthology.orchestra.run.smithi045.stdout:299 2023-10-08T12:47:51.124 INFO:teuthology.orchestra.run.smithi045.stdout:299.out 2023-10-08T12:47:51.124 INFO:teuthology.orchestra.run.smithi045.stdout:300 2023-10-08T12:47:51.124 INFO:teuthology.orchestra.run.smithi045.stdout:300.out 2023-10-08T12:47:51.124 INFO:teuthology.orchestra.run.smithi045.stdout:301 2023-10-08T12:47:51.124 INFO:teuthology.orchestra.run.smithi045.stdout:301.out 2023-10-08T12:47:51.124 INFO:teuthology.orchestra.run.smithi045.stdout:302 2023-10-08T12:47:51.124 INFO:teuthology.orchestra.run.smithi045.stdout:302.out 2023-10-08T12:47:51.125 INFO:teuthology.orchestra.run.smithi045.stdout:303 2023-10-08T12:47:51.125 INFO:teuthology.orchestra.run.smithi045.stdout:303.out 2023-10-08T12:47:51.125 INFO:teuthology.orchestra.run.smithi045.stdout:304 2023-10-08T12:47:51.125 INFO:teuthology.orchestra.run.smithi045.stdout:304.out 2023-10-08T12:47:51.125 INFO:teuthology.orchestra.run.smithi045.stdout:305 2023-10-08T12:47:51.125 INFO:teuthology.orchestra.run.smithi045.stdout:305.out 2023-10-08T12:47:51.125 INFO:teuthology.orchestra.run.smithi045.stdout:306 2023-10-08T12:47:51.125 INFO:teuthology.orchestra.run.smithi045.stdout:306.out 2023-10-08T12:47:51.125 INFO:teuthology.orchestra.run.smithi045.stdout:307 2023-10-08T12:47:51.125 INFO:teuthology.orchestra.run.smithi045.stdout:307.out 2023-10-08T12:47:51.125 INFO:teuthology.orchestra.run.smithi045.stdout:308 2023-10-08T12:47:51.125 INFO:teuthology.orchestra.run.smithi045.stdout:308.out 2023-10-08T12:47:51.126 INFO:teuthology.orchestra.run.smithi045.stdout:309 2023-10-08T12:47:51.126 INFO:teuthology.orchestra.run.smithi045.stdout:309.out 2023-10-08T12:47:51.126 INFO:teuthology.orchestra.run.smithi045.stdout:310 2023-10-08T12:47:51.126 INFO:teuthology.orchestra.run.smithi045.stdout:310.out 2023-10-08T12:47:51.126 INFO:teuthology.orchestra.run.smithi045.stdout:311 2023-10-08T12:47:51.126 INFO:teuthology.orchestra.run.smithi045.stdout:311.out 2023-10-08T12:47:51.126 INFO:teuthology.orchestra.run.smithi045.stdout:312 2023-10-08T12:47:51.126 INFO:teuthology.orchestra.run.smithi045.stdout:312.out 2023-10-08T12:47:51.126 INFO:teuthology.orchestra.run.smithi045.stdout:313 2023-10-08T12:47:51.126 INFO:teuthology.orchestra.run.smithi045.stdout:313.out 2023-10-08T12:47:51.126 INFO:teuthology.orchestra.run.smithi045.stdout:314 2023-10-08T12:47:51.126 INFO:teuthology.orchestra.run.smithi045.stdout:314.out 2023-10-08T12:47:51.127 INFO:teuthology.orchestra.run.smithi045.stdout:315 2023-10-08T12:47:51.127 INFO:teuthology.orchestra.run.smithi045.stdout:315.out 2023-10-08T12:47:51.127 INFO:teuthology.orchestra.run.smithi045.stdout:316 2023-10-08T12:47:51.127 INFO:teuthology.orchestra.run.smithi045.stdout:316.out 2023-10-08T12:47:51.127 INFO:teuthology.orchestra.run.smithi045.stdout:317 2023-10-08T12:47:51.127 INFO:teuthology.orchestra.run.smithi045.stdout:317.out 2023-10-08T12:47:51.127 INFO:teuthology.orchestra.run.smithi045.stdout:318 2023-10-08T12:47:51.127 INFO:teuthology.orchestra.run.smithi045.stdout:318.out 2023-10-08T12:47:51.127 INFO:teuthology.orchestra.run.smithi045.stdout:319 2023-10-08T12:47:51.127 INFO:teuthology.orchestra.run.smithi045.stdout:319.out 2023-10-08T12:47:51.127 INFO:teuthology.orchestra.run.smithi045.stdout:320 2023-10-08T12:47:51.127 INFO:teuthology.orchestra.run.smithi045.stdout:320.out 2023-10-08T12:47:51.127 INFO:teuthology.orchestra.run.smithi045.stdout:321 2023-10-08T12:47:51.128 INFO:teuthology.orchestra.run.smithi045.stdout:321.out 2023-10-08T12:47:51.128 INFO:teuthology.orchestra.run.smithi045.stdout:322 2023-10-08T12:47:51.128 INFO:teuthology.orchestra.run.smithi045.stdout:322.out 2023-10-08T12:47:51.128 INFO:teuthology.orchestra.run.smithi045.stdout:323 2023-10-08T12:47:51.128 INFO:teuthology.orchestra.run.smithi045.stdout:323.out 2023-10-08T12:47:51.128 INFO:teuthology.orchestra.run.smithi045.stdout:324 2023-10-08T12:47:51.128 INFO:teuthology.orchestra.run.smithi045.stdout:324.out 2023-10-08T12:47:51.128 INFO:teuthology.orchestra.run.smithi045.stdout:325 2023-10-08T12:47:51.128 INFO:teuthology.orchestra.run.smithi045.stdout:325.out 2023-10-08T12:47:51.128 INFO:teuthology.orchestra.run.smithi045.stdout:326 2023-10-08T12:47:51.128 INFO:teuthology.orchestra.run.smithi045.stdout:326.out 2023-10-08T12:47:51.128 INFO:teuthology.orchestra.run.smithi045.stdout:327 2023-10-08T12:47:51.129 INFO:teuthology.orchestra.run.smithi045.stdout:327.out 2023-10-08T12:47:51.129 INFO:teuthology.orchestra.run.smithi045.stdout:328 2023-10-08T12:47:51.129 INFO:teuthology.orchestra.run.smithi045.stdout:328.out 2023-10-08T12:47:51.129 INFO:teuthology.orchestra.run.smithi045.stdout:329 2023-10-08T12:47:51.129 INFO:teuthology.orchestra.run.smithi045.stdout:329.out 2023-10-08T12:47:51.129 INFO:teuthology.orchestra.run.smithi045.stdout:330 2023-10-08T12:47:51.129 INFO:teuthology.orchestra.run.smithi045.stdout:330.out 2023-10-08T12:47:51.129 INFO:teuthology.orchestra.run.smithi045.stdout:331 2023-10-08T12:47:51.129 INFO:teuthology.orchestra.run.smithi045.stdout:331.out 2023-10-08T12:47:51.129 INFO:teuthology.orchestra.run.smithi045.stdout:332 2023-10-08T12:47:51.129 INFO:teuthology.orchestra.run.smithi045.stdout:332.out 2023-10-08T12:47:51.129 INFO:teuthology.orchestra.run.smithi045.stdout:333 2023-10-08T12:47:51.129 INFO:teuthology.orchestra.run.smithi045.stdout:333.out 2023-10-08T12:47:51.130 INFO:teuthology.orchestra.run.smithi045.stdout:334 2023-10-08T12:47:51.130 INFO:teuthology.orchestra.run.smithi045.stdout:334.out 2023-10-08T12:47:51.130 INFO:teuthology.orchestra.run.smithi045.stdout:335 2023-10-08T12:47:51.130 INFO:teuthology.orchestra.run.smithi045.stdout:335.out 2023-10-08T12:47:51.130 INFO:teuthology.orchestra.run.smithi045.stdout:336 2023-10-08T12:47:51.130 INFO:teuthology.orchestra.run.smithi045.stdout:336.out 2023-10-08T12:47:51.130 INFO:teuthology.orchestra.run.smithi045.stdout:337 2023-10-08T12:47:51.130 INFO:teuthology.orchestra.run.smithi045.stdout:337.out 2023-10-08T12:47:51.130 INFO:teuthology.orchestra.run.smithi045.stdout:338 2023-10-08T12:47:51.130 INFO:teuthology.orchestra.run.smithi045.stdout:338.out 2023-10-08T12:47:51.130 INFO:teuthology.orchestra.run.smithi045.stdout:339 2023-10-08T12:47:51.130 INFO:teuthology.orchestra.run.smithi045.stdout:339.out 2023-10-08T12:47:51.131 INFO:teuthology.orchestra.run.smithi045.stdout:340 2023-10-08T12:47:51.131 INFO:teuthology.orchestra.run.smithi045.stdout:340.out 2023-10-08T12:47:51.131 INFO:teuthology.orchestra.run.smithi045.stdout:341 2023-10-08T12:47:51.131 INFO:teuthology.orchestra.run.smithi045.stdout:341.out 2023-10-08T12:47:51.131 INFO:teuthology.orchestra.run.smithi045.stdout:342 2023-10-08T12:47:51.131 INFO:teuthology.orchestra.run.smithi045.stdout:342.out 2023-10-08T12:47:51.131 INFO:teuthology.orchestra.run.smithi045.stdout:343 2023-10-08T12:47:51.131 INFO:teuthology.orchestra.run.smithi045.stdout:343.out 2023-10-08T12:47:51.131 INFO:teuthology.orchestra.run.smithi045.stdout:344 2023-10-08T12:47:51.131 INFO:teuthology.orchestra.run.smithi045.stdout:344.out 2023-10-08T12:47:51.131 INFO:teuthology.orchestra.run.smithi045.stdout:345 2023-10-08T12:47:51.131 INFO:teuthology.orchestra.run.smithi045.stdout:345.out 2023-10-08T12:47:51.132 INFO:teuthology.orchestra.run.smithi045.stdout:346 2023-10-08T12:47:51.132 INFO:teuthology.orchestra.run.smithi045.stdout:346.out 2023-10-08T12:47:51.132 INFO:teuthology.orchestra.run.smithi045.stdout:347 2023-10-08T12:47:51.132 INFO:teuthology.orchestra.run.smithi045.stdout:347.out 2023-10-08T12:47:51.132 INFO:teuthology.orchestra.run.smithi045.stdout:348 2023-10-08T12:47:51.132 INFO:teuthology.orchestra.run.smithi045.stdout:348.out 2023-10-08T12:47:51.132 INFO:teuthology.orchestra.run.smithi045.stdout:349 2023-10-08T12:47:51.132 INFO:teuthology.orchestra.run.smithi045.stdout:349.out 2023-10-08T12:47:51.132 INFO:teuthology.orchestra.run.smithi045.stdout:350 2023-10-08T12:47:51.132 INFO:teuthology.orchestra.run.smithi045.stdout:350.out 2023-10-08T12:47:51.132 INFO:teuthology.orchestra.run.smithi045.stdout:351 2023-10-08T12:47:51.133 INFO:teuthology.orchestra.run.smithi045.stdout:351.out 2023-10-08T12:47:51.133 INFO:teuthology.orchestra.run.smithi045.stdout:352 2023-10-08T12:47:51.133 INFO:teuthology.orchestra.run.smithi045.stdout:352.out 2023-10-08T12:47:51.133 INFO:teuthology.orchestra.run.smithi045.stdout:353 2023-10-08T12:47:51.133 INFO:teuthology.orchestra.run.smithi045.stdout:353.out 2023-10-08T12:47:51.133 INFO:teuthology.orchestra.run.smithi045.stdout:354 2023-10-08T12:47:51.133 INFO:teuthology.orchestra.run.smithi045.stdout:354.out 2023-10-08T12:47:51.133 INFO:teuthology.orchestra.run.smithi045.stdout:355 2023-10-08T12:47:51.133 INFO:teuthology.orchestra.run.smithi045.stdout:355.out 2023-10-08T12:47:51.133 INFO:teuthology.orchestra.run.smithi045.stdout:356 2023-10-08T12:47:51.133 INFO:teuthology.orchestra.run.smithi045.stdout:356.out 2023-10-08T12:47:51.133 INFO:teuthology.orchestra.run.smithi045.stdout:357 2023-10-08T12:47:51.134 INFO:teuthology.orchestra.run.smithi045.stdout:357.out 2023-10-08T12:47:51.134 INFO:teuthology.orchestra.run.smithi045.stdout:358 2023-10-08T12:47:51.134 INFO:teuthology.orchestra.run.smithi045.stdout:358.out 2023-10-08T12:47:51.134 INFO:teuthology.orchestra.run.smithi045.stdout:359 2023-10-08T12:47:51.134 INFO:teuthology.orchestra.run.smithi045.stdout:359.out 2023-10-08T12:47:51.134 INFO:teuthology.orchestra.run.smithi045.stdout:360 2023-10-08T12:47:51.134 INFO:teuthology.orchestra.run.smithi045.stdout:360.out 2023-10-08T12:47:51.134 INFO:teuthology.orchestra.run.smithi045.stdout:361 2023-10-08T12:47:51.134 INFO:teuthology.orchestra.run.smithi045.stdout:361.out 2023-10-08T12:47:51.134 INFO:teuthology.orchestra.run.smithi045.stdout:362 2023-10-08T12:47:51.134 INFO:teuthology.orchestra.run.smithi045.stdout:362.out 2023-10-08T12:47:51.134 INFO:teuthology.orchestra.run.smithi045.stdout:363 2023-10-08T12:47:51.135 INFO:teuthology.orchestra.run.smithi045.stdout:363.out 2023-10-08T12:47:51.135 INFO:teuthology.orchestra.run.smithi045.stdout:364 2023-10-08T12:47:51.135 INFO:teuthology.orchestra.run.smithi045.stdout:364.out 2023-10-08T12:47:51.135 INFO:teuthology.orchestra.run.smithi045.stdout:365 2023-10-08T12:47:51.135 INFO:teuthology.orchestra.run.smithi045.stdout:365.out 2023-10-08T12:47:51.135 INFO:teuthology.orchestra.run.smithi045.stdout:366 2023-10-08T12:47:51.135 INFO:teuthology.orchestra.run.smithi045.stdout:366.out 2023-10-08T12:47:51.135 INFO:teuthology.orchestra.run.smithi045.stdout:367 2023-10-08T12:47:51.135 INFO:teuthology.orchestra.run.smithi045.stdout:367.out 2023-10-08T12:47:51.135 INFO:teuthology.orchestra.run.smithi045.stdout:368 2023-10-08T12:47:51.135 INFO:teuthology.orchestra.run.smithi045.stdout:368.out 2023-10-08T12:47:51.135 INFO:teuthology.orchestra.run.smithi045.stdout:369 2023-10-08T12:47:51.136 INFO:teuthology.orchestra.run.smithi045.stdout:369.out 2023-10-08T12:47:51.136 INFO:teuthology.orchestra.run.smithi045.stdout:370 2023-10-08T12:47:51.136 INFO:teuthology.orchestra.run.smithi045.stdout:370.out 2023-10-08T12:47:51.136 INFO:teuthology.orchestra.run.smithi045.stdout:371 2023-10-08T12:47:51.136 INFO:teuthology.orchestra.run.smithi045.stdout:371.out 2023-10-08T12:47:51.136 INFO:teuthology.orchestra.run.smithi045.stdout:372 2023-10-08T12:47:51.136 INFO:teuthology.orchestra.run.smithi045.stdout:372.out 2023-10-08T12:47:51.136 INFO:teuthology.orchestra.run.smithi045.stdout:373 2023-10-08T12:47:51.136 INFO:teuthology.orchestra.run.smithi045.stdout:373.out 2023-10-08T12:47:51.136 INFO:teuthology.orchestra.run.smithi045.stdout:374 2023-10-08T12:47:51.136 INFO:teuthology.orchestra.run.smithi045.stdout:374.out 2023-10-08T12:47:51.136 INFO:teuthology.orchestra.run.smithi045.stdout:375 2023-10-08T12:47:51.137 INFO:teuthology.orchestra.run.smithi045.stdout:375.out 2023-10-08T12:47:51.137 INFO:teuthology.orchestra.run.smithi045.stdout:376 2023-10-08T12:47:51.137 INFO:teuthology.orchestra.run.smithi045.stdout:376.out 2023-10-08T12:47:51.137 INFO:teuthology.orchestra.run.smithi045.stdout:377 2023-10-08T12:47:51.137 INFO:teuthology.orchestra.run.smithi045.stdout:377.out 2023-10-08T12:47:51.137 INFO:teuthology.orchestra.run.smithi045.stdout:378 2023-10-08T12:47:51.137 INFO:teuthology.orchestra.run.smithi045.stdout:378.out 2023-10-08T12:47:51.137 INFO:teuthology.orchestra.run.smithi045.stdout:379 2023-10-08T12:47:51.137 INFO:teuthology.orchestra.run.smithi045.stdout:379.out 2023-10-08T12:47:51.137 INFO:teuthology.orchestra.run.smithi045.stdout:380 2023-10-08T12:47:51.137 INFO:teuthology.orchestra.run.smithi045.stdout:380.out 2023-10-08T12:47:51.138 INFO:teuthology.orchestra.run.smithi045.stdout:381 2023-10-08T12:47:51.138 INFO:teuthology.orchestra.run.smithi045.stdout:381.out 2023-10-08T12:47:51.138 INFO:teuthology.orchestra.run.smithi045.stdout:382 2023-10-08T12:47:51.138 INFO:teuthology.orchestra.run.smithi045.stdout:382.out 2023-10-08T12:47:51.138 INFO:teuthology.orchestra.run.smithi045.stdout:383 2023-10-08T12:47:51.138 INFO:teuthology.orchestra.run.smithi045.stdout:383.out 2023-10-08T12:47:51.138 INFO:teuthology.orchestra.run.smithi045.stdout:384 2023-10-08T12:47:51.138 INFO:teuthology.orchestra.run.smithi045.stdout:384.out 2023-10-08T12:47:51.138 INFO:teuthology.orchestra.run.smithi045.stdout:385 2023-10-08T12:47:51.138 INFO:teuthology.orchestra.run.smithi045.stdout:385.out 2023-10-08T12:47:51.139 INFO:teuthology.orchestra.run.smithi045.stdout:386 2023-10-08T12:47:51.139 INFO:teuthology.orchestra.run.smithi045.stdout:386.out 2023-10-08T12:47:51.139 INFO:teuthology.orchestra.run.smithi045.stdout:387 2023-10-08T12:47:51.139 INFO:teuthology.orchestra.run.smithi045.stdout:387.out 2023-10-08T12:47:51.139 INFO:teuthology.orchestra.run.smithi045.stdout:388 2023-10-08T12:47:51.139 INFO:teuthology.orchestra.run.smithi045.stdout:388.out 2023-10-08T12:47:51.139 INFO:teuthology.orchestra.run.smithi045.stdout:389 2023-10-08T12:47:51.139 INFO:teuthology.orchestra.run.smithi045.stdout:389.out 2023-10-08T12:47:51.139 INFO:teuthology.orchestra.run.smithi045.stdout:390 2023-10-08T12:47:51.139 INFO:teuthology.orchestra.run.smithi045.stdout:390.out 2023-10-08T12:47:51.139 INFO:teuthology.orchestra.run.smithi045.stdout:391 2023-10-08T12:47:51.139 INFO:teuthology.orchestra.run.smithi045.stdout:391.out 2023-10-08T12:47:51.139 INFO:teuthology.orchestra.run.smithi045.stdout:392 2023-10-08T12:47:51.140 INFO:teuthology.orchestra.run.smithi045.stdout:392.out 2023-10-08T12:47:51.140 INFO:teuthology.orchestra.run.smithi045.stdout:393 2023-10-08T12:47:51.140 INFO:teuthology.orchestra.run.smithi045.stdout:393.out 2023-10-08T12:47:51.140 INFO:teuthology.orchestra.run.smithi045.stdout:394 2023-10-08T12:47:51.140 INFO:teuthology.orchestra.run.smithi045.stdout:394.out 2023-10-08T12:47:51.140 INFO:teuthology.orchestra.run.smithi045.stdout:395 2023-10-08T12:47:51.140 INFO:teuthology.orchestra.run.smithi045.stdout:395.out 2023-10-08T12:47:51.140 INFO:teuthology.orchestra.run.smithi045.stdout:396 2023-10-08T12:47:51.140 INFO:teuthology.orchestra.run.smithi045.stdout:396.out 2023-10-08T12:47:51.140 INFO:teuthology.orchestra.run.smithi045.stdout:397 2023-10-08T12:47:51.141 INFO:teuthology.orchestra.run.smithi045.stdout:397.out 2023-10-08T12:47:51.141 INFO:teuthology.orchestra.run.smithi045.stdout:398 2023-10-08T12:47:51.141 INFO:teuthology.orchestra.run.smithi045.stdout:398.out 2023-10-08T12:47:51.141 INFO:teuthology.orchestra.run.smithi045.stdout:399 2023-10-08T12:47:51.141 INFO:teuthology.orchestra.run.smithi045.stdout:399.out 2023-10-08T12:47:51.141 INFO:teuthology.orchestra.run.smithi045.stdout:400 2023-10-08T12:47:51.141 INFO:teuthology.orchestra.run.smithi045.stdout:400.out 2023-10-08T12:47:51.141 INFO:teuthology.orchestra.run.smithi045.stdout:401 2023-10-08T12:47:51.141 INFO:teuthology.orchestra.run.smithi045.stdout:401.out 2023-10-08T12:47:51.141 INFO:teuthology.orchestra.run.smithi045.stdout:402 2023-10-08T12:47:51.141 INFO:teuthology.orchestra.run.smithi045.stdout:402.out 2023-10-08T12:47:51.141 INFO:teuthology.orchestra.run.smithi045.stdout:403 2023-10-08T12:47:51.142 INFO:teuthology.orchestra.run.smithi045.stdout:403.out 2023-10-08T12:47:51.142 INFO:teuthology.orchestra.run.smithi045.stdout:404 2023-10-08T12:47:51.142 INFO:teuthology.orchestra.run.smithi045.stdout:404.out 2023-10-08T12:47:51.142 INFO:teuthology.orchestra.run.smithi045.stdout:405 2023-10-08T12:47:51.142 INFO:teuthology.orchestra.run.smithi045.stdout:405.out 2023-10-08T12:47:51.142 INFO:teuthology.orchestra.run.smithi045.stdout:406 2023-10-08T12:47:51.142 INFO:teuthology.orchestra.run.smithi045.stdout:406.out 2023-10-08T12:47:51.142 INFO:teuthology.orchestra.run.smithi045.stdout:407 2023-10-08T12:47:51.142 INFO:teuthology.orchestra.run.smithi045.stdout:407.out 2023-10-08T12:47:51.142 INFO:teuthology.orchestra.run.smithi045.stdout:408 2023-10-08T12:47:51.142 INFO:teuthology.orchestra.run.smithi045.stdout:408.out 2023-10-08T12:47:51.142 INFO:teuthology.orchestra.run.smithi045.stdout:409 2023-10-08T12:47:51.143 INFO:teuthology.orchestra.run.smithi045.stdout:409.out 2023-10-08T12:47:51.143 INFO:teuthology.orchestra.run.smithi045.stdout:410 2023-10-08T12:47:51.143 INFO:teuthology.orchestra.run.smithi045.stdout:410.out 2023-10-08T12:47:51.143 INFO:teuthology.orchestra.run.smithi045.stdout:411 2023-10-08T12:47:51.143 INFO:teuthology.orchestra.run.smithi045.stdout:411.out 2023-10-08T12:47:51.143 INFO:teuthology.orchestra.run.smithi045.stdout:412 2023-10-08T12:47:51.143 INFO:teuthology.orchestra.run.smithi045.stdout:412.out 2023-10-08T12:47:51.143 INFO:teuthology.orchestra.run.smithi045.stdout:413 2023-10-08T12:47:51.143 INFO:teuthology.orchestra.run.smithi045.stdout:413.out 2023-10-08T12:47:51.143 INFO:teuthology.orchestra.run.smithi045.stdout:414 2023-10-08T12:47:51.143 INFO:teuthology.orchestra.run.smithi045.stdout:414.out 2023-10-08T12:47:51.143 INFO:teuthology.orchestra.run.smithi045.stdout:415 2023-10-08T12:47:51.144 INFO:teuthology.orchestra.run.smithi045.stdout:415.out 2023-10-08T12:47:51.144 INFO:teuthology.orchestra.run.smithi045.stdout:416 2023-10-08T12:47:51.144 INFO:teuthology.orchestra.run.smithi045.stdout:416.out 2023-10-08T12:47:51.144 INFO:teuthology.orchestra.run.smithi045.stdout:417 2023-10-08T12:47:51.144 INFO:teuthology.orchestra.run.smithi045.stdout:417.out 2023-10-08T12:47:51.144 INFO:teuthology.orchestra.run.smithi045.stdout:418 2023-10-08T12:47:51.144 INFO:teuthology.orchestra.run.smithi045.stdout:418.out 2023-10-08T12:47:51.144 INFO:teuthology.orchestra.run.smithi045.stdout:419 2023-10-08T12:47:51.144 INFO:teuthology.orchestra.run.smithi045.stdout:419.out 2023-10-08T12:47:51.144 INFO:teuthology.orchestra.run.smithi045.stdout:420 2023-10-08T12:47:51.144 INFO:teuthology.orchestra.run.smithi045.stdout:420.out 2023-10-08T12:47:51.145 INFO:teuthology.orchestra.run.smithi045.stdout:421 2023-10-08T12:47:51.145 INFO:teuthology.orchestra.run.smithi045.stdout:421.out 2023-10-08T12:47:51.145 INFO:teuthology.orchestra.run.smithi045.stdout:422 2023-10-08T12:47:51.145 INFO:teuthology.orchestra.run.smithi045.stdout:422.out 2023-10-08T12:47:51.145 INFO:teuthology.orchestra.run.smithi045.stdout:423 2023-10-08T12:47:51.145 INFO:teuthology.orchestra.run.smithi045.stdout:423.out 2023-10-08T12:47:51.145 INFO:teuthology.orchestra.run.smithi045.stdout:424 2023-10-08T12:47:51.145 INFO:teuthology.orchestra.run.smithi045.stdout:424.out 2023-10-08T12:47:51.145 INFO:teuthology.orchestra.run.smithi045.stdout:425 2023-10-08T12:47:51.145 INFO:teuthology.orchestra.run.smithi045.stdout:425.out 2023-10-08T12:47:51.145 INFO:teuthology.orchestra.run.smithi045.stdout:426 2023-10-08T12:47:51.145 INFO:teuthology.orchestra.run.smithi045.stdout:426.out 2023-10-08T12:47:51.146 INFO:teuthology.orchestra.run.smithi045.stdout:427 2023-10-08T12:47:51.146 INFO:teuthology.orchestra.run.smithi045.stdout:427.out 2023-10-08T12:47:51.146 INFO:teuthology.orchestra.run.smithi045.stdout:428 2023-10-08T12:47:51.146 INFO:teuthology.orchestra.run.smithi045.stdout:428.out 2023-10-08T12:47:51.146 INFO:teuthology.orchestra.run.smithi045.stdout:429 2023-10-08T12:47:51.146 INFO:teuthology.orchestra.run.smithi045.stdout:429.out 2023-10-08T12:47:51.146 INFO:teuthology.orchestra.run.smithi045.stdout:430 2023-10-08T12:47:51.146 INFO:teuthology.orchestra.run.smithi045.stdout:430.out 2023-10-08T12:47:51.146 INFO:teuthology.orchestra.run.smithi045.stdout:431 2023-10-08T12:47:51.146 INFO:teuthology.orchestra.run.smithi045.stdout:431.out 2023-10-08T12:47:51.146 INFO:teuthology.orchestra.run.smithi045.stdout:432 2023-10-08T12:47:51.146 INFO:teuthology.orchestra.run.smithi045.stdout:432.out 2023-10-08T12:47:51.147 INFO:teuthology.orchestra.run.smithi045.stdout:433 2023-10-08T12:47:51.147 INFO:teuthology.orchestra.run.smithi045.stdout:433.out 2023-10-08T12:47:51.147 INFO:teuthology.orchestra.run.smithi045.stdout:434 2023-10-08T12:47:51.147 INFO:teuthology.orchestra.run.smithi045.stdout:434.out 2023-10-08T12:47:51.147 INFO:teuthology.orchestra.run.smithi045.stdout:435 2023-10-08T12:47:51.147 INFO:teuthology.orchestra.run.smithi045.stdout:435.out 2023-10-08T12:47:51.147 INFO:teuthology.orchestra.run.smithi045.stdout:436 2023-10-08T12:47:51.147 INFO:teuthology.orchestra.run.smithi045.stdout:436.out 2023-10-08T12:47:51.147 INFO:teuthology.orchestra.run.smithi045.stdout:437 2023-10-08T12:47:51.147 INFO:teuthology.orchestra.run.smithi045.stdout:437.out 2023-10-08T12:47:51.147 INFO:teuthology.orchestra.run.smithi045.stdout:438 2023-10-08T12:47:51.147 INFO:teuthology.orchestra.run.smithi045.stdout:438.out 2023-10-08T12:47:51.148 INFO:teuthology.orchestra.run.smithi045.stdout:439 2023-10-08T12:47:51.148 INFO:teuthology.orchestra.run.smithi045.stdout:439.out 2023-10-08T12:47:51.148 INFO:teuthology.orchestra.run.smithi045.stdout:440 2023-10-08T12:47:51.148 INFO:teuthology.orchestra.run.smithi045.stdout:440.out 2023-10-08T12:47:51.148 INFO:teuthology.orchestra.run.smithi045.stdout:441 2023-10-08T12:47:51.148 INFO:teuthology.orchestra.run.smithi045.stdout:441.out 2023-10-08T12:47:51.148 INFO:teuthology.orchestra.run.smithi045.stdout:442 2023-10-08T12:47:51.148 INFO:teuthology.orchestra.run.smithi045.stdout:442.out 2023-10-08T12:47:51.148 INFO:teuthology.orchestra.run.smithi045.stdout:443 2023-10-08T12:47:51.148 INFO:teuthology.orchestra.run.smithi045.stdout:443.out 2023-10-08T12:47:51.148 INFO:teuthology.orchestra.run.smithi045.stdout:444 2023-10-08T12:47:51.149 INFO:teuthology.orchestra.run.smithi045.stdout:444.out 2023-10-08T12:47:51.149 INFO:teuthology.orchestra.run.smithi045.stdout:445 2023-10-08T12:47:51.149 INFO:teuthology.orchestra.run.smithi045.stdout:445.out 2023-10-08T12:47:51.149 INFO:teuthology.orchestra.run.smithi045.stdout:446 2023-10-08T12:47:51.149 INFO:teuthology.orchestra.run.smithi045.stdout:446.out 2023-10-08T12:47:51.149 INFO:teuthology.orchestra.run.smithi045.stdout:447 2023-10-08T12:47:51.149 INFO:teuthology.orchestra.run.smithi045.stdout:447.out 2023-10-08T12:47:51.149 INFO:teuthology.orchestra.run.smithi045.stdout:448 2023-10-08T12:47:51.149 INFO:teuthology.orchestra.run.smithi045.stdout:448.out 2023-10-08T12:47:51.150 INFO:teuthology.orchestra.run.smithi045.stdout:449 2023-10-08T12:47:51.150 INFO:teuthology.orchestra.run.smithi045.stdout:449.out 2023-10-08T12:47:51.150 INFO:teuthology.orchestra.run.smithi045.stdout:450 2023-10-08T12:47:51.150 INFO:teuthology.orchestra.run.smithi045.stdout:450.out 2023-10-08T12:47:51.150 INFO:teuthology.orchestra.run.smithi045.stdout:451 2023-10-08T12:47:51.150 INFO:teuthology.orchestra.run.smithi045.stdout:451.out 2023-10-08T12:47:51.150 INFO:teuthology.orchestra.run.smithi045.stdout:452 2023-10-08T12:47:51.150 INFO:teuthology.orchestra.run.smithi045.stdout:452.out 2023-10-08T12:47:51.150 INFO:teuthology.orchestra.run.smithi045.stdout:453 2023-10-08T12:47:51.150 INFO:teuthology.orchestra.run.smithi045.stdout:453.out 2023-10-08T12:47:51.150 INFO:teuthology.orchestra.run.smithi045.stdout:454 2023-10-08T12:47:51.150 INFO:teuthology.orchestra.run.smithi045.stdout:454.out 2023-10-08T12:47:51.151 INFO:teuthology.orchestra.run.smithi045.stdout:455 2023-10-08T12:47:51.151 INFO:teuthology.orchestra.run.smithi045.stdout:455.out 2023-10-08T12:47:51.151 INFO:teuthology.orchestra.run.smithi045.stdout:456 2023-10-08T12:47:51.151 INFO:teuthology.orchestra.run.smithi045.stdout:456.out 2023-10-08T12:47:51.151 INFO:teuthology.orchestra.run.smithi045.stdout:457 2023-10-08T12:47:51.151 INFO:teuthology.orchestra.run.smithi045.stdout:457.out 2023-10-08T12:47:51.151 INFO:teuthology.orchestra.run.smithi045.stdout:458 2023-10-08T12:47:51.151 INFO:teuthology.orchestra.run.smithi045.stdout:458.out 2023-10-08T12:47:51.151 INFO:teuthology.orchestra.run.smithi045.stdout:459 2023-10-08T12:47:51.151 INFO:teuthology.orchestra.run.smithi045.stdout:459.out 2023-10-08T12:47:51.151 INFO:teuthology.orchestra.run.smithi045.stdout:460 2023-10-08T12:47:51.151 INFO:teuthology.orchestra.run.smithi045.stdout:460.out 2023-10-08T12:47:51.152 INFO:teuthology.orchestra.run.smithi045.stdout:461 2023-10-08T12:47:51.152 INFO:teuthology.orchestra.run.smithi045.stdout:461.out 2023-10-08T12:47:51.152 INFO:teuthology.orchestra.run.smithi045.stdout:462 2023-10-08T12:47:51.152 INFO:teuthology.orchestra.run.smithi045.stdout:462.out 2023-10-08T12:47:51.152 INFO:teuthology.orchestra.run.smithi045.stdout:463 2023-10-08T12:47:51.152 INFO:teuthology.orchestra.run.smithi045.stdout:463.out 2023-10-08T12:47:51.152 INFO:teuthology.orchestra.run.smithi045.stdout:464 2023-10-08T12:47:51.152 INFO:teuthology.orchestra.run.smithi045.stdout:464.out 2023-10-08T12:47:51.152 INFO:teuthology.orchestra.run.smithi045.stdout:465 2023-10-08T12:47:51.152 INFO:teuthology.orchestra.run.smithi045.stdout:465.out 2023-10-08T12:47:51.152 INFO:teuthology.orchestra.run.smithi045.stdout:466 2023-10-08T12:47:51.152 INFO:teuthology.orchestra.run.smithi045.stdout:466.out 2023-10-08T12:47:51.153 INFO:teuthology.orchestra.run.smithi045.stdout:467 2023-10-08T12:47:51.153 INFO:teuthology.orchestra.run.smithi045.stdout:467.out 2023-10-08T12:47:51.153 INFO:teuthology.orchestra.run.smithi045.stdout:468 2023-10-08T12:47:51.153 INFO:teuthology.orchestra.run.smithi045.stdout:468.out 2023-10-08T12:47:51.153 INFO:teuthology.orchestra.run.smithi045.stdout:469 2023-10-08T12:47:51.153 INFO:teuthology.orchestra.run.smithi045.stdout:469.out 2023-10-08T12:47:51.153 INFO:teuthology.orchestra.run.smithi045.stdout:470 2023-10-08T12:47:51.153 INFO:teuthology.orchestra.run.smithi045.stdout:470.out 2023-10-08T12:47:51.153 INFO:teuthology.orchestra.run.smithi045.stdout:471 2023-10-08T12:47:51.153 INFO:teuthology.orchestra.run.smithi045.stdout:471.out 2023-10-08T12:47:51.153 INFO:teuthology.orchestra.run.smithi045.stdout:472 2023-10-08T12:47:51.153 INFO:teuthology.orchestra.run.smithi045.stdout:472.out 2023-10-08T12:47:51.153 INFO:teuthology.orchestra.run.smithi045.stdout:473 2023-10-08T12:47:51.154 INFO:teuthology.orchestra.run.smithi045.stdout:473.out 2023-10-08T12:47:51.154 INFO:teuthology.orchestra.run.smithi045.stdout:474 2023-10-08T12:47:51.154 INFO:teuthology.orchestra.run.smithi045.stdout:474.out 2023-10-08T12:47:51.154 INFO:teuthology.orchestra.run.smithi045.stdout:475 2023-10-08T12:47:51.154 INFO:teuthology.orchestra.run.smithi045.stdout:475.out 2023-10-08T12:47:51.154 INFO:teuthology.orchestra.run.smithi045.stdout:476 2023-10-08T12:47:51.154 INFO:teuthology.orchestra.run.smithi045.stdout:476.out 2023-10-08T12:47:51.154 INFO:teuthology.orchestra.run.smithi045.stdout:477 2023-10-08T12:47:51.154 INFO:teuthology.orchestra.run.smithi045.stdout:477.out 2023-10-08T12:47:51.154 INFO:teuthology.orchestra.run.smithi045.stdout:478 2023-10-08T12:47:51.154 INFO:teuthology.orchestra.run.smithi045.stdout:478.out 2023-10-08T12:47:51.154 INFO:teuthology.orchestra.run.smithi045.stdout:479 2023-10-08T12:47:51.155 INFO:teuthology.orchestra.run.smithi045.stdout:479.out 2023-10-08T12:47:51.155 INFO:teuthology.orchestra.run.smithi045.stdout:480 2023-10-08T12:47:51.155 INFO:teuthology.orchestra.run.smithi045.stdout:480.out 2023-10-08T12:47:51.155 INFO:teuthology.orchestra.run.smithi045.stdout:481 2023-10-08T12:47:51.155 INFO:teuthology.orchestra.run.smithi045.stdout:481.out 2023-10-08T12:47:51.155 INFO:teuthology.orchestra.run.smithi045.stdout:482 2023-10-08T12:47:51.155 INFO:teuthology.orchestra.run.smithi045.stdout:482.out 2023-10-08T12:47:51.155 INFO:teuthology.orchestra.run.smithi045.stdout:483 2023-10-08T12:47:51.155 INFO:teuthology.orchestra.run.smithi045.stdout:483.out 2023-10-08T12:47:51.155 INFO:teuthology.orchestra.run.smithi045.stdout:484 2023-10-08T12:47:51.155 INFO:teuthology.orchestra.run.smithi045.stdout:484.out 2023-10-08T12:47:51.155 INFO:teuthology.orchestra.run.smithi045.stdout:485 2023-10-08T12:47:51.156 INFO:teuthology.orchestra.run.smithi045.stdout:485.out 2023-10-08T12:47:51.156 INFO:teuthology.orchestra.run.smithi045.stdout:486 2023-10-08T12:47:51.156 INFO:teuthology.orchestra.run.smithi045.stdout:486.out 2023-10-08T12:47:51.156 INFO:teuthology.orchestra.run.smithi045.stdout:487 2023-10-08T12:47:51.156 INFO:teuthology.orchestra.run.smithi045.stdout:487.out 2023-10-08T12:47:51.156 INFO:teuthology.orchestra.run.smithi045.stdout:488 2023-10-08T12:47:51.156 INFO:teuthology.orchestra.run.smithi045.stdout:488.out 2023-10-08T12:47:51.156 INFO:teuthology.orchestra.run.smithi045.stdout:489 2023-10-08T12:47:51.156 INFO:teuthology.orchestra.run.smithi045.stdout:489.out 2023-10-08T12:47:51.156 INFO:teuthology.orchestra.run.smithi045.stdout:490 2023-10-08T12:47:51.156 INFO:teuthology.orchestra.run.smithi045.stdout:490.out 2023-10-08T12:47:51.156 INFO:teuthology.orchestra.run.smithi045.stdout:491 2023-10-08T12:47:51.156 INFO:teuthology.orchestra.run.smithi045.stdout:491.out 2023-10-08T12:47:51.157 INFO:teuthology.orchestra.run.smithi045.stdout:492 2023-10-08T12:47:51.157 INFO:teuthology.orchestra.run.smithi045.stdout:492.out 2023-10-08T12:47:51.157 INFO:teuthology.orchestra.run.smithi045.stdout:493 2023-10-08T12:47:51.157 INFO:teuthology.orchestra.run.smithi045.stdout:493.out 2023-10-08T12:47:51.157 INFO:teuthology.orchestra.run.smithi045.stdout:494 2023-10-08T12:47:51.157 INFO:teuthology.orchestra.run.smithi045.stdout:494.out 2023-10-08T12:47:51.157 INFO:teuthology.orchestra.run.smithi045.stdout:495 2023-10-08T12:47:51.157 INFO:teuthology.orchestra.run.smithi045.stdout:495.out 2023-10-08T12:47:51.157 INFO:teuthology.orchestra.run.smithi045.stdout:496 2023-10-08T12:47:51.157 INFO:teuthology.orchestra.run.smithi045.stdout:496.out 2023-10-08T12:47:51.157 INFO:teuthology.orchestra.run.smithi045.stdout:497 2023-10-08T12:47:51.157 INFO:teuthology.orchestra.run.smithi045.stdout:497.out 2023-10-08T12:47:51.158 INFO:teuthology.orchestra.run.smithi045.stdout:498 2023-10-08T12:47:51.158 INFO:teuthology.orchestra.run.smithi045.stdout:498.out 2023-10-08T12:47:51.158 INFO:teuthology.orchestra.run.smithi045.stdout:499 2023-10-08T12:47:51.158 INFO:teuthology.orchestra.run.smithi045.stdout:499.out 2023-10-08T12:47:51.158 INFO:teuthology.orchestra.run.smithi045.stdout:500 2023-10-08T12:47:51.158 INFO:teuthology.orchestra.run.smithi045.stdout:500.out 2023-10-08T12:47:51.158 INFO:teuthology.orchestra.run.smithi045.stdout:501 2023-10-08T12:47:51.158 INFO:teuthology.orchestra.run.smithi045.stdout:501.out 2023-10-08T12:47:51.158 INFO:teuthology.orchestra.run.smithi045.stdout:502 2023-10-08T12:47:51.158 INFO:teuthology.orchestra.run.smithi045.stdout:502.out 2023-10-08T12:47:51.158 INFO:teuthology.orchestra.run.smithi045.stdout:503 2023-10-08T12:47:51.158 INFO:teuthology.orchestra.run.smithi045.stdout:503.out 2023-10-08T12:47:51.159 INFO:teuthology.orchestra.run.smithi045.stdout:504 2023-10-08T12:47:51.159 INFO:teuthology.orchestra.run.smithi045.stdout:504.out 2023-10-08T12:47:51.159 INFO:teuthology.orchestra.run.smithi045.stdout:505 2023-10-08T12:47:51.159 INFO:teuthology.orchestra.run.smithi045.stdout:505.out 2023-10-08T12:47:51.159 INFO:teuthology.orchestra.run.smithi045.stdout:506 2023-10-08T12:47:51.159 INFO:teuthology.orchestra.run.smithi045.stdout:506.out 2023-10-08T12:47:51.159 INFO:teuthology.orchestra.run.smithi045.stdout:507 2023-10-08T12:47:51.159 INFO:teuthology.orchestra.run.smithi045.stdout:507.out 2023-10-08T12:47:51.159 INFO:teuthology.orchestra.run.smithi045.stdout:508 2023-10-08T12:47:51.159 INFO:teuthology.orchestra.run.smithi045.stdout:508.out 2023-10-08T12:47:51.159 INFO:teuthology.orchestra.run.smithi045.stdout:509 2023-10-08T12:47:51.159 INFO:teuthology.orchestra.run.smithi045.stdout:509.out 2023-10-08T12:47:51.160 INFO:teuthology.orchestra.run.smithi045.stdout:510 2023-10-08T12:47:51.160 INFO:teuthology.orchestra.run.smithi045.stdout:510.out 2023-10-08T12:47:51.160 INFO:teuthology.orchestra.run.smithi045.stdout:511 2023-10-08T12:47:51.160 INFO:teuthology.orchestra.run.smithi045.stdout:511.out 2023-10-08T12:47:51.160 INFO:teuthology.orchestra.run.smithi045.stdout:512 2023-10-08T12:47:51.160 INFO:teuthology.orchestra.run.smithi045.stdout:512.out 2023-10-08T12:47:51.160 INFO:teuthology.orchestra.run.smithi045.stdout:513 2023-10-08T12:47:51.160 INFO:teuthology.orchestra.run.smithi045.stdout:513.out 2023-10-08T12:47:51.160 INFO:teuthology.orchestra.run.smithi045.stdout:514 2023-10-08T12:47:51.160 INFO:teuthology.orchestra.run.smithi045.stdout:514.out 2023-10-08T12:47:51.160 INFO:teuthology.orchestra.run.smithi045.stdout:515 2023-10-08T12:47:51.160 INFO:teuthology.orchestra.run.smithi045.stdout:515.out 2023-10-08T12:47:51.160 INFO:teuthology.orchestra.run.smithi045.stdout:516 2023-10-08T12:47:51.161 INFO:teuthology.orchestra.run.smithi045.stdout:516.out 2023-10-08T12:47:51.161 INFO:teuthology.orchestra.run.smithi045.stdout:517 2023-10-08T12:47:51.161 INFO:teuthology.orchestra.run.smithi045.stdout:517.out 2023-10-08T12:47:51.161 INFO:teuthology.orchestra.run.smithi045.stdout:518 2023-10-08T12:47:51.161 INFO:teuthology.orchestra.run.smithi045.stdout:518.out 2023-10-08T12:47:51.161 INFO:teuthology.orchestra.run.smithi045.stdout:519 2023-10-08T12:47:51.161 INFO:teuthology.orchestra.run.smithi045.stdout:519.out 2023-10-08T12:47:51.161 INFO:teuthology.orchestra.run.smithi045.stdout:520 2023-10-08T12:47:51.161 INFO:teuthology.orchestra.run.smithi045.stdout:520.out 2023-10-08T12:47:51.161 INFO:teuthology.orchestra.run.smithi045.stdout:521 2023-10-08T12:47:51.161 INFO:teuthology.orchestra.run.smithi045.stdout:521.out 2023-10-08T12:47:51.161 INFO:teuthology.orchestra.run.smithi045.stdout:522 2023-10-08T12:47:51.162 INFO:teuthology.orchestra.run.smithi045.stdout:522.out 2023-10-08T12:47:51.162 INFO:teuthology.orchestra.run.smithi045.stdout:523 2023-10-08T12:47:51.162 INFO:teuthology.orchestra.run.smithi045.stdout:523.out 2023-10-08T12:47:51.162 INFO:teuthology.orchestra.run.smithi045.stdout:524 2023-10-08T12:47:51.162 INFO:teuthology.orchestra.run.smithi045.stdout:524.out 2023-10-08T12:47:51.162 INFO:teuthology.orchestra.run.smithi045.stdout:525 2023-10-08T12:47:51.162 INFO:teuthology.orchestra.run.smithi045.stdout:525.out 2023-10-08T12:47:51.162 INFO:teuthology.orchestra.run.smithi045.stdout:526 2023-10-08T12:47:51.162 INFO:teuthology.orchestra.run.smithi045.stdout:526.out 2023-10-08T12:47:51.162 INFO:teuthology.orchestra.run.smithi045.stdout:527 2023-10-08T12:47:51.162 INFO:teuthology.orchestra.run.smithi045.stdout:527.out 2023-10-08T12:47:51.163 INFO:teuthology.orchestra.run.smithi045.stdout:528 2023-10-08T12:47:51.163 INFO:teuthology.orchestra.run.smithi045.stdout:528.out 2023-10-08T12:47:51.163 INFO:teuthology.orchestra.run.smithi045.stdout:529 2023-10-08T12:47:51.163 INFO:teuthology.orchestra.run.smithi045.stdout:529.out 2023-10-08T12:47:51.163 INFO:teuthology.orchestra.run.smithi045.stdout:530 2023-10-08T12:47:51.163 INFO:teuthology.orchestra.run.smithi045.stdout:530.out 2023-10-08T12:47:51.163 INFO:teuthology.orchestra.run.smithi045.stdout:531 2023-10-08T12:47:51.163 INFO:teuthology.orchestra.run.smithi045.stdout:531.out 2023-10-08T12:47:51.163 INFO:teuthology.orchestra.run.smithi045.stdout:532 2023-10-08T12:47:51.163 INFO:teuthology.orchestra.run.smithi045.stdout:532.out 2023-10-08T12:47:51.163 INFO:teuthology.orchestra.run.smithi045.stdout:533 2023-10-08T12:47:51.163 INFO:teuthology.orchestra.run.smithi045.stdout:533.out 2023-10-08T12:47:51.163 INFO:teuthology.orchestra.run.smithi045.stdout:534 2023-10-08T12:47:51.164 INFO:teuthology.orchestra.run.smithi045.stdout:534.out 2023-10-08T12:47:51.164 INFO:teuthology.orchestra.run.smithi045.stdout:535 2023-10-08T12:47:51.164 INFO:teuthology.orchestra.run.smithi045.stdout:535.out 2023-10-08T12:47:51.164 INFO:teuthology.orchestra.run.smithi045.stdout:536 2023-10-08T12:47:51.164 INFO:teuthology.orchestra.run.smithi045.stdout:536.out 2023-10-08T12:47:51.164 INFO:teuthology.orchestra.run.smithi045.stdout:537 2023-10-08T12:47:51.164 INFO:teuthology.orchestra.run.smithi045.stdout:537.out 2023-10-08T12:47:51.164 INFO:teuthology.orchestra.run.smithi045.stdout:538 2023-10-08T12:47:51.164 INFO:teuthology.orchestra.run.smithi045.stdout:538.out 2023-10-08T12:47:51.164 INFO:teuthology.orchestra.run.smithi045.stdout:539 2023-10-08T12:47:51.164 INFO:teuthology.orchestra.run.smithi045.stdout:539.out 2023-10-08T12:47:51.164 INFO:teuthology.orchestra.run.smithi045.stdout:540 2023-10-08T12:47:51.165 INFO:teuthology.orchestra.run.smithi045.stdout:540.out 2023-10-08T12:47:51.165 INFO:teuthology.orchestra.run.smithi045.stdout:541 2023-10-08T12:47:51.165 INFO:teuthology.orchestra.run.smithi045.stdout:541.out 2023-10-08T12:47:51.165 INFO:teuthology.orchestra.run.smithi045.stdout:542 2023-10-08T12:47:51.165 INFO:teuthology.orchestra.run.smithi045.stdout:542.out 2023-10-08T12:47:51.165 INFO:teuthology.orchestra.run.smithi045.stdout:543 2023-10-08T12:47:51.165 INFO:teuthology.orchestra.run.smithi045.stdout:543.out 2023-10-08T12:47:51.165 INFO:teuthology.orchestra.run.smithi045.stdout:544 2023-10-08T12:47:51.165 INFO:teuthology.orchestra.run.smithi045.stdout:544.out 2023-10-08T12:47:51.165 INFO:teuthology.orchestra.run.smithi045.stdout:545 2023-10-08T12:47:51.165 INFO:teuthology.orchestra.run.smithi045.stdout:545.out 2023-10-08T12:47:51.165 INFO:teuthology.orchestra.run.smithi045.stdout:546 2023-10-08T12:47:51.166 INFO:teuthology.orchestra.run.smithi045.stdout:546.out 2023-10-08T12:47:51.166 INFO:teuthology.orchestra.run.smithi045.stdout:547 2023-10-08T12:47:51.166 INFO:teuthology.orchestra.run.smithi045.stdout:547.out 2023-10-08T12:47:51.166 INFO:teuthology.orchestra.run.smithi045.stdout:548 2023-10-08T12:47:51.166 INFO:teuthology.orchestra.run.smithi045.stdout:548.out 2023-10-08T12:47:51.166 INFO:teuthology.orchestra.run.smithi045.stdout:549 2023-10-08T12:47:51.166 INFO:teuthology.orchestra.run.smithi045.stdout:549.out 2023-10-08T12:47:51.166 INFO:teuthology.orchestra.run.smithi045.stdout:550 2023-10-08T12:47:51.166 INFO:teuthology.orchestra.run.smithi045.stdout:550.out 2023-10-08T12:47:51.166 INFO:teuthology.orchestra.run.smithi045.stdout:551 2023-10-08T12:47:51.166 INFO:teuthology.orchestra.run.smithi045.stdout:551.out 2023-10-08T12:47:51.166 INFO:teuthology.orchestra.run.smithi045.stdout:552 2023-10-08T12:47:51.167 INFO:teuthology.orchestra.run.smithi045.stdout:552.out 2023-10-08T12:47:51.167 INFO:teuthology.orchestra.run.smithi045.stdout:553 2023-10-08T12:47:51.167 INFO:teuthology.orchestra.run.smithi045.stdout:553.out 2023-10-08T12:47:51.167 INFO:teuthology.orchestra.run.smithi045.stdout:554 2023-10-08T12:47:51.167 INFO:teuthology.orchestra.run.smithi045.stdout:554.out 2023-10-08T12:47:51.167 INFO:teuthology.orchestra.run.smithi045.stdout:555 2023-10-08T12:47:51.167 INFO:teuthology.orchestra.run.smithi045.stdout:555.out 2023-10-08T12:47:51.167 INFO:teuthology.orchestra.run.smithi045.stdout:556 2023-10-08T12:47:51.167 INFO:teuthology.orchestra.run.smithi045.stdout:556.out 2023-10-08T12:47:51.167 INFO:teuthology.orchestra.run.smithi045.stdout:557 2023-10-08T12:47:51.167 INFO:teuthology.orchestra.run.smithi045.stdout:557.out 2023-10-08T12:47:51.167 INFO:teuthology.orchestra.run.smithi045.stdout:558 2023-10-08T12:47:51.167 INFO:teuthology.orchestra.run.smithi045.stdout:558.out 2023-10-08T12:47:51.168 INFO:teuthology.orchestra.run.smithi045.stdout:559 2023-10-08T12:47:51.168 INFO:teuthology.orchestra.run.smithi045.stdout:559.out 2023-10-08T12:47:51.168 INFO:teuthology.orchestra.run.smithi045.stdout:560 2023-10-08T12:47:51.168 INFO:teuthology.orchestra.run.smithi045.stdout:560.out 2023-10-08T12:47:51.168 INFO:teuthology.orchestra.run.smithi045.stdout:561 2023-10-08T12:47:51.168 INFO:teuthology.orchestra.run.smithi045.stdout:561.out 2023-10-08T12:47:51.168 INFO:teuthology.orchestra.run.smithi045.stdout:562 2023-10-08T12:47:51.168 INFO:teuthology.orchestra.run.smithi045.stdout:562.out 2023-10-08T12:47:51.168 INFO:teuthology.orchestra.run.smithi045.stdout:563 2023-10-08T12:47:51.168 INFO:teuthology.orchestra.run.smithi045.stdout:563.out 2023-10-08T12:47:51.168 INFO:teuthology.orchestra.run.smithi045.stdout:564 2023-10-08T12:47:51.168 INFO:teuthology.orchestra.run.smithi045.stdout:564.out 2023-10-08T12:47:51.169 INFO:teuthology.orchestra.run.smithi045.stdout:565 2023-10-08T12:47:51.169 INFO:teuthology.orchestra.run.smithi045.stdout:565.out 2023-10-08T12:47:51.169 INFO:teuthology.orchestra.run.smithi045.stdout:566 2023-10-08T12:47:51.169 INFO:teuthology.orchestra.run.smithi045.stdout:566.out 2023-10-08T12:47:51.169 INFO:teuthology.orchestra.run.smithi045.stdout:567 2023-10-08T12:47:51.169 INFO:teuthology.orchestra.run.smithi045.stdout:567.out 2023-10-08T12:47:51.169 INFO:teuthology.orchestra.run.smithi045.stdout:568 2023-10-08T12:47:51.169 INFO:teuthology.orchestra.run.smithi045.stdout:568.out 2023-10-08T12:47:51.169 INFO:teuthology.orchestra.run.smithi045.stdout:569 2023-10-08T12:47:51.169 INFO:teuthology.orchestra.run.smithi045.stdout:569.out 2023-10-08T12:47:51.169 INFO:teuthology.orchestra.run.smithi045.stdout:570 2023-10-08T12:47:51.169 INFO:teuthology.orchestra.run.smithi045.stdout:570.out 2023-10-08T12:47:51.169 INFO:teuthology.orchestra.run.smithi045.stdout:571 2023-10-08T12:47:51.170 INFO:teuthology.orchestra.run.smithi045.stdout:571.out 2023-10-08T12:47:51.170 INFO:teuthology.orchestra.run.smithi045.stdout:572 2023-10-08T12:47:51.170 INFO:teuthology.orchestra.run.smithi045.stdout:572.out 2023-10-08T12:47:51.170 INFO:teuthology.orchestra.run.smithi045.stdout:573 2023-10-08T12:47:51.170 INFO:teuthology.orchestra.run.smithi045.stdout:573.out 2023-10-08T12:47:51.170 INFO:teuthology.orchestra.run.smithi045.stdout:574 2023-10-08T12:47:51.170 INFO:teuthology.orchestra.run.smithi045.stdout:574.out 2023-10-08T12:47:51.170 INFO:teuthology.orchestra.run.smithi045.stdout:575 2023-10-08T12:47:51.170 INFO:teuthology.orchestra.run.smithi045.stdout:575.out 2023-10-08T12:47:51.170 INFO:teuthology.orchestra.run.smithi045.stdout:576 2023-10-08T12:47:51.170 INFO:teuthology.orchestra.run.smithi045.stdout:576.out 2023-10-08T12:47:51.170 INFO:teuthology.orchestra.run.smithi045.stdout:577 2023-10-08T12:47:51.171 INFO:teuthology.orchestra.run.smithi045.stdout:577.out 2023-10-08T12:47:51.171 INFO:teuthology.orchestra.run.smithi045.stdout:578 2023-10-08T12:47:51.171 INFO:teuthology.orchestra.run.smithi045.stdout:578.out 2023-10-08T12:47:51.171 INFO:teuthology.orchestra.run.smithi045.stdout:579 2023-10-08T12:47:51.171 INFO:teuthology.orchestra.run.smithi045.stdout:579.out 2023-10-08T12:47:51.171 INFO:teuthology.orchestra.run.smithi045.stdout:580 2023-10-08T12:47:51.171 INFO:teuthology.orchestra.run.smithi045.stdout:580.out 2023-10-08T12:47:51.171 INFO:teuthology.orchestra.run.smithi045.stdout:581 2023-10-08T12:47:51.171 INFO:teuthology.orchestra.run.smithi045.stdout:581.out 2023-10-08T12:47:51.171 INFO:teuthology.orchestra.run.smithi045.stdout:582 2023-10-08T12:47:51.171 INFO:teuthology.orchestra.run.smithi045.stdout:582.out 2023-10-08T12:47:51.171 INFO:teuthology.orchestra.run.smithi045.stdout:583 2023-10-08T12:47:51.171 INFO:teuthology.orchestra.run.smithi045.stdout:583.out 2023-10-08T12:47:51.172 INFO:teuthology.orchestra.run.smithi045.stdout:584 2023-10-08T12:47:51.172 INFO:teuthology.orchestra.run.smithi045.stdout:584.out 2023-10-08T12:47:51.172 INFO:teuthology.orchestra.run.smithi045.stdout:585 2023-10-08T12:47:51.172 INFO:teuthology.orchestra.run.smithi045.stdout:585.out 2023-10-08T12:47:51.172 INFO:teuthology.orchestra.run.smithi045.stdout:586 2023-10-08T12:47:51.172 INFO:teuthology.orchestra.run.smithi045.stdout:586.out 2023-10-08T12:47:51.172 INFO:teuthology.orchestra.run.smithi045.stdout:587 2023-10-08T12:47:51.172 INFO:teuthology.orchestra.run.smithi045.stdout:587.out 2023-10-08T12:47:51.172 INFO:teuthology.orchestra.run.smithi045.stdout:588 2023-10-08T12:47:51.172 INFO:teuthology.orchestra.run.smithi045.stdout:588.out 2023-10-08T12:47:51.172 INFO:teuthology.orchestra.run.smithi045.stdout:589 2023-10-08T12:47:51.172 INFO:teuthology.orchestra.run.smithi045.stdout:589.out 2023-10-08T12:47:51.173 INFO:teuthology.orchestra.run.smithi045.stdout:590 2023-10-08T12:47:51.173 INFO:teuthology.orchestra.run.smithi045.stdout:590.out 2023-10-08T12:47:51.173 INFO:teuthology.orchestra.run.smithi045.stdout:591 2023-10-08T12:47:51.173 INFO:teuthology.orchestra.run.smithi045.stdout:591.out 2023-10-08T12:47:51.173 INFO:teuthology.orchestra.run.smithi045.stdout:592 2023-10-08T12:47:51.173 INFO:teuthology.orchestra.run.smithi045.stdout:592.out 2023-10-08T12:47:51.173 INFO:teuthology.orchestra.run.smithi045.stdout:593 2023-10-08T12:47:51.173 INFO:teuthology.orchestra.run.smithi045.stdout:593.out 2023-10-08T12:47:51.173 INFO:teuthology.orchestra.run.smithi045.stdout:594 2023-10-08T12:47:51.173 INFO:teuthology.orchestra.run.smithi045.stdout:594.out 2023-10-08T12:47:51.173 INFO:teuthology.orchestra.run.smithi045.stdout:595 2023-10-08T12:47:51.173 INFO:teuthology.orchestra.run.smithi045.stdout:595.out 2023-10-08T12:47:51.173 INFO:teuthology.orchestra.run.smithi045.stdout:596 2023-10-08T12:47:51.174 INFO:teuthology.orchestra.run.smithi045.stdout:596.out 2023-10-08T12:47:51.174 INFO:teuthology.orchestra.run.smithi045.stdout:597 2023-10-08T12:47:51.174 INFO:teuthology.orchestra.run.smithi045.stdout:597.out 2023-10-08T12:47:51.174 INFO:teuthology.orchestra.run.smithi045.stdout:598 2023-10-08T12:47:51.174 INFO:teuthology.orchestra.run.smithi045.stdout:598.out 2023-10-08T12:47:51.174 INFO:teuthology.orchestra.run.smithi045.stdout:599 2023-10-08T12:47:51.174 INFO:teuthology.orchestra.run.smithi045.stdout:599.out 2023-10-08T12:47:51.174 INFO:teuthology.orchestra.run.smithi045.stdout:600 2023-10-08T12:47:51.174 INFO:teuthology.orchestra.run.smithi045.stdout:600.out 2023-10-08T12:47:51.174 INFO:teuthology.orchestra.run.smithi045.stdout:601 2023-10-08T12:47:51.174 INFO:teuthology.orchestra.run.smithi045.stdout:601.out 2023-10-08T12:47:51.175 INFO:teuthology.orchestra.run.smithi045.stdout:602 2023-10-08T12:47:51.175 INFO:teuthology.orchestra.run.smithi045.stdout:602.out 2023-10-08T12:47:51.175 INFO:teuthology.orchestra.run.smithi045.stdout:603 2023-10-08T12:47:51.175 INFO:teuthology.orchestra.run.smithi045.stdout:603.out 2023-10-08T12:47:51.175 INFO:teuthology.orchestra.run.smithi045.stdout:604 2023-10-08T12:47:51.175 INFO:teuthology.orchestra.run.smithi045.stdout:604.out 2023-10-08T12:47:51.175 INFO:teuthology.orchestra.run.smithi045.stdout:605 2023-10-08T12:47:51.175 INFO:teuthology.orchestra.run.smithi045.stdout:605.out 2023-10-08T12:47:51.175 INFO:teuthology.orchestra.run.smithi045.stdout:606 2023-10-08T12:47:51.175 INFO:teuthology.orchestra.run.smithi045.stdout:606.out 2023-10-08T12:47:51.175 INFO:teuthology.orchestra.run.smithi045.stdout:607 2023-10-08T12:47:51.175 INFO:teuthology.orchestra.run.smithi045.stdout:607.out 2023-10-08T12:47:51.176 INFO:teuthology.orchestra.run.smithi045.stdout:608 2023-10-08T12:47:51.176 INFO:teuthology.orchestra.run.smithi045.stdout:608.out 2023-10-08T12:47:51.176 INFO:teuthology.orchestra.run.smithi045.stdout:609 2023-10-08T12:47:51.176 INFO:teuthology.orchestra.run.smithi045.stdout:609.out 2023-10-08T12:47:51.176 INFO:teuthology.orchestra.run.smithi045.stdout:610 2023-10-08T12:47:51.176 INFO:teuthology.orchestra.run.smithi045.stdout:610.out 2023-10-08T12:47:51.176 INFO:teuthology.orchestra.run.smithi045.stdout:611 2023-10-08T12:47:51.176 INFO:teuthology.orchestra.run.smithi045.stdout:611.out 2023-10-08T12:47:51.176 INFO:teuthology.orchestra.run.smithi045.stdout:612 2023-10-08T12:47:51.176 INFO:teuthology.orchestra.run.smithi045.stdout:612.out 2023-10-08T12:47:51.176 INFO:teuthology.orchestra.run.smithi045.stdout:613 2023-10-08T12:47:51.176 INFO:teuthology.orchestra.run.smithi045.stdout:613.out 2023-10-08T12:47:51.177 INFO:teuthology.orchestra.run.smithi045.stdout:614 2023-10-08T12:47:51.177 INFO:teuthology.orchestra.run.smithi045.stdout:614.out 2023-10-08T12:47:51.177 INFO:teuthology.orchestra.run.smithi045.stdout:615 2023-10-08T12:47:51.177 INFO:teuthology.orchestra.run.smithi045.stdout:615.out 2023-10-08T12:47:51.177 INFO:teuthology.orchestra.run.smithi045.stdout:616 2023-10-08T12:47:51.177 INFO:teuthology.orchestra.run.smithi045.stdout:616.out 2023-10-08T12:47:51.177 INFO:teuthology.orchestra.run.smithi045.stdout:617 2023-10-08T12:47:51.177 INFO:teuthology.orchestra.run.smithi045.stdout:617.out 2023-10-08T12:47:51.177 INFO:teuthology.orchestra.run.smithi045.stdout:618 2023-10-08T12:47:51.177 INFO:teuthology.orchestra.run.smithi045.stdout:618.out 2023-10-08T12:47:51.177 INFO:teuthology.orchestra.run.smithi045.stdout:619 2023-10-08T12:47:51.177 INFO:teuthology.orchestra.run.smithi045.stdout:619.out 2023-10-08T12:47:51.178 INFO:teuthology.orchestra.run.smithi045.stdout:620 2023-10-08T12:47:51.178 INFO:teuthology.orchestra.run.smithi045.stdout:620.out 2023-10-08T12:47:51.178 INFO:teuthology.orchestra.run.smithi045.stdout:621 2023-10-08T12:47:51.178 INFO:teuthology.orchestra.run.smithi045.stdout:621.out 2023-10-08T12:47:51.178 INFO:teuthology.orchestra.run.smithi045.stdout:622 2023-10-08T12:47:51.178 INFO:teuthology.orchestra.run.smithi045.stdout:622.out 2023-10-08T12:47:51.178 INFO:teuthology.orchestra.run.smithi045.stdout:623 2023-10-08T12:47:51.178 INFO:teuthology.orchestra.run.smithi045.stdout:623.out 2023-10-08T12:47:51.178 INFO:teuthology.orchestra.run.smithi045.stdout:624 2023-10-08T12:47:51.178 INFO:teuthology.orchestra.run.smithi045.stdout:624.out 2023-10-08T12:47:51.178 INFO:teuthology.orchestra.run.smithi045.stdout:625 2023-10-08T12:47:51.178 INFO:teuthology.orchestra.run.smithi045.stdout:625.out 2023-10-08T12:47:51.178 INFO:teuthology.orchestra.run.smithi045.stdout:626 2023-10-08T12:47:51.179 INFO:teuthology.orchestra.run.smithi045.stdout:626.out 2023-10-08T12:47:51.179 INFO:teuthology.orchestra.run.smithi045.stdout:627 2023-10-08T12:47:51.179 INFO:teuthology.orchestra.run.smithi045.stdout:627.out 2023-10-08T12:47:51.179 INFO:teuthology.orchestra.run.smithi045.stdout:628 2023-10-08T12:47:51.179 INFO:teuthology.orchestra.run.smithi045.stdout:628.out 2023-10-08T12:47:51.179 INFO:teuthology.orchestra.run.smithi045.stdout:629 2023-10-08T12:47:51.179 INFO:teuthology.orchestra.run.smithi045.stdout:629.out 2023-10-08T12:47:51.179 INFO:teuthology.orchestra.run.smithi045.stdout:630 2023-10-08T12:47:51.179 INFO:teuthology.orchestra.run.smithi045.stdout:630.out 2023-10-08T12:47:51.179 INFO:teuthology.orchestra.run.smithi045.stdout:631 2023-10-08T12:47:51.179 INFO:teuthology.orchestra.run.smithi045.stdout:631.out 2023-10-08T12:47:51.179 INFO:teuthology.orchestra.run.smithi045.stdout:632 2023-10-08T12:47:51.180 INFO:teuthology.orchestra.run.smithi045.stdout:632.out 2023-10-08T12:47:51.180 INFO:teuthology.orchestra.run.smithi045.stdout:633 2023-10-08T12:47:51.180 INFO:teuthology.orchestra.run.smithi045.stdout:633.out 2023-10-08T12:47:51.180 INFO:teuthology.orchestra.run.smithi045.stdout:634 2023-10-08T12:47:51.180 INFO:teuthology.orchestra.run.smithi045.stdout:634.out 2023-10-08T12:47:51.180 INFO:teuthology.orchestra.run.smithi045.stdout:635 2023-10-08T12:47:51.180 INFO:teuthology.orchestra.run.smithi045.stdout:635.out 2023-10-08T12:47:51.180 INFO:teuthology.orchestra.run.smithi045.stdout:636 2023-10-08T12:47:51.180 INFO:teuthology.orchestra.run.smithi045.stdout:636.out 2023-10-08T12:47:51.180 INFO:teuthology.orchestra.run.smithi045.stdout:637 2023-10-08T12:47:51.180 INFO:teuthology.orchestra.run.smithi045.stdout:637.out 2023-10-08T12:47:51.180 INFO:teuthology.orchestra.run.smithi045.stdout:638 2023-10-08T12:47:51.181 INFO:teuthology.orchestra.run.smithi045.stdout:638.out 2023-10-08T12:47:51.181 INFO:teuthology.orchestra.run.smithi045.stdout:639 2023-10-08T12:47:51.181 INFO:teuthology.orchestra.run.smithi045.stdout:639.out 2023-10-08T12:47:51.181 INFO:teuthology.orchestra.run.smithi045.stdout:640 2023-10-08T12:47:51.181 INFO:teuthology.orchestra.run.smithi045.stdout:640.out 2023-10-08T12:47:51.181 INFO:teuthology.orchestra.run.smithi045.stdout:641 2023-10-08T12:47:51.181 INFO:teuthology.orchestra.run.smithi045.stdout:641.out 2023-10-08T12:47:51.181 INFO:teuthology.orchestra.run.smithi045.stdout:642 2023-10-08T12:47:51.181 INFO:teuthology.orchestra.run.smithi045.stdout:642.out 2023-10-08T12:47:51.181 INFO:teuthology.orchestra.run.smithi045.stdout:643 2023-10-08T12:47:51.181 INFO:teuthology.orchestra.run.smithi045.stdout:643.out 2023-10-08T12:47:51.181 INFO:teuthology.orchestra.run.smithi045.stdout:644 2023-10-08T12:47:51.181 INFO:teuthology.orchestra.run.smithi045.stdout:644.out 2023-10-08T12:47:51.182 INFO:teuthology.orchestra.run.smithi045.stdout:645 2023-10-08T12:47:51.182 INFO:teuthology.orchestra.run.smithi045.stdout:645.out 2023-10-08T12:47:51.182 INFO:teuthology.orchestra.run.smithi045.stdout:646 2023-10-08T12:47:51.182 INFO:teuthology.orchestra.run.smithi045.stdout:646.out 2023-10-08T12:47:51.182 INFO:teuthology.orchestra.run.smithi045.stdout:647 2023-10-08T12:47:51.182 INFO:teuthology.orchestra.run.smithi045.stdout:647.out 2023-10-08T12:47:51.182 INFO:teuthology.orchestra.run.smithi045.stdout:648 2023-10-08T12:47:51.182 INFO:teuthology.orchestra.run.smithi045.stdout:648.out 2023-10-08T12:47:51.182 INFO:teuthology.orchestra.run.smithi045.stdout:649 2023-10-08T12:47:51.182 INFO:teuthology.orchestra.run.smithi045.stdout:649.out 2023-10-08T12:47:51.182 INFO:teuthology.orchestra.run.smithi045.stdout:650 2023-10-08T12:47:51.182 INFO:teuthology.orchestra.run.smithi045.stdout:650.out 2023-10-08T12:47:51.183 INFO:teuthology.orchestra.run.smithi045.stdout:651 2023-10-08T12:47:51.183 INFO:teuthology.orchestra.run.smithi045.stdout:651.out 2023-10-08T12:47:51.183 INFO:teuthology.orchestra.run.smithi045.stdout:652 2023-10-08T12:47:51.183 INFO:teuthology.orchestra.run.smithi045.stdout:652.out 2023-10-08T12:47:51.183 INFO:teuthology.orchestra.run.smithi045.stdout:653 2023-10-08T12:47:51.183 INFO:teuthology.orchestra.run.smithi045.stdout:653.out 2023-10-08T12:47:51.183 INFO:teuthology.orchestra.run.smithi045.stdout:654 2023-10-08T12:47:51.183 INFO:teuthology.orchestra.run.smithi045.stdout:654.out 2023-10-08T12:47:51.183 INFO:teuthology.orchestra.run.smithi045.stdout:655 2023-10-08T12:47:51.183 INFO:teuthology.orchestra.run.smithi045.stdout:655.out 2023-10-08T12:47:51.183 INFO:teuthology.orchestra.run.smithi045.stdout:656 2023-10-08T12:47:51.183 INFO:teuthology.orchestra.run.smithi045.stdout:656.out 2023-10-08T12:47:51.184 INFO:teuthology.orchestra.run.smithi045.stdout:657 2023-10-08T12:47:51.184 INFO:teuthology.orchestra.run.smithi045.stdout:657.out 2023-10-08T12:47:51.184 INFO:teuthology.orchestra.run.smithi045.stdout:658 2023-10-08T12:47:51.184 INFO:teuthology.orchestra.run.smithi045.stdout:658.out 2023-10-08T12:47:51.184 INFO:teuthology.orchestra.run.smithi045.stdout:659 2023-10-08T12:47:51.184 INFO:teuthology.orchestra.run.smithi045.stdout:659.out 2023-10-08T12:47:51.184 INFO:teuthology.orchestra.run.smithi045.stdout:660 2023-10-08T12:47:51.184 INFO:teuthology.orchestra.run.smithi045.stdout:660.out 2023-10-08T12:47:51.184 INFO:teuthology.orchestra.run.smithi045.stdout:661 2023-10-08T12:47:51.184 INFO:teuthology.orchestra.run.smithi045.stdout:661.out 2023-10-08T12:47:51.184 INFO:teuthology.orchestra.run.smithi045.stdout:662 2023-10-08T12:47:51.184 INFO:teuthology.orchestra.run.smithi045.stdout:662.out 2023-10-08T12:47:51.184 INFO:teuthology.orchestra.run.smithi045.stdout:663 2023-10-08T12:47:51.185 INFO:teuthology.orchestra.run.smithi045.stdout:663.out 2023-10-08T12:47:51.185 INFO:teuthology.orchestra.run.smithi045.stdout:664 2023-10-08T12:47:51.185 INFO:teuthology.orchestra.run.smithi045.stdout:664.out 2023-10-08T12:47:51.185 INFO:teuthology.orchestra.run.smithi045.stdout:665 2023-10-08T12:47:51.185 INFO:teuthology.orchestra.run.smithi045.stdout:665.out 2023-10-08T12:47:51.185 INFO:teuthology.orchestra.run.smithi045.stdout:666 2023-10-08T12:47:51.185 INFO:teuthology.orchestra.run.smithi045.stdout:666.out 2023-10-08T12:47:51.185 INFO:teuthology.orchestra.run.smithi045.stdout:667 2023-10-08T12:47:51.185 INFO:teuthology.orchestra.run.smithi045.stdout:667.out 2023-10-08T12:47:51.185 INFO:teuthology.orchestra.run.smithi045.stdout:668 2023-10-08T12:47:51.185 INFO:teuthology.orchestra.run.smithi045.stdout:668.out 2023-10-08T12:47:51.185 INFO:teuthology.orchestra.run.smithi045.stdout:669 2023-10-08T12:47:51.186 INFO:teuthology.orchestra.run.smithi045.stdout:669.out 2023-10-08T12:47:51.186 INFO:teuthology.orchestra.run.smithi045.stdout:670 2023-10-08T12:47:51.186 INFO:teuthology.orchestra.run.smithi045.stdout:670.out 2023-10-08T12:47:51.186 INFO:teuthology.orchestra.run.smithi045.stdout:671 2023-10-08T12:47:51.186 INFO:teuthology.orchestra.run.smithi045.stdout:671.out 2023-10-08T12:47:51.186 INFO:teuthology.orchestra.run.smithi045.stdout:672 2023-10-08T12:47:51.186 INFO:teuthology.orchestra.run.smithi045.stdout:672.out 2023-10-08T12:47:51.186 INFO:teuthology.orchestra.run.smithi045.stdout:673 2023-10-08T12:47:51.186 INFO:teuthology.orchestra.run.smithi045.stdout:673.out 2023-10-08T12:47:51.186 INFO:teuthology.orchestra.run.smithi045.stdout:674 2023-10-08T12:47:51.186 INFO:teuthology.orchestra.run.smithi045.stdout:674.out 2023-10-08T12:47:51.186 INFO:teuthology.orchestra.run.smithi045.stdout:675 2023-10-08T12:47:51.187 INFO:teuthology.orchestra.run.smithi045.stdout:675.out 2023-10-08T12:47:51.187 INFO:teuthology.orchestra.run.smithi045.stdout:676 2023-10-08T12:47:51.187 INFO:teuthology.orchestra.run.smithi045.stdout:676.out 2023-10-08T12:47:51.187 INFO:teuthology.orchestra.run.smithi045.stdout:677 2023-10-08T12:47:51.187 INFO:teuthology.orchestra.run.smithi045.stdout:677.out 2023-10-08T12:47:51.187 INFO:teuthology.orchestra.run.smithi045.stdout:678 2023-10-08T12:47:51.187 INFO:teuthology.orchestra.run.smithi045.stdout:678.out 2023-10-08T12:47:51.187 INFO:teuthology.orchestra.run.smithi045.stdout:679 2023-10-08T12:47:51.187 INFO:teuthology.orchestra.run.smithi045.stdout:679.out 2023-10-08T12:47:51.187 INFO:teuthology.orchestra.run.smithi045.stdout:680 2023-10-08T12:47:51.187 INFO:teuthology.orchestra.run.smithi045.stdout:680.out 2023-10-08T12:47:51.188 INFO:teuthology.orchestra.run.smithi045.stdout:681 2023-10-08T12:47:51.188 INFO:teuthology.orchestra.run.smithi045.stdout:681.out 2023-10-08T12:47:51.188 INFO:teuthology.orchestra.run.smithi045.stdout:682 2023-10-08T12:47:51.188 INFO:teuthology.orchestra.run.smithi045.stdout:682.out 2023-10-08T12:47:51.188 INFO:teuthology.orchestra.run.smithi045.stdout:683 2023-10-08T12:47:51.188 INFO:teuthology.orchestra.run.smithi045.stdout:683.out 2023-10-08T12:47:51.188 INFO:teuthology.orchestra.run.smithi045.stdout:684 2023-10-08T12:47:51.188 INFO:teuthology.orchestra.run.smithi045.stdout:684.out 2023-10-08T12:47:51.188 INFO:teuthology.orchestra.run.smithi045.stdout:685 2023-10-08T12:47:51.188 INFO:teuthology.orchestra.run.smithi045.stdout:685.out 2023-10-08T12:47:51.188 INFO:teuthology.orchestra.run.smithi045.stdout:686 2023-10-08T12:47:51.188 INFO:teuthology.orchestra.run.smithi045.stdout:686.out 2023-10-08T12:47:51.189 INFO:teuthology.orchestra.run.smithi045.stdout:687 2023-10-08T12:47:51.189 INFO:teuthology.orchestra.run.smithi045.stdout:687.out 2023-10-08T12:47:51.189 INFO:teuthology.orchestra.run.smithi045.stdout:688 2023-10-08T12:47:51.189 INFO:teuthology.orchestra.run.smithi045.stdout:688.out 2023-10-08T12:47:51.189 INFO:teuthology.orchestra.run.smithi045.stdout:689 2023-10-08T12:47:51.189 INFO:teuthology.orchestra.run.smithi045.stdout:689.out 2023-10-08T12:47:51.189 INFO:teuthology.orchestra.run.smithi045.stdout:690 2023-10-08T12:47:51.189 INFO:teuthology.orchestra.run.smithi045.stdout:690.out 2023-10-08T12:47:51.189 INFO:teuthology.orchestra.run.smithi045.stdout:691 2023-10-08T12:47:51.189 INFO:teuthology.orchestra.run.smithi045.stdout:691.out 2023-10-08T12:47:51.189 INFO:teuthology.orchestra.run.smithi045.stdout:692 2023-10-08T12:47:51.189 INFO:teuthology.orchestra.run.smithi045.stdout:692.out 2023-10-08T12:47:51.189 INFO:teuthology.orchestra.run.smithi045.stdout:693 2023-10-08T12:47:51.190 INFO:teuthology.orchestra.run.smithi045.stdout:693.out 2023-10-08T12:47:51.190 INFO:teuthology.orchestra.run.smithi045.stdout:694 2023-10-08T12:47:51.190 INFO:teuthology.orchestra.run.smithi045.stdout:694.out 2023-10-08T12:47:51.190 INFO:teuthology.orchestra.run.smithi045.stdout:695 2023-10-08T12:47:51.190 INFO:teuthology.orchestra.run.smithi045.stdout:695.out 2023-10-08T12:47:51.190 INFO:teuthology.orchestra.run.smithi045.stdout:696 2023-10-08T12:47:51.190 INFO:teuthology.orchestra.run.smithi045.stdout:696.out 2023-10-08T12:47:51.190 INFO:teuthology.orchestra.run.smithi045.stdout:697 2023-10-08T12:47:51.190 INFO:teuthology.orchestra.run.smithi045.stdout:697.out 2023-10-08T12:47:51.190 INFO:teuthology.orchestra.run.smithi045.stdout:698 2023-10-08T12:47:51.190 INFO:teuthology.orchestra.run.smithi045.stdout:698.out 2023-10-08T12:47:51.190 INFO:teuthology.orchestra.run.smithi045.stdout:699 2023-10-08T12:47:51.191 INFO:teuthology.orchestra.run.smithi045.stdout:699.out 2023-10-08T12:47:51.191 INFO:teuthology.orchestra.run.smithi045.stdout:700 2023-10-08T12:47:51.191 INFO:teuthology.orchestra.run.smithi045.stdout:700.out 2023-10-08T12:47:51.191 INFO:teuthology.orchestra.run.smithi045.stdout:701 2023-10-08T12:47:51.191 INFO:teuthology.orchestra.run.smithi045.stdout:701.out 2023-10-08T12:47:51.191 INFO:teuthology.orchestra.run.smithi045.stdout:702 2023-10-08T12:47:51.191 INFO:teuthology.orchestra.run.smithi045.stdout:702.out 2023-10-08T12:47:51.191 INFO:teuthology.orchestra.run.smithi045.stdout:703 2023-10-08T12:47:51.191 INFO:teuthology.orchestra.run.smithi045.stdout:703.out 2023-10-08T12:47:51.191 INFO:teuthology.orchestra.run.smithi045.stdout:704 2023-10-08T12:47:51.191 INFO:teuthology.orchestra.run.smithi045.stdout:704.out 2023-10-08T12:47:51.191 INFO:teuthology.orchestra.run.smithi045.stdout:705 2023-10-08T12:47:51.191 INFO:teuthology.orchestra.run.smithi045.stdout:705.out 2023-10-08T12:47:51.192 INFO:teuthology.orchestra.run.smithi045.stdout:706 2023-10-08T12:47:51.192 INFO:teuthology.orchestra.run.smithi045.stdout:706.out 2023-10-08T12:47:51.192 INFO:teuthology.orchestra.run.smithi045.stdout:707 2023-10-08T12:47:51.192 INFO:teuthology.orchestra.run.smithi045.stdout:707.out 2023-10-08T12:47:51.192 INFO:teuthology.orchestra.run.smithi045.stdout:708 2023-10-08T12:47:51.192 INFO:teuthology.orchestra.run.smithi045.stdout:708.out 2023-10-08T12:47:51.192 INFO:teuthology.orchestra.run.smithi045.stdout:709 2023-10-08T12:47:51.192 INFO:teuthology.orchestra.run.smithi045.stdout:709.out 2023-10-08T12:47:51.192 INFO:teuthology.orchestra.run.smithi045.stdout:710 2023-10-08T12:47:51.192 INFO:teuthology.orchestra.run.smithi045.stdout:710.out 2023-10-08T12:47:51.192 INFO:teuthology.orchestra.run.smithi045.stdout:711 2023-10-08T12:47:51.192 INFO:teuthology.orchestra.run.smithi045.stdout:711.out 2023-10-08T12:47:51.192 INFO:teuthology.orchestra.run.smithi045.stdout:712 2023-10-08T12:47:51.193 INFO:teuthology.orchestra.run.smithi045.stdout:712.out 2023-10-08T12:47:51.193 INFO:teuthology.orchestra.run.smithi045.stdout:713 2023-10-08T12:47:51.193 INFO:teuthology.orchestra.run.smithi045.stdout:713.out 2023-10-08T12:47:51.193 INFO:teuthology.orchestra.run.smithi045.stdout:714 2023-10-08T12:47:51.193 INFO:teuthology.orchestra.run.smithi045.stdout:714.out 2023-10-08T12:47:51.193 INFO:teuthology.orchestra.run.smithi045.stdout:715 2023-10-08T12:47:51.193 INFO:teuthology.orchestra.run.smithi045.stdout:715.out 2023-10-08T12:47:51.193 INFO:teuthology.orchestra.run.smithi045.stdout:716 2023-10-08T12:47:51.193 INFO:teuthology.orchestra.run.smithi045.stdout:716.out 2023-10-08T12:47:51.193 INFO:teuthology.orchestra.run.smithi045.stdout:717 2023-10-08T12:47:51.193 INFO:teuthology.orchestra.run.smithi045.stdout:717.out 2023-10-08T12:47:51.193 INFO:teuthology.orchestra.run.smithi045.stdout:718 2023-10-08T12:47:51.194 INFO:teuthology.orchestra.run.smithi045.stdout:718.out 2023-10-08T12:47:51.194 INFO:teuthology.orchestra.run.smithi045.stdout:719 2023-10-08T12:47:51.194 INFO:teuthology.orchestra.run.smithi045.stdout:719.out 2023-10-08T12:47:51.194 INFO:teuthology.orchestra.run.smithi045.stdout:720 2023-10-08T12:47:51.194 INFO:teuthology.orchestra.run.smithi045.stdout:720.out 2023-10-08T12:47:51.194 INFO:teuthology.orchestra.run.smithi045.stdout:721 2023-10-08T12:47:51.194 INFO:teuthology.orchestra.run.smithi045.stdout:721.out 2023-10-08T12:47:51.194 INFO:teuthology.orchestra.run.smithi045.stdout:722 2023-10-08T12:47:51.194 INFO:teuthology.orchestra.run.smithi045.stdout:722.out 2023-10-08T12:47:51.194 INFO:teuthology.orchestra.run.smithi045.stdout:723 2023-10-08T12:47:51.194 INFO:teuthology.orchestra.run.smithi045.stdout:723.out 2023-10-08T12:47:51.194 INFO:teuthology.orchestra.run.smithi045.stdout:724 2023-10-08T12:47:51.194 INFO:teuthology.orchestra.run.smithi045.stdout:724.out 2023-10-08T12:47:51.195 INFO:teuthology.orchestra.run.smithi045.stdout:725 2023-10-08T12:47:51.195 INFO:teuthology.orchestra.run.smithi045.stdout:725.out 2023-10-08T12:47:51.195 INFO:teuthology.orchestra.run.smithi045.stdout:726 2023-10-08T12:47:51.195 INFO:teuthology.orchestra.run.smithi045.stdout:726.out 2023-10-08T12:47:51.195 INFO:teuthology.orchestra.run.smithi045.stdout:727 2023-10-08T12:47:51.195 INFO:teuthology.orchestra.run.smithi045.stdout:727.out 2023-10-08T12:47:51.195 INFO:teuthology.orchestra.run.smithi045.stdout:728 2023-10-08T12:47:51.195 INFO:teuthology.orchestra.run.smithi045.stdout:728.out 2023-10-08T12:47:51.195 INFO:teuthology.orchestra.run.smithi045.stdout:729 2023-10-08T12:47:51.195 INFO:teuthology.orchestra.run.smithi045.stdout:729.out 2023-10-08T12:47:51.195 INFO:teuthology.orchestra.run.smithi045.stdout:730 2023-10-08T12:47:51.195 INFO:teuthology.orchestra.run.smithi045.stdout:730.out 2023-10-08T12:47:51.195 INFO:teuthology.orchestra.run.smithi045.stdout:731 2023-10-08T12:47:51.196 INFO:teuthology.orchestra.run.smithi045.stdout:731.out 2023-10-08T12:47:51.196 INFO:teuthology.orchestra.run.smithi045.stdout:group.list 2023-10-08T12:47:51.196 INFO:teuthology.orchestra.run.smithi045.stdout:Makefile 2023-10-08T12:47:51.196 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-10-08T12:47:51.432 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:47:51.436 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:47:51.437 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:47:51.438 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:47:51.438 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:47:58.486 INFO:teuthology.orchestra.run.smithi045.stdout:generic/001 7s 2023-10-08T12:47:58.490 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/001 2023-10-08T12:47:58.490 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:47:58.492 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:47:58.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:47:58.665 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-10-08T12:47:58.945 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:47:58.949 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:47:58.950 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:47:58.951 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:47:58.951 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:47:59.437 INFO:teuthology.orchestra.run.smithi045.stdout:generic/002 0s 2023-10-08T12:47:59.441 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/002 2023-10-08T12:47:59.441 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:47:59.444 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:47:59.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:47:59.485 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-10-08T12:47:59.705 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:47:59.709 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:47:59.709 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:47:59.710 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:47:59.711 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:48:00.045 INFO:teuthology.orchestra.run.smithi045.stdout:generic/003 [not run] atime not maintained by ceph 2023-10-08T12:48:00.049 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/003 2023-10-08T12:48:00.049 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/003 2023-10-08T12:48:00.049 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:48:00.051 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:48:00.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:48:00.081 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-10-08T12:48:00.302 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:48:00.306 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:48:00.307 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:48:00.308 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:48:00.308 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:48:00.643 INFO:teuthology.orchestra.run.smithi045.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-10-08T12:48:00.647 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/004 2023-10-08T12:48:00.647 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/004 2023-10-08T12:48:00.648 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:48:00.649 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:48:00.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:48:00.669 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-10-08T12:48:00.885 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:48:00.889 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:48:00.890 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:48:00.890 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:48:00.891 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:48:01.365 INFO:teuthology.orchestra.run.smithi045.stdout:generic/005 0s 2023-10-08T12:48:01.370 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/005 2023-10-08T12:48:01.370 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:48:01.372 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:48:01.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:48:01.436 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-10-08T12:48:01.656 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:48:01.660 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:48:01.661 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:48:01.662 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:48:01.662 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:48:02.933 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:48:02.936 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:48:27.676 INFO:teuthology.orchestra.run.smithi045.stdout:generic/006 26s 2023-10-08T12:48:27.735 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/006 2023-10-08T12:48:27.735 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:48:27.737 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:48:27.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:48:27.761 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-10-08T12:48:27.983 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:48:27.990 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:48:27.990 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:48:27.992 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:48:27.993 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:48:33.022 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:48:33.025 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:49:03.494 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:49:03.497 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:49:17.789 INFO:teuthology.orchestra.run.smithi045.stdout:generic/007 49s 2023-10-08T12:49:17.799 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/007 2023-10-08T12:49:17.799 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:49:17.803 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:49:17.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:49:17.903 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-10-08T12:49:18.111 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:49:18.115 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:49:18.116 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:49:18.117 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:49:18.117 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:49:18.527 INFO:teuthology.orchestra.run.smithi045.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-08T12:49:18.531 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/008 2023-10-08T12:49:18.531 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/008 2023-10-08T12:49:18.531 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:49:18.533 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:49:18.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:49:18.555 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-10-08T12:49:18.776 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:49:18.780 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:49:18.781 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:49:18.782 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:49:18.782 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:49:19.155 INFO:teuthology.orchestra.run.smithi045.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-08T12:49:19.159 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/009 2023-10-08T12:49:19.159 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/009 2023-10-08T12:49:19.159 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:49:19.161 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:49:19.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:49:19.184 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-10-08T12:49:19.399 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:49:19.403 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:49:19.403 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:49:19.404 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:49:19.404 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:49:19.729 INFO:teuthology.orchestra.run.smithi045.stdout:generic/010 [not run] /tmp/tmp.UxcFNZjwoAxfstests-dev/src/dbtest not built 2023-10-08T12:49:19.733 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/010 2023-10-08T12:49:19.733 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/010 2023-10-08T12:49:19.733 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:49:19.735 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:49:19.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:49:19.765 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-10-08T12:49:19.989 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:49:19.993 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:49:19.993 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:49:19.994 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:49:19.994 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:49:33.567 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:49:33.570 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:49:53.574 INFO:teuthology.orchestra.run.smithi045.stdout:generic/011 33s 2023-10-08T12:49:53.578 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/011 2023-10-08T12:49:53.578 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:49:53.581 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:49:53.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:49:53.955 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-10-08T12:49:54.312 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:49:54.316 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:49:54.316 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:49:54.317 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:49:54.317 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:49:54.718 INFO:teuthology.orchestra.run.smithi045.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T12:49:54.723 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/012 2023-10-08T12:49:54.723 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/012 2023-10-08T12:49:54.723 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:49:54.725 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:49:54.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:49:54.756 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-10-08T12:49:54.973 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:49:54.977 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:49:54.978 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:49:54.979 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:49:54.979 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:50:03.991 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:50:03.999 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:50:34.184 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:50:34.186 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:50:56.964 INFO:teuthology.orchestra.run.smithi045.stdout:generic/013 61s 2023-10-08T12:50:56.970 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/013 2023-10-08T12:50:56.971 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:50:56.973 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:50:57.011 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:50:57.011 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-10-08T12:50:57.358 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:50:57.367 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:50:57.367 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:50:57.369 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:50:57.369 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:51:04.489 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:51:04.493 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:51:34.901 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:51:34.904 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:52:05.009 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:52:05.018 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:52:35.426 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:52:35.432 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:53:05.519 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:53:05.522 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:53:35.628 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:53:35.631 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:54:05.752 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:54:05.755 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:54:35.848 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:54:35.851 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:55:05.951 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:55:05.954 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:55:12.691 INFO:teuthology.orchestra.run.smithi045.stdout:generic/014 255s 2023-10-08T12:55:12.697 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/014 2023-10-08T12:55:12.697 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:55:12.699 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:12.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:55:12.734 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-10-08T12:55:13.101 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:55:13.109 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:55:13.109 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:55:13.110 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:55:13.110 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:13.579 INFO:teuthology.orchestra.run.smithi045.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-08T12:55:13.584 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/015 2023-10-08T12:55:13.584 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/015 2023-10-08T12:55:13.584 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:55:13.591 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:13.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:55:13.623 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-10-08T12:55:14.004 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:55:14.011 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:55:14.012 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:55:14.013 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:55:14.013 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:14.621 INFO:teuthology.orchestra.run.smithi045.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T12:55:14.625 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/016 2023-10-08T12:55:14.625 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/016 2023-10-08T12:55:14.626 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:55:14.628 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:14.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:55:14.662 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-10-08T12:55:15.024 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:55:15.028 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:55:15.028 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:55:15.030 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:55:15.030 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:15.535 INFO:teuthology.orchestra.run.smithi045.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-08T12:55:15.540 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/017 2023-10-08T12:55:15.540 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/017 2023-10-08T12:55:15.540 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:55:15.542 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:15.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:55:15.578 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-10-08T12:55:15.934 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:55:15.948 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:55:15.949 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:55:15.950 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:55:15.950 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:16.653 INFO:teuthology.orchestra.run.smithi045.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-10-08T12:55:16.674 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/018 2023-10-08T12:55:16.674 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/018 2023-10-08T12:55:16.674 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:55:16.676 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:16.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:55:16.704 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-10-08T12:55:17.062 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:55:17.067 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:55:17.068 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:55:17.069 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:55:17.069 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:17.522 INFO:teuthology.orchestra.run.smithi045.stdout:generic/019 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T12:55:17.528 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/019 2023-10-08T12:55:17.528 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/019 2023-10-08T12:55:17.528 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:55:17.530 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:17.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:55:17.561 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-10-08T12:55:17.895 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:55:17.900 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:55:17.901 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:55:17.902 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:55:17.902 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:21.350 INFO:teuthology.orchestra.run.smithi045.stdout:generic/020 3s 2023-10-08T12:55:21.360 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/020 2023-10-08T12:55:21.361 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:55:21.367 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:21.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:55:21.398 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-10-08T12:55:21.774 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:55:21.778 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:55:21.779 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:55:21.780 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:55:21.780 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:22.394 INFO:teuthology.orchestra.run.smithi045.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T12:55:22.401 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/021 2023-10-08T12:55:22.402 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/021 2023-10-08T12:55:22.402 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:55:22.405 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:22.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:55:22.452 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-10-08T12:55:22.780 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:55:22.785 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:55:22.785 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:55:22.787 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:55:22.787 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:23.418 INFO:teuthology.orchestra.run.smithi045.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T12:55:23.426 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/022 2023-10-08T12:55:23.426 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/022 2023-10-08T12:55:23.426 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:55:23.429 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:23.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:55:23.465 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-10-08T12:55:23.864 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:55:23.870 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:55:23.870 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:55:23.876 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:55:23.876 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:25.570 INFO:teuthology.orchestra.run.smithi045.stdout:generic/023 1s 2023-10-08T12:55:25.641 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/023 2023-10-08T12:55:25.641 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:55:25.644 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:25.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:55:25.745 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-10-08T12:55:26.131 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:55:26.140 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:55:26.141 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:55:26.142 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:55:26.142 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:26.623 INFO:teuthology.orchestra.run.smithi045.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-10-08T12:55:26.628 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/024 2023-10-08T12:55:26.628 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/024 2023-10-08T12:55:26.628 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:55:26.631 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:26.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:55:26.673 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-10-08T12:55:27.030 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:55:27.040 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:55:27.040 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:55:27.042 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:55:27.042 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:27.633 INFO:teuthology.orchestra.run.smithi045.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-10-08T12:55:27.642 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/025 2023-10-08T12:55:27.643 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/025 2023-10-08T12:55:27.643 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:55:27.646 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:27.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:55:27.688 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-10-08T12:55:28.034 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:55:28.041 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:55:28.042 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:55:28.043 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:55:28.043 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:28.590 INFO:teuthology.orchestra.run.smithi045.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-10-08T12:55:28.599 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/026 2023-10-08T12:55:28.599 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/026 2023-10-08T12:55:28.599 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:55:28.606 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:28.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:55:28.642 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-10-08T12:55:28.950 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:55:28.956 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:55:28.956 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:55:28.958 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:55:28.958 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:29.425 INFO:teuthology.orchestra.run.smithi045.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-08T12:55:29.430 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/027 2023-10-08T12:55:29.430 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/027 2023-10-08T12:55:29.431 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:55:29.433 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:29.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:55:29.470 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-10-08T12:55:29.803 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:55:29.812 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:55:29.812 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:55:29.813 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:55:29.813 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:35.314 INFO:teuthology.orchestra.run.smithi045.stdout:generic/028 5s 2023-10-08T12:55:35.320 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/028 2023-10-08T12:55:35.320 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:55:35.323 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:35.360 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:55:35.361 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-10-08T12:55:35.756 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:55:35.765 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:55:35.765 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:55:35.766 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:55:35.766 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:36.060 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:55:36.063 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:55:39.279 INFO:teuthology.orchestra.run.smithi045.stdout:generic/029 3s 2023-10-08T12:55:39.287 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/029 2023-10-08T12:55:39.287 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:55:39.289 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:39.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:55:39.309 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-10-08T12:55:39.665 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:55:39.669 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:55:39.670 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:55:39.674 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:55:39.674 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:44.272 INFO:teuthology.orchestra.run.smithi045.stdout:generic/030 5s 2023-10-08T12:55:44.278 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/030 2023-10-08T12:55:44.278 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:55:44.280 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:44.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:55:44.294 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-10-08T12:55:44.672 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:55:44.677 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:55:44.677 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:55:44.678 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:55:44.678 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:45.220 INFO:teuthology.orchestra.run.smithi045.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-10-08T12:55:45.225 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/031 2023-10-08T12:55:45.225 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/031 2023-10-08T12:55:45.225 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:55:45.227 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:45.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:55:45.262 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-10-08T12:55:45.627 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:55:45.643 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:55:45.643 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:55:45.649 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:55:45.649 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:46.100 INFO:teuthology.orchestra.run.smithi045.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T12:55:46.106 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/032 2023-10-08T12:55:46.106 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/032 2023-10-08T12:55:46.106 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:55:46.111 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:46.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:55:46.149 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-10-08T12:55:46.485 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:55:46.494 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:55:46.494 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:55:46.497 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:55:46.498 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:47.075 INFO:teuthology.orchestra.run.smithi045.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-08T12:55:47.082 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/033 2023-10-08T12:55:47.082 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/033 2023-10-08T12:55:47.083 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:55:47.085 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:47.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:55:47.127 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-10-08T12:55:47.489 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:55:47.493 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:55:47.494 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:55:47.495 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:55:47.495 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:47.970 INFO:teuthology.orchestra.run.smithi045.stdout:generic/034 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T12:55:47.976 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/034 2023-10-08T12:55:47.976 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/034 2023-10-08T12:55:47.976 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:55:47.978 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:47.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:55:47.998 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-10-08T12:55:48.336 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:55:48.341 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:55:48.341 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:55:48.342 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:55:48.342 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:48.911 INFO:teuthology.orchestra.run.smithi045.stdout:generic/035 0s 2023-10-08T12:55:48.917 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/035 2023-10-08T12:55:48.918 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:55:48.920 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:48.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:55:48.963 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-10-08T12:55:49.328 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:55:49.337 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:55:49.337 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:55:49.343 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:55:49.343 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:59.931 INFO:teuthology.orchestra.run.smithi045.stdout:generic/036 10s 2023-10-08T12:55:59.942 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/036 2023-10-08T12:55:59.943 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:55:59.945 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:55:59.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:55:59.978 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-10-08T12:56:00.353 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:00.357 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:00.358 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:00.363 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:00.363 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:06.143 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:56:06.146 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:56:06.980 INFO:teuthology.orchestra.run.smithi045.stdout:generic/037 6s 2023-10-08T12:56:07.009 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/037 2023-10-08T12:56:07.009 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:07.011 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:07.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:07.026 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-10-08T12:56:07.400 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:07.405 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:07.405 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:07.410 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:07.410 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:07.888 INFO:teuthology.orchestra.run.smithi045.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T12:56:07.896 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/038 2023-10-08T12:56:07.896 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/038 2023-10-08T12:56:07.896 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:07.898 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:07.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:07.940 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-10-08T12:56:08.269 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:08.281 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:08.281 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:08.281 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:08.282 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:08.765 INFO:teuthology.orchestra.run.smithi045.stdout:generic/039 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T12:56:08.770 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/039 2023-10-08T12:56:08.770 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/039 2023-10-08T12:56:08.770 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:08.776 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:08.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:08.799 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-10-08T12:56:09.163 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:09.172 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:09.173 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:09.173 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:09.174 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:09.711 INFO:teuthology.orchestra.run.smithi045.stdout:generic/040 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T12:56:09.716 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/040 2023-10-08T12:56:09.716 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/040 2023-10-08T12:56:09.716 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:09.718 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:09.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:09.756 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-10-08T12:56:10.159 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:10.169 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:10.172 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:10.174 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:10.174 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:10.702 INFO:teuthology.orchestra.run.smithi045.stdout:generic/041 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T12:56:10.707 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/041 2023-10-08T12:56:10.707 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/041 2023-10-08T12:56:10.707 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:10.710 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:10.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:10.741 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-10-08T12:56:11.122 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:11.127 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:11.127 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:11.128 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:11.129 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:11.808 INFO:teuthology.orchestra.run.smithi045.stdout:generic/042 [not run] ceph does not support shutdown 2023-10-08T12:56:11.829 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/042 2023-10-08T12:56:11.829 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/042 2023-10-08T12:56:11.829 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:11.831 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:11.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:11.873 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-10-08T12:56:12.223 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:12.227 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:12.228 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:12.229 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:12.229 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:12.920 INFO:teuthology.orchestra.run.smithi045.stdout:generic/043 [not run] ceph does not support shutdown 2023-10-08T12:56:12.938 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/043 2023-10-08T12:56:12.938 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/043 2023-10-08T12:56:12.938 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:12.940 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:12.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:12.973 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-10-08T12:56:13.322 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:13.326 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:13.327 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:13.328 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:13.328 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:14.049 INFO:teuthology.orchestra.run.smithi045.stdout:generic/044 [not run] ceph does not support shutdown 2023-10-08T12:56:14.079 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/044 2023-10-08T12:56:14.079 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/044 2023-10-08T12:56:14.079 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:14.084 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:14.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:14.112 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-10-08T12:56:14.471 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:14.480 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:14.480 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:14.481 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:14.481 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:15.187 INFO:teuthology.orchestra.run.smithi045.stdout:generic/045 [not run] ceph does not support shutdown 2023-10-08T12:56:15.207 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/045 2023-10-08T12:56:15.207 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/045 2023-10-08T12:56:15.207 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:15.210 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:15.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:15.232 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-10-08T12:56:15.610 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:15.623 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:15.623 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:15.624 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:15.625 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:16.315 INFO:teuthology.orchestra.run.smithi045.stdout:generic/046 [not run] ceph does not support shutdown 2023-10-08T12:56:16.334 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/046 2023-10-08T12:56:16.334 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/046 2023-10-08T12:56:16.334 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:16.337 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:16.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:16.366 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-10-08T12:56:16.699 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:16.711 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:16.712 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:16.713 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:16.713 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:17.455 INFO:teuthology.orchestra.run.smithi045.stdout:generic/047 [not run] ceph does not support shutdown 2023-10-08T12:56:17.476 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/047 2023-10-08T12:56:17.476 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/047 2023-10-08T12:56:17.476 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:17.478 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:17.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:17.504 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-10-08T12:56:17.875 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:17.879 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:17.880 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:17.881 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:17.881 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:18.560 INFO:teuthology.orchestra.run.smithi045.stdout:generic/048 [not run] ceph does not support shutdown 2023-10-08T12:56:18.597 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/048 2023-10-08T12:56:18.597 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/048 2023-10-08T12:56:18.598 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:18.603 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:18.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:18.636 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-10-08T12:56:18.980 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:18.991 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:18.992 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:19.000 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:19.000 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:19.641 INFO:teuthology.orchestra.run.smithi045.stdout:generic/049 [not run] ceph does not support shutdown 2023-10-08T12:56:19.666 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/049 2023-10-08T12:56:19.666 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/049 2023-10-08T12:56:19.667 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:19.669 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:19.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:19.697 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-10-08T12:56:20.065 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:20.076 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:20.077 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:20.078 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:20.078 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:20.732 INFO:teuthology.orchestra.run.smithi045.stdout:generic/050 [not run] ceph does not support shutdown 2023-10-08T12:56:20.760 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/050 2023-10-08T12:56:20.761 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/050 2023-10-08T12:56:20.761 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:20.763 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:20.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:20.787 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-10-08T12:56:21.125 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:21.131 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:21.131 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:21.134 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:21.134 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:21.795 INFO:teuthology.orchestra.run.smithi045.stdout:generic/051 [not run] ceph does not support shutdown 2023-10-08T12:56:21.800 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/051 2023-10-08T12:56:21.800 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/051 2023-10-08T12:56:21.801 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:21.803 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:21.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:21.840 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-10-08T12:56:22.183 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:22.188 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:22.188 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:22.189 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:22.190 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:22.836 INFO:teuthology.orchestra.run.smithi045.stdout:generic/052 [not run] ceph does not support shutdown 2023-10-08T12:56:22.862 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/052 2023-10-08T12:56:22.862 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/052 2023-10-08T12:56:22.862 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:22.864 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:22.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:22.890 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-10-08T12:56:23.211 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:23.217 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:23.217 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:23.219 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:23.219 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:24.155 INFO:teuthology.orchestra.run.smithi045.stdout:generic/053 1s 2023-10-08T12:56:24.166 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/053 2023-10-08T12:56:24.166 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:24.168 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:24.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:24.180 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-10-08T12:56:24.504 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:24.513 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:24.513 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:24.517 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:24.517 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:25.252 INFO:teuthology.orchestra.run.smithi045.stdout:generic/054 [not run] ceph does not support shutdown 2023-10-08T12:56:25.270 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/054 2023-10-08T12:56:25.271 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/054 2023-10-08T12:56:25.271 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:25.274 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:25.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:25.297 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-10-08T12:56:25.664 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:25.669 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:25.670 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:25.671 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:25.671 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:26.384 INFO:teuthology.orchestra.run.smithi045.stdout:generic/055 [not run] ceph does not support shutdown 2023-10-08T12:56:26.410 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/055 2023-10-08T12:56:26.410 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/055 2023-10-08T12:56:26.410 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:26.420 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:26.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:26.446 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-10-08T12:56:26.844 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:26.849 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:26.849 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:26.852 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:26.852 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:27.387 INFO:teuthology.orchestra.run.smithi045.stdout:generic/056 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T12:56:27.398 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/056 2023-10-08T12:56:27.398 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/056 2023-10-08T12:56:27.398 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:27.401 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:27.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:27.439 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-10-08T12:56:27.793 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:27.798 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:27.799 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:27.800 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:27.800 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:28.306 INFO:teuthology.orchestra.run.smithi045.stdout:generic/057 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T12:56:28.313 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/057 2023-10-08T12:56:28.313 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/057 2023-10-08T12:56:28.313 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:28.315 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:28.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:28.345 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-10-08T12:56:28.683 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:28.689 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:28.691 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:28.692 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:28.692 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:29.276 INFO:teuthology.orchestra.run.smithi045.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T12:56:29.282 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/058 2023-10-08T12:56:29.282 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/058 2023-10-08T12:56:29.282 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:29.285 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:29.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:29.330 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-10-08T12:56:29.676 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:29.683 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:29.683 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:29.684 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:29.685 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:30.226 INFO:teuthology.orchestra.run.smithi045.stdout:generic/059 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T12:56:30.231 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/059 2023-10-08T12:56:30.231 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/059 2023-10-08T12:56:30.231 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:30.233 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:30.263 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:30.263 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-10-08T12:56:30.644 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:30.652 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:30.656 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:30.657 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:30.657 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:31.270 INFO:teuthology.orchestra.run.smithi045.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T12:56:31.276 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/060 2023-10-08T12:56:31.276 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/060 2023-10-08T12:56:31.276 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:31.279 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:31.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:31.316 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-10-08T12:56:31.691 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:31.707 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:31.707 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:31.709 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:31.709 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:32.332 INFO:teuthology.orchestra.run.smithi045.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T12:56:32.336 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/061 2023-10-08T12:56:32.336 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/061 2023-10-08T12:56:32.336 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:32.339 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:32.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:32.381 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-10-08T12:56:32.713 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:32.719 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:32.719 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:32.720 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:32.720 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:34.907 INFO:teuthology.orchestra.run.smithi045.stdout:generic/062 2s 2023-10-08T12:56:34.913 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/062 2023-10-08T12:56:34.913 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:34.917 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:34.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:34.933 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-10-08T12:56:35.293 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:35.300 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:35.301 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:35.302 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:35.302 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:35.974 INFO:teuthology.orchestra.run.smithi045.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T12:56:35.986 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/063 2023-10-08T12:56:35.986 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/063 2023-10-08T12:56:35.986 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:35.990 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:36.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:36.024 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-10-08T12:56:36.271 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:56:36.274 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:56:36.387 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:36.392 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:36.393 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:36.394 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:36.394 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:37.078 INFO:teuthology.orchestra.run.smithi045.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-08T12:56:37.086 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/064 2023-10-08T12:56:37.087 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/064 2023-10-08T12:56:37.087 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:37.089 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:37.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:37.119 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-10-08T12:56:37.487 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:37.491 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:37.491 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:37.492 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:37.492 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:37.980 INFO:teuthology.orchestra.run.smithi045.stdout:generic/065 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T12:56:37.985 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/065 2023-10-08T12:56:37.985 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/065 2023-10-08T12:56:37.985 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:37.988 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:38.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:38.027 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-10-08T12:56:38.373 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:38.379 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:38.379 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:38.380 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:38.380 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:38.922 INFO:teuthology.orchestra.run.smithi045.stdout:generic/066 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T12:56:38.927 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/066 2023-10-08T12:56:38.927 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/066 2023-10-08T12:56:38.927 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:38.929 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:38.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:38.953 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-10-08T12:56:39.300 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:39.311 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:39.313 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:39.314 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:39.314 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:39.859 INFO:teuthology.orchestra.run.smithi045.stdout:generic/067 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T12:56:39.865 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/067 2023-10-08T12:56:39.865 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/067 2023-10-08T12:56:39.865 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:39.869 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:39.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:39.899 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-10-08T12:56:40.272 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:40.282 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:40.283 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:40.284 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:40.284 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:40.776 INFO:teuthology.orchestra.run.smithi045.stdout:generic/068 [not run] ceph does not support freezing 2023-10-08T12:56:40.781 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/068 2023-10-08T12:56:40.781 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/068 2023-10-08T12:56:40.781 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:40.784 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:40.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:40.813 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-10-08T12:56:41.149 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:41.154 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:41.154 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:41.156 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:41.156 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:49.714 INFO:teuthology.orchestra.run.smithi045.stdout:generic/069 8s 2023-10-08T12:56:49.723 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/069 2023-10-08T12:56:49.723 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:56:49.725 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:56:49.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:56:49.740 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-10-08T12:56:50.100 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:56:50.106 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:56:50.107 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:56:50.108 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:56:50.108 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:57:06.909 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:57:06.912 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:57:16.396 INFO:teuthology.orchestra.run.smithi045.stdout:generic/070 26s 2023-10-08T12:57:16.405 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/070 2023-10-08T12:57:16.405 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:57:16.408 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:57:16.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:57:16.479 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-10-08T12:57:16.855 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:57:16.863 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:57:16.864 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:57:16.865 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:57:16.866 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:57:17.377 INFO:teuthology.orchestra.run.smithi045.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-10-08T12:57:17.383 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/071 2023-10-08T12:57:17.383 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/071 2023-10-08T12:57:17.383 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:57:17.389 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:57:17.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:57:17.427 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-10-08T12:57:17.736 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:57:17.746 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:57:17.747 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:57:17.750 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:57:17.750 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:57:18.346 INFO:teuthology.orchestra.run.smithi045.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-10-08T12:57:18.351 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/072 2023-10-08T12:57:18.351 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/072 2023-10-08T12:57:18.351 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:57:18.354 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:57:18.395 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:57:18.395 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-10-08T12:57:18.721 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:57:18.726 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:57:18.726 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:57:18.728 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:57:18.728 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:57:19.227 INFO:teuthology.orchestra.run.smithi045.stdout:generic/073 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T12:57:19.232 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/073 2023-10-08T12:57:19.232 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/073 2023-10-08T12:57:19.232 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:57:19.240 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:57:19.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:57:19.269 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-10-08T12:57:19.638 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:57:19.644 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:57:19.645 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:57:19.654 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:57:19.654 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:57:37.017 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:57:37.022 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:57:37.179 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-10-08T12:57:37.178+0000 7fd76dbb2700 -1 Fail to open '/proc/208482/cmdline' error = (2) No such file or directory 2023-10-08T12:57:37.179 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-10-08T12:57:37.178+0000 7fd76dbb2700 -1 received signal: Hangup from (PID: 208482) UID: 0 2023-10-08T12:57:37.186 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-10-08T12:57:37.177+0000 7f00eeb81700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 208482) UID: 0 2023-10-08T12:57:40.065 INFO:teuthology.orchestra.run.smithi045.stdout:generic/074 21s 2023-10-08T12:57:40.078 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/074 2023-10-08T12:57:40.078 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:57:40.080 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:57:40.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:57:40.451 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-10-08T12:57:40.911 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:57:40.918 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:57:40.918 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:57:40.919 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:57:40.919 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:58:16.810 INFO:teuthology.orchestra.run.smithi045.stdout:generic/075 35s 2023-10-08T12:58:16.816 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/075 2023-10-08T12:58:16.816 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:58:16.819 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:58:16.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:58:16.860 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-10-08T12:58:17.277 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:58:17.282 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:58:17.283 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:58:17.295 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:58:17.295 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:58:17.843 INFO:teuthology.orchestra.run.smithi045.stdout:generic/076 [not run] require 172.21.15.45:6789:/scratch to be local device 2023-10-08T12:58:17.852 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/076 2023-10-08T12:58:17.852 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/076 2023-10-08T12:58:17.852 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:58:17.858 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:58:17.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:58:17.894 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-10-08T12:58:18.331 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:58:18.336 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:58:18.336 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:58:18.337 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:58:18.338 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:58:21.354 INFO:teuthology.orchestra.run.smithi045.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-08T12:58:21.364 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/077 2023-10-08T12:58:21.365 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/077 2023-10-08T12:58:21.365 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:58:21.367 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:58:21.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:58:21.421 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-10-08T12:58:21.849 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:58:21.860 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:58:21.860 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:58:21.861 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:58:21.861 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:58:22.492 INFO:teuthology.orchestra.run.smithi045.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-10-08T12:58:22.516 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/078 2023-10-08T12:58:22.516 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/078 2023-10-08T12:58:22.516 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:58:22.522 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:58:22.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:58:22.579 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-10-08T12:58:23.049 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:58:23.062 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:58:23.062 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:58:23.063 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:58:23.063 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:58:23.739 INFO:teuthology.orchestra.run.smithi045.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-10-08T12:58:23.747 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/079 2023-10-08T12:58:23.747 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/079 2023-10-08T12:58:23.748 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:58:23.761 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:58:23.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:58:23.816 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-10-08T12:58:24.215 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:58:24.230 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:58:24.234 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:58:24.238 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:58:24.238 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:58:26.876 INFO:teuthology.orchestra.run.smithi045.stdout:generic/080 2s 2023-10-08T12:58:26.891 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/080 2023-10-08T12:58:26.891 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:58:26.898 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:58:26.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:58:26.958 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-10-08T12:58:27.392 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:58:27.400 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:58:27.400 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:58:27.401 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:58:27.401 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:58:28.014 INFO:teuthology.orchestra.run.smithi045.stdout:generic/081 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T12:58:28.018 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/081 2023-10-08T12:58:28.019 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/081 2023-10-08T12:58:28.019 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:58:28.021 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:58:28.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:58:28.053 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-10-08T12:58:28.479 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:58:28.484 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:58:28.485 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:58:28.486 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:58:28.486 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:58:29.054 INFO:teuthology.orchestra.run.smithi045.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-08T12:58:29.059 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/082 2023-10-08T12:58:29.059 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/082 2023-10-08T12:58:29.059 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:58:29.061 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:58:29.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:58:29.086 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-10-08T12:58:29.497 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:58:29.502 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:58:29.503 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:58:29.504 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:58:29.504 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:58:29.998 INFO:teuthology.orchestra.run.smithi045.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-08T12:58:30.011 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/083 2023-10-08T12:58:30.011 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/083 2023-10-08T12:58:30.011 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:58:30.025 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:58:30.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:58:30.061 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-10-08T12:58:30.549 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:58:30.562 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:58:30.564 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:58:30.565 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:58:30.565 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:58:38.849 INFO:teuthology.orchestra.run.smithi045.stdout:generic/084 8s 2023-10-08T12:58:38.868 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/084 2023-10-08T12:58:38.869 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:58:38.871 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:58:38.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:58:38.895 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-10-08T12:58:39.368 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:58:39.388 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:58:39.389 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:58:39.392 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:58:39.392 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:58:40.022 INFO:teuthology.orchestra.run.smithi045.stdout:generic/085 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T12:58:40.032 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/085 2023-10-08T12:58:40.032 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/085 2023-10-08T12:58:40.032 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:58:40.035 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:58:40.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:58:40.082 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-10-08T12:58:40.625 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:58:40.634 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:58:40.635 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:58:40.636 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:58:40.636 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:58:41.244 INFO:teuthology.orchestra.run.smithi045.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T12:58:41.254 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/086 2023-10-08T12:58:41.255 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/086 2023-10-08T12:58:41.255 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:58:41.257 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:58:41.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:58:41.313 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-10-08T12:58:41.760 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:58:41.764 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:58:41.765 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:58:41.769 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:58:41.769 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:58:42.448 INFO:teuthology.orchestra.run.smithi045.stdout:generic/087 0s 2023-10-08T12:58:42.492 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/087 2023-10-08T12:58:42.492 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:58:42.495 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:58:42.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:58:42.575 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-10-08T12:58:43.025 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:58:43.036 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:58:43.036 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:58:43.038 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:58:43.038 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:58:43.630 INFO:teuthology.orchestra.run.smithi045.stdout:generic/088 0s 2023-10-08T12:58:43.747 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/088 2023-10-08T12:58:43.747 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T12:58:43.750 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T12:58:43.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:58:43.806 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-10-08T12:58:44.218 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T12:58:44.228 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T12:58:44.231 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T12:58:44.237 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T12:58:44.237 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:00:43.256 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:00:43.259 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:01:14.170 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:01:14.172 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:01:44.247 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:01:44.250 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:02:14.508 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:02:14.512 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:02:44.627 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:02:44.630 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:02:44.669 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-10-08T13:02:44.668+0000 7f00eeb81700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 217670) UID: 0 2023-10-08T13:02:44.670 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-10-08T13:02:44.668+0000 7fd76dbb2700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 217670) UID: 0 2023-10-08T13:05:42.689 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:05:42.691 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:06:12.768 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:06:12.771 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:06:42.865 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:06:42.869 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:06:42.925 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-10-08T13:06:42.924+0000 7fd76dbb2700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 219779) UID: 0 2023-10-08T13:06:42.927 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-10-08T13:06:42.925+0000 7f00eeb81700 -1 Fail to open '/proc/219779/cmdline' error = (2) No such file or directory 2023-10-08T13:06:42.927 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-10-08T13:06:42.925+0000 7f00eeb81700 -1 received signal: Hangup from (PID: 219779) UID: 0 2023-10-08T13:07:02.681 INFO:teuthology.orchestra.run.smithi045.stdout:generic/089 498s 2023-10-08T13:07:02.691 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/089 2023-10-08T13:07:02.691 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:07:02.693 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:07:02.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:07:02.993 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-10-08T13:07:03.342 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:07:03.346 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:07:03.346 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:07:03.347 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:07:03.347 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:07:04.014 INFO:teuthology.orchestra.run.smithi045.stdout:generic/090 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T13:07:04.019 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/090 2023-10-08T13:07:04.019 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/090 2023-10-08T13:07:04.019 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:07:04.021 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:07:04.054 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:07:04.055 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-10-08T13:07:04.273 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:07:04.277 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:07:04.278 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:07:04.279 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:07:04.279 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:08:43.977 INFO:teuthology.orchestra.run.smithi045.stdout:generic/091 99s 2023-10-08T13:08:43.982 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/091 2023-10-08T13:08:43.982 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:08:43.984 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:08:44.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:08:44.013 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-10-08T13:08:44.252 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:08:44.256 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:08:44.257 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:08:44.258 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:08:44.258 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:08:44.582 INFO:teuthology.orchestra.run.smithi045.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T13:08:44.586 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/092 2023-10-08T13:08:44.586 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/092 2023-10-08T13:08:44.586 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:08:44.588 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:08:44.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:08:44.612 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-10-08T13:08:44.835 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:08:44.840 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:08:44.840 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:08:44.841 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:08:44.841 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:08:45.461 INFO:teuthology.orchestra.run.smithi045.stdout:generic/093 0s 2023-10-08T13:08:45.466 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/093 2023-10-08T13:08:45.466 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:08:45.468 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:08:45.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:08:45.503 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-10-08T13:08:45.725 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:08:45.729 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:08:45.729 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:08:45.730 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:08:45.731 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:08:46.119 INFO:teuthology.orchestra.run.smithi045.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-08T13:08:46.123 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/094 2023-10-08T13:08:46.123 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/094 2023-10-08T13:08:46.123 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:08:46.125 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:08:46.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:08:46.151 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-10-08T13:08:46.375 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:08:46.379 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:08:46.380 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:08:46.380 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:08:46.380 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:08:58.927 INFO:teuthology.orchestra.run.smithi045.stdout:generic/095 12s 2023-10-08T13:08:58.932 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/095 2023-10-08T13:08:58.932 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:08:58.934 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:08:58.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:08:58.942 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-10-08T13:08:59.169 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:08:59.174 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:08:59.174 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:08:59.175 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:08:59.175 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:08:59.590 INFO:teuthology.orchestra.run.smithi045.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-08T13:08:59.594 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/096 2023-10-08T13:08:59.594 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/096 2023-10-08T13:08:59.595 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:08:59.596 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:08:59.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:08:59.621 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-10-08T13:08:59.863 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:08:59.870 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:08:59.870 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:08:59.870 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:08:59.870 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:09:00.436 INFO:teuthology.orchestra.run.smithi045.stdout:generic/097 0s 2023-10-08T13:09:00.490 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/097 2023-10-08T13:09:00.490 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:09:00.492 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:09:00.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:09:00.521 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-10-08T13:09:00.748 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:09:00.753 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:09:00.753 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:09:00.754 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:09:00.754 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:09:03.212 INFO:teuthology.orchestra.run.smithi045.stdout:generic/098 3s 2023-10-08T13:09:03.217 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/098 2023-10-08T13:09:03.217 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:09:03.219 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:09:03.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:09:03.228 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-10-08T13:09:03.492 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:09:03.496 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:09:03.496 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:09:03.497 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:09:03.498 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:09:04.409 INFO:teuthology.orchestra.run.smithi045.stdout:generic/099 1s 2023-10-08T13:09:04.414 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/099 2023-10-08T13:09:04.414 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:09:04.416 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:09:04.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:09:04.466 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-10-08T13:09:04.688 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:09:04.709 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:09:04.709 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:09:04.711 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:09:04.711 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:09:16.430 INFO:teuthology.orchestra.run.smithi045.stdout:generic/100 12s 2023-10-08T13:09:16.435 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/100 2023-10-08T13:09:16.435 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:09:16.437 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:09:20.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:09:20.162 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-10-08T13:09:20.504 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:09:20.508 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:09:20.509 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:09:20.510 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:09:20.510 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:09:20.866 INFO:teuthology.orchestra.run.smithi045.stdout:generic/101 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T13:09:20.870 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/101 2023-10-08T13:09:20.870 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/101 2023-10-08T13:09:20.871 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:09:20.873 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:09:20.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:09:20.892 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-10-08T13:09:21.114 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:09:21.118 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:09:21.118 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:09:21.119 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:09:21.119 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:09:21.446 INFO:teuthology.orchestra.run.smithi045.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-08T13:09:21.450 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/102 2023-10-08T13:09:21.450 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/102 2023-10-08T13:09:21.451 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:09:21.452 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:09:21.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:09:21.487 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-10-08T13:09:21.707 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:09:21.711 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:09:21.711 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:09:21.712 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:09:21.713 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:09:22.069 INFO:teuthology.orchestra.run.smithi045.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T13:09:22.073 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/103 2023-10-08T13:09:22.073 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/103 2023-10-08T13:09:22.073 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:09:22.075 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:09:22.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:09:22.099 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-10-08T13:09:22.318 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:09:22.322 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:09:22.322 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:09:22.323 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:09:22.323 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:09:22.673 INFO:teuthology.orchestra.run.smithi045.stdout:generic/104 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T13:09:22.677 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/104 2023-10-08T13:09:22.677 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/104 2023-10-08T13:09:22.678 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:09:22.680 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:09:22.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:09:22.715 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-10-08T13:09:22.935 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:09:22.939 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:09:22.939 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:09:22.940 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:09:22.940 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:09:23.581 INFO:teuthology.orchestra.run.smithi045.stdout:generic/105 0s 2023-10-08T13:09:23.585 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/105 2023-10-08T13:09:23.586 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:09:23.588 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:09:23.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:09:23.596 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-10-08T13:09:23.820 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:09:23.824 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:09:23.824 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:09:23.825 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:09:23.825 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:09:24.236 INFO:teuthology.orchestra.run.smithi045.stdout:generic/106 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T13:09:24.240 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/106 2023-10-08T13:09:24.240 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/106 2023-10-08T13:09:24.240 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:09:24.242 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:09:24.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:09:24.270 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-10-08T13:09:24.491 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:09:24.495 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:09:24.495 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:09:24.496 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:09:24.497 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:09:24.847 INFO:teuthology.orchestra.run.smithi045.stdout:generic/107 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T13:09:24.851 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/107 2023-10-08T13:09:24.851 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/107 2023-10-08T13:09:24.851 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:09:24.853 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:09:24.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:09:24.879 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-10-08T13:09:25.101 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:09:25.105 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:09:25.105 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:09:25.106 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:09:25.106 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:09:25.565 INFO:teuthology.orchestra.run.smithi045.stdout:generic/108 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T13:09:25.569 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/108 2023-10-08T13:09:25.569 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/108 2023-10-08T13:09:25.569 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:09:25.571 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:09:25.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:09:25.593 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-10-08T13:09:25.811 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:09:25.815 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:09:25.816 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:09:25.817 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:09:25.817 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:09:33.196 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:09:33.199 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:09:58.156 INFO:teuthology.orchestra.run.smithi045.stdout:generic/109 32s 2023-10-08T13:09:58.161 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/109 2023-10-08T13:09:58.161 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:09:58.163 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:09:58.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:09:58.172 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-10-08T13:09:59.212 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:09:59.216 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:09:59.216 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:09:59.217 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:09:59.217 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:10:03.268 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:10:03.271 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:10:19.341 INFO:teuthology.orchestra.run.smithi045.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:10:19.345 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/110 2023-10-08T13:10:19.345 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/110 2023-10-08T13:10:19.346 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:10:19.347 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:10:19.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:19.388 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-10-08T13:10:19.957 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:10:19.973 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:10:19.973 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:10:19.977 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:10:19.977 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:10:20.336 INFO:teuthology.orchestra.run.smithi045.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:10:20.340 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/111 2023-10-08T13:10:20.340 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/111 2023-10-08T13:10:20.341 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:10:20.342 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:10:20.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:20.379 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-10-08T13:10:20.606 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:10:20.610 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:10:20.610 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:10:20.611 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:10:20.612 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:10:33.337 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:10:33.339 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:10:36.006 INFO:teuthology.orchestra.run.smithi045.stdout:generic/112 16s 2023-10-08T13:10:36.011 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/112 2023-10-08T13:10:36.011 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:10:36.013 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:10:36.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:36.045 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-10-08T13:10:36.269 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:10:36.273 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:10:36.274 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:10:36.275 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:10:36.275 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:10:51.309 INFO:teuthology.orchestra.run.smithi045.stdout:generic/113 15s 2023-10-08T13:10:51.314 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/113 2023-10-08T13:10:51.314 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:10:51.316 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:10:51.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:51.345 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-10-08T13:10:51.655 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:10:51.690 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:10:51.691 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:10:51.692 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:10:51.692 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:10:52.165 INFO:teuthology.orchestra.run.smithi045.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-10-08T13:10:52.169 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/114 2023-10-08T13:10:52.169 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/114 2023-10-08T13:10:52.169 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:10:52.171 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:10:52.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:52.199 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-10-08T13:10:52.422 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:10:52.426 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:10:52.427 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:10:52.428 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:10:52.428 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:10:52.793 INFO:teuthology.orchestra.run.smithi045.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:10:52.797 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/115 2023-10-08T13:10:52.797 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/115 2023-10-08T13:10:52.797 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:10:52.799 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:10:52.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:52.838 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-10-08T13:10:53.057 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:10:53.061 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:10:53.061 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:10:53.062 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:10:53.062 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:10:53.429 INFO:teuthology.orchestra.run.smithi045.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:10:53.433 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/116 2023-10-08T13:10:53.433 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/116 2023-10-08T13:10:53.433 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:10:53.435 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:10:53.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:53.471 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-10-08T13:10:53.694 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:10:53.699 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:10:53.699 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:10:53.700 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:10:53.700 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:11:03.402 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:11:03.405 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:11:07.068 INFO:teuthology.orchestra.run.smithi045.stdout:generic/117 14s 2023-10-08T13:11:07.072 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/117 2023-10-08T13:11:07.073 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:11:07.074 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:11:07.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:11:07.083 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-10-08T13:11:07.306 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:11:07.310 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:11:07.311 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:11:07.312 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:11:07.312 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:11:08.086 INFO:teuthology.orchestra.run.smithi045.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:11:08.090 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/118 2023-10-08T13:11:08.090 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/118 2023-10-08T13:11:08.090 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:11:08.092 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:11:08.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:11:08.130 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-10-08T13:11:08.350 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:11:08.354 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:11:08.355 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:11:08.356 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:11:08.356 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:11:08.818 INFO:teuthology.orchestra.run.smithi045.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:11:08.823 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/119 2023-10-08T13:11:08.823 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/119 2023-10-08T13:11:08.823 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:11:08.825 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:11:08.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:11:08.863 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-10-08T13:11:09.083 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:11:09.087 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:11:09.088 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:11:09.089 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:11:09.089 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:11:09.420 INFO:teuthology.orchestra.run.smithi045.stdout:generic/120 [not run] atime not maintained by ceph 2023-10-08T13:11:09.420 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/120 2023-10-08T13:11:09.420 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/120 2023-10-08T13:11:09.420 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:11:09.421 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:11:09.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:11:09.440 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-10-08T13:11:09.664 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:11:09.669 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:11:09.669 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:11:09.670 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:11:09.670 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:11:10.033 INFO:teuthology.orchestra.run.smithi045.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-10-08T13:11:10.037 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/121 2023-10-08T13:11:10.037 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/121 2023-10-08T13:11:10.037 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:11:10.041 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:11:10.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:11:10.077 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-10-08T13:11:10.306 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:11:10.310 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:11:10.311 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:11:10.312 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:11:10.312 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:11:10.676 INFO:teuthology.orchestra.run.smithi045.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-10-08T13:11:10.680 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/122 2023-10-08T13:11:10.681 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/122 2023-10-08T13:11:10.681 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:11:10.683 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:11:10.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:11:10.721 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-10-08T13:11:10.941 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:11:10.948 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:11:10.948 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:11:10.948 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:11:10.948 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:11:11.463 INFO:teuthology.orchestra.run.smithi045.stdout:generic/123 0s 2023-10-08T13:11:11.468 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/123 2023-10-08T13:11:11.468 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:11:11.470 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:11:11.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:11:11.503 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-10-08T13:11:11.728 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:11:11.732 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:11:11.733 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:11:11.734 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:11:11.734 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:11:13.802 INFO:teuthology.orchestra.run.smithi045.stdout:generic/124 2s 2023-10-08T13:11:13.806 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/124 2023-10-08T13:11:13.806 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:11:13.808 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:11:13.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:11:13.998 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-10-08T13:11:14.227 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:11:14.231 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:11:14.231 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:11:14.232 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:11:14.232 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:11:33.488 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:11:33.491 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:12:03.625 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:12:03.628 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:12:15.909 INFO:teuthology.orchestra.run.smithi045.stdout:generic/125 61s 2023-10-08T13:12:15.915 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/125 2023-10-08T13:12:15.915 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:12:15.918 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:12:15.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:12:15.945 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-10-08T13:12:16.173 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:12:16.178 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:12:16.178 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:12:16.179 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:12:16.179 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:12:16.686 INFO:teuthology.orchestra.run.smithi045.stdout:generic/126 0s 2023-10-08T13:12:16.691 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/126 2023-10-08T13:12:16.691 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:12:16.693 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:12:16.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:12:16.763 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-10-08T13:12:16.987 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:12:16.992 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:12:16.992 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:12:16.993 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:12:16.993 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:12:33.708 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:12:33.710 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:13:03.782 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:13:03.786 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:13:33.876 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:13:33.879 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:14:03.950 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:14:03.953 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:14:34.050 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:14:34.053 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:15:04.128 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:15:04.131 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:15:34.200 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:15:34.203 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:16:04.294 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:16:04.296 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:16:34.392 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:16:34.394 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:17:04.463 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:17:04.466 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:17:34.520 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:17:34.524 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:18:04.610 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:18:04.612 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:18:34.757 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:18:34.759 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:19:04.904 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:19:04.907 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:19:34.994 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:19:34.998 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:20:05.091 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:20:05.094 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:20:35.469 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:20:35.471 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:21:05.528 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:21:05.530 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:21:35.672 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:21:35.675 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:21:48.524 INFO:teuthology.orchestra.run.smithi045.stdout:generic/127 571s 2023-10-08T13:21:48.528 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/127 2023-10-08T13:21:48.529 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:21:48.531 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:21:48.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:21:48.559 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-10-08T13:21:48.784 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:21:48.788 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:21:48.788 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:21:48.789 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:21:48.789 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:21:49.550 INFO:teuthology.orchestra.run.smithi045.stdout:generic/128 1s 2023-10-08T13:21:49.555 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/128 2023-10-08T13:21:49.556 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:21:49.557 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:21:49.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:21:49.566 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-10-08T13:21:49.790 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:21:49.793 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:21:49.794 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:21:49.795 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:21:49.795 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:22:05.773 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:22:05.776 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:22:36.105 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:22:36.112 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:23:06.205 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:23:06.208 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:23:36.725 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:23:36.727 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:24:06.854 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:24:06.864 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:24:37.007 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:24:37.028 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:25:07.136 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:25:07.148 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:25:37.294 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:25:37.301 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:26:07.430 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:26:07.432 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:26:37.719 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:26:37.722 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:27:08.258 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:27:08.261 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:27:38.405 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:27:38.408 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:28:08.828 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:28:08.845 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:28:39.034 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:28:39.050 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:29:09.216 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:29:09.218 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:29:39.429 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:29:39.431 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:30:09.647 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:30:09.655 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:30:39.771 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:30:39.791 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:31:10.696 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:31:10.701 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:31:40.826 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:31:40.842 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:32:11.270 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:32:11.273 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:32:41.427 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:32:41.429 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:33:11.614 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:33:11.631 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:33:41.745 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:33:41.766 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:34:11.957 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:34:11.980 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:34:42.349 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:34:42.358 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:34:42.528 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-10-08T13:34:42.526+0000 7f3991658700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114878) UID: 0 2023-10-08T13:34:42.528 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-10-08T13:34:42.527+0000 7eff1a006700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114878) UID: 0 2023-10-08T13:34:42.529 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-10-08T13:34:42.528+0000 7f0d20ed4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114878) UID: 0 2023-10-08T13:34:42.535 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T13:34:42.535+0000 7ff165866700 -1 Fail to open '/proc/114878/cmdline' error = (2) No such file or directory 2023-10-08T13:34:42.535 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T13:34:42.535+0000 7ff165866700 -1 received signal: Hangup from (PID: 114878) UID: 0 2023-10-08T13:38:47.106 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:38:47.170 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:38:47.446 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T13:38:47.439+0000 7f12925ec700 -1 received signal: Hangup from (PID: 258606) UID: 0 2023-10-08T13:38:47.447 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-08T13:38:47.440+0000 7f850b43a700 -1 Fail to open '/proc/258606/cmdline' error = (2) No such file or directory 2023-10-08T13:38:47.447 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-08T13:38:47.440+0000 7f850b43a700 -1 received signal: Hangup from (PID: 258606) UID: 0 2023-10-08T13:38:47.447 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T13:38:47.440+0000 7f485127c700 -1 Fail to open '/proc/258606/cmdline' error = (2) No such file or directory 2023-10-08T13:38:47.447 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T13:38:47.440+0000 7f485127c700 -1 received signal: Hangup from (PID: 258606) UID: 0 2023-10-08T13:38:47.463 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T13:38:47.446+0000 7fae5722b700 -1 Fail to open '/proc/258606/cmdline' error = (2) No such file or directory 2023-10-08T13:38:47.463 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T13:38:47.446+0000 7fae5722b700 -1 received signal: Hangup from (PID: 258606) UID: 0 2023-10-08T13:38:47.556 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T13:38:47.540+0000 7ff165866700 -1 received signal: Hangup from (PID: 114939) UID: 0 2023-10-08T13:38:47.557 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-10-08T13:38:47.540+0000 7eff1a006700 -1 received signal: Hangup from (PID: 114939) UID: 0 2023-10-08T13:38:47.557 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-10-08T13:38:47.539+0000 7f0d20ed4700 -1 received signal: Hangup from (PID: 114939) UID: 0 2023-10-08T13:38:47.559 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-10-08T13:38:47.536+0000 7f3991658700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114939) UID: 0 2023-10-08T13:42:18.188 INFO:teuthology.orchestra.run.smithi045.stdout:generic/129 1228s 2023-10-08T13:42:18.303 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/129 2023-10-08T13:42:18.304 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:42:18.305 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:42:18.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:42:18.382 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-10-08T13:42:19.567 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:42:19.571 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:42:19.571 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:42:19.572 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:42:19.572 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:42:32.908 INFO:teuthology.orchestra.run.smithi045.stdout:generic/130 13s 2023-10-08T13:42:32.917 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/130 2023-10-08T13:42:32.917 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:42:32.919 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:42:32.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:42:32.928 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-10-08T13:42:33.152 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:42:33.156 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:42:33.157 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:42:33.157 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:42:33.158 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:42:34.742 INFO:teuthology.orchestra.run.smithi045.stdout:generic/131 1s 2023-10-08T13:42:34.750 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/131 2023-10-08T13:42:34.750 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:42:34.753 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:42:34.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:42:34.846 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-10-08T13:42:35.318 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:42:35.322 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:42:35.323 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:42:35.323 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:42:35.324 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:42:49.811 INFO:teuthology.orchestra.run.smithi045.stdout:generic/132 14s 2023-10-08T13:42:49.816 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/132 2023-10-08T13:42:49.816 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:42:49.818 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:42:49.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:42:49.827 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-10-08T13:42:50.044 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:42:50.048 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:42:50.049 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:42:50.050 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:42:50.050 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:44:45.973 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:44:45.975 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:45:16.068 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:45:16.070 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:45:46.165 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:45:46.168 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:46:16.280 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:46:16.283 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:46:46.436 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:46:46.438 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:46:48.723 INFO:teuthology.orchestra.run.smithi045.stdout:generic/133 238s 2023-10-08T13:46:48.727 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/133 2023-10-08T13:46:48.727 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:46:48.729 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:46:48.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:46:48.768 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-10-08T13:46:49.067 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:46:49.071 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:46:49.072 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:46:49.073 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:46:49.073 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:46:49.545 INFO:teuthology.orchestra.run.smithi045.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:46:49.549 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/134 2023-10-08T13:46:49.549 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/134 2023-10-08T13:46:49.549 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:46:49.551 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:46:49.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:46:49.594 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-10-08T13:46:49.813 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:46:49.817 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:46:49.817 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:46:49.819 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:46:49.819 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:46:50.640 INFO:teuthology.orchestra.run.smithi045.stdout:generic/135 0s 2023-10-08T13:46:50.645 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/135 2023-10-08T13:46:50.646 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:46:50.647 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:46:50.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:46:50.656 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-10-08T13:46:50.877 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:46:50.881 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:46:50.882 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:46:50.883 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:46:50.883 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:46:51.257 INFO:teuthology.orchestra.run.smithi045.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2023-10-08T13:46:51.261 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/136 2023-10-08T13:46:51.262 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/136 2023-10-08T13:46:51.262 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:46:51.264 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:46:51.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:46:51.320 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-10-08T13:46:51.537 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:46:51.542 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:46:51.542 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:46:51.543 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:46:51.543 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:46:51.928 INFO:teuthology.orchestra.run.smithi045.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:46:51.932 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/137 2023-10-08T13:46:51.933 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/137 2023-10-08T13:46:51.933 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:46:51.935 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:46:51.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:46:51.980 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-10-08T13:46:52.202 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:46:52.204 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:46:52.204 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:46:52.205 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:46:52.205 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:46:52.579 INFO:teuthology.orchestra.run.smithi045.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:46:52.582 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/138 2023-10-08T13:46:52.583 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/138 2023-10-08T13:46:52.583 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:46:52.585 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:46:52.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:46:52.635 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-10-08T13:46:52.855 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:46:52.859 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:46:52.860 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:46:52.861 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:46:52.861 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:46:53.245 INFO:teuthology.orchestra.run.smithi045.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:46:53.249 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/139 2023-10-08T13:46:53.249 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/139 2023-10-08T13:46:53.249 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:46:53.251 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:46:53.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:46:53.300 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-10-08T13:46:53.519 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:46:53.524 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:46:53.524 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:46:53.525 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:46:53.525 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:46:53.898 INFO:teuthology.orchestra.run.smithi045.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:46:53.901 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/140 2023-10-08T13:46:53.902 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/140 2023-10-08T13:46:53.902 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:46:53.904 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:46:53.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:46:53.957 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-10-08T13:46:54.182 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:46:54.186 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:46:54.186 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:46:54.187 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:46:54.187 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:46:54.803 INFO:teuthology.orchestra.run.smithi045.stdout:generic/141 0s 2023-10-08T13:46:54.807 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/141 2023-10-08T13:46:54.808 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:46:54.810 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:46:54.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:46:54.818 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-10-08T13:46:55.039 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:46:55.043 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:46:55.044 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:46:55.045 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:46:55.045 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:46:55.417 INFO:teuthology.orchestra.run.smithi045.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:46:55.421 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/142 2023-10-08T13:46:55.421 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/142 2023-10-08T13:46:55.421 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:46:55.423 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:46:55.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:46:55.473 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-10-08T13:46:55.694 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:46:55.698 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:46:55.699 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:46:55.700 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:46:55.700 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:46:56.083 INFO:teuthology.orchestra.run.smithi045.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:46:56.087 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/143 2023-10-08T13:46:56.087 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/143 2023-10-08T13:46:56.088 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:46:56.089 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:46:56.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:46:56.146 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-10-08T13:46:56.365 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:46:56.369 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:46:56.370 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:46:56.371 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:46:56.371 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:46:56.741 INFO:teuthology.orchestra.run.smithi045.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:46:56.745 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/144 2023-10-08T13:46:56.745 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/144 2023-10-08T13:46:56.745 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:46:56.747 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:46:56.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:46:56.798 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-10-08T13:46:57.022 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:46:57.026 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:46:57.027 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:46:57.028 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:46:57.028 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:46:57.412 INFO:teuthology.orchestra.run.smithi045.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:46:57.416 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/145 2023-10-08T13:46:57.416 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/145 2023-10-08T13:46:57.416 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:46:57.418 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:46:57.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:46:57.461 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-10-08T13:46:57.679 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:46:57.683 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:46:57.684 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:46:57.684 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:46:57.685 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:46:58.071 INFO:teuthology.orchestra.run.smithi045.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:46:58.075 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/146 2023-10-08T13:46:58.075 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/146 2023-10-08T13:46:58.075 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:46:58.077 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:46:58.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:46:58.126 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-10-08T13:46:58.350 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:46:58.354 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:46:58.354 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:46:58.355 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:46:58.355 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:46:58.720 INFO:teuthology.orchestra.run.smithi045.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:46:58.724 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/147 2023-10-08T13:46:58.724 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/147 2023-10-08T13:46:58.724 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:46:58.726 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:46:58.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:46:58.773 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-10-08T13:46:58.996 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:46:59.000 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:46:59.000 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:46:59.001 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:46:59.002 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:46:59.377 INFO:teuthology.orchestra.run.smithi045.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:46:59.381 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/148 2023-10-08T13:46:59.382 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/148 2023-10-08T13:46:59.382 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:46:59.385 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:46:59.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:46:59.430 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-10-08T13:46:59.649 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:46:59.653 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:46:59.654 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:46:59.655 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:46:59.655 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:00.040 INFO:teuthology.orchestra.run.smithi045.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:47:00.045 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/149 2023-10-08T13:47:00.045 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/149 2023-10-08T13:47:00.045 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:00.047 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:00.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:00.098 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-10-08T13:47:00.317 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:00.321 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:00.321 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:00.322 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:00.322 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:00.695 INFO:teuthology.orchestra.run.smithi045.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:47:00.699 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/150 2023-10-08T13:47:00.699 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/150 2023-10-08T13:47:00.700 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:00.701 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:00.760 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:00.760 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-10-08T13:47:00.983 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:00.987 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:00.987 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:00.988 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:00.989 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:01.362 INFO:teuthology.orchestra.run.smithi045.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:47:01.366 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/151 2023-10-08T13:47:01.366 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/151 2023-10-08T13:47:01.366 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:01.368 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:01.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:01.429 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-10-08T13:47:01.651 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:01.655 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:01.656 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:01.657 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:01.657 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:02.035 INFO:teuthology.orchestra.run.smithi045.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:47:02.039 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/152 2023-10-08T13:47:02.039 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/152 2023-10-08T13:47:02.039 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:02.041 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:02.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:02.088 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-10-08T13:47:02.311 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:02.316 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:02.316 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:02.317 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:02.317 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:02.687 INFO:teuthology.orchestra.run.smithi045.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:47:02.691 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/153 2023-10-08T13:47:02.691 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/153 2023-10-08T13:47:02.691 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:02.693 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:02.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:02.746 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-10-08T13:47:02.970 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:02.974 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:02.974 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:02.975 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:02.975 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:03.355 INFO:teuthology.orchestra.run.smithi045.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:47:03.359 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/154 2023-10-08T13:47:03.359 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/154 2023-10-08T13:47:03.359 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:03.361 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:03.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:03.409 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-10-08T13:47:03.631 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:03.635 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:03.636 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:03.637 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:03.637 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:04.012 INFO:teuthology.orchestra.run.smithi045.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:47:04.016 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/155 2023-10-08T13:47:04.016 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/155 2023-10-08T13:47:04.016 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:04.018 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:04.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:04.073 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-10-08T13:47:04.291 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:04.296 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:04.296 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:04.297 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:04.297 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:04.673 INFO:teuthology.orchestra.run.smithi045.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:47:04.677 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/156 2023-10-08T13:47:04.677 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/156 2023-10-08T13:47:04.677 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:04.679 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:04.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:04.726 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-10-08T13:47:04.949 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:04.953 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:04.954 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:04.955 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:04.955 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:05.345 INFO:teuthology.orchestra.run.smithi045.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:47:05.349 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/157 2023-10-08T13:47:05.349 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/157 2023-10-08T13:47:05.349 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:05.351 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:05.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:05.403 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-10-08T13:47:05.624 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:05.628 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:05.628 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:05.629 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:05.629 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:06.014 INFO:teuthology.orchestra.run.smithi045.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2023-10-08T13:47:06.018 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/158 2023-10-08T13:47:06.018 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/158 2023-10-08T13:47:06.018 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:06.020 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:06.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:06.082 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-10-08T13:47:06.301 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:06.305 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:06.306 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:06.307 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:06.307 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:06.686 INFO:teuthology.orchestra.run.smithi045.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-10-08T13:47:06.690 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/159 2023-10-08T13:47:06.690 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/159 2023-10-08T13:47:06.691 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:06.693 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:06.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:06.731 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-10-08T13:47:06.954 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:06.959 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:06.959 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:06.960 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:06.960 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:07.342 INFO:teuthology.orchestra.run.smithi045.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-10-08T13:47:07.346 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/160 2023-10-08T13:47:07.346 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/160 2023-10-08T13:47:07.346 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:07.348 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:07.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:07.388 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-10-08T13:47:07.606 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:07.610 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:07.610 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:07.611 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:07.611 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:08.186 INFO:teuthology.orchestra.run.smithi045.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:08.190 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/161 2023-10-08T13:47:08.190 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/161 2023-10-08T13:47:08.191 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:08.192 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:08.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:08.230 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-10-08T13:47:08.447 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:08.451 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:08.452 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:08.453 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:08.453 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:08.994 INFO:teuthology.orchestra.run.smithi045.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-10-08T13:47:09.036 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/162 2023-10-08T13:47:09.037 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/162 2023-10-08T13:47:09.037 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:09.038 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:09.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:09.070 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-10-08T13:47:09.288 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:09.293 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:09.293 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:09.294 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:09.294 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:09.856 INFO:teuthology.orchestra.run.smithi045.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-10-08T13:47:09.896 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/163 2023-10-08T13:47:09.897 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/163 2023-10-08T13:47:09.897 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:09.898 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:09.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:09.927 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-10-08T13:47:10.146 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:10.151 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:10.151 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:10.152 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:10.152 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:10.750 INFO:teuthology.orchestra.run.smithi045.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:10.754 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/164 2023-10-08T13:47:10.755 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/164 2023-10-08T13:47:10.755 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:10.757 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:10.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:10.786 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-10-08T13:47:11.010 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:11.014 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:11.015 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:11.016 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:11.016 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:11.599 INFO:teuthology.orchestra.run.smithi045.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:11.603 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/165 2023-10-08T13:47:11.603 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/165 2023-10-08T13:47:11.603 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:11.605 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:11.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:11.648 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-10-08T13:47:11.875 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:11.879 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:11.879 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:11.880 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:11.880 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:12.455 INFO:teuthology.orchestra.run.smithi045.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:12.459 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/166 2023-10-08T13:47:12.459 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/166 2023-10-08T13:47:12.459 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:12.461 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:12.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:12.494 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-10-08T13:47:12.715 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:12.719 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:12.720 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:12.721 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:12.721 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:13.333 INFO:teuthology.orchestra.run.smithi045.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:13.337 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/167 2023-10-08T13:47:13.338 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/167 2023-10-08T13:47:13.338 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:13.341 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:13.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:13.373 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-10-08T13:47:13.595 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:13.599 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:13.599 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:13.600 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:13.600 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:14.201 INFO:teuthology.orchestra.run.smithi045.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:14.205 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/168 2023-10-08T13:47:14.206 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/168 2023-10-08T13:47:14.206 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:14.208 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:14.245 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:14.246 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-10-08T13:47:14.466 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:14.471 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:14.471 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:14.472 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:14.472 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:15.300 INFO:teuthology.orchestra.run.smithi045.stdout:generic/169 1s 2023-10-08T13:47:15.305 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/169 2023-10-08T13:47:15.305 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:15.307 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:15.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:15.315 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-10-08T13:47:15.536 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:15.540 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:15.540 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:15.541 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:15.542 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:16.141 INFO:teuthology.orchestra.run.smithi045.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:16.145 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/170 2023-10-08T13:47:16.145 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/170 2023-10-08T13:47:16.146 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:16.148 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:16.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:16.179 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-10-08T13:47:16.402 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:16.406 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:16.406 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:16.407 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:16.408 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:16.541 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:47:16.543 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:47:17.013 INFO:teuthology.orchestra.run.smithi045.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:17.016 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/171 2023-10-08T13:47:17.016 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/171 2023-10-08T13:47:17.016 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:17.018 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:17.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:17.047 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-10-08T13:47:17.271 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:17.275 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:17.275 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:17.277 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:17.278 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:17.872 INFO:teuthology.orchestra.run.smithi045.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:17.876 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/172 2023-10-08T13:47:17.876 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/172 2023-10-08T13:47:17.876 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:17.878 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:17.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:17.912 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-10-08T13:47:18.133 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:18.137 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:18.137 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:18.138 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:18.138 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:18.722 INFO:teuthology.orchestra.run.smithi045.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:18.726 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/173 2023-10-08T13:47:18.726 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/173 2023-10-08T13:47:18.726 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:18.728 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:18.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:18.761 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-10-08T13:47:18.983 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:18.987 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:18.987 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:18.988 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:18.988 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:19.579 INFO:teuthology.orchestra.run.smithi045.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:19.583 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/174 2023-10-08T13:47:19.583 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/174 2023-10-08T13:47:19.583 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:19.585 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:19.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:19.619 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-10-08T13:47:19.852 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:19.856 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:19.856 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:19.857 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:19.857 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:20.436 INFO:teuthology.orchestra.run.smithi045.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:20.440 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/175 2023-10-08T13:47:20.440 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/175 2023-10-08T13:47:20.440 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:20.442 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:20.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:20.479 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-10-08T13:47:20.698 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:20.705 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:20.706 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:20.706 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:20.706 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:21.304 INFO:teuthology.orchestra.run.smithi045.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:21.308 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/176 2023-10-08T13:47:21.308 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/176 2023-10-08T13:47:21.308 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:21.310 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:21.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:21.346 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-10-08T13:47:21.570 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:21.574 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:21.575 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:21.576 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:21.576 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:22.107 INFO:teuthology.orchestra.run.smithi045.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-08T13:47:22.111 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/177 2023-10-08T13:47:22.111 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/177 2023-10-08T13:47:22.111 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:22.113 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:22.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:22.147 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-10-08T13:47:22.366 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:22.370 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:22.371 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:22.372 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:22.372 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:22.742 INFO:teuthology.orchestra.run.smithi045.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:47:22.746 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/178 2023-10-08T13:47:22.747 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/178 2023-10-08T13:47:22.747 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:22.749 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:22.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:22.797 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-10-08T13:47:23.028 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:23.032 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:23.033 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:23.034 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:23.034 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:23.399 INFO:teuthology.orchestra.run.smithi045.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:47:23.403 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/179 2023-10-08T13:47:23.403 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/179 2023-10-08T13:47:23.403 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:23.405 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:23.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:23.465 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-10-08T13:47:23.684 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:23.688 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:23.689 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:23.690 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:23.690 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:24.069 INFO:teuthology.orchestra.run.smithi045.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:47:24.074 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/180 2023-10-08T13:47:24.074 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/180 2023-10-08T13:47:24.074 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:24.076 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:24.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:24.123 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-10-08T13:47:24.346 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:24.350 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:24.351 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:24.352 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:24.352 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:24.714 INFO:teuthology.orchestra.run.smithi045.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:47:24.718 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/181 2023-10-08T13:47:24.718 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/181 2023-10-08T13:47:24.718 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:24.720 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:24.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:24.770 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-10-08T13:47:24.988 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:24.992 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:24.992 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:24.993 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:24.993 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:25.367 INFO:teuthology.orchestra.run.smithi045.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2023-10-08T13:47:25.371 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/182 2023-10-08T13:47:25.372 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/182 2023-10-08T13:47:25.372 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:25.374 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:25.422 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:25.423 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-10-08T13:47:25.649 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:25.653 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:25.653 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:25.654 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:25.654 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:26.231 INFO:teuthology.orchestra.run.smithi045.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:26.291 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/183 2023-10-08T13:47:26.291 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/183 2023-10-08T13:47:26.291 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:26.291 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:26.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:26.292 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-10-08T13:47:26.515 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:26.519 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:26.520 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:26.521 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:26.521 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:26.912 INFO:teuthology.orchestra.run.smithi045.stdout:generic/184 0s 2023-10-08T13:47:26.918 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/184 2023-10-08T13:47:26.918 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:26.919 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:26.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:26.952 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-10-08T13:47:27.175 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:27.179 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:27.180 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:27.181 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:27.181 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:27.760 INFO:teuthology.orchestra.run.smithi045.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:27.764 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/185 2023-10-08T13:47:27.764 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/185 2023-10-08T13:47:27.764 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:27.766 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:27.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:27.798 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-10-08T13:47:28.016 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:28.020 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:28.020 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:28.021 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:28.022 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:28.613 INFO:teuthology.orchestra.run.smithi045.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:28.617 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/186 2023-10-08T13:47:28.617 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/186 2023-10-08T13:47:28.617 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:28.619 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:28.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:28.649 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-10-08T13:47:28.867 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:28.871 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:28.872 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:28.873 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:28.873 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:29.467 INFO:teuthology.orchestra.run.smithi045.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:29.471 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/187 2023-10-08T13:47:29.471 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/187 2023-10-08T13:47:29.471 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:29.473 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:29.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:29.511 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-10-08T13:47:29.733 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:29.737 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:29.738 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:29.739 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:29.739 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:30.335 INFO:teuthology.orchestra.run.smithi045.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:30.342 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/188 2023-10-08T13:47:30.343 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/188 2023-10-08T13:47:30.343 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:30.344 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:30.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:30.376 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-10-08T13:47:30.594 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:30.599 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:30.599 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:30.600 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:30.600 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:31.199 INFO:teuthology.orchestra.run.smithi045.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:31.203 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/189 2023-10-08T13:47:31.204 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/189 2023-10-08T13:47:31.204 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:31.206 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:31.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:31.244 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-10-08T13:47:31.465 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:31.469 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:31.469 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:31.470 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:31.470 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:32.053 INFO:teuthology.orchestra.run.smithi045.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:32.057 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/190 2023-10-08T13:47:32.057 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/190 2023-10-08T13:47:32.057 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:32.059 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:32.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:32.090 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-10-08T13:47:32.314 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:32.318 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:32.318 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:32.319 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:32.319 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:32.915 INFO:teuthology.orchestra.run.smithi045.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:32.919 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/191 2023-10-08T13:47:32.919 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/191 2023-10-08T13:47:32.919 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:32.921 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:32.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:32.952 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-10-08T13:47:33.178 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:33.182 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:33.182 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:33.183 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:33.183 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:33.534 INFO:teuthology.orchestra.run.smithi045.stdout:generic/192 [not run] atime not maintained by ceph 2023-10-08T13:47:33.538 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/192 2023-10-08T13:47:33.538 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/192 2023-10-08T13:47:33.539 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:33.540 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:33.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:33.571 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-10-08T13:47:33.793 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:33.797 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:33.798 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:33.799 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:33.799 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:34.695 INFO:teuthology.orchestra.run.smithi045.stdout:generic/193 0s 2023-10-08T13:47:34.699 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/193 2023-10-08T13:47:34.700 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:34.702 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:34.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:34.749 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-10-08T13:47:34.972 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:34.976 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:34.976 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:34.978 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:34.978 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:35.572 INFO:teuthology.orchestra.run.smithi045.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:35.576 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/194 2023-10-08T13:47:35.576 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/194 2023-10-08T13:47:35.576 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:35.578 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:35.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:35.610 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-10-08T13:47:35.830 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:35.835 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:35.835 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:35.836 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:35.836 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:36.439 INFO:teuthology.orchestra.run.smithi045.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:36.443 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/195 2023-10-08T13:47:36.443 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/195 2023-10-08T13:47:36.443 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:36.445 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:36.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:36.479 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-10-08T13:47:36.698 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:36.702 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:36.703 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:36.704 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:36.704 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:37.313 INFO:teuthology.orchestra.run.smithi045.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:37.318 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/196 2023-10-08T13:47:37.318 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/196 2023-10-08T13:47:37.318 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:37.320 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:37.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:37.351 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-10-08T13:47:37.571 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:37.575 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:37.575 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:37.576 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:37.577 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:38.158 INFO:teuthology.orchestra.run.smithi045.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:38.162 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/197 2023-10-08T13:47:38.162 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/197 2023-10-08T13:47:38.162 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:38.164 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:38.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:38.200 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-10-08T13:47:38.423 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:38.427 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:38.427 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:38.429 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:38.429 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:39.185 INFO:teuthology.orchestra.run.smithi045.stdout:generic/198 1s 2023-10-08T13:47:39.190 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/198 2023-10-08T13:47:39.190 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:39.192 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:39.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:39.240 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-10-08T13:47:39.457 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:39.461 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:39.462 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:39.463 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:39.463 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:40.057 INFO:teuthology.orchestra.run.smithi045.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:40.062 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/199 2023-10-08T13:47:40.062 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/199 2023-10-08T13:47:40.062 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:40.064 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:40.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:40.116 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-10-08T13:47:40.342 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:40.346 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:40.346 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:40.347 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:40.348 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:40.921 INFO:teuthology.orchestra.run.smithi045.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:40.926 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/200 2023-10-08T13:47:40.926 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/200 2023-10-08T13:47:40.926 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:40.928 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:40.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:40.962 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-10-08T13:47:41.185 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:41.190 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:41.190 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:41.191 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:41.191 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:41.779 INFO:teuthology.orchestra.run.smithi045.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:41.783 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/201 2023-10-08T13:47:41.783 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/201 2023-10-08T13:47:41.783 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:41.785 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:41.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:41.828 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-10-08T13:47:42.056 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:42.060 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:42.060 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:42.061 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:42.062 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:42.644 INFO:teuthology.orchestra.run.smithi045.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:42.647 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/202 2023-10-08T13:47:42.648 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/202 2023-10-08T13:47:42.648 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:42.650 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:42.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:42.690 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-10-08T13:47:42.912 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:42.916 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:42.917 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:42.918 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:42.918 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:43.511 INFO:teuthology.orchestra.run.smithi045.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:43.515 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/203 2023-10-08T13:47:43.516 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/203 2023-10-08T13:47:43.516 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:43.518 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:43.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:43.553 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-10-08T13:47:43.772 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:43.777 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:43.777 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:43.778 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:43.778 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:44.530 INFO:teuthology.orchestra.run.smithi045.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-08T13:47:44.535 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/204 2023-10-08T13:47:44.535 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/204 2023-10-08T13:47:44.535 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:44.538 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:44.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:44.566 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-10-08T13:47:44.798 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:44.802 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:44.802 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:44.803 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:44.804 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:45.384 INFO:teuthology.orchestra.run.smithi045.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:45.388 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/205 2023-10-08T13:47:45.388 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/205 2023-10-08T13:47:45.388 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:45.390 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:45.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:45.416 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-10-08T13:47:45.635 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:45.639 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:45.639 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:45.640 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:45.640 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:46.249 INFO:teuthology.orchestra.run.smithi045.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:47:46.253 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/206 2023-10-08T13:47:46.253 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/206 2023-10-08T13:47:46.253 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:46.255 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:46.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:46.293 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-10-08T13:47:46.513 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:46.517 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:46.517 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:46.518 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:46.518 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:46.740 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:47:46.742 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:47:52.864 INFO:teuthology.orchestra.run.smithi045.stdout:generic/207 6s 2023-10-08T13:47:52.869 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/207 2023-10-08T13:47:52.869 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:47:52.871 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:47:52.908 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:47:52.908 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-10-08T13:47:53.130 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:47:53.134 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:47:53.135 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:47:53.136 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:47:53.136 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:48:16.804 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:48:16.806 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:48:46.930 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:48:46.934 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:49:17.057 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:49:17.059 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:49:47.179 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:49:47.183 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:49:47.248 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-10-08T13:49:47.247+0000 7f3991658700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115907) UID: 0 2023-10-08T13:49:47.248 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-10-08T13:49:47.247+0000 7eff1a006700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115907) UID: 0 2023-10-08T13:49:47.249 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-10-08T13:49:47.247+0000 7f0d20ed4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115907) UID: 0 2023-10-08T13:49:47.249 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T13:49:47.247+0000 7ff165866700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115907) UID: 0 2023-10-08T13:51:13.604 INFO:teuthology.orchestra.run.smithi045.stdout:generic/208 200s 2023-10-08T13:51:13.609 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/208 2023-10-08T13:51:13.609 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:51:13.611 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:51:13.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:51:13.646 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-10-08T13:51:13.867 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:51:13.871 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:51:13.872 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:51:13.873 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:51:13.873 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:51:50.988 INFO:teuthology.orchestra.run.smithi045.stdout:generic/209 36s 2023-10-08T13:51:50.992 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/209 2023-10-08T13:51:50.992 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:51:50.995 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:51:51.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:51:51.038 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-10-08T13:51:51.260 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:51:51.264 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:51:51.264 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:51:51.265 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:51:51.265 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:51:51.719 INFO:teuthology.orchestra.run.smithi045.stdout:generic/210 0s 2023-10-08T13:51:51.729 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/210 2023-10-08T13:51:51.730 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:51:51.731 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:51:51.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:51:51.773 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-10-08T13:51:51.998 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:51:52.002 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:51:52.002 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:51:52.003 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:51:52.003 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:51:52.531 INFO:teuthology.orchestra.run.smithi045.stdout:generic/211 0s 2023-10-08T13:51:52.536 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/211 2023-10-08T13:51:52.536 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:51:52.538 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:51:52.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:51:52.572 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-10-08T13:51:52.792 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:51:52.796 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:51:52.797 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:51:52.798 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:51:52.798 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:51:53.236 INFO:teuthology.orchestra.run.smithi045.stdout:generic/212 0s 2023-10-08T13:51:53.241 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/212 2023-10-08T13:51:53.241 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:51:53.243 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:51:53.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:51:53.277 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-10-08T13:51:53.495 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:51:53.499 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:51:53.500 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:51:53.501 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:51:53.501 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:51:53.852 INFO:teuthology.orchestra.run.smithi045.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T13:51:53.856 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/213 2023-10-08T13:51:53.856 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/213 2023-10-08T13:51:53.856 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:51:53.858 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:51:53.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:51:53.880 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-10-08T13:51:54.105 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:51:54.110 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:51:54.110 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:51:54.111 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:51:54.111 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:51:54.469 INFO:teuthology.orchestra.run.smithi045.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T13:51:54.473 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/214 2023-10-08T13:51:54.473 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/214 2023-10-08T13:51:54.473 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:51:54.475 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:51:54.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:51:54.504 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-10-08T13:51:54.722 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:51:54.726 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:51:54.727 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:51:54.728 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:51:54.728 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:51:57.121 INFO:teuthology.orchestra.run.smithi045.stdout:generic/215 3s 2023-10-08T13:51:57.127 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/215 2023-10-08T13:51:57.127 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:51:57.129 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:51:57.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:51:57.171 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-10-08T13:51:57.394 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:51:57.398 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:51:57.398 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:51:57.399 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:51:57.399 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:51:57.953 INFO:teuthology.orchestra.run.smithi045.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:51:57.957 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/216 2023-10-08T13:51:57.957 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/216 2023-10-08T13:51:57.957 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:51:57.959 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:51:57.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:51:57.988 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-10-08T13:51:58.207 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:51:58.211 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:51:58.211 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:51:58.212 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:51:58.212 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:51:58.778 INFO:teuthology.orchestra.run.smithi045.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:51:58.782 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/217 2023-10-08T13:51:58.782 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/217 2023-10-08T13:51:58.782 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:51:58.784 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:51:58.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:51:58.808 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-10-08T13:51:59.026 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:51:59.030 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:51:59.030 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:51:59.031 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:51:59.031 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:51:59.584 INFO:teuthology.orchestra.run.smithi045.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:51:59.588 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/218 2023-10-08T13:51:59.589 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/218 2023-10-08T13:51:59.589 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:51:59.590 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:51:59.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:51:59.610 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-10-08T13:51:59.833 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:51:59.836 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:51:59.836 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:51:59.837 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:51:59.838 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:00.164 INFO:teuthology.orchestra.run.smithi045.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-08T13:52:00.169 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/219 2023-10-08T13:52:00.170 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/219 2023-10-08T13:52:00.170 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:52:00.170 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:00.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:52:00.201 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-10-08T13:52:00.423 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:52:00.427 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:52:00.428 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:52:00.429 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:52:00.429 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:00.983 INFO:teuthology.orchestra.run.smithi045.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:52:00.987 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/220 2023-10-08T13:52:00.987 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/220 2023-10-08T13:52:00.989 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:52:00.989 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:01.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:52:01.017 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-10-08T13:52:01.235 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:52:01.239 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:52:01.239 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:52:01.240 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:52:01.241 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:02.600 INFO:teuthology.orchestra.run.smithi045.stdout:generic/221 1s 2023-10-08T13:52:02.607 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/221 2023-10-08T13:52:02.607 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:52:02.609 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:02.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:52:02.638 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-10-08T13:52:02.869 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:52:02.873 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:52:02.874 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:52:02.875 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:52:02.875 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:03.422 INFO:teuthology.orchestra.run.smithi045.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:52:03.427 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/222 2023-10-08T13:52:03.427 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/222 2023-10-08T13:52:03.427 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:52:03.429 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:03.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:52:03.459 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-10-08T13:52:03.676 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:52:03.680 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:52:03.681 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:52:03.682 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:52:03.682 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:04.019 INFO:teuthology.orchestra.run.smithi045.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T13:52:04.023 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/223 2023-10-08T13:52:04.023 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/223 2023-10-08T13:52:04.024 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:52:04.026 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:04.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:52:04.062 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-10-08T13:52:04.281 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:52:04.285 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:52:04.286 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:52:04.286 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:52:04.287 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:04.627 INFO:teuthology.orchestra.run.smithi045.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-08T13:52:04.631 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/224 2023-10-08T13:52:04.631 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/224 2023-10-08T13:52:04.631 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:52:04.633 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:04.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:52:04.657 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-10-08T13:52:04.877 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:52:04.879 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:52:04.880 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:52:04.881 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:52:04.881 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:05.274 INFO:teuthology.orchestra.run.smithi045.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-08T13:52:05.278 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/225 2023-10-08T13:52:05.278 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/225 2023-10-08T13:52:05.278 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:52:05.280 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:05.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:52:05.305 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-10-08T13:52:05.523 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:52:05.527 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:52:05.527 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:52:05.528 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:52:05.528 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:05.911 INFO:teuthology.orchestra.run.smithi045.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-08T13:52:05.915 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/226 2023-10-08T13:52:05.915 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/226 2023-10-08T13:52:05.915 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:52:05.917 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:05.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:52:05.943 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-10-08T13:52:06.168 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:52:06.172 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:52:06.172 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:52:06.173 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:52:06.173 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:06.726 INFO:teuthology.orchestra.run.smithi045.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:52:06.730 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/227 2023-10-08T13:52:06.730 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/227 2023-10-08T13:52:06.730 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:52:06.732 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:06.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:52:06.754 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-10-08T13:52:06.972 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:52:06.976 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:52:06.977 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:52:06.978 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:52:06.978 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:07.348 INFO:teuthology.orchestra.run.smithi045.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T13:52:07.352 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/228 2023-10-08T13:52:07.352 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/228 2023-10-08T13:52:07.353 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:52:07.354 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:07.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:52:07.379 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-10-08T13:52:07.601 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:52:07.606 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:52:07.607 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:52:07.607 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:52:07.608 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:08.143 INFO:teuthology.orchestra.run.smithi045.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:52:08.148 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/229 2023-10-08T13:52:08.148 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/229 2023-10-08T13:52:08.148 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:52:08.150 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:08.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:52:08.175 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-10-08T13:52:08.396 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:52:08.400 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:52:08.401 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:52:08.402 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:52:08.402 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:08.736 INFO:teuthology.orchestra.run.smithi045.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-08T13:52:08.740 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/230 2023-10-08T13:52:08.740 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/230 2023-10-08T13:52:08.740 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:52:08.742 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:08.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:52:08.770 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-10-08T13:52:08.989 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:52:08.993 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:52:08.994 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:52:08.995 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:52:08.995 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:09.316 INFO:teuthology.orchestra.run.smithi045.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-08T13:52:09.320 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/231 2023-10-08T13:52:09.320 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/231 2023-10-08T13:52:09.320 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:52:09.322 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:09.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:52:09.349 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-10-08T13:52:09.567 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:52:09.571 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:52:09.571 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:52:09.572 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:52:09.572 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:09.903 INFO:teuthology.orchestra.run.smithi045.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-08T13:52:09.907 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/232 2023-10-08T13:52:09.907 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/232 2023-10-08T13:52:09.908 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:52:09.909 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:09.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:52:09.934 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-10-08T13:52:10.152 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:52:10.156 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:52:10.157 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:52:10.157 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:52:10.158 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:10.477 INFO:teuthology.orchestra.run.smithi045.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-08T13:52:10.481 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/233 2023-10-08T13:52:10.481 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/233 2023-10-08T13:52:10.482 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:52:10.483 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:10.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:52:10.507 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-10-08T13:52:10.726 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:52:10.730 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:52:10.731 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:52:10.732 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:52:10.732 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:11.063 INFO:teuthology.orchestra.run.smithi045.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-08T13:52:11.067 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/234 2023-10-08T13:52:11.067 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/234 2023-10-08T13:52:11.067 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:52:11.069 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:11.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:52:11.104 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-10-08T13:52:11.330 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:52:11.334 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:52:11.335 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:52:11.336 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:52:11.336 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:11.664 INFO:teuthology.orchestra.run.smithi045.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-08T13:52:11.667 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/235 2023-10-08T13:52:11.667 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/235 2023-10-08T13:52:11.667 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:52:11.669 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:11.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:52:11.697 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-10-08T13:52:11.920 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:52:11.924 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:52:11.925 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:52:11.926 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:52:11.926 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:13.335 INFO:teuthology.orchestra.run.smithi045.stdout:generic/236 1s 2023-10-08T13:52:13.341 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/236 2023-10-08T13:52:13.341 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:52:13.343 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:13.370 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:52:13.371 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-10-08T13:52:13.600 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:52:13.604 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:52:13.605 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:52:13.606 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:52:13.606 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:14.031 INFO:teuthology.orchestra.run.smithi045.stdout:generic/237 1s 2023-10-08T13:52:14.036 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/237 2023-10-08T13:52:14.036 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:52:14.038 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:14.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:52:14.070 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-10-08T13:52:14.293 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:52:14.297 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:52:14.298 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:52:14.299 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:52:14.299 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:14.851 INFO:teuthology.orchestra.run.smithi045.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:52:14.855 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/238 2023-10-08T13:52:14.855 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/238 2023-10-08T13:52:14.856 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:52:14.857 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:14.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:52:14.886 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-10-08T13:52:15.107 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:52:15.114 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:52:15.114 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:52:15.114 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:52:15.114 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:52:18.240 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:52:18.301 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:52:48.494 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:52:48.533 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:53:18.784 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:53:18.805 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:53:49.052 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:53:49.059 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:54:13.361 INFO:teuthology.orchestra.run.smithi045.stdout:generic/239 118s 2023-10-08T13:54:13.365 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/239 2023-10-08T13:54:13.366 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:54:13.368 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:54:13.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:54:13.401 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-10-08T13:54:13.630 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:54:13.634 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:54:13.634 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:54:13.635 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:54:13.636 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:54:14.348 INFO:teuthology.orchestra.run.smithi045.stdout:generic/240 1s 2023-10-08T13:54:14.353 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/240 2023-10-08T13:54:14.354 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:54:14.355 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:54:14.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:54:14.388 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-10-08T13:54:14.627 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:54:14.631 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:54:14.632 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:54:14.633 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:54:14.633 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:54:19.143 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:54:19.145 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:54:49.554 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:54:49.568 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:54:49.746 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-10-08T13:54:49.744+0000 7fd76dbb2700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 315118) UID: 0 2023-10-08T13:54:49.746 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-10-08T13:54:49.745+0000 7f00eeb81700 -1 received signal: Hangup from (PID: 315118) UID: 0 2023-10-08T13:55:27.727 INFO:teuthology.orchestra.run.smithi045.stdout:generic/241 73s 2023-10-08T13:55:27.843 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/241 2023-10-08T13:55:27.843 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:55:27.845 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:28.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:55:28.567 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-10-08T13:55:28.790 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:55:28.794 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:55:28.795 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:55:28.796 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:55:28.796 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:29.762 INFO:teuthology.orchestra.run.smithi045.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:55:29.766 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/242 2023-10-08T13:55:29.766 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/242 2023-10-08T13:55:29.766 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:55:29.768 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:29.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:55:29.800 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-10-08T13:55:30.046 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:55:30.050 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:55:30.050 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:55:30.051 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:55:30.051 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:30.646 INFO:teuthology.orchestra.run.smithi045.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:55:30.650 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/243 2023-10-08T13:55:30.651 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/243 2023-10-08T13:55:30.651 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:55:30.653 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:30.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:55:30.684 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-10-08T13:55:30.904 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:55:30.908 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:55:30.908 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:55:30.909 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:55:30.909 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:31.249 INFO:teuthology.orchestra.run.smithi045.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-08T13:55:31.253 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/244 2023-10-08T13:55:31.253 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/244 2023-10-08T13:55:31.253 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:55:31.255 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:31.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:55:31.278 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-10-08T13:55:31.495 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:55:31.499 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:55:31.500 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:55:31.501 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:55:31.501 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:31.916 INFO:teuthology.orchestra.run.smithi045.stdout:generic/245 0s 2023-10-08T13:55:31.988 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/245 2023-10-08T13:55:31.989 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:55:31.990 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:32.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:55:32.035 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-10-08T13:55:32.263 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:55:32.267 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:55:32.267 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:55:32.268 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:55:32.268 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:32.664 INFO:teuthology.orchestra.run.smithi045.stdout:generic/246 0s 2023-10-08T13:55:32.753 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/246 2023-10-08T13:55:32.754 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:55:32.755 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:32.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:55:32.800 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-10-08T13:55:33.026 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:55:33.030 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:55:33.030 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:55:33.031 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:55:33.031 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:43.718 INFO:teuthology.orchestra.run.smithi045.stdout:generic/247 10s 2023-10-08T13:55:43.723 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/247 2023-10-08T13:55:43.723 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:55:43.725 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:43.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:55:43.734 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-10-08T13:55:43.956 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:55:43.960 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:55:43.961 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:55:43.962 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:55:43.962 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:44.346 INFO:teuthology.orchestra.run.smithi045.stdout:generic/248 0s 2023-10-08T13:55:44.373 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/248 2023-10-08T13:55:44.374 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:55:44.375 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:44.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:55:44.421 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-10-08T13:55:44.648 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:55:44.652 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:55:44.652 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:55:44.653 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:55:44.654 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:45.273 INFO:teuthology.orchestra.run.smithi045.stdout:generic/249 1s 2023-10-08T13:55:45.278 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/249 2023-10-08T13:55:45.278 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:55:45.280 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:45.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:55:45.312 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-10-08T13:55:45.533 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:55:45.537 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:55:45.537 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:55:45.538 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:55:45.539 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:45.893 INFO:teuthology.orchestra.run.smithi045.stdout:generic/250 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T13:55:45.897 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/250 2023-10-08T13:55:45.897 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/250 2023-10-08T13:55:45.897 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:55:45.899 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:45.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:55:45.927 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-10-08T13:55:46.187 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:55:46.191 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:55:46.191 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:55:46.192 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:55:46.192 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:46.724 INFO:teuthology.orchestra.run.smithi045.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:55:46.753 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/251 2023-10-08T13:55:46.754 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/251 2023-10-08T13:55:46.754 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:55:46.755 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:46.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:55:46.779 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-10-08T13:55:47.003 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:55:47.006 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:55:47.007 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:55:47.008 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:55:47.008 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:47.338 INFO:teuthology.orchestra.run.smithi045.stdout:generic/252 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T13:55:47.342 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/252 2023-10-08T13:55:47.342 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/252 2023-10-08T13:55:47.342 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:55:47.344 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:47.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:55:47.366 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-10-08T13:55:47.587 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:55:47.591 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:55:47.592 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:55:47.593 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:55:47.593 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:48.176 INFO:teuthology.orchestra.run.smithi045.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:55:48.180 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/253 2023-10-08T13:55:48.180 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/253 2023-10-08T13:55:48.180 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:55:48.182 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:48.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:55:48.210 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-10-08T13:55:48.435 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:55:48.439 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:55:48.440 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:55:48.441 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:55:48.441 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:49.030 INFO:teuthology.orchestra.run.smithi045.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:55:49.034 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/254 2023-10-08T13:55:49.034 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/254 2023-10-08T13:55:49.034 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:55:49.036 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:49.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:55:49.067 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-10-08T13:55:49.289 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:55:49.293 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:55:49.294 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:55:49.295 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:55:49.295 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:49.765 INFO:teuthology.orchestra.run.smithi045.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T13:55:49.768 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/255 2023-10-08T13:55:49.769 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/255 2023-10-08T13:55:49.769 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:55:49.771 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:49.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:55:49.814 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-10-08T13:55:50.035 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:55:50.039 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:55:50.039 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:55:50.040 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:55:50.041 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:50.608 INFO:teuthology.orchestra.run.smithi045.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-08T13:55:50.611 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/256 2023-10-08T13:55:50.612 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/256 2023-10-08T13:55:50.612 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:55:50.613 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:50.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:55:50.653 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-10-08T13:55:50.878 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:55:50.882 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:55:50.883 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:55:50.884 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:55:50.884 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:51.831 INFO:teuthology.orchestra.run.smithi045.stdout:generic/257 0s 2023-10-08T13:55:51.836 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/257 2023-10-08T13:55:51.836 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:55:51.838 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:51.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:55:51.969 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-10-08T13:55:52.339 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:55:52.343 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:55:52.344 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:55:52.345 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:55:52.345 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:52.674 INFO:teuthology.orchestra.run.smithi045.stdout:generic/258 [not run] ceph does not support negative timestamps 2023-10-08T13:55:52.678 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/258 2023-10-08T13:55:52.678 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/258 2023-10-08T13:55:52.679 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:55:52.680 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:52.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:55:52.703 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-10-08T13:55:52.922 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:55:52.927 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:55:52.927 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:55:52.928 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:55:52.928 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:53.519 INFO:teuthology.orchestra.run.smithi045.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:55:53.523 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/259 2023-10-08T13:55:53.523 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/259 2023-10-08T13:55:53.524 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:55:53.526 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:53.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:55:53.559 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-10-08T13:55:53.781 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:55:53.785 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:55:53.785 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:55:53.786 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:55:53.787 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:54.314 INFO:teuthology.orchestra.run.smithi045.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:55:54.334 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/260 2023-10-08T13:55:54.334 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/260 2023-10-08T13:55:54.335 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:55:54.336 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:54.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:55:54.363 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-10-08T13:55:54.600 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:55:54.604 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:55:54.604 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:55:54.605 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:55:54.605 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:55.190 INFO:teuthology.orchestra.run.smithi045.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:55:55.195 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/261 2023-10-08T13:55:55.195 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/261 2023-10-08T13:55:55.195 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:55:55.197 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:55.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:55:55.227 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-10-08T13:55:55.446 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:55:55.450 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:55:55.451 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:55:55.452 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:55:55.452 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:56.067 INFO:teuthology.orchestra.run.smithi045.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:55:56.071 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/262 2023-10-08T13:55:56.072 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/262 2023-10-08T13:55:56.072 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:55:56.074 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:55:56.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:55:56.104 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-10-08T13:55:56.329 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:55:56.333 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:55:56.334 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:55:56.335 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:55:56.335 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:41.269 INFO:teuthology.orchestra.run.smithi045.stdout:generic/263 45s 2023-10-08T13:56:41.299 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/263 2023-10-08T13:56:41.299 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:56:41.301 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:41.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:56:41.335 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-10-08T13:56:41.686 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:56:41.690 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:56:41.691 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:56:41.692 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:56:41.692 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:42.278 INFO:teuthology.orchestra.run.smithi045.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:56:42.282 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/264 2023-10-08T13:56:42.282 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/264 2023-10-08T13:56:42.283 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:56:42.284 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:42.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:56:42.307 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-10-08T13:56:42.528 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:56:42.532 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:56:42.532 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:56:42.533 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:56:42.533 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:43.139 INFO:teuthology.orchestra.run.smithi045.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:56:43.143 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/265 2023-10-08T13:56:43.143 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/265 2023-10-08T13:56:43.144 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:56:43.145 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:43.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:56:43.170 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-10-08T13:56:43.408 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:56:43.412 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:56:43.413 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:56:43.414 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:56:43.414 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:44.002 INFO:teuthology.orchestra.run.smithi045.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:56:44.006 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/266 2023-10-08T13:56:44.006 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/266 2023-10-08T13:56:44.006 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:56:44.008 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:44.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:56:44.038 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-10-08T13:56:44.263 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:56:44.268 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:56:44.268 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:56:44.269 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:56:44.269 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:45.133 INFO:teuthology.orchestra.run.smithi045.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:56:45.135 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/267 2023-10-08T13:56:45.135 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/267 2023-10-08T13:56:45.135 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:56:45.137 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:45.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:56:45.166 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-10-08T13:56:45.394 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:56:45.399 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:56:45.399 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:56:45.400 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:56:45.400 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:46.009 INFO:teuthology.orchestra.run.smithi045.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:56:46.013 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/268 2023-10-08T13:56:46.013 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/268 2023-10-08T13:56:46.013 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:56:46.015 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:46.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:56:46.040 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-10-08T13:56:46.266 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:56:46.271 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:56:46.271 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:56:46.272 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:56:46.272 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:46.608 INFO:teuthology.orchestra.run.smithi045.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-08T13:56:46.628 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/269 2023-10-08T13:56:46.628 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/269 2023-10-08T13:56:46.628 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:56:46.629 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:46.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:56:46.663 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-10-08T13:56:46.881 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:56:46.885 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:56:46.885 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:56:46.886 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:56:46.886 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:47.229 INFO:teuthology.orchestra.run.smithi045.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-08T13:56:47.233 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/270 2023-10-08T13:56:47.233 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/270 2023-10-08T13:56:47.233 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:56:47.235 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:47.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:56:47.264 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-10-08T13:56:47.490 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:56:47.494 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:56:47.494 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:56:47.495 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:56:47.495 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:48.094 INFO:teuthology.orchestra.run.smithi045.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:56:48.098 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/271 2023-10-08T13:56:48.098 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/271 2023-10-08T13:56:48.098 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:56:48.100 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:48.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:56:48.126 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-10-08T13:56:48.351 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:56:48.355 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:56:48.355 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:56:48.356 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:56:48.356 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:48.967 INFO:teuthology.orchestra.run.smithi045.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:56:48.972 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/272 2023-10-08T13:56:48.972 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/272 2023-10-08T13:56:48.972 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:56:48.974 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:49.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:56:49.004 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-10-08T13:56:49.233 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:56:49.237 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:56:49.238 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:56:49.238 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:56:49.238 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:49.585 INFO:teuthology.orchestra.run.smithi045.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-08T13:56:49.589 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/273 2023-10-08T13:56:49.589 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/273 2023-10-08T13:56:49.589 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:56:49.592 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:49.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:56:49.619 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-10-08T13:56:49.842 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:56:49.846 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:56:49.846 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:56:49.847 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:56:49.847 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:50.197 INFO:teuthology.orchestra.run.smithi045.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-10-08T13:56:50.201 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/274 2023-10-08T13:56:50.201 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/274 2023-10-08T13:56:50.201 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:56:50.203 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:50.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:56:50.227 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-10-08T13:56:50.451 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:56:50.456 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:56:50.456 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:56:50.457 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:56:50.457 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:50.784 INFO:teuthology.orchestra.run.smithi045.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-08T13:56:50.788 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/275 2023-10-08T13:56:50.788 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/275 2023-10-08T13:56:50.788 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:56:50.790 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:50.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:56:50.817 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-10-08T13:56:51.041 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:56:51.045 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:56:51.046 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:56:51.047 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:56:51.047 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:51.710 INFO:teuthology.orchestra.run.smithi045.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:56:51.714 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/276 2023-10-08T13:56:51.714 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/276 2023-10-08T13:56:51.714 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:56:51.716 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:51.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:56:51.747 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-10-08T13:56:51.969 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:56:51.973 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:56:51.973 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:56:51.974 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:56:51.975 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:52.384 INFO:teuthology.orchestra.run.smithi045.stdout:generic/277 [not run] file system doesn't support chattr +A 2023-10-08T13:56:52.388 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/277 2023-10-08T13:56:52.388 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/277 2023-10-08T13:56:52.388 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:56:52.390 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:52.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:56:52.425 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-10-08T13:56:52.723 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:56:52.727 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:56:52.728 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:56:52.729 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:56:52.729 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:53.362 INFO:teuthology.orchestra.run.smithi045.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:56:53.366 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/278 2023-10-08T13:56:53.366 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/278 2023-10-08T13:56:53.366 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:56:53.368 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:53.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:56:53.394 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-10-08T13:56:53.625 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:56:53.629 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:56:53.630 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:56:53.631 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:56:53.631 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:54.249 INFO:teuthology.orchestra.run.smithi045.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:56:54.253 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/279 2023-10-08T13:56:54.254 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/279 2023-10-08T13:56:54.254 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:56:54.256 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:54.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:56:54.282 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-10-08T13:56:54.514 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:56:54.518 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:56:54.518 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:56:54.519 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:56:54.519 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:54.948 INFO:teuthology.orchestra.run.smithi045.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-08T13:56:54.952 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/280 2023-10-08T13:56:54.952 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/280 2023-10-08T13:56:54.952 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:56:54.954 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:54.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:56:54.981 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-10-08T13:56:55.202 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:56:55.206 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:56:55.207 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:56:55.208 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:56:55.208 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:55.793 INFO:teuthology.orchestra.run.smithi045.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:56:55.797 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/281 2023-10-08T13:56:55.797 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/281 2023-10-08T13:56:55.798 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:56:55.800 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:55.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:56:55.826 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-10-08T13:56:56.058 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:56:56.062 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:56:56.062 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:56:56.063 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:56:56.064 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:56.652 INFO:teuthology.orchestra.run.smithi045.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:56:56.656 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/282 2023-10-08T13:56:56.656 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/282 2023-10-08T13:56:56.656 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:56:56.658 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:56.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:56:56.692 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-10-08T13:56:56.913 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:56:56.917 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:56:56.917 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:56:56.918 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:56:56.918 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:57.543 INFO:teuthology.orchestra.run.smithi045.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:56:57.547 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/283 2023-10-08T13:56:57.547 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/283 2023-10-08T13:56:57.547 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:56:57.549 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:57.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:56:57.576 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-10-08T13:56:57.796 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:56:57.800 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:56:57.801 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:56:57.802 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:56:57.802 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:58.378 INFO:teuthology.orchestra.run.smithi045.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:56:58.383 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/284 2023-10-08T13:56:58.383 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/284 2023-10-08T13:56:58.383 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:56:58.385 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:56:58.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:56:58.411 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-10-08T13:56:58.643 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:56:58.647 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:56:58.647 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:56:58.648 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:56:58.648 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:00.088 INFO:teuthology.orchestra.run.smithi045.stdout:generic/285 2s 2023-10-08T13:57:00.093 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/285 2023-10-08T13:57:00.093 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:57:00.095 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:00.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:57:00.494 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-10-08T13:57:00.866 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:57:00.871 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:57:00.871 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:57:00.872 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:57:00.873 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:01.340 INFO:teuthology.orchestra.run.smithi045.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T13:57:01.345 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/286 2023-10-08T13:57:01.346 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/286 2023-10-08T13:57:01.346 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:57:01.355 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:01.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:57:01.410 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-10-08T13:57:01.851 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:57:01.861 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:57:01.863 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:57:01.864 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:57:01.864 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:02.834 INFO:teuthology.orchestra.run.smithi045.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:57:02.844 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/287 2023-10-08T13:57:02.844 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/287 2023-10-08T13:57:02.845 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:57:02.854 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:02.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:57:02.903 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-10-08T13:57:03.335 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:57:03.346 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:57:03.347 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:57:03.351 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:57:03.351 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:04.182 INFO:teuthology.orchestra.run.smithi045.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:57:04.211 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/288 2023-10-08T13:57:04.212 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/288 2023-10-08T13:57:04.212 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:57:04.215 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:04.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:57:04.242 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-10-08T13:57:04.693 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:57:04.699 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:57:04.700 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:57:04.701 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:57:04.701 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:05.605 INFO:teuthology.orchestra.run.smithi045.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:57:05.612 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/289 2023-10-08T13:57:05.613 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/289 2023-10-08T13:57:05.613 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:57:05.614 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:05.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:57:05.650 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-10-08T13:57:06.101 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:57:06.116 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:57:06.116 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:57:06.117 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:57:06.117 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:06.776 INFO:teuthology.orchestra.run.smithi045.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:57:06.780 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/290 2023-10-08T13:57:06.780 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/290 2023-10-08T13:57:06.780 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:57:06.782 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:06.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:57:06.805 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-10-08T13:57:07.031 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:57:07.035 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:57:07.036 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:57:07.037 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:57:07.037 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:07.634 INFO:teuthology.orchestra.run.smithi045.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:57:07.638 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/291 2023-10-08T13:57:07.638 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/291 2023-10-08T13:57:07.638 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:57:07.640 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:07.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:57:07.670 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-10-08T13:57:07.892 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:57:07.896 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:57:07.896 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:57:07.897 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:57:07.897 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:08.474 INFO:teuthology.orchestra.run.smithi045.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:57:08.478 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/292 2023-10-08T13:57:08.478 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/292 2023-10-08T13:57:08.478 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:57:08.480 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:08.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:57:08.504 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-10-08T13:57:08.729 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:57:08.733 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:57:08.733 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:57:08.734 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:57:08.735 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:09.313 INFO:teuthology.orchestra.run.smithi045.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:57:09.317 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/293 2023-10-08T13:57:09.317 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/293 2023-10-08T13:57:09.318 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:57:09.319 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:09.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:57:09.348 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-10-08T13:57:09.570 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:57:09.574 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:57:09.575 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:57:09.575 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:57:09.575 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:10.267 INFO:teuthology.orchestra.run.smithi045.stdout:generic/294 1s 2023-10-08T13:57:10.272 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/294 2023-10-08T13:57:10.272 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:57:10.274 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:10.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:57:10.283 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-10-08T13:57:10.507 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:57:10.511 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:57:10.511 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:57:10.512 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:57:10.512 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:11.093 INFO:teuthology.orchestra.run.smithi045.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:57:11.097 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/295 2023-10-08T13:57:11.097 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/295 2023-10-08T13:57:11.097 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:57:11.099 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:11.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:57:11.125 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-10-08T13:57:11.350 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:57:11.354 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:57:11.355 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:57:11.356 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:57:11.356 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:11.940 INFO:teuthology.orchestra.run.smithi045.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:57:11.944 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/296 2023-10-08T13:57:11.944 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/296 2023-10-08T13:57:11.944 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:57:11.946 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:11.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:57:11.987 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-10-08T13:57:12.212 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:57:12.235 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:57:12.235 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:57:12.235 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:57:12.236 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:12.791 INFO:teuthology.orchestra.run.smithi045.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:57:12.795 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/297 2023-10-08T13:57:12.795 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/297 2023-10-08T13:57:12.795 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:57:12.797 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:12.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:57:12.829 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-10-08T13:57:13.051 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:57:13.055 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:57:13.055 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:57:13.056 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:57:13.056 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:13.620 INFO:teuthology.orchestra.run.smithi045.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:57:13.624 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/298 2023-10-08T13:57:13.624 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/298 2023-10-08T13:57:13.624 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:57:13.626 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:13.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:57:13.655 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-10-08T13:57:13.874 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:57:13.878 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:57:13.878 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:57:13.879 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:57:13.879 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:14.294 INFO:teuthology.orchestra.run.smithi045.stdout:generic/299 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T13:57:14.298 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/299 2023-10-08T13:57:14.298 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/299 2023-10-08T13:57:14.298 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:57:14.300 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:14.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:57:14.331 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-10-08T13:57:14.560 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:57:14.563 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:57:14.564 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:57:14.565 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:57:14.566 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:14.968 INFO:teuthology.orchestra.run.smithi045.stdout:generic/300 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T13:57:14.972 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/300 2023-10-08T13:57:14.972 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/300 2023-10-08T13:57:14.972 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:57:14.974 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:15.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:57:15.003 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-10-08T13:57:15.228 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:57:15.232 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:57:15.232 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:57:15.233 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:57:15.233 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:15.809 INFO:teuthology.orchestra.run.smithi045.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:57:15.813 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/301 2023-10-08T13:57:15.813 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/301 2023-10-08T13:57:15.813 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:57:15.815 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:15.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:57:15.843 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-10-08T13:57:16.068 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:57:16.072 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:57:16.072 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:57:16.073 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:57:16.073 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:16.633 INFO:teuthology.orchestra.run.smithi045.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:57:16.637 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/302 2023-10-08T13:57:16.637 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/302 2023-10-08T13:57:16.637 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:57:16.640 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:16.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:57:16.666 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-10-08T13:57:16.890 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:57:16.894 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:57:16.894 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:57:16.896 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:57:16.896 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:17.276 INFO:teuthology.orchestra.run.smithi045.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T13:57:17.280 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/303 2023-10-08T13:57:17.281 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/303 2023-10-08T13:57:17.281 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:57:17.283 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:17.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:57:17.317 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-10-08T13:57:17.539 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:57:17.543 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:57:17.544 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:57:17.545 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:57:17.545 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:17.909 INFO:teuthology.orchestra.run.smithi045.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2023-10-08T13:57:17.914 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/304 2023-10-08T13:57:17.914 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/304 2023-10-08T13:57:17.914 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:57:17.916 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:17.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:57:17.967 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-10-08T13:57:18.195 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:57:18.199 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:57:18.199 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:57:18.200 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:57:18.200 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:18.755 INFO:teuthology.orchestra.run.smithi045.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T13:57:18.759 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/305 2023-10-08T13:57:18.760 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/305 2023-10-08T13:57:18.760 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:57:18.761 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:18.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:57:18.791 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-10-08T13:57:19.014 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:57:19.019 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:57:19.019 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:57:19.020 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:57:19.020 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:19.706 INFO:teuthology.orchestra.run.smithi045.stdout:generic/306 0s 2023-10-08T13:57:19.711 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/306 2023-10-08T13:57:19.711 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:57:19.713 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:19.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:57:19.751 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-10-08T13:57:19.974 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:57:19.978 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:57:19.978 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:57:19.980 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:57:19.980 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:21.824 INFO:teuthology.orchestra.run.smithi045.stdout:generic/307 1s 2023-10-08T13:57:21.829 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/307 2023-10-08T13:57:21.829 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:57:21.831 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:21.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:57:21.840 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-10-08T13:57:22.064 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:57:22.068 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:57:22.068 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:57:22.070 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:57:22.070 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:22.443 INFO:teuthology.orchestra.run.smithi045.stdout:generic/308 0s 2023-10-08T13:57:22.448 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/308 2023-10-08T13:57:22.449 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:57:22.450 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:22.476 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:57:22.476 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-10-08T13:57:22.706 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:57:22.707 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:57:22.708 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:57:22.709 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:57:22.710 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:24.100 INFO:teuthology.orchestra.run.smithi045.stdout:generic/309 2s 2023-10-08T13:57:24.105 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/309 2023-10-08T13:57:24.105 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:57:24.107 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:57:24.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:57:24.142 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-10-08T13:57:24.386 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:57:24.390 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:57:24.391 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:57:24.392 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:57:24.392 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:58:11.551 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:58:11.554 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:58:41.705 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:58:41.708 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:58:42.737 INFO:teuthology.orchestra.run.smithi045.stdout:generic/310 78s 2023-10-08T13:58:42.741 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/310 2023-10-08T13:58:42.741 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:58:42.743 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:58:42.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:58:42.813 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-10-08T13:58:43.039 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:58:43.043 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:58:43.043 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:58:43.044 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:58:43.044 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:58:43.579 INFO:teuthology.orchestra.run.smithi045.stdout:generic/311 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T13:58:43.583 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/311 2023-10-08T13:58:43.583 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/311 2023-10-08T13:58:43.583 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:58:43.584 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:58:43.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:58:43.609 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-10-08T13:58:43.833 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:58:43.837 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:58:43.837 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:58:43.838 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:58:43.838 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:58:44.163 INFO:teuthology.orchestra.run.smithi045.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T13:58:44.168 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/312 2023-10-08T13:58:44.168 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/312 2023-10-08T13:58:44.168 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:58:44.169 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:58:44.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:58:44.194 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-10-08T13:58:44.413 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:58:44.418 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:58:44.418 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:58:44.419 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:58:44.419 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:58:48.804 INFO:teuthology.orchestra.run.smithi045.stdout:generic/313 4s 2023-10-08T13:58:48.810 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/313 2023-10-08T13:58:48.810 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:58:48.812 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:58:48.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:58:48.843 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-10-08T13:58:49.073 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:58:49.077 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:58:49.078 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:58:49.079 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:58:49.079 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:58:49.617 INFO:teuthology.orchestra.run.smithi045.stdout:generic/314 0s 2023-10-08T13:58:49.621 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/314 2023-10-08T13:58:49.621 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:58:49.624 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:58:49.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:58:49.648 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-10-08T13:58:49.872 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:58:49.877 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:58:49.878 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:58:49.878 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:58:49.878 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:58:50.218 INFO:teuthology.orchestra.run.smithi045.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-10-08T13:58:50.222 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/315 2023-10-08T13:58:50.222 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/315 2023-10-08T13:58:50.222 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:58:50.224 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:58:50.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:58:50.258 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-10-08T13:58:50.483 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:58:50.487 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:58:50.488 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:58:50.489 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:58:50.489 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:58:50.933 INFO:teuthology.orchestra.run.smithi045.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-08T13:58:50.937 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/316 2023-10-08T13:58:50.937 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/316 2023-10-08T13:58:50.937 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:58:50.939 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:58:50.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:58:50.967 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-10-08T13:58:51.190 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:58:51.194 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:58:51.195 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:58:51.196 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:58:51.196 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:58:55.196 INFO:teuthology.orchestra.run.smithi045.stdout:generic/317 4s 2023-10-08T13:58:55.201 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/317 2023-10-08T13:58:55.201 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:58:55.203 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:58:55.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:58:55.213 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-10-08T13:58:55.448 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:58:55.453 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:58:55.453 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:58:55.454 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:58:55.454 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:58:56.354 INFO:teuthology.orchestra.run.smithi045.stdout:generic/318 1s 2023-10-08T13:58:56.359 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/318 2023-10-08T13:58:56.359 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:58:56.361 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:58:56.370 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:58:56.370 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-10-08T13:58:56.600 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:58:56.604 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:58:56.604 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:58:56.605 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:58:56.605 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:58:57.245 INFO:teuthology.orchestra.run.smithi045.stdout:generic/319 1s 2023-10-08T13:58:57.250 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/319 2023-10-08T13:58:57.250 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:58:57.252 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:58:57.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:58:57.261 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-10-08T13:58:57.482 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:58:57.487 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:58:57.487 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:58:57.488 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:58:57.488 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:58:57.843 INFO:teuthology.orchestra.run.smithi045.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-08T13:58:57.847 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/320 2023-10-08T13:58:57.847 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/320 2023-10-08T13:58:57.847 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:58:57.849 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:58:57.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:58:57.873 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-10-08T13:58:58.099 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:58:58.102 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:58:58.103 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:58:58.104 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:58:58.104 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:58:58.458 INFO:teuthology.orchestra.run.smithi045.stdout:generic/321 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T13:58:58.462 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/321 2023-10-08T13:58:58.462 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/321 2023-10-08T13:58:58.462 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:58:58.464 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:58:58.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:58:58.487 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-10-08T13:58:58.706 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:58:58.710 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:58:58.711 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:58:58.712 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:58:58.712 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:58:59.057 INFO:teuthology.orchestra.run.smithi045.stdout:generic/322 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T13:58:59.062 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/322 2023-10-08T13:58:59.062 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/322 2023-10-08T13:58:59.063 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T13:58:59.063 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:58:59.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:58:59.094 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-10-08T13:58:59.319 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T13:58:59.323 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T13:58:59.323 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T13:58:59.324 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T13:58:59.324 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T13:59:11.769 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:59:11.772 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:59:41.833 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:59:41.836 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:00:11.980 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:00:11.984 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:00:12.032 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-08T14:00:12.031+0000 7f850b43a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 361805) UID: 0 2023-10-08T14:00:12.033 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T14:00:12.031+0000 7f12925ec700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 361805) UID: 0 2023-10-08T14:00:12.033 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T14:00:12.031+0000 7fae5722b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 361805) UID: 0 2023-10-08T14:00:12.033 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T14:00:12.031+0000 7f485127c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 361805) UID: 0 2023-10-08T14:01:00.244 INFO:teuthology.orchestra.run.smithi045.stdout:generic/323 121s 2023-10-08T14:01:00.314 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/323 2023-10-08T14:01:00.314 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:01:00.316 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:01:00.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:01:00.350 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-10-08T14:01:00.576 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:01:00.580 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:01:00.581 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:01:00.582 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:01:00.582 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:01:00.914 INFO:teuthology.orchestra.run.smithi045.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2023-10-08T14:01:00.918 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/324 2023-10-08T14:01:00.918 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/324 2023-10-08T14:01:00.918 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:01:00.920 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:01:00.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:01:00.946 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-10-08T14:01:01.168 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:01:01.172 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:01:01.172 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:01:01.173 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:01:01.173 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:01:01.540 INFO:teuthology.orchestra.run.smithi045.stdout:generic/325 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T14:01:01.544 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/325 2023-10-08T14:01:01.544 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/325 2023-10-08T14:01:01.544 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:01:01.546 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:01:01.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:01:01.567 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-10-08T14:01:01.800 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:01:01.804 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:01:01.804 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:01:01.805 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:01:01.805 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:01:02.592 INFO:teuthology.orchestra.run.smithi045.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T14:01:02.596 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/326 2023-10-08T14:01:02.597 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/326 2023-10-08T14:01:02.597 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:01:02.598 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:01:02.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:01:02.627 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-10-08T14:01:02.846 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:01:02.851 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:01:02.851 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:01:02.853 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:01:02.853 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:01:03.438 INFO:teuthology.orchestra.run.smithi045.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T14:01:03.443 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/327 2023-10-08T14:01:03.443 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/327 2023-10-08T14:01:03.443 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:01:03.445 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:01:03.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:01:03.471 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-10-08T14:01:03.701 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:01:03.705 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:01:03.705 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:01:03.706 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:01:03.707 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:01:04.291 INFO:teuthology.orchestra.run.smithi045.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T14:01:04.295 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/328 2023-10-08T14:01:04.295 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/328 2023-10-08T14:01:04.295 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:01:04.297 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:01:04.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:01:04.334 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-10-08T14:01:04.561 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:01:04.565 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:01:04.566 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:01:04.567 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:01:04.567 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:01:05.346 INFO:teuthology.orchestra.run.smithi045.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T14:01:05.350 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/329 2023-10-08T14:01:05.350 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/329 2023-10-08T14:01:05.350 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:01:05.353 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:01:05.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:01:05.381 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-10-08T14:01:05.606 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:01:05.609 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:01:05.610 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:01:05.611 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:01:05.611 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:01:06.208 INFO:teuthology.orchestra.run.smithi045.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T14:01:06.212 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/330 2023-10-08T14:01:06.212 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/330 2023-10-08T14:01:06.212 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:01:06.214 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:01:06.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:01:06.241 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-10-08T14:01:06.474 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:01:06.478 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:01:06.479 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:01:06.480 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:01:06.480 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:01:07.094 INFO:teuthology.orchestra.run.smithi045.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T14:01:07.099 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/331 2023-10-08T14:01:07.099 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/331 2023-10-08T14:01:07.099 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:01:07.101 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:01:07.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:01:07.134 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-10-08T14:01:07.369 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:01:07.374 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:01:07.374 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:01:07.375 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:01:07.375 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:01:07.965 INFO:teuthology.orchestra.run.smithi045.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T14:01:07.969 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/332 2023-10-08T14:01:07.970 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/332 2023-10-08T14:01:07.970 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:01:07.971 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:01:07.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:01:07.998 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-10-08T14:01:08.222 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:01:08.225 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:01:08.226 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:01:08.227 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:01:08.227 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:01:08.825 INFO:teuthology.orchestra.run.smithi045.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T14:01:08.828 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/333 2023-10-08T14:01:08.829 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/333 2023-10-08T14:01:08.829 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:01:08.831 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:01:08.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:01:08.856 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-10-08T14:01:09.081 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:01:09.085 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:01:09.085 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:01:09.086 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:01:09.086 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:01:09.990 INFO:teuthology.orchestra.run.smithi045.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T14:01:09.994 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/334 2023-10-08T14:01:09.994 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/334 2023-10-08T14:01:09.994 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:01:09.996 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:01:10.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:01:10.025 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-10-08T14:01:10.248 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:01:10.252 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:01:10.252 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:01:10.253 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:01:10.254 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:01:11.264 INFO:teuthology.orchestra.run.smithi045.stdout:generic/335 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T14:01:11.268 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/335 2023-10-08T14:01:11.268 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/335 2023-10-08T14:01:11.268 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:01:11.270 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:01:11.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:01:11.298 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-10-08T14:01:11.535 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:01:11.539 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:01:11.539 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:01:11.540 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:01:11.541 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:01:12.250 INFO:teuthology.orchestra.run.smithi045.stdout:generic/336 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T14:01:12.254 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/336 2023-10-08T14:01:12.254 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/336 2023-10-08T14:01:12.254 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:01:12.256 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:01:12.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:01:12.301 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-10-08T14:01:12.569 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:01:12.573 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:01:12.574 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:01:12.575 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:01:12.575 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:01:13.309 INFO:teuthology.orchestra.run.smithi045.stdout:generic/337 1s 2023-10-08T14:01:13.491 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/337 2023-10-08T14:01:13.492 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:01:13.493 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:01:13.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:01:13.503 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-10-08T14:01:13.731 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:01:13.735 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:01:13.738 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:01:13.738 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:01:13.738 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:01:14.374 INFO:teuthology.orchestra.run.smithi045.stdout:generic/338 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T14:01:14.378 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/338 2023-10-08T14:01:14.378 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/338 2023-10-08T14:01:14.378 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:01:14.380 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:01:14.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:01:14.408 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-10-08T14:01:14.632 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:01:14.636 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:01:14.637 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:01:14.638 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:01:14.638 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:04.069 INFO:teuthology.orchestra.run.smithi045.stdout:generic/339 50s 2023-10-08T14:02:04.114 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/339 2023-10-08T14:02:04.114 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:04.153 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:04.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:04.208 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-10-08T14:02:04.781 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:04.785 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:04.786 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:04.787 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:04.787 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:08.076 INFO:teuthology.orchestra.run.smithi045.stdout:generic/340 3s 2023-10-08T14:02:08.097 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/340 2023-10-08T14:02:08.097 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:08.118 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:08.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:08.132 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-10-08T14:02:08.626 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:08.640 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:08.641 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:08.642 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:08.642 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:10.197 INFO:teuthology.orchestra.run.smithi045.stdout:generic/341 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T14:02:10.201 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/341 2023-10-08T14:02:10.201 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/341 2023-10-08T14:02:10.202 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:10.204 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:10.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:10.230 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-10-08T14:02:10.456 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:10.460 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:10.460 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:10.461 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:10.461 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:10.821 INFO:teuthology.orchestra.run.smithi045.stdout:generic/342 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T14:02:10.825 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/342 2023-10-08T14:02:10.825 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/342 2023-10-08T14:02:10.825 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:10.827 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:10.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:10.856 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-10-08T14:02:11.100 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:11.104 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:11.104 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:11.105 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:11.105 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:12.594 INFO:teuthology.orchestra.run.smithi045.stdout:generic/343 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T14:02:12.598 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/343 2023-10-08T14:02:12.598 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/343 2023-10-08T14:02:12.598 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:12.600 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:12.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:12.630 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-10-08T14:02:12.871 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:12.875 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:12.876 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:12.877 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:12.877 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:17.841 INFO:teuthology.orchestra.run.smithi045.stdout:generic/344 4s 2023-10-08T14:02:17.846 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/344 2023-10-08T14:02:17.846 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:17.848 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:17.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:17.857 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-10-08T14:02:18.162 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:18.179 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:18.179 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:18.180 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:18.181 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:24.080 INFO:teuthology.orchestra.run.smithi045.stdout:generic/345 6s 2023-10-08T14:02:24.085 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/345 2023-10-08T14:02:24.085 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:24.088 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:24.097 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:24.097 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-10-08T14:02:24.328 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:24.334 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:24.334 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:24.334 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:24.334 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:27.599 INFO:teuthology.orchestra.run.smithi045.stdout:generic/346 3s 2023-10-08T14:02:27.604 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/346 2023-10-08T14:02:27.604 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:27.606 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:27.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:27.615 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-10-08T14:02:27.838 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:27.842 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:27.877 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:27.877 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:27.877 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:28.445 INFO:teuthology.orchestra.run.smithi045.stdout:generic/347 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T14:02:28.461 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/347 2023-10-08T14:02:28.461 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/347 2023-10-08T14:02:28.461 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:28.466 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:28.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:28.524 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-10-08T14:02:28.836 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:28.841 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:28.841 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:28.842 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:28.842 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:29.221 INFO:teuthology.orchestra.run.smithi045.stdout:generic/348 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T14:02:29.225 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/348 2023-10-08T14:02:29.225 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/348 2023-10-08T14:02:29.225 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:29.227 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:29.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:29.256 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-10-08T14:02:29.484 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:29.489 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:29.489 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:29.490 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:29.491 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:29.959 INFO:teuthology.orchestra.run.smithi045.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-08T14:02:29.963 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/349 2023-10-08T14:02:29.963 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/349 2023-10-08T14:02:29.963 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:29.965 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:29.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:29.995 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-10-08T14:02:30.237 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:30.241 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:30.242 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:30.243 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:30.243 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:31.146 INFO:teuthology.orchestra.run.smithi045.stdout:generic/350 1s 2023-10-08T14:02:31.151 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/350 2023-10-08T14:02:31.151 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:31.153 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:31.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:31.162 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-10-08T14:02:31.384 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:31.388 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:31.389 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:31.390 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:31.390 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:31.757 INFO:teuthology.orchestra.run.smithi045.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T14:02:31.761 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/351 2023-10-08T14:02:31.762 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/351 2023-10-08T14:02:31.762 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:31.764 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:31.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:31.800 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-10-08T14:02:32.021 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:32.025 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:32.026 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:32.027 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:32.027 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:32.622 INFO:teuthology.orchestra.run.smithi045.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T14:02:32.626 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/352 2023-10-08T14:02:32.627 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/352 2023-10-08T14:02:32.627 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:32.629 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:32.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:32.656 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-10-08T14:02:32.885 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:32.889 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:32.890 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:32.891 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:32.891 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:33.498 INFO:teuthology.orchestra.run.smithi045.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T14:02:33.502 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/353 2023-10-08T14:02:33.502 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/353 2023-10-08T14:02:33.502 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:33.504 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:33.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:33.527 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-10-08T14:02:33.746 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:33.750 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:33.750 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:33.752 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:33.752 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:38.649 INFO:teuthology.orchestra.run.smithi045.stdout:generic/354 5s 2023-10-08T14:02:38.655 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/354 2023-10-08T14:02:38.655 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:38.656 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:38.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:38.665 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-10-08T14:02:38.888 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:38.892 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:38.893 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:38.894 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:38.894 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:39.952 INFO:teuthology.orchestra.run.smithi045.stdout:generic/355 0s 2023-10-08T14:02:39.960 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/355 2023-10-08T14:02:39.961 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:39.963 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:40.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:40.023 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-10-08T14:02:40.378 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:40.382 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:40.382 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:40.383 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:40.383 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:40.991 INFO:teuthology.orchestra.run.smithi045.stdout:generic/356 [not run] swapfiles are not supported 2023-10-08T14:02:40.995 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/356 2023-10-08T14:02:40.995 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/356 2023-10-08T14:02:40.995 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:40.997 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:41.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:41.032 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-10-08T14:02:41.253 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:41.258 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:41.258 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:41.259 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:41.259 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:41.848 INFO:teuthology.orchestra.run.smithi045.stdout:generic/357 [not run] swapfiles are not supported 2023-10-08T14:02:41.852 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/357 2023-10-08T14:02:41.852 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/357 2023-10-08T14:02:41.852 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:41.854 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:41.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:41.890 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-10-08T14:02:42.114 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:42.118 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:42.118 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:42.119 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:42.119 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:42.709 INFO:teuthology.orchestra.run.smithi045.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T14:02:42.713 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/358 2023-10-08T14:02:42.713 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/358 2023-10-08T14:02:42.713 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:42.715 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:42.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:42.750 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-10-08T14:02:42.972 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:42.976 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:42.976 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:42.978 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:42.978 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:43.563 INFO:teuthology.orchestra.run.smithi045.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T14:02:43.567 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/359 2023-10-08T14:02:43.567 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/359 2023-10-08T14:02:43.567 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:43.569 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:43.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:43.604 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-10-08T14:02:43.827 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:43.831 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:43.831 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:43.833 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:43.833 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:44.238 INFO:teuthology.orchestra.run.smithi045.stdout:generic/360 0s 2023-10-08T14:02:44.246 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/360 2023-10-08T14:02:44.247 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:44.249 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:44.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:44.277 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-10-08T14:02:44.499 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:44.503 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:44.503 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:44.504 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:44.505 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:44.870 INFO:teuthology.orchestra.run.smithi045.stdout:generic/361 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T14:02:44.874 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/361 2023-10-08T14:02:44.874 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/361 2023-10-08T14:02:44.874 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:44.876 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:44.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:44.900 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-10-08T14:02:45.126 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:45.130 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:45.131 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:45.132 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:45.132 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:45.474 INFO:teuthology.orchestra.run.smithi045.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2023-10-08T14:02:45.478 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/362 2023-10-08T14:02:45.478 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/362 2023-10-08T14:02:45.479 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:45.481 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:45.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:45.506 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-10-08T14:02:45.736 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:45.740 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:45.741 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:45.742 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:45.742 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:46.089 INFO:teuthology.orchestra.run.smithi045.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2023-10-08T14:02:46.093 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/363 2023-10-08T14:02:46.093 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/363 2023-10-08T14:02:46.093 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:46.095 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:46.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:46.121 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-10-08T14:02:46.341 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:46.345 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:46.346 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:46.347 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:46.347 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:46.696 INFO:teuthology.orchestra.run.smithi045.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2023-10-08T14:02:46.701 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/364 2023-10-08T14:02:46.701 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/364 2023-10-08T14:02:46.701 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:46.703 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:46.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:46.727 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-10-08T14:02:46.956 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:46.960 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:46.960 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:46.961 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:46.961 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:47.303 INFO:teuthology.orchestra.run.smithi045.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2023-10-08T14:02:47.307 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/365 2023-10-08T14:02:47.307 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/365 2023-10-08T14:02:47.307 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:47.309 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:47.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:47.339 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-10-08T14:02:47.562 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:47.566 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:47.567 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:47.568 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:47.568 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:47.903 INFO:teuthology.orchestra.run.smithi045.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2023-10-08T14:02:47.907 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/366 2023-10-08T14:02:47.907 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/366 2023-10-08T14:02:47.907 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:47.909 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:47.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:47.936 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-10-08T14:02:48.160 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:48.164 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:48.165 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:48.166 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:48.166 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:48.509 INFO:teuthology.orchestra.run.smithi045.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2023-10-08T14:02:48.513 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/367 2023-10-08T14:02:48.513 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/367 2023-10-08T14:02:48.513 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:48.515 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:48.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:48.537 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-10-08T14:02:48.758 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:48.762 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:48.763 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:48.764 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:48.764 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:49.098 INFO:teuthology.orchestra.run.smithi045.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2023-10-08T14:02:49.102 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/368 2023-10-08T14:02:49.102 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/368 2023-10-08T14:02:49.102 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:49.104 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:49.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:49.133 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-10-08T14:02:49.351 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:49.356 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:49.356 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:49.357 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:49.357 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:49.690 INFO:teuthology.orchestra.run.smithi045.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2023-10-08T14:02:49.694 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/369 2023-10-08T14:02:49.694 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/369 2023-10-08T14:02:49.694 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:49.696 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:49.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:49.735 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-10-08T14:02:49.961 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:49.966 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:49.966 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:49.967 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:49.967 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:50.313 INFO:teuthology.orchestra.run.smithi045.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2023-10-08T14:02:50.317 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/370 2023-10-08T14:02:50.317 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/370 2023-10-08T14:02:50.317 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:50.319 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:50.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:50.351 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-10-08T14:02:50.575 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:50.579 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:50.579 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:50.580 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:50.580 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:50.933 INFO:teuthology.orchestra.run.smithi045.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T14:02:50.937 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/371 2023-10-08T14:02:50.937 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/371 2023-10-08T14:02:50.937 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:50.939 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:50.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:50.977 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-10-08T14:02:51.202 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:51.206 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:51.207 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:51.208 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:51.208 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:51.788 INFO:teuthology.orchestra.run.smithi045.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T14:02:51.792 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/372 2023-10-08T14:02:51.792 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/372 2023-10-08T14:02:51.792 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:51.794 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:51.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:51.822 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-10-08T14:02:52.051 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:52.055 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:52.055 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:52.057 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:52.057 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:52.649 INFO:teuthology.orchestra.run.smithi045.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T14:02:52.653 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/373 2023-10-08T14:02:52.653 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/373 2023-10-08T14:02:52.653 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:52.655 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:52.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:52.688 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-10-08T14:02:52.918 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:52.922 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:52.922 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:52.923 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:52.923 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:53.512 INFO:teuthology.orchestra.run.smithi045.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-10-08T14:02:53.545 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/374 2023-10-08T14:02:53.545 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/374 2023-10-08T14:02:53.545 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:53.547 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:53.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:53.580 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-10-08T14:02:53.801 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:53.805 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:53.806 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:53.807 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:53.807 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:54.247 INFO:teuthology.orchestra.run.smithi045.stdout:generic/375 0s 2023-10-08T14:02:54.252 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/375 2023-10-08T14:02:54.252 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:54.254 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:54.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:54.291 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-10-08T14:02:54.514 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:54.518 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:54.518 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:54.519 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:54.520 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:54.877 INFO:teuthology.orchestra.run.smithi045.stdout:generic/376 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T14:02:54.881 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/376 2023-10-08T14:02:54.881 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/376 2023-10-08T14:02:54.881 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:54.883 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:54.908 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:54.908 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-10-08T14:02:55.130 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:55.134 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:55.135 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:55.136 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:55.136 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:55.755 INFO:teuthology.orchestra.run.smithi045.stdout:generic/377 0s 2023-10-08T14:02:55.760 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/377 2023-10-08T14:02:55.760 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:55.762 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:55.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:55.771 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-10-08T14:02:56.000 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:56.004 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:56.005 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:56.006 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:56.006 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:56.491 INFO:teuthology.orchestra.run.smithi045.stdout:generic/378 0s 2023-10-08T14:02:56.496 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/378 2023-10-08T14:02:56.496 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:56.498 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:56.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:56.543 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-10-08T14:02:56.777 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:56.781 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:56.781 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:56.783 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:56.783 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:57.137 INFO:teuthology.orchestra.run.smithi045.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-08T14:02:57.141 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/379 2023-10-08T14:02:57.141 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/379 2023-10-08T14:02:57.141 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:57.143 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:57.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:57.174 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-10-08T14:02:57.395 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:57.399 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:57.400 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:57.401 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:57.401 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:57.731 INFO:teuthology.orchestra.run.smithi045.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-08T14:02:57.736 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/380 2023-10-08T14:02:57.736 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/380 2023-10-08T14:02:57.736 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:57.738 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:57.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:57.773 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-10-08T14:02:58.002 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:58.007 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:58.007 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:58.008 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:58.009 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:58.354 INFO:teuthology.orchestra.run.smithi045.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-08T14:02:58.358 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/381 2023-10-08T14:02:58.358 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/381 2023-10-08T14:02:58.358 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:58.360 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:58.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:58.394 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-10-08T14:02:58.613 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:58.617 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:58.618 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:58.619 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:58.619 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:58.959 INFO:teuthology.orchestra.run.smithi045.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-08T14:02:58.963 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/382 2023-10-08T14:02:58.963 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/382 2023-10-08T14:02:58.963 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:58.965 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:58.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:58.989 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-10-08T14:02:59.210 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:59.214 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:59.215 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:59.216 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:59.216 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:59.556 INFO:teuthology.orchestra.run.smithi045.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-08T14:02:59.560 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/383 2023-10-08T14:02:59.561 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/383 2023-10-08T14:02:59.561 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:02:59.563 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:02:59.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:02:59.591 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-10-08T14:02:59.815 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:02:59.819 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:02:59.820 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:02:59.821 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:02:59.821 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:00.166 INFO:teuthology.orchestra.run.smithi045.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-08T14:03:00.170 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/384 2023-10-08T14:03:00.170 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/384 2023-10-08T14:03:00.170 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:00.172 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:00.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:00.199 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-10-08T14:03:00.420 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:00.424 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:00.424 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:00.425 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:00.426 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:00.757 INFO:teuthology.orchestra.run.smithi045.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-08T14:03:00.761 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/385 2023-10-08T14:03:00.761 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/385 2023-10-08T14:03:00.761 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:00.763 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:00.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:00.789 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-10-08T14:03:01.012 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:01.016 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:01.016 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:01.017 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:01.017 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:01.359 INFO:teuthology.orchestra.run.smithi045.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-08T14:03:01.363 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/386 2023-10-08T14:03:01.363 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/386 2023-10-08T14:03:01.363 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:01.365 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:01.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:01.395 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-10-08T14:03:01.617 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:01.621 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:01.622 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:01.623 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:01.623 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:02.207 INFO:teuthology.orchestra.run.smithi045.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T14:03:02.211 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/387 2023-10-08T14:03:02.211 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/387 2023-10-08T14:03:02.211 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:02.213 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:02.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:02.239 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-10-08T14:03:02.462 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:02.467 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:02.467 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:02.468 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:02.468 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:02.857 INFO:teuthology.orchestra.run.smithi045.stdout:generic/388 [not run] require 172.21.15.45:6789:/scratch to be local device 2023-10-08T14:03:02.861 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/388 2023-10-08T14:03:02.861 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/388 2023-10-08T14:03:02.861 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:02.863 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:02.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:02.895 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-10-08T14:03:03.122 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:03.127 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:03.127 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:03.128 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:03.128 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:03.484 INFO:teuthology.orchestra.run.smithi045.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-10-08T14:03:03.488 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/389 2023-10-08T14:03:03.489 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/389 2023-10-08T14:03:03.489 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:03.490 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:03.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:03.517 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-10-08T14:03:03.738 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:03.743 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:03.743 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:03.744 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:03.744 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:04.105 INFO:teuthology.orchestra.run.smithi045.stdout:generic/390 [not run] ceph does not support freezing 2023-10-08T14:03:04.109 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/390 2023-10-08T14:03:04.109 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/390 2023-10-08T14:03:04.109 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:04.111 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:04.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:04.140 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-10-08T14:03:04.364 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:04.368 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:04.368 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:04.369 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:04.369 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:04.728 INFO:teuthology.orchestra.run.smithi045.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T14:03:04.732 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/391 2023-10-08T14:03:04.732 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/391 2023-10-08T14:03:04.733 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:04.735 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:04.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:04.762 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-10-08T14:03:04.986 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:04.991 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:04.991 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:04.992 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:04.992 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:05.520 INFO:teuthology.orchestra.run.smithi045.stdout:generic/392 [not run] ceph does not support shutdown 2023-10-08T14:03:05.540 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/392 2023-10-08T14:03:05.540 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/392 2023-10-08T14:03:05.540 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:05.542 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:05.553 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:03:05.556 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:03:05.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:05.574 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-10-08T14:03:05.870 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:05.874 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:05.875 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:05.876 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:05.876 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:07.069 INFO:teuthology.orchestra.run.smithi045.stdout:generic/393 1s 2023-10-08T14:03:07.074 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/393 2023-10-08T14:03:07.075 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:07.076 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:07.085 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:07.085 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-10-08T14:03:07.309 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:07.313 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:07.313 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:07.315 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:07.315 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:07.696 INFO:teuthology.orchestra.run.smithi045.stdout:generic/394 0s 2023-10-08T14:03:07.700 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/394 2023-10-08T14:03:07.700 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:07.702 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:07.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:07.739 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-10-08T14:03:07.962 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:07.966 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:07.967 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:07.968 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:07.968 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:08.737 INFO:teuthology.orchestra.run.smithi045.stdout:generic/395 [not run] kernel does not support ceph encryption 2023-10-08T14:03:08.759 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/395 2023-10-08T14:03:08.759 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/395 2023-10-08T14:03:08.759 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:08.767 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:08.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:08.795 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-10-08T14:03:09.147 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:09.151 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:09.152 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:09.153 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:09.153 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:09.918 INFO:teuthology.orchestra.run.smithi045.stdout:generic/396 [not run] kernel does not support ceph encryption 2023-10-08T14:03:09.938 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/396 2023-10-08T14:03:09.938 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/396 2023-10-08T14:03:09.938 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:09.940 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:09.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:09.966 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-10-08T14:03:10.190 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:10.194 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:10.195 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:10.196 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:10.196 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:10.779 INFO:teuthology.orchestra.run.smithi045.stdout:generic/397 [not run] kernel does not support ceph encryption 2023-10-08T14:03:10.798 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/397 2023-10-08T14:03:10.798 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/397 2023-10-08T14:03:10.798 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:10.800 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:10.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:10.831 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-10-08T14:03:11.056 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:11.060 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:11.060 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:11.061 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:11.061 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:11.637 INFO:teuthology.orchestra.run.smithi045.stdout:generic/398 [not run] kernel does not support ceph encryption 2023-10-08T14:03:11.665 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/398 2023-10-08T14:03:11.665 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/398 2023-10-08T14:03:11.665 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:11.667 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:11.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:11.690 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-10-08T14:03:11.910 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:11.914 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:11.915 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:11.916 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:11.916 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:12.499 INFO:teuthology.orchestra.run.smithi045.stdout:generic/399 [not run] kernel does not support ceph encryption 2023-10-08T14:03:12.528 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/399 2023-10-08T14:03:12.528 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/399 2023-10-08T14:03:12.528 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:12.530 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:12.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:12.559 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-10-08T14:03:12.793 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:12.798 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:12.798 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:12.799 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:12.799 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:13.135 INFO:teuthology.orchestra.run.smithi045.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-08T14:03:13.139 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/400 2023-10-08T14:03:13.139 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/400 2023-10-08T14:03:13.139 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:13.141 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:13.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:13.174 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-10-08T14:03:13.394 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:13.398 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:13.399 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:13.400 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:13.400 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:14.039 INFO:teuthology.orchestra.run.smithi045.stdout:generic/401 1s 2023-10-08T14:03:14.044 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/401 2023-10-08T14:03:14.044 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:14.046 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:14.055 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:14.055 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-10-08T14:03:14.281 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:14.285 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:14.286 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:14.287 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:14.287 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:14.834 INFO:teuthology.orchestra.run.smithi045.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2023-10-08T14:03:14.861 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/402 2023-10-08T14:03:14.862 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/402 2023-10-08T14:03:14.862 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:14.863 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:14.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:14.898 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-10-08T14:03:15.137 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:15.140 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:15.140 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:15.142 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:15.142 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:15.884 INFO:teuthology.orchestra.run.smithi045.stdout:generic/403 0s 2023-10-08T14:03:15.889 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/403 2023-10-08T14:03:15.889 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:15.891 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:15.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:15.900 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-10-08T14:03:16.124 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:16.128 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:16.128 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:16.129 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:16.129 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:16.491 INFO:teuthology.orchestra.run.smithi045.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T14:03:16.495 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/404 2023-10-08T14:03:16.495 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/404 2023-10-08T14:03:16.495 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:16.497 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:16.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:16.534 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-10-08T14:03:16.754 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:16.759 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:16.759 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:16.760 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:16.760 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:17.153 INFO:teuthology.orchestra.run.smithi045.stdout:generic/405 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T14:03:17.155 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/405 2023-10-08T14:03:17.156 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/405 2023-10-08T14:03:17.156 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:17.158 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:17.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:17.189 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-10-08T14:03:17.411 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:17.415 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:17.415 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:17.416 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:17.416 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:19.256 INFO:teuthology.orchestra.run.smithi045.stdout:generic/406 2s 2023-10-08T14:03:19.261 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/406 2023-10-08T14:03:19.261 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:19.263 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:19.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:19.272 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-10-08T14:03:19.494 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:19.499 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:19.499 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:19.500 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:19.500 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:19.902 INFO:teuthology.orchestra.run.smithi045.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T14:03:19.906 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/407 2023-10-08T14:03:19.906 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/407 2023-10-08T14:03:19.906 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:19.908 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:19.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:19.952 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-10-08T14:03:20.240 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:20.244 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:20.244 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:20.245 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:20.246 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:20.641 INFO:teuthology.orchestra.run.smithi045.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2023-10-08T14:03:20.644 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/408 2023-10-08T14:03:20.644 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/408 2023-10-08T14:03:20.644 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:20.646 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:20.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:20.694 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-10-08T14:03:20.919 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:20.923 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:20.924 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:20.925 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:20.925 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:21.275 INFO:teuthology.orchestra.run.smithi045.stdout:generic/409 [not run] require 172.21.15.45:6789:/scratch to be local device 2023-10-08T14:03:21.279 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/409 2023-10-08T14:03:21.279 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/409 2023-10-08T14:03:21.279 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:21.281 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:21.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:21.305 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-10-08T14:03:21.527 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:21.532 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:21.532 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:21.533 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:21.533 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:21.884 INFO:teuthology.orchestra.run.smithi045.stdout:generic/410 [not run] require 172.21.15.45:6789:/scratch to be local device 2023-10-08T14:03:21.888 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/410 2023-10-08T14:03:21.888 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/410 2023-10-08T14:03:21.888 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:21.890 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:21.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:21.916 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-10-08T14:03:22.136 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:22.140 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:22.141 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:22.142 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:22.142 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:22.488 INFO:teuthology.orchestra.run.smithi045.stdout:generic/411 [not run] require 172.21.15.45:6789:/scratch to be local device 2023-10-08T14:03:22.492 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/411 2023-10-08T14:03:22.492 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/411 2023-10-08T14:03:22.492 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:22.494 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:22.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:22.521 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-10-08T14:03:22.747 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:22.751 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:22.752 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:22.753 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:22.753 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:23.512 INFO:teuthology.orchestra.run.smithi045.stdout:generic/412 1s 2023-10-08T14:03:23.516 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/412 2023-10-08T14:03:23.516 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:23.518 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:23.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:23.527 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-10-08T14:03:23.751 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:23.755 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:23.755 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:23.756 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:23.757 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:24.259 INFO:teuthology.orchestra.run.smithi045.stdout:generic/413 [not run] mount 172.21.15.45:6789:/scratch with dax failed 2023-10-08T14:03:24.263 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/413 2023-10-08T14:03:24.263 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/413 2023-10-08T14:03:24.263 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:24.265 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:24.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:24.291 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-10-08T14:03:24.515 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:24.519 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:24.519 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:24.520 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:24.521 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:25.099 INFO:teuthology.orchestra.run.smithi045.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T14:03:25.103 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/414 2023-10-08T14:03:25.103 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/414 2023-10-08T14:03:25.103 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:25.105 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:25.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:25.135 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-10-08T14:03:25.358 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:25.363 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:25.363 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:25.364 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:25.364 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:25.960 INFO:teuthology.orchestra.run.smithi045.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T14:03:25.964 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/415 2023-10-08T14:03:25.964 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/415 2023-10-08T14:03:25.964 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:25.966 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:25.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:25.994 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-10-08T14:03:26.224 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:26.228 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:26.229 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:26.230 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:26.230 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:26.575 INFO:teuthology.orchestra.run.smithi045.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-08T14:03:26.581 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/416 2023-10-08T14:03:26.582 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/416 2023-10-08T14:03:26.582 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:26.582 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:26.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:26.605 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-10-08T14:03:26.827 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:26.831 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:26.832 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:26.833 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:26.833 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:27.356 INFO:teuthology.orchestra.run.smithi045.stdout:generic/417 [not run] ceph does not support shutdown 2023-10-08T14:03:27.379 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/417 2023-10-08T14:03:27.379 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/417 2023-10-08T14:03:27.379 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:27.380 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:27.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:27.403 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-10-08T14:03:27.623 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:27.627 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:27.628 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:27.629 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:27.629 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:28.025 INFO:teuthology.orchestra.run.smithi045.stdout:generic/418 [not run] require 172.21.15.45:6789:/test to be valid block disk 2023-10-08T14:03:28.030 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/418 2023-10-08T14:03:28.030 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/418 2023-10-08T14:03:28.030 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:28.032 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:28.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:28.067 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-10-08T14:03:28.294 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:28.299 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:28.299 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:28.300 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:28.300 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:28.873 INFO:teuthology.orchestra.run.smithi045.stdout:generic/419 [not run] kernel does not support ceph encryption 2023-10-08T14:03:28.899 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/419 2023-10-08T14:03:28.900 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/419 2023-10-08T14:03:28.900 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:28.901 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:28.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:28.928 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-10-08T14:03:29.150 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:29.154 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:29.154 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:29.155 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:29.156 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:29.658 INFO:teuthology.orchestra.run.smithi045.stdout:generic/420 0s 2023-10-08T14:03:29.663 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/420 2023-10-08T14:03:29.663 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:29.665 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:29.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:29.711 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-10-08T14:03:29.932 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:29.937 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:29.937 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:29.938 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:29.938 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:30.507 INFO:teuthology.orchestra.run.smithi045.stdout:generic/421 [not run] kernel does not support ceph encryption 2023-10-08T14:03:30.533 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/421 2023-10-08T14:03:30.533 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/421 2023-10-08T14:03:30.533 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:30.535 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:30.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:30.566 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-10-08T14:03:30.789 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:30.793 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:30.793 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:30.794 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:30.794 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:31.168 INFO:teuthology.orchestra.run.smithi045.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-10-08T14:03:31.173 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/422 2023-10-08T14:03:31.173 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/422 2023-10-08T14:03:31.173 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:31.175 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:31.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:31.209 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-10-08T14:03:31.431 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:31.435 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:31.436 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:31.437 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:31.437 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:31.878 INFO:teuthology.orchestra.run.smithi045.stdout:generic/423 0s 2023-10-08T14:03:31.883 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/423 2023-10-08T14:03:31.883 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:31.885 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:31.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:31.932 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-10-08T14:03:32.162 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:32.166 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:32.167 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:32.168 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:32.168 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:32.523 INFO:teuthology.orchestra.run.smithi045.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-10-08T14:03:32.527 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/424 2023-10-08T14:03:32.529 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/424 2023-10-08T14:03:32.529 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:32.530 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:32.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:32.563 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-10-08T14:03:32.791 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:32.795 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:32.795 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:32.796 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:32.796 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:33.202 INFO:teuthology.orchestra.run.smithi045.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2023-10-08T14:03:33.206 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/425 2023-10-08T14:03:33.206 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/425 2023-10-08T14:03:33.206 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:03:33.208 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:33.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:03:33.251 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-10-08T14:03:33.474 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:03:33.478 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:03:33.479 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:03:33.480 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:03:33.480 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:03:35.712 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:03:35.714 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:04:05.817 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:04:05.856 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:04:25.604 INFO:teuthology.orchestra.run.smithi045.stdout:generic/426 52s 2023-10-08T14:04:25.674 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/426 2023-10-08T14:04:25.675 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:04:25.689 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:04:25.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:04:25.791 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-10-08T14:04:26.784 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:04:26.789 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:04:26.789 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:04:26.790 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:04:26.790 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:04:27.251 INFO:teuthology.orchestra.run.smithi045.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-08T14:04:27.255 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/427 2023-10-08T14:04:27.255 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/427 2023-10-08T14:04:27.255 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:04:27.257 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:04:27.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:04:27.282 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-10-08T14:04:27.552 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:04:27.557 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:04:27.557 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:04:27.558 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:04:27.558 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:04:27.930 INFO:teuthology.orchestra.run.smithi045.stdout:generic/428 0s 2023-10-08T14:04:27.943 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/428 2023-10-08T14:04:27.943 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:04:27.945 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:04:27.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:04:27.973 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-10-08T14:04:28.196 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:04:28.200 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:04:28.201 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:04:28.201 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:04:28.202 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:04:28.768 INFO:teuthology.orchestra.run.smithi045.stdout:generic/429 [not run] kernel does not support ceph encryption 2023-10-08T14:04:28.791 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/429 2023-10-08T14:04:28.791 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/429 2023-10-08T14:04:28.791 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:04:28.793 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:04:28.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:04:28.816 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-10-08T14:04:29.034 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:04:29.039 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:04:29.039 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:04:29.040 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:04:29.040 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:04:29.481 INFO:teuthology.orchestra.run.smithi045.stdout:generic/430 0s 2023-10-08T14:04:29.493 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/430 2023-10-08T14:04:29.493 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:04:29.495 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:04:29.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:04:29.536 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-10-08T14:04:29.752 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:04:29.756 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:04:29.757 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:04:29.758 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:04:29.758 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:04:30.166 INFO:teuthology.orchestra.run.smithi045.stdout:generic/431 1s 2023-10-08T14:04:30.170 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/431 2023-10-08T14:04:30.171 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:04:30.173 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:04:30.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:04:30.224 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-10-08T14:04:30.451 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:04:30.455 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:04:30.456 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:04:30.457 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:04:30.457 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:04:30.882 INFO:teuthology.orchestra.run.smithi045.stdout:generic/432 0s 2023-10-08T14:04:30.887 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/432 2023-10-08T14:04:30.887 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:04:30.889 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:04:30.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:04:30.930 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-10-08T14:04:31.152 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:04:31.156 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:04:31.157 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:04:31.158 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:04:31.158 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:04:31.565 INFO:teuthology.orchestra.run.smithi045.stdout:generic/433 0s 2023-10-08T14:04:31.569 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/433 2023-10-08T14:04:31.569 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:04:31.572 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:04:31.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:04:31.615 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-10-08T14:04:31.833 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:04:31.838 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:04:31.838 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:04:31.839 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:04:31.839 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:04:32.272 INFO:teuthology.orchestra.run.smithi045.stdout:generic/434 0s 2023-10-08T14:04:32.276 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/434 2023-10-08T14:04:32.277 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:04:32.279 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:04:32.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:04:32.334 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-10-08T14:04:32.571 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:04:32.576 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:04:32.576 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:04:32.577 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:04:32.577 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:04:33.117 INFO:teuthology.orchestra.run.smithi045.stdout:generic/435 [not run] kernel does not support ceph encryption 2023-10-08T14:04:33.131 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/435 2023-10-08T14:04:33.131 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/435 2023-10-08T14:04:33.131 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:04:33.133 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:04:33.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:04:33.155 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-10-08T14:04:33.377 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:04:33.381 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:04:33.382 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:04:33.383 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:04:33.383 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:04:34.024 INFO:teuthology.orchestra.run.smithi045.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T14:04:34.028 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/436 2023-10-08T14:04:34.028 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/436 2023-10-08T14:04:34.029 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:04:34.030 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:04:34.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:04:34.058 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-10-08T14:04:34.279 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:04:34.283 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:04:34.283 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:04:34.284 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:04:34.285 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:04:35.299 INFO:teuthology.orchestra.run.smithi045.stdout:generic/437 1s 2023-10-08T14:04:35.304 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/437 2023-10-08T14:04:35.304 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:04:35.306 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:04:35.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:04:35.337 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-10-08T14:04:35.559 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:04:35.563 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:04:35.564 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:04:35.565 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:04:35.565 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:04:37.397 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:04:37.400 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:05:07.522 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:05:07.524 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:05:37.575 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:05:37.578 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:05:41.800 INFO:teuthology.orchestra.run.smithi045.stdout:generic/438 66s 2023-10-08T14:05:41.805 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/438 2023-10-08T14:05:41.805 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:05:41.807 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:05:41.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:05:41.839 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-10-08T14:05:42.063 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:05:42.067 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:05:42.067 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:05:42.068 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:05:42.068 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:05:42.918 INFO:teuthology.orchestra.run.smithi045.stdout:generic/439 0s 2023-10-08T14:05:42.923 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/439 2023-10-08T14:05:42.923 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:05:42.925 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:05:42.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:05:42.963 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-10-08T14:05:43.190 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:05:43.195 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:05:43.195 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:05:43.196 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:05:43.196 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:05:43.755 INFO:teuthology.orchestra.run.smithi045.stdout:generic/440 [not run] kernel does not support ceph encryption 2023-10-08T14:05:43.787 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/440 2023-10-08T14:05:43.788 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/440 2023-10-08T14:05:43.788 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:05:43.789 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:05:43.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:05:43.812 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-10-08T14:05:44.038 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:05:44.042 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:05:44.042 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:05:44.043 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:05:44.043 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:05:44.452 INFO:teuthology.orchestra.run.smithi045.stdout:generic/441 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T14:05:44.457 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/441 2023-10-08T14:05:44.457 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/441 2023-10-08T14:05:44.457 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:05:44.459 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:05:44.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:05:44.480 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-10-08T14:05:44.706 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:05:44.710 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:05:44.710 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:05:44.711 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:05:44.711 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:05:45.056 INFO:teuthology.orchestra.run.smithi045.stdout:generic/442 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T14:05:45.060 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/442 2023-10-08T14:05:45.060 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/442 2023-10-08T14:05:45.060 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:05:45.062 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:05:45.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:05:45.086 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-10-08T14:05:45.310 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:05:45.315 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:05:45.315 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:05:45.316 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:05:45.316 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:05:45.690 INFO:teuthology.orchestra.run.smithi045.stdout:generic/443 0s 2023-10-08T14:05:45.695 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/443 2023-10-08T14:05:45.696 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:05:45.698 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:05:45.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:05:45.731 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-10-08T14:05:45.957 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:05:45.962 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:05:45.962 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:05:45.963 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:05:45.963 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:05:46.379 INFO:teuthology.orchestra.run.smithi045.stdout:generic/444 0s 2023-10-08T14:05:46.384 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/444 2023-10-08T14:05:46.385 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:05:46.386 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:05:46.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:05:46.423 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-10-08T14:05:46.654 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:05:46.658 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:05:46.658 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:05:46.659 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:05:46.659 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:05:47.335 INFO:teuthology.orchestra.run.smithi045.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T14:05:47.339 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/445 2023-10-08T14:05:47.339 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/445 2023-10-08T14:05:47.339 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:05:47.341 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:05:47.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:05:47.372 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-10-08T14:05:47.600 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:05:47.604 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:05:47.605 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:05:47.606 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:05:47.606 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:07.113 INFO:teuthology.orchestra.run.smithi045.stdout:generic/446 20s 2023-10-08T14:06:07.118 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/446 2023-10-08T14:06:07.118 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:06:07.120 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:07.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:06:07.129 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-10-08T14:06:07.350 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:06:07.355 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:06:07.355 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:06:07.356 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:06:07.356 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:07.723 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:06:07.726 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:06:07.938 INFO:teuthology.orchestra.run.smithi045.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T14:06:07.942 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/447 2023-10-08T14:06:07.943 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/447 2023-10-08T14:06:07.943 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:06:07.945 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:07.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:06:07.971 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-10-08T14:06:08.196 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:06:08.200 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:06:08.200 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:06:08.201 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:06:08.201 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:09.282 INFO:teuthology.orchestra.run.smithi045.stdout:generic/448 1s 2023-10-08T14:06:09.286 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/448 2023-10-08T14:06:09.287 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:06:09.289 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:09.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:06:09.332 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-10-08T14:06:09.567 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:06:09.571 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:06:09.572 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:06:09.573 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:06:09.573 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:09.939 INFO:teuthology.orchestra.run.smithi045.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-08T14:06:09.943 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/449 2023-10-08T14:06:09.943 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/449 2023-10-08T14:06:09.943 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:06:09.945 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:09.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:06:09.982 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-10-08T14:06:10.211 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:06:10.215 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:06:10.216 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:06:10.216 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:06:10.217 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:11.035 INFO:teuthology.orchestra.run.smithi045.stdout:generic/450 1s 2023-10-08T14:06:11.040 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/450 2023-10-08T14:06:11.040 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:06:11.042 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:11.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:06:11.074 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-10-08T14:06:11.295 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:06:11.299 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:06:11.299 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:06:11.300 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:06:11.300 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:37.838 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:06:37.841 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:06:41.775 INFO:teuthology.orchestra.run.smithi045.stdout:generic/451 30s 2023-10-08T14:06:41.780 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/451 2023-10-08T14:06:41.780 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:06:41.782 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:41.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:06:41.816 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-10-08T14:06:42.051 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:06:42.055 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:06:42.055 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:06:42.057 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:06:42.057 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:42.686 INFO:teuthology.orchestra.run.smithi045.stdout:generic/452 0s 2023-10-08T14:06:42.691 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/452 2023-10-08T14:06:42.691 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:06:42.693 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:42.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:06:42.702 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-10-08T14:06:42.928 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:06:42.932 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:06:42.932 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:06:42.933 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:06:42.933 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:43.279 INFO:teuthology.orchestra.run.smithi045.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2023-10-08T14:06:43.283 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/453 2023-10-08T14:06:43.283 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/453 2023-10-08T14:06:43.283 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:06:43.285 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:43.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:06:43.321 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-10-08T14:06:43.545 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:06:43.549 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:06:43.550 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:06:43.551 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:06:43.551 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:43.911 INFO:teuthology.orchestra.run.smithi045.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2023-10-08T14:06:43.915 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/454 2023-10-08T14:06:43.915 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/454 2023-10-08T14:06:43.915 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:06:43.917 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:43.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:06:43.959 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-10-08T14:06:44.181 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:06:44.185 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:06:44.186 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:06:44.187 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:06:44.187 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:44.606 INFO:teuthology.orchestra.run.smithi045.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2023-10-08T14:06:44.610 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/455 2023-10-08T14:06:44.610 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/455 2023-10-08T14:06:44.610 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:06:44.612 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:44.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:06:44.642 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-10-08T14:06:44.869 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:06:44.873 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:06:44.873 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:06:44.874 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:06:44.874 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:45.246 INFO:teuthology.orchestra.run.smithi045.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T14:06:45.251 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/456 2023-10-08T14:06:45.251 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/456 2023-10-08T14:06:45.251 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:06:45.253 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:45.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:06:45.284 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-10-08T14:06:45.508 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:06:45.512 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:06:45.513 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:06:45.514 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:06:45.514 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:46.153 INFO:teuthology.orchestra.run.smithi045.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T14:06:46.157 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/457 2023-10-08T14:06:46.157 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/457 2023-10-08T14:06:46.157 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:06:46.159 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:46.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:06:46.195 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-10-08T14:06:46.424 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:06:46.428 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:06:46.428 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:06:46.429 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:06:46.429 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:46.996 INFO:teuthology.orchestra.run.smithi045.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T14:06:47.000 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/458 2023-10-08T14:06:47.000 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/458 2023-10-08T14:06:47.000 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:06:47.002 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:47.030 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:06:47.030 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-10-08T14:06:47.251 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:06:47.255 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:06:47.255 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:06:47.256 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:06:47.256 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:47.833 INFO:teuthology.orchestra.run.smithi045.stdout:generic/459 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T14:06:47.837 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/459 2023-10-08T14:06:47.837 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/459 2023-10-08T14:06:47.837 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:06:47.839 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:47.874 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:06:47.874 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-10-08T14:06:48.099 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:06:48.103 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:06:48.103 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:06:48.104 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:06:48.104 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:50.078 INFO:teuthology.orchestra.run.smithi045.stdout:generic/460 2s 2023-10-08T14:06:50.083 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/460 2023-10-08T14:06:50.083 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:06:50.085 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:50.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:06:50.094 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-10-08T14:06:50.329 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:06:50.332 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:06:50.333 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:06:50.334 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:06:50.334 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:51.069 INFO:teuthology.orchestra.run.smithi045.stdout:generic/461 [not run] ceph does not support shutdown 2023-10-08T14:06:51.073 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/461 2023-10-08T14:06:51.073 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/461 2023-10-08T14:06:51.073 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:06:51.075 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:51.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:06:51.104 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-10-08T14:06:51.324 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:06:51.328 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:06:51.329 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:06:51.329 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:06:51.330 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:51.809 INFO:teuthology.orchestra.run.smithi045.stdout:generic/462 [not run] mount 172.21.15.45:6789:/scratch with dax failed 2023-10-08T14:06:51.813 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/462 2023-10-08T14:06:51.813 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/462 2023-10-08T14:06:51.813 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:06:51.815 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:51.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:06:51.844 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-10-08T14:06:52.073 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:06:52.077 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:06:52.077 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:06:52.078 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:06:52.079 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:52.471 INFO:teuthology.orchestra.run.smithi045.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T14:06:52.475 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/463 2023-10-08T14:06:52.475 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/463 2023-10-08T14:06:52.475 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:06:52.477 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:06:52.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:06:52.519 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-10-08T14:06:52.746 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:06:52.750 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:06:52.750 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:06:52.751 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:06:52.752 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:07:07.977 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:07:08.003 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:07:38.174 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:07:38.177 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:07:49.790 INFO:teuthology.orchestra.run.smithi045.stdout:generic/464 57s 2023-10-08T14:07:49.795 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/464 2023-10-08T14:07:49.795 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:07:49.797 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:07:49.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:07:49.806 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-10-08T14:07:50.027 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:07:50.031 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:07:50.031 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:07:50.032 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:07:50.032 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:07:54.039 INFO:teuthology.orchestra.run.smithi045.stdout:generic/465 4s 2023-10-08T14:07:54.045 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/465 2023-10-08T14:07:54.045 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:07:54.046 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:07:54.055 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:07:54.055 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-10-08T14:07:54.288 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:07:54.293 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:07:54.293 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:07:54.294 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:07:54.294 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:07:54.646 INFO:teuthology.orchestra.run.smithi045.stdout:generic/466 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T14:07:54.650 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/466 2023-10-08T14:07:54.650 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/466 2023-10-08T14:07:54.650 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:07:54.652 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:07:54.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:07:54.684 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-10-08T14:07:54.967 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:07:54.971 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:07:54.971 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:07:54.973 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:07:54.973 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:08:08.233 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:08:08.270 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:08:38.942 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:08:38.973 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:08:55.338 INFO:teuthology.orchestra.run.smithi045.stdout:generic/467 60s 2023-10-08T14:08:55.426 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/467 2023-10-08T14:08:55.426 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:08:55.428 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:08:55.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:08:55.533 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-10-08T14:08:56.645 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:08:56.649 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:08:56.650 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:08:56.651 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:08:56.651 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:08:57.235 INFO:teuthology.orchestra.run.smithi045.stdout:generic/468 [not run] ceph does not support shutdown 2023-10-08T14:08:57.257 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/468 2023-10-08T14:08:57.257 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/468 2023-10-08T14:08:57.257 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:08:57.259 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:08:57.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:08:57.283 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-10-08T14:08:57.515 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:08:57.519 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:08:57.520 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:08:57.521 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:08:57.521 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:08:57.886 INFO:teuthology.orchestra.run.smithi045.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-10-08T14:08:57.890 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/469 2023-10-08T14:08:57.891 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/469 2023-10-08T14:08:57.891 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:08:57.893 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:08:57.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:08:57.936 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-10-08T14:08:58.159 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:08:58.165 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:08:58.165 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:08:58.165 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:08:58.165 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:08:58.542 INFO:teuthology.orchestra.run.smithi045.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2023-10-08T14:08:58.546 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/470 2023-10-08T14:08:58.546 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/470 2023-10-08T14:08:58.546 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:08:58.548 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:08:58.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:08:58.573 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-10-08T14:08:58.798 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:08:58.801 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:08:58.802 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:08:58.803 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:08:58.803 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:09:09.688 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:09:10.153 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:09:38.700 INFO:teuthology.orchestra.run.smithi045.stdout:generic/471 39s 2023-10-08T14:09:38.730 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/471 2023-10-08T14:09:38.730 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:09:38.733 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:09:38.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:09:38.945 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-10-08T14:09:39.718 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:09:39.766 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:09:39.767 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:09:39.767 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:09:39.767 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:09:40.906 INFO:teuthology.orchestra.run.smithi045.stdout:generic/472 [not run] swapfiles are not supported 2023-10-08T14:09:40.910 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/472 2023-10-08T14:09:40.911 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/472 2023-10-08T14:09:40.911 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:09:40.913 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:09:40.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:09:40.942 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-10-08T14:09:41.148 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:09:41.150 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:09:41.177 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:09:41.181 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:09:41.181 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:09:41.182 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:09:41.182 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:09:41.451 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-10-08T14:09:41.450+0000 7fd76dbb2700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 622501) UID: 0 2023-10-08T14:09:41.452 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-10-08T14:09:41.451+0000 7f00eeb81700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 622501) UID: 0 2023-10-08T14:09:41.811 INFO:teuthology.orchestra.run.smithi045.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-08T14:09:41.815 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/473 2023-10-08T14:09:41.815 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/473 2023-10-08T14:09:41.816 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:09:41.818 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:09:41.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:09:41.845 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-10-08T14:09:42.109 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:09:42.113 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:09:42.114 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:09:42.115 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:09:42.115 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:09:42.652 INFO:teuthology.orchestra.run.smithi045.stdout:generic/474 [not run] ceph does not support shutdown 2023-10-08T14:09:42.676 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/474 2023-10-08T14:09:42.676 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/474 2023-10-08T14:09:42.676 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:09:42.678 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:09:42.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:09:42.708 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-10-08T14:09:42.941 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:09:42.945 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:09:42.945 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:09:42.946 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:09:42.946 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:09:43.318 INFO:teuthology.orchestra.run.smithi045.stdout:generic/475 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T14:09:43.322 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/475 2023-10-08T14:09:43.322 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/475 2023-10-08T14:09:43.322 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T14:09:43.324 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:09:43.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T14:09:43.350 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-10-08T14:09:43.573 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T14:09:43.577 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T14:09:43.577 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T14:09:43.578 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T14:09:43.578 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T14:13:57.141 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:13:57.212 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:14:27.928 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:14:27.931 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:14:27.975 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T14:14:27.974+0000 7f485127c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 624637) UID: 0 2023-10-08T14:14:28.002 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T14:14:27.975+0000 7f12925ec700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 624637) UID: 0 2023-10-08T14:14:28.003 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-08T14:14:27.974+0000 7f850b43a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 624637) UID: 0 2023-10-08T14:14:28.003 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T14:14:27.975+0000 7fae5722b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 624637) UID: 0 2023-10-08T14:18:20.997 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:18:21.001 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:18:51.828 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:18:51.831 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:19:22.072 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:19:22.085 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:19:52.630 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:19:52.641 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:20:22.851 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:20:22.858 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:20:52.963 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:20:52.966 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:21:23.055 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:21:23.079 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:21:54.013 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:21:54.098 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:22:24.457 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:22:24.460 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:22:54.674 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:22:54.679 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:23:25.019 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:23:25.043 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:23:55.213 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:23:55.216 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:24:25.405 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:24:25.427 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:24:55.691 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:24:55.697 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:25:25.781 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:25:25.800 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:25:25.906 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-10-08T14:25:25.905+0000 7f0d20ed4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119603) UID: 0 2023-10-08T14:25:25.907 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-10-08T14:25:25.907+0000 7eff1a006700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119603) UID: 0 2023-10-08T14:25:25.910 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-10-08T14:25:25.910+0000 7f3991658700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119603) UID: 0 2023-10-08T14:25:25.911 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T14:25:25.910+0000 7ff165866700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119603) UID: 0 2023-10-08T14:29:07.804 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:29:07.817 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:29:08.941 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-10-08T14:29:08.939+0000 7fd76dbb2700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 625215) UID: 0 2023-10-08T14:29:08.942 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-10-08T14:29:08.939+0000 7f00eeb81700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 625215) UID: 0 2023-10-08T14:34:08.913 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:34:08.927 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:34:09.782 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-10-08T14:34:09.781+0000 7eff1a006700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119741) UID: 0 2023-10-08T14:34:09.782 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-10-08T14:34:09.781+0000 7f3991658700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119741) UID: 0 2023-10-08T14:34:09.783 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T14:34:09.781+0000 7ff165866700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119741) UID: 0 2023-10-08T14:34:09.783 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-10-08T14:34:09.782+0000 7f0d20ed4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119741) UID: 0 2023-10-08T14:37:42.143 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:37:42.147 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:37:42.412 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-08T14:37:42.411+0000 7f850b43a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 625355) UID: 0 2023-10-08T14:37:42.507 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T14:37:42.411+0000 7fae5722b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 625355) UID: 0 2023-10-08T14:37:42.508 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T14:37:42.412+0000 7f12925ec700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 625355) UID: 0 2023-10-08T14:37:42.508 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T14:37:42.412+0000 7f485127c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 625355) UID: 0 2023-10-08T14:45:03.223 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:45:03.226 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:45:04.037 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T14:45:04.037+0000 7ff165866700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119917) UID: 0 2023-10-08T14:45:04.038 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-10-08T14:45:04.038+0000 7eff1a006700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119917) UID: 0 2023-10-08T14:45:04.039 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-10-08T14:45:04.039+0000 7f0d20ed4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119917) UID: 0 2023-10-08T14:45:04.040 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-10-08T14:45:04.037+0000 7f3991658700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119917) UID: 0 2023-10-08T14:45:04.278 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-10-08T14:45:04.273+0000 7fd76dbb2700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 625457) UID: 0 2023-10-08T14:45:04.291 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-10-08T14:45:04.290+0000 7f00eeb81700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 625457) UID: 0 2023-10-08T14:51:35.166 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:51:35.169 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:52:05.491 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:52:05.540 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:52:35.997 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:52:36.000 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:53:06.736 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:53:06.782 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:53:37.070 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:53:37.127 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:54:07.256 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:54:07.259 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:54:37.425 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:54:37.428 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:55:07.969 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:55:07.984 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:55:08.162 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T14:55:08.161+0000 7fae5722b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 625763) UID: 0 2023-10-08T14:55:08.163 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T14:55:08.161+0000 7f485127c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 625763) UID: 0 2023-10-08T14:55:08.163 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T14:55:08.161+0000 7f12925ec700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 625763) UID: 0 2023-10-08T14:55:08.167 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-08T14:55:08.161+0000 7f850b43a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 625763) UID: 0 2023-10-08T14:58:39.973 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:58:39.976 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:58:40.236 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-10-08T14:58:40.235+0000 7fd76dbb2700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 625832) UID: 0 2023-10-08T14:58:40.236 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-10-08T14:58:40.235+0000 7f00eeb81700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 625832) UID: 0 2023-10-08T15:03:06.234 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:03:06.262 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:03:36.649 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:03:36.667 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:04:06.802 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:04:06.869 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:04:37.219 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:04:37.222 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:05:07.599 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:05:07.603 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:05:37.833 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:05:37.838 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:06:07.937 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:06:08.010 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:06:38.329 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:06:38.361 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:07:08.869 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:07:08.872 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:07:39.002 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:07:39.004 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:08:09.189 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:08:09.193 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:08:39.949 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:08:39.952 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:09:10.278 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:09:10.897 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:09:41.561 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:09:41.564 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:09:41.641 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-08T15:09:41.640+0000 7f850b43a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 626253) UID: 0 2023-10-08T15:09:41.642 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T15:09:41.641+0000 7fae5722b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 626253) UID: 0 2023-10-08T15:09:41.646 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T15:09:41.641+0000 7f485127c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 626253) UID: 0 2023-10-08T15:09:41.646 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T15:09:41.641+0000 7f12925ec700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 626253) UID: 0 2023-10-08T15:10:34.741 INFO:teuthology.orchestra.run.smithi045.stdout:generic/476 3651s 2023-10-08T15:10:34.800 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/476 2023-10-08T15:10:34.800 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:10:34.810 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:10:34.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:10:34.849 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-10-08T15:10:50.296 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:10:50.651 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:10:50.651 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:10:50.651 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:10:50.651 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:13:02.911 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:13:02.957 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:13:03.911 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-10-08T15:13:03.911+0000 7fd76dbb2700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 626597) UID: 0 2023-10-08T15:13:03.913 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-10-08T15:13:03.910+0000 7f00eeb81700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 626597) UID: 0 2023-10-08T15:18:24.430 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:18:24.439 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:18:24.743 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-10-08T15:18:24.742+0000 7f00eeb81700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 626665) UID: 0 2023-10-08T15:18:24.744 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-10-08T15:18:24.742+0000 7fd76dbb2700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 626665) UID: 0 2023-10-08T15:18:24.811 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-10-08T15:18:24.810+0000 7eff1a006700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120822) UID: 0 2023-10-08T15:18:24.811 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-10-08T15:18:24.811+0000 7f3991658700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120822) UID: 0 2023-10-08T15:18:24.812 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T15:18:24.811+0000 7ff165866700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120822) UID: 0 2023-10-08T15:18:24.813 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-10-08T15:18:24.810+0000 7f0d20ed4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120822) UID: 0 2023-10-08T15:19:38.221 INFO:teuthology.orchestra.run.smithi045.stdout:generic/477 41s 2023-10-08T15:19:38.290 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/477 2023-10-08T15:19:38.290 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:19:38.336 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:19:38.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:19:38.604 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-10-08T15:19:41.792 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:19:41.797 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:19:41.798 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:19:41.799 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:19:41.799 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:19:53.663 INFO:teuthology.orchestra.run.smithi045.stdout:generic/478 11s 2023-10-08T15:19:53.673 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/478 2023-10-08T15:19:53.673 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:19:53.676 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:19:53.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:19:53.738 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-10-08T15:19:54.144 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:19:54.162 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:19:54.163 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:19:54.168 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:19:54.168 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:19:55.016 INFO:teuthology.orchestra.run.smithi045.stdout:generic/479 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T15:19:55.028 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/479 2023-10-08T15:19:55.028 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/479 2023-10-08T15:19:55.029 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:19:55.031 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:19:55.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:19:55.074 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-10-08T15:19:55.566 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:19:55.572 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:19:55.572 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:19:55.574 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:19:55.574 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:19:56.243 INFO:teuthology.orchestra.run.smithi045.stdout:generic/480 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T15:19:56.248 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/480 2023-10-08T15:19:56.248 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/480 2023-10-08T15:19:56.248 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:19:56.251 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:19:56.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:19:56.294 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-10-08T15:19:56.738 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:19:56.743 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:19:56.744 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:19:56.749 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:19:56.749 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:19:57.417 INFO:teuthology.orchestra.run.smithi045.stdout:generic/481 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T15:19:57.424 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/481 2023-10-08T15:19:57.424 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/481 2023-10-08T15:19:57.424 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:19:57.432 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:19:57.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:19:57.466 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-10-08T15:19:57.880 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:19:57.891 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:19:57.891 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:19:57.892 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:19:57.893 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:19:58.676 INFO:teuthology.orchestra.run.smithi045.stdout:generic/482 [not run] This test requires a valid $LOGWRITES_DEV 2023-10-08T15:19:58.681 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/482 2023-10-08T15:19:58.681 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/482 2023-10-08T15:19:58.681 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:19:58.685 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:19:58.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:19:58.729 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-10-08T15:19:59.162 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:19:59.170 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:19:59.171 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:19:59.172 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:19:59.172 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:19:59.774 INFO:teuthology.orchestra.run.smithi045.stdout:generic/483 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T15:19:59.780 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/483 2023-10-08T15:19:59.780 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/483 2023-10-08T15:19:59.780 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:19:59.784 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:19:59.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:19:59.816 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-10-08T15:20:00.296 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:00.300 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:00.300 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:00.302 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:00.302 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:00.927 INFO:teuthology.orchestra.run.smithi045.stdout:generic/484 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T15:20:00.932 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/484 2023-10-08T15:20:00.932 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/484 2023-10-08T15:20:00.932 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:00.936 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:00.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:00.973 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-10-08T15:20:01.402 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:01.410 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:01.410 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:01.411 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:01.411 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:02.060 INFO:teuthology.orchestra.run.smithi045.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-10-08T15:20:02.077 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/485 2023-10-08T15:20:02.078 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/485 2023-10-08T15:20:02.078 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:02.085 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:02.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:02.152 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-10-08T15:20:02.575 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:02.604 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:02.605 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:02.609 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:02.609 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:04.537 INFO:teuthology.orchestra.run.smithi045.stdout:generic/486 1s 2023-10-08T15:20:04.664 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/486 2023-10-08T15:20:04.664 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:04.667 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:04.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:04.679 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-10-08T15:20:05.176 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:05.181 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:05.182 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:05.187 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:05.187 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:06.031 INFO:teuthology.orchestra.run.smithi045.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2023-10-08T15:20:06.040 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/487 2023-10-08T15:20:06.040 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/487 2023-10-08T15:20:06.041 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:06.043 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:06.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:06.087 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-10-08T15:20:06.471 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:06.476 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:06.476 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:06.477 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:06.477 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:07.234 INFO:teuthology.orchestra.run.smithi045.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-08T15:20:07.239 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/488 2023-10-08T15:20:07.239 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/488 2023-10-08T15:20:07.240 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:07.242 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:07.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:07.283 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-10-08T15:20:07.685 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:07.694 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:07.694 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:07.695 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:07.695 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:08.280 INFO:teuthology.orchestra.run.smithi045.stdout:generic/489 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T15:20:08.284 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/489 2023-10-08T15:20:08.285 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/489 2023-10-08T15:20:08.285 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:08.288 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:08.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:08.332 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-10-08T15:20:08.743 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:08.749 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:08.750 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:08.751 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:08.751 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:11.395 INFO:teuthology.orchestra.run.smithi045.stdout:generic/490 2s 2023-10-08T15:20:11.403 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/490 2023-10-08T15:20:11.403 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:11.415 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:11.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:11.523 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-10-08T15:20:11.979 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:11.984 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:11.984 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:11.985 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:11.985 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:12.655 INFO:teuthology.orchestra.run.smithi045.stdout:generic/491 [not run] ceph does not support freezing 2023-10-08T15:20:12.660 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/491 2023-10-08T15:20:12.660 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/491 2023-10-08T15:20:12.660 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:12.663 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:12.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:12.711 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-10-08T15:20:13.207 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:13.221 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:13.221 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:13.222 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:13.222 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:13.863 INFO:teuthology.orchestra.run.smithi045.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2023-10-08T15:20:13.868 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/492 2023-10-08T15:20:13.869 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/492 2023-10-08T15:20:13.869 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:13.875 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:13.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:13.914 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-10-08T15:20:14.390 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:14.397 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:14.398 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:14.399 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:14.399 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:15.530 INFO:teuthology.orchestra.run.smithi045.stdout:generic/493 [not run] swapfiles are not supported 2023-10-08T15:20:15.541 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/493 2023-10-08T15:20:15.541 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/493 2023-10-08T15:20:15.541 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:15.548 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:15.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:15.606 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-10-08T15:20:16.039 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:16.048 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:16.048 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:16.049 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:16.049 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:17.039 INFO:teuthology.orchestra.run.smithi045.stdout:generic/494 [not run] swapfiles are not supported 2023-10-08T15:20:17.047 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/494 2023-10-08T15:20:17.048 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/494 2023-10-08T15:20:17.048 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:17.051 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:17.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:17.080 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-10-08T15:20:17.498 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:17.507 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:17.508 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:17.509 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:17.509 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:18.518 INFO:teuthology.orchestra.run.smithi045.stdout:generic/495 [not run] swapfiles are not supported 2023-10-08T15:20:18.523 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/495 2023-10-08T15:20:18.523 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/495 2023-10-08T15:20:18.523 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:18.525 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:18.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:18.574 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-10-08T15:20:18.981 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:18.987 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:18.987 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:18.988 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:18.989 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:19.959 INFO:teuthology.orchestra.run.smithi045.stdout:generic/496 [not run] swapfiles are not supported 2023-10-08T15:20:19.964 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/496 2023-10-08T15:20:19.964 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/496 2023-10-08T15:20:19.964 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:19.967 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:20.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:20.005 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-10-08T15:20:20.499 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:20.510 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:20.520 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:20.524 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:20.524 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:21.544 INFO:teuthology.orchestra.run.smithi045.stdout:generic/497 [not run] swapfiles are not supported 2023-10-08T15:20:21.548 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/497 2023-10-08T15:20:21.548 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/497 2023-10-08T15:20:21.548 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:21.551 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:21.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:21.591 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-10-08T15:20:22.053 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:22.064 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:22.065 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:22.066 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:22.066 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:22.716 INFO:teuthology.orchestra.run.smithi045.stdout:generic/498 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T15:20:22.722 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/498 2023-10-08T15:20:22.722 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/498 2023-10-08T15:20:22.722 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:22.725 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:22.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:22.772 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-10-08T15:20:23.284 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:23.293 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:23.293 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:23.295 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:23.295 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:23.964 INFO:teuthology.orchestra.run.smithi045.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-10-08T15:20:23.969 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/499 2023-10-08T15:20:23.969 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/499 2023-10-08T15:20:23.969 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:23.977 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:24.031 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:24.031 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-10-08T15:20:24.498 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:24.503 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:24.504 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:24.505 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:24.505 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:25.170 INFO:teuthology.orchestra.run.smithi045.stdout:generic/500 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T15:20:25.174 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/500 2023-10-08T15:20:25.174 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/500 2023-10-08T15:20:25.175 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:25.177 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:25.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:25.219 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-10-08T15:20:25.645 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:25.651 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:25.651 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:25.652 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:25.652 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:26.730 INFO:teuthology.orchestra.run.smithi045.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T15:20:26.736 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/501 2023-10-08T15:20:26.736 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/501 2023-10-08T15:20:26.737 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:26.754 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:26.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:26.797 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-10-08T15:20:27.227 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:27.240 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:27.241 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:27.242 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:27.242 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:27.941 INFO:teuthology.orchestra.run.smithi045.stdout:generic/502 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T15:20:27.946 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/502 2023-10-08T15:20:27.946 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/502 2023-10-08T15:20:27.946 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:27.949 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:28.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:28.005 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-10-08T15:20:28.416 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:28.421 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:28.427 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:28.430 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:28.430 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:29.040 INFO:teuthology.orchestra.run.smithi045.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T15:20:29.045 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/503 2023-10-08T15:20:29.046 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/503 2023-10-08T15:20:29.046 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:29.049 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:29.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:29.120 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-10-08T15:20:29.519 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:29.533 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:29.534 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:29.535 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:29.535 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:30.150 INFO:teuthology.orchestra.run.smithi045.stdout:generic/504 1s 2023-10-08T15:20:30.158 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/504 2023-10-08T15:20:30.158 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:30.161 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:30.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:30.227 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-10-08T15:20:30.636 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:30.641 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:30.643 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:30.645 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:30.645 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:31.498 INFO:teuthology.orchestra.run.smithi045.stdout:generic/505 [not run] ceph does not support shutdown 2023-10-08T15:20:31.533 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/505 2023-10-08T15:20:31.533 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/505 2023-10-08T15:20:31.533 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:31.535 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:31.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:31.571 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-10-08T15:20:32.083 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:32.090 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:32.094 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:32.095 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:32.096 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:32.726 INFO:teuthology.orchestra.run.smithi045.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-08T15:20:32.731 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/506 2023-10-08T15:20:32.731 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/506 2023-10-08T15:20:32.731 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:32.733 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:32.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:32.765 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-10-08T15:20:33.265 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:33.269 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:33.270 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:33.277 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:33.277 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:33.972 INFO:teuthology.orchestra.run.smithi045.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-10-08T15:20:33.981 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/507 2023-10-08T15:20:33.981 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/507 2023-10-08T15:20:33.981 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:33.984 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:34.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:34.054 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-10-08T15:20:34.511 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:34.515 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:34.516 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:34.517 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:34.517 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:35.101 INFO:teuthology.orchestra.run.smithi045.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2023-10-08T15:20:35.105 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/508 2023-10-08T15:20:35.105 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/508 2023-10-08T15:20:35.106 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:35.109 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:35.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:35.145 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-10-08T15:20:35.651 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:35.656 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:35.657 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:35.660 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:35.660 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:36.294 INFO:teuthology.orchestra.run.smithi045.stdout:generic/509 [not run] O_TMPFILE is not supported 2023-10-08T15:20:36.302 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/509 2023-10-08T15:20:36.302 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/509 2023-10-08T15:20:36.302 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:36.304 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:36.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:36.345 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-10-08T15:20:36.755 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:36.763 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:36.763 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:36.765 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:36.765 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:37.379 INFO:teuthology.orchestra.run.smithi045.stdout:generic/510 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T15:20:37.396 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/510 2023-10-08T15:20:37.396 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/510 2023-10-08T15:20:37.396 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:37.400 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:37.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:37.433 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-10-08T15:20:37.798 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:37.804 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:37.805 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:37.806 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:37.806 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:38.434 INFO:teuthology.orchestra.run.smithi045.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-10-08T15:20:38.440 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/511 2023-10-08T15:20:38.440 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/511 2023-10-08T15:20:38.441 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:38.444 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:38.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:38.500 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-10-08T15:20:38.952 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:39.693 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:39.693 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:39.693 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:39.694 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:39.694 INFO:teuthology.orchestra.run.smithi045.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T15:20:39.694 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/512 2023-10-08T15:20:39.694 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/512 2023-10-08T15:20:39.694 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:39.694 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:39.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:39.694 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-10-08T15:20:40.150 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:40.217 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:40.218 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:40.218 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:40.218 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:41.116 INFO:teuthology.orchestra.run.smithi045.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T15:20:41.128 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/513 2023-10-08T15:20:41.128 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/513 2023-10-08T15:20:41.128 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:41.129 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:41.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:41.197 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-10-08T15:20:41.596 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:41.600 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:41.600 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:41.601 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:41.601 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:42.503 INFO:teuthology.orchestra.run.smithi045.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T15:20:42.507 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/514 2023-10-08T15:20:42.507 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/514 2023-10-08T15:20:42.507 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:42.509 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:42.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:42.542 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-10-08T15:20:42.925 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:42.932 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:42.932 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:42.939 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:42.939 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:43.911 INFO:teuthology.orchestra.run.smithi045.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T15:20:43.916 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/515 2023-10-08T15:20:43.916 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/515 2023-10-08T15:20:43.916 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:43.925 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:43.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:43.970 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-10-08T15:20:44.352 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:44.357 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:44.359 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:44.361 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:44.361 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:44.981 INFO:teuthology.orchestra.run.smithi045.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2023-10-08T15:20:44.998 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/516 2023-10-08T15:20:44.998 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/516 2023-10-08T15:20:44.998 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:45.002 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:45.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:45.077 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-10-08T15:20:45.542 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:45.581 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:45.581 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:45.581 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:45.581 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:46.532 INFO:teuthology.orchestra.run.smithi045.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-10-08T15:20:46.618 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/517 2023-10-08T15:20:46.619 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/517 2023-10-08T15:20:46.619 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:46.621 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:46.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:46.661 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-10-08T15:20:47.161 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:47.166 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:47.167 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:47.168 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:47.168 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:48.234 INFO:teuthology.orchestra.run.smithi045.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T15:20:48.244 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/518 2023-10-08T15:20:48.244 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/518 2023-10-08T15:20:48.244 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:48.247 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:48.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:48.289 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-10-08T15:20:48.743 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:48.748 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:48.749 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:48.750 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:48.750 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:49.395 INFO:teuthology.orchestra.run.smithi045.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2023-10-08T15:20:49.405 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/519 2023-10-08T15:20:49.405 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/519 2023-10-08T15:20:49.405 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:49.408 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:49.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:49.479 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-10-08T15:20:49.895 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:49.917 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:49.917 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:49.918 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:49.919 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:50.488 INFO:teuthology.orchestra.run.smithi045.stdout:generic/520 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T15:20:50.494 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/520 2023-10-08T15:20:50.495 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/520 2023-10-08T15:20:50.495 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T15:20:50.498 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:20:50.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T15:20:50.547 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-10-08T15:20:51.042 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T15:20:51.048 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T15:20:51.048 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T15:20:51.049 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T15:20:51.049 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T15:21:07.578 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-08T15:21:07.577+0000 7f850b43a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 649095) UID: 0 2023-10-08T15:21:07.579 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T15:21:07.577+0000 7fae5722b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 649095) UID: 0 2023-10-08T15:21:07.579 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T15:21:07.577+0000 7f485127c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 649095) UID: 0 2023-10-08T15:21:07.580 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T15:21:07.580+0000 7f12925ec700 -1 Fail to open '/proc/649095/cmdline' error = (2) No such file or directory 2023-10-08T15:21:07.580 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T15:21:07.580+0000 7f12925ec700 -1 received signal: Hangup from (PID: 649095) UID: 0 2023-10-08T15:24:21.076 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:24:21.079 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:24:51.460 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:24:51.465 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:24:51.517 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-08T15:24:51.516+0000 7f850b43a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 649175) UID: 0 2023-10-08T15:24:51.517 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T15:24:51.516+0000 7fae5722b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 649175) UID: 0 2023-10-08T15:24:51.519 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T15:24:51.519+0000 7f485127c700 -1 Fail to open '/proc/649175/cmdline' error = (2) No such file or directory 2023-10-08T15:24:51.519 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T15:24:51.519+0000 7f485127c700 -1 received signal: Hangup from (PID: 649175) UID: 0 2023-10-08T15:24:51.520 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T15:24:51.520+0000 7f12925ec700 -1 Fail to open '/proc/649175/cmdline' error = (2) No such file or directory 2023-10-08T15:24:51.520 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T15:24:51.520+0000 7f12925ec700 -1 received signal: Hangup from (PID: 649175) UID: 0 2023-10-08T15:27:52.902 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:27:52.905 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:28:23.049 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:28:23.052 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:28:53.276 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:28:53.279 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:29:23.539 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:29:23.542 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:29:53.976 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:29:53.983 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:30:24.065 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:30:24.069 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:30:54.162 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:30:54.167 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:31:24.253 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:31:24.256 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:31:24.314 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-10-08T15:31:24.314+0000 7eff1a006700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121346) UID: 0 2023-10-08T15:31:24.315 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-10-08T15:31:24.314+0000 7f0d20ed4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121346) UID: 0 2023-10-08T15:31:24.315 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-10-08T15:31:24.314+0000 7f3991658700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121346) UID: 0 2023-10-08T15:31:24.315 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T15:31:24.315+0000 7ff165866700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121346) UID: 0 2023-10-08T15:34:17.521 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:34:17.524 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:34:17.597 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-10-08T15:34:17.597+0000 7f0d20ed4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121396) UID: 0 2023-10-08T15:34:17.598 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-10-08T15:34:17.597+0000 7f3991658700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121396) UID: 0 2023-10-08T15:34:17.598 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-10-08T15:34:17.597+0000 7eff1a006700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121396) UID: 0 2023-10-08T15:34:17.599 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T15:34:17.598+0000 7ff165866700 -1 Fail to open '/proc/121396/cmdline' error = (2) No such file or directory 2023-10-08T15:34:17.599 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T15:34:17.598+0000 7ff165866700 -1 received signal: Hangup from (PID: 121396) UID: 0 2023-10-08T15:37:07.186 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:37:07.190 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:37:37.292 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:37:37.294 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:38:07.374 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:38:07.380 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:38:37.469 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:38:37.472 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:39:07.543 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:39:07.546 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:39:37.642 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:39:37.645 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:39:37.683 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-10-08T15:39:37.682+0000 7f3991658700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121566) UID: 0 2023-10-08T15:39:37.684 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-10-08T15:39:37.682+0000 7eff1a006700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121566) UID: 0 2023-10-08T15:39:37.684 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-10-08T15:39:37.683+0000 7f0d20ed4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121566) UID: 0 2023-10-08T15:39:37.684 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T15:39:37.683+0000 7ff165866700 -1 received signal: Hangup from (PID: 121566) UID: 0 2023-10-08T15:42:28.275 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:42:28.281 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:42:58.375 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:42:58.378 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:43:28.598 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:43:28.601 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:43:58.819 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:43:58.822 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:44:28.892 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:44:28.895 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:44:59.268 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:44:59.272 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:45:29.346 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:45:29.348 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:45:59.727 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:45:59.733 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:46:29.841 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:46:29.850 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:47:00.007 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:47:00.010 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:47:30.168 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:47:30.176 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:48:00.292 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:48:00.295 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:48:30.380 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:48:30.383 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:49:00.503 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:49:00.506 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:49:30.670 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:49:30.672 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:50:01.206 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:50:01.209 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:50:31.308 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:50:31.312 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:50:31.373 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T15:50:31.373+0000 7f12925ec700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 650077) UID: 0 2023-10-08T15:50:31.374 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T15:50:31.374+0000 7f485127c700 -1 received signal: Hangup from (PID: 650077) UID: 0 2023-10-08T15:50:31.394 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-08T15:50:31.374+0000 7f850b43a700 -1 received signal: Hangup from (PID: 650077) UID: 0 2023-10-08T15:50:31.395 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T15:50:31.373+0000 7fae5722b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 650077) UID: 0 2023-10-08T15:53:33.929 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:53:33.932 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:54:04.041 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:54:04.046 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:54:34.364 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:54:34.370 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:55:04.451 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:55:04.453 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:55:34.606 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:55:34.610 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:56:04.676 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:56:04.679 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:56:34.758 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:56:34.761 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:57:04.833 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:57:04.839 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:57:34.933 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:57:34.935 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:58:05.016 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:58:05.019 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:58:35.522 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:58:35.525 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:59:05.623 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:59:05.630 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:59:35.737 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:59:35.740 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:00:05.834 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:00:05.837 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:00:35.999 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:00:36.002 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:01:06.113 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:01:06.117 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:01:36.191 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:01:36.194 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:02:06.309 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:02:06.312 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:02:36.604 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:02:36.608 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:03:06.685 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:03:06.690 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:03:36.774 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:03:36.777 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:04:06.870 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:04:06.875 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:04:36.995 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:04:36.997 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:05:07.154 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:05:07.157 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:05:37.234 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:05:37.238 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:06:07.329 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:06:07.332 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:06:37.705 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:06:37.708 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:07:07.782 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:07:07.785 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:07:37.864 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:07:37.866 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:08:07.953 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:08:07.955 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:08:38.029 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:08:38.032 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:09:08.143 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:09:08.146 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:09:38.249 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:09:38.254 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:10:08.362 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:10:08.366 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:10:38.488 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:10:38.490 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:11:08.593 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:11:08.596 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:11:38.709 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:11:38.712 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:11:38.811 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-10-08T16:11:38.810+0000 7f3991658700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123002) UID: 0 2023-10-08T16:11:38.811 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-10-08T16:11:38.810+0000 7eff1a006700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123002) UID: 0 2023-10-08T16:11:38.811 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-10-08T16:11:38.810+0000 7f0d20ed4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123002) UID: 0 2023-10-08T16:11:38.812 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T16:11:38.811+0000 7ff165866700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123002) UID: 0 2023-10-08T16:14:32.158 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:14:32.161 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:15:02.262 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:15:02.265 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:15:02.318 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-10-08T16:15:02.318+0000 7f3991658700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123081) UID: 0 2023-10-08T16:15:02.320 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-10-08T16:15:02.319+0000 7eff1a006700 -1 Fail to open '/proc/123081/cmdline' error = (2) No such file or directory 2023-10-08T16:15:02.320 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-10-08T16:15:02.319+0000 7eff1a006700 -1 received signal: Hangup from (PID: 123081) UID: 0 2023-10-08T16:15:02.321 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-10-08T16:15:02.319+0000 7f0d20ed4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123081) UID: 0 2023-10-08T16:15:02.321 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T16:15:02.321+0000 7ff165866700 -1 Fail to open '/proc/123081/cmdline' error = (2) No such file or directory 2023-10-08T16:15:02.321 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T16:15:02.321+0000 7ff165866700 -1 received signal: Hangup from (PID: 123081) UID: 0 2023-10-08T16:17:53.965 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:17:53.968 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:17:54.037 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T16:17:54.036+0000 7f12925ec700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 651182) UID: 0 2023-10-08T16:17:54.037 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T16:17:54.036+0000 7f485127c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 651182) UID: 0 2023-10-08T16:17:54.038 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-08T16:17:54.038+0000 7f850b43a700 -1 received signal: Hangup from (PID: 651182) UID: 0 2023-10-08T16:17:54.041 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T16:17:54.036+0000 7fae5722b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 651182) UID: 0 2023-10-08T16:23:25.760 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:23:25.763 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:23:25.844 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T16:23:25.843+0000 7f12925ec700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 651253) UID: 0 2023-10-08T16:23:25.845 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T16:23:25.843+0000 7fae5722b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 651253) UID: 0 2023-10-08T16:23:25.846 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-08T16:23:25.843+0000 7f850b43a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 651253) UID: 0 2023-10-08T16:23:25.848 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T16:23:25.846+0000 7f485127c700 -1 Fail to open '/proc/651253/cmdline' error = (2) No such file or directory 2023-10-08T16:23:25.848 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T16:23:25.846+0000 7f485127c700 -1 received signal: Hangup from (PID: 651253) UID: 0 2023-10-08T16:26:42.223 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:26:42.226 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:26:42.311 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T16:26:42.310+0000 7fae5722b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 651312) UID: 0 2023-10-08T16:26:42.311 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T16:26:42.310+0000 7f485127c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 651312) UID: 0 2023-10-08T16:26:42.311 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-08T16:26:42.310+0000 7f850b43a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 651312) UID: 0 2023-10-08T16:26:42.315 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T16:26:42.313+0000 7f12925ec700 -1 Fail to open '/proc/651312/cmdline' error = (2) No such file or directory 2023-10-08T16:26:42.315 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T16:26:42.313+0000 7f12925ec700 -1 received signal: Hangup from (PID: 651312) UID: 0 2023-10-08T16:29:47.414 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:29:47.417 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:29:47.500 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T16:29:47.498+0000 7ff165866700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123289) UID: 0 2023-10-08T16:29:47.500 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-10-08T16:29:47.498+0000 7f3991658700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123289) UID: 0 2023-10-08T16:29:47.501 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-10-08T16:29:47.499+0000 7f0d20ed4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123289) UID: 0 2023-10-08T16:29:47.501 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-10-08T16:29:47.498+0000 7eff1a006700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123289) UID: 0 2023-10-08T16:32:44.797 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:32:44.800 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:33:15.090 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:33:15.093 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:33:45.158 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:33:45.163 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:34:15.254 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:34:15.257 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:34:45.660 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:34:46.780 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:35:17.147 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:35:17.149 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:35:47.251 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:35:47.253 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:36:17.347 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:36:17.351 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:36:47.433 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:36:47.438 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:37:17.524 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:37:17.528 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:37:17.705 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-10-08T16:37:17.704+0000 7f00eeb81700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 651637) UID: 0 2023-10-08T16:37:17.705 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-10-08T16:37:17.704+0000 7fd76dbb2700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 651637) UID: 0 2023-10-08T16:40:29.770 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:40:29.776 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:40:59.877 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:40:59.881 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:41:29.962 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:41:29.964 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:42:00.035 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:42:00.037 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:42:30.366 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:42:30.368 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:43:00.448 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:43:00.451 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:43:30.586 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:43:30.595 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:44:00.658 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:44:00.661 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:44:30.791 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:44:30.794 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:45:00.889 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:45:00.894 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:45:31.042 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:45:31.045 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:46:01.165 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:46:01.169 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:46:31.253 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:46:31.261 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:47:01.370 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:47:01.372 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:47:31.780 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:47:31.784 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:48:01.857 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:48:01.860 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:48:32.300 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:48:32.303 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:49:02.377 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:49:02.380 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:49:32.499 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:49:32.505 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:50:02.872 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:50:02.880 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:50:32.978 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:50:32.983 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:50:49.491 INFO:teuthology.orchestra.run.smithi045.stdout:generic/521 5398s 2023-10-08T16:50:49.509 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/521 2023-10-08T16:50:49.509 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T16:50:49.521 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T16:50:49.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T16:50:49.583 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-10-08T16:50:50.221 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T16:50:50.227 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T16:50:50.227 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T16:50:50.227 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T16:50:50.227 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T16:51:03.092 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:51:03.095 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:51:33.179 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:51:33.181 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:52:03.267 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:52:03.271 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:52:33.357 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:52:33.361 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:53:03.441 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:53:03.445 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:53:33.517 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:53:33.520 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:54:03.600 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:54:03.605 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:54:03.670 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T16:54:03.669+0000 7f12925ec700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 652873) UID: 0 2023-10-08T16:54:03.670 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T16:54:03.669+0000 7fae5722b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 652873) UID: 0 2023-10-08T16:54:03.671 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T16:54:03.669+0000 7f485127c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 652873) UID: 0 2023-10-08T16:54:03.671 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-08T16:54:03.669+0000 7f850b43a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 652873) UID: 0 2023-10-08T16:57:02.026 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:57:02.029 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:57:32.128 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:57:32.131 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:58:02.200 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:58:02.204 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:58:32.281 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:58:32.283 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:59:02.370 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:59:02.374 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:59:32.720 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:59:32.722 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:00:02.790 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:00:02.792 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:00:32.898 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:00:32.900 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:01:02.977 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:01:02.980 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:01:03.048 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-10-08T17:01:03.047+0000 7f3991658700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124581) UID: 0 2023-10-08T17:01:03.049 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T17:01:03.047+0000 7ff165866700 -1 Fail to open '/proc/124581/cmdline' error = (2) No such file or directory 2023-10-08T17:01:03.050 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T17:01:03.047+0000 7ff165866700 -1 received signal: Hangup from (PID: 124581) UID: 0 2023-10-08T17:01:03.050 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-10-08T17:01:03.047+0000 7f0d20ed4700 -1 Fail to open '/proc/124581/cmdline' error = (2) No such file or directory 2023-10-08T17:01:03.050 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-10-08T17:01:03.047+0000 7f0d20ed4700 -1 received signal: Hangup from (PID: 124581) UID: 0 2023-10-08T17:01:03.051 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-10-08T17:01:03.047+0000 7eff1a006700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124581) UID: 0 2023-10-08T17:03:56.294 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:03:56.303 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:03:56.392 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T17:03:56.391+0000 7fae5722b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 653189) UID: 0 2023-10-08T17:03:56.393 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T17:03:56.392+0000 7f12925ec700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 653189) UID: 0 2023-10-08T17:03:56.394 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-08T17:03:56.391+0000 7f850b43a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 653189) UID: 0 2023-10-08T17:03:56.397 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T17:03:56.396+0000 7f485127c700 -1 Fail to open '/proc/653189/cmdline' error = (2) No such file or directory 2023-10-08T17:03:56.397 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T17:03:56.396+0000 7f485127c700 -1 received signal: Hangup from (PID: 653189) UID: 0 2023-10-08T17:03:56.846 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-10-08T17:03:56.846+0000 7eff1a006700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124631) UID: 0 2023-10-08T17:03:56.847 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-10-08T17:03:56.846+0000 7f0d20ed4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124631) UID: 0 2023-10-08T17:03:56.847 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-10-08T17:03:56.846+0000 7f3991658700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124631) UID: 0 2023-10-08T17:03:56.847 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T17:03:56.846+0000 7ff165866700 -1 Fail to open '/proc/124631/cmdline' error = (2) No such file or directory 2023-10-08T17:03:56.847 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T17:03:56.846+0000 7ff165866700 -1 received signal: Hangup from (PID: 124631) UID: 0 2023-10-08T17:06:53.959 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:06:53.961 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:06:54.014 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-10-08T17:06:54.013+0000 7f3991658700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124683) UID: 0 2023-10-08T17:06:54.014 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-10-08T17:06:54.014+0000 7f0d20ed4700 -1 Fail to open '/proc/124683/cmdline' error = (2) No such file or directory 2023-10-08T17:06:54.014 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-10-08T17:06:54.014+0000 7f0d20ed4700 -1 received signal: Hangup from (PID: 124683) UID: 0 2023-10-08T17:06:54.015 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T17:06:54.014+0000 7ff165866700 -1 Fail to open '/proc/124683/cmdline' error = (2) No such file or directory 2023-10-08T17:06:54.015 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T17:06:54.014+0000 7ff165866700 -1 received signal: Hangup from (PID: 124683) UID: 0 2023-10-08T17:06:54.017 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-10-08T17:06:54.017+0000 7eff1a006700 -1 Fail to open '/proc/124683/cmdline' error = (2) No such file or directory 2023-10-08T17:06:54.017 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-10-08T17:06:54.017+0000 7eff1a006700 -1 received signal: Hangup from (PID: 124683) UID: 0 2023-10-08T17:09:17.372 INFO:teuthology.orchestra.run.smithi078.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.6.log.1: 2023-10-08T17:09:17.372 INFO:teuthology.orchestra.run.smithi078.stderr:gzip: stdin: file size changed while zipping 2023-10-08T17:09:48.784 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:09:48.789 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:10:19.164 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:10:19.167 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:10:49.244 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:10:49.249 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:11:19.333 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:11:19.338 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:11:49.413 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:11:49.416 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:12:19.507 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:12:19.509 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:12:49.578 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:12:49.586 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:13:19.676 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:13:19.684 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:13:49.764 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:13:49.769 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:14:19.852 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:14:19.862 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:14:49.958 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:14:49.962 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:15:20.059 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:15:20.066 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:15:50.148 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:15:50.156 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:16:20.588 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:16:20.590 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:16:50.684 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:16:50.687 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:17:21.013 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:17:21.015 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:17:51.095 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:17:51.159 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:18:21.337 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:18:21.340 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:18:51.407 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:18:51.411 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:19:21.903 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:19:21.905 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:19:52.333 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:19:52.337 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:20:22.448 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:20:22.450 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:20:52.579 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:20:52.636 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:21:22.726 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:21:22.731 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:21:52.813 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:21:52.816 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:22:23.111 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:22:23.116 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:22:23.169 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-10-08T17:22:23.168+0000 7f3991658700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125369) UID: 0 2023-10-08T17:22:23.169 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T17:22:23.168+0000 7ff165866700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125369) UID: 0 2023-10-08T17:22:23.170 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-10-08T17:22:23.168+0000 7eff1a006700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125369) UID: 0 2023-10-08T17:22:23.170 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-10-08T17:22:23.168+0000 7f0d20ed4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125369) UID: 0 2023-10-08T17:25:10.233 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:25:10.340 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:25:40.443 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:25:40.447 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:26:10.534 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:26:10.538 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:26:40.626 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:26:40.629 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:27:10.703 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:27:10.705 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:27:10.813 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T17:27:10.810+0000 7fae5722b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 654069) UID: 0 2023-10-08T17:27:10.814 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-08T17:27:10.810+0000 7f850b43a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 654069) UID: 0 2023-10-08T17:27:10.814 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T17:27:10.810+0000 7f12925ec700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 654069) UID: 0 2023-10-08T17:27:10.818 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T17:27:10.818+0000 7f485127c700 -1 Fail to open '/proc/654069/cmdline' error = (2) No such file or directory 2023-10-08T17:27:10.819 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T17:27:10.818+0000 7f485127c700 -1 received signal: Hangup from (PID: 654069) UID: 0 2023-10-08T17:30:12.567 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:30:12.582 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:30:43.017 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:30:43.021 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:31:13.109 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:31:13.112 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:31:43.217 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:31:43.220 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:32:13.306 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:32:13.309 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:32:43.421 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:32:43.424 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:33:13.517 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:33:13.520 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:33:43.599 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:33:43.603 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:34:13.684 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:34:13.687 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:34:44.146 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:34:44.149 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:35:14.221 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:35:14.227 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:35:44.363 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:35:44.375 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:36:14.465 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:36:14.467 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:36:44.549 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:36:44.555 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:37:14.637 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:37:14.643 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:37:14.699 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T17:37:14.698+0000 7f485127c700 -1 Fail to open '/proc/654475/cmdline' error = (2) No such file or directory 2023-10-08T17:37:14.699 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T17:37:14.698+0000 7f485127c700 -1 received signal: Hangup from (PID: 654475) UID: 0 2023-10-08T17:37:14.700 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T17:37:14.700+0000 7fae5722b700 -1 Fail to open '/proc/654475/cmdline' error = (2) No such file or directory 2023-10-08T17:37:14.701 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T17:37:14.700+0000 7fae5722b700 -1 received signal: Hangup from (PID: 654475) UID: 0 2023-10-08T17:37:14.701 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T17:37:14.698+0000 7f12925ec700 -1 Fail to read '/proc/654475/cmdline' error = (3) No such process 2023-10-08T17:37:14.701 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T17:37:14.698+0000 7f12925ec700 -1 received signal: Hangup from (PID: 654475) UID: 0 2023-10-08T17:37:14.701 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-08T17:37:14.700+0000 7f850b43a700 -1 Fail to open '/proc/654475/cmdline' error = (2) No such file or directory 2023-10-08T17:37:14.701 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-08T17:37:14.700+0000 7f850b43a700 -1 received signal: Hangup from (PID: 654475) UID: 0 2023-10-08T17:40:17.062 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:40:17.064 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:40:47.193 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:40:47.196 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:41:17.274 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:41:17.276 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:41:47.351 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:41:47.354 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:42:17.827 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:42:17.830 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:42:17.884 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-10-08T17:42:17.883+0000 7fd76dbb2700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 654630) UID: 0 2023-10-08T17:42:17.885 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-10-08T17:42:17.883+0000 7f00eeb81700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 654630) UID: 0 2023-10-08T17:45:03.407 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-08T17:45:03.406+0000 7f850b43a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 654659) UID: 0 2023-10-08T17:45:03.408 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T17:45:03.406+0000 7fae5722b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 654659) UID: 0 2023-10-08T17:45:03.408 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T17:45:03.406+0000 7f485127c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 654659) UID: 0 2023-10-08T17:45:03.409 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T17:45:03.409+0000 7f12925ec700 -1 Fail to open '/proc/654659/cmdline' error = (2) No such file or directory 2023-10-08T17:45:03.409 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T17:45:03.409+0000 7f12925ec700 -1 received signal: Hangup from (PID: 654659) UID: 0 2023-10-08T17:48:12.464 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:48:12.469 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:48:42.760 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:48:42.765 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:49:12.840 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:49:12.844 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:49:42.920 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:49:42.923 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:50:13.010 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:50:13.012 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:50:43.108 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:50:43.114 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:50:43.168 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-10-08T17:50:43.167+0000 7f3991658700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126272) UID: 0 2023-10-08T17:50:43.169 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-10-08T17:50:43.167+0000 7eff1a006700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126272) UID: 0 2023-10-08T17:50:43.169 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T17:50:43.167+0000 7ff165866700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126272) UID: 0 2023-10-08T17:50:43.169 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-10-08T17:50:43.167+0000 7f0d20ed4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126272) UID: 0 2023-10-08T17:51:52.007 INFO:teuthology.orchestra.run.smithi045.stdout:generic/522 3661s 2023-10-08T17:51:52.035 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/522 2023-10-08T17:51:52.035 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T17:51:52.037 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:51:52.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T17:51:52.102 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-10-08T17:51:52.660 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T17:51:52.665 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T17:51:52.666 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T17:51:52.667 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T17:51:52.667 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:51:53.596 INFO:teuthology.orchestra.run.smithi045.stdout:generic/523 1s 2023-10-08T17:51:53.603 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/523 2023-10-08T17:51:53.603 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T17:51:53.606 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:51:53.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T17:51:53.618 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-10-08T17:51:54.015 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T17:51:54.024 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T17:51:54.024 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T17:51:54.025 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T17:51:54.025 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:52:00.515 INFO:teuthology.orchestra.run.smithi045.stdout:generic/524 6s 2023-10-08T17:52:00.522 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/524 2023-10-08T17:52:00.522 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T17:52:00.525 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:52:00.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T17:52:00.541 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-10-08T17:52:00.893 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T17:52:00.902 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T17:52:00.903 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T17:52:00.904 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T17:52:00.904 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:52:01.713 INFO:teuthology.orchestra.run.smithi045.stdout:generic/525 [not run] filesystem does not support huge file size 2023-10-08T17:52:01.736 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/525 2023-10-08T17:52:01.736 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/525 2023-10-08T17:52:01.736 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T17:52:01.740 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:52:01.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T17:52:01.778 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-10-08T17:52:02.137 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T17:52:02.143 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T17:52:02.144 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T17:52:02.145 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T17:52:02.145 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:52:02.792 INFO:teuthology.orchestra.run.smithi045.stdout:generic/526 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T17:52:02.868 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/526 2023-10-08T17:52:02.869 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/526 2023-10-08T17:52:02.869 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T17:52:02.869 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:52:02.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T17:52:02.869 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-10-08T17:52:03.231 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T17:52:03.239 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T17:52:03.239 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T17:52:03.240 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T17:52:03.240 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:52:03.809 INFO:teuthology.orchestra.run.smithi045.stdout:generic/527 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T17:52:03.818 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/527 2023-10-08T17:52:03.819 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/527 2023-10-08T17:52:03.819 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T17:52:03.821 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:52:03.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T17:52:03.860 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-10-08T17:52:04.183 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T17:52:04.194 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T17:52:04.195 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T17:52:04.196 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T17:52:04.196 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:52:04.841 INFO:teuthology.orchestra.run.smithi045.stdout:generic/528 0s 2023-10-08T17:52:04.851 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/528 2023-10-08T17:52:04.851 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T17:52:04.854 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:52:04.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T17:52:04.901 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-10-08T17:52:05.272 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T17:52:05.276 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T17:52:05.276 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T17:52:05.277 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T17:52:05.277 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:52:06.565 INFO:teuthology.orchestra.run.smithi045.stdout:generic/529 1s 2023-10-08T17:52:06.580 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/529 2023-10-08T17:52:06.580 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T17:52:06.587 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:52:06.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T17:52:06.606 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-10-08T17:52:06.967 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T17:52:06.972 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T17:52:06.975 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T17:52:06.975 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T17:52:06.976 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:52:07.829 INFO:teuthology.orchestra.run.smithi045.stdout:generic/530 [not run] ceph does not support shutdown 2023-10-08T17:52:07.855 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/530 2023-10-08T17:52:07.855 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/530 2023-10-08T17:52:07.855 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T17:52:07.858 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:52:07.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T17:52:07.888 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-10-08T17:52:08.258 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T17:52:08.264 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T17:52:08.264 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T17:52:08.266 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T17:52:08.266 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:52:08.779 INFO:teuthology.orchestra.run.smithi045.stdout:generic/531 [not run] O_TMPFILE is not supported 2023-10-08T17:52:08.783 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/531 2023-10-08T17:52:08.783 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/531 2023-10-08T17:52:08.783 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T17:52:08.785 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:52:08.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T17:52:08.817 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-10-08T17:52:09.208 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T17:52:09.213 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T17:52:09.216 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T17:52:09.223 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T17:52:09.237 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:52:09.853 INFO:teuthology.orchestra.run.smithi045.stdout:generic/532 0s 2023-10-08T17:52:09.858 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/532 2023-10-08T17:52:09.858 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T17:52:09.862 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:52:09.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T17:52:09.932 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-10-08T17:52:10.293 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T17:52:10.302 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T17:52:10.303 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T17:52:10.310 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T17:52:10.310 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:52:11.324 INFO:teuthology.orchestra.run.smithi045.stdout:generic/533 1s 2023-10-08T17:52:11.332 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/533 2023-10-08T17:52:11.332 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T17:52:11.334 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:52:11.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T17:52:11.361 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-10-08T17:52:11.704 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T17:52:11.718 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T17:52:11.718 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T17:52:11.719 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T17:52:11.719 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:52:12.242 INFO:teuthology.orchestra.run.smithi045.stdout:generic/534 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T17:52:12.249 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/534 2023-10-08T17:52:12.249 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/534 2023-10-08T17:52:12.249 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T17:52:12.253 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:52:12.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T17:52:12.294 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-10-08T17:52:12.677 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T17:52:12.682 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T17:52:12.682 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T17:52:12.685 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T17:52:12.685 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:52:13.170 INFO:teuthology.orchestra.run.smithi045.stdout:generic/535 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T17:52:13.174 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/535 2023-10-08T17:52:13.174 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/535 2023-10-08T17:52:13.175 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T17:52:13.177 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:52:13.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T17:52:13.204 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-10-08T17:52:13.577 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T17:52:13.586 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T17:52:13.586 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T17:52:13.587 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T17:52:13.587 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:52:14.394 INFO:teuthology.orchestra.run.smithi045.stdout:generic/536 [not run] ceph does not support shutdown 2023-10-08T17:52:14.425 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/536 2023-10-08T17:52:14.425 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/536 2023-10-08T17:52:14.425 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T17:52:14.429 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:52:14.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T17:52:14.457 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-10-08T17:52:14.818 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T17:52:14.822 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T17:52:14.823 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T17:52:14.824 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T17:52:14.824 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:52:15.552 INFO:teuthology.orchestra.run.smithi045.stdout:generic/537 [not run] FSTRIM not supported 2023-10-08T17:52:15.585 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/537 2023-10-08T17:52:15.585 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/537 2023-10-08T17:52:15.585 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T17:52:15.587 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:52:15.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T17:52:15.625 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-10-08T17:52:15.959 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T17:52:15.963 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T17:52:15.963 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T17:52:15.965 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T17:52:15.965 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T17:53:36.953 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:53:36.963 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:53:37.031 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-10-08T17:53:37.029+0000 7f3991658700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126322) UID: 0 2023-10-08T17:53:37.031 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-10-08T17:53:37.029+0000 7eff1a006700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126322) UID: 0 2023-10-08T17:53:37.032 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T17:53:37.030+0000 7ff165866700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126322) UID: 0 2023-10-08T17:53:37.032 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-10-08T17:53:37.030+0000 7f0d20ed4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126322) UID: 0 2023-10-08T17:56:29.319 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:56:29.326 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:56:29.394 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T17:56:29.394+0000 7f485127c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 666237) UID: 0 2023-10-08T17:56:29.395 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T17:56:29.393+0000 7f12925ec700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 666237) UID: 0 2023-10-08T17:56:29.395 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T17:56:29.394+0000 7fae5722b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 666237) UID: 0 2023-10-08T17:56:29.395 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-08T17:56:29.393+0000 7f850b43a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 666237) UID: 0 2023-10-08T17:59:38.657 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:59:38.660 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:00:08.769 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:00:08.772 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:00:39.292 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:00:39.297 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:01:09.369 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:01:09.372 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:01:23.282 INFO:teuthology.orchestra.run.smithi045.stdout:generic/538 547s 2023-10-08T18:01:23.291 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/538 2023-10-08T18:01:23.292 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:01:23.294 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:01:23.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:01:23.551 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-10-08T18:01:24.253 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:01:24.265 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:01:24.276 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:01:24.276 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:01:24.277 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:01:26.915 INFO:teuthology.orchestra.run.smithi045.stdout:generic/539 2s 2023-10-08T18:01:26.922 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/539 2023-10-08T18:01:26.922 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:01:26.925 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:01:26.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:01:26.974 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-10-08T18:01:27.347 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:01:27.360 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:01:27.360 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:01:27.363 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:01:27.364 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:01:28.211 INFO:teuthology.orchestra.run.smithi045.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T18:01:28.216 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/540 2023-10-08T18:01:28.216 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/540 2023-10-08T18:01:28.217 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:01:28.219 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:01:28.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:01:28.255 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-10-08T18:01:28.610 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:01:28.627 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:01:28.627 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:01:28.628 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:01:28.628 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:01:29.569 INFO:teuthology.orchestra.run.smithi045.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T18:01:29.577 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/541 2023-10-08T18:01:29.577 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/541 2023-10-08T18:01:29.577 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:01:29.580 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:01:29.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:01:29.627 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-10-08T18:01:30.009 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:01:30.014 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:01:30.018 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:01:30.020 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:01:30.020 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:01:30.863 INFO:teuthology.orchestra.run.smithi045.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T18:01:30.869 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/542 2023-10-08T18:01:30.869 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/542 2023-10-08T18:01:30.869 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:01:30.875 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:01:30.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:01:30.924 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-10-08T18:01:31.273 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:01:31.278 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:01:31.278 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:01:31.279 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:01:31.280 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:01:32.198 INFO:teuthology.orchestra.run.smithi045.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T18:01:32.204 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/543 2023-10-08T18:01:32.204 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/543 2023-10-08T18:01:32.204 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:01:32.206 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:01:32.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:01:32.250 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-10-08T18:01:32.624 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:01:32.629 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:01:32.630 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:01:32.631 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:01:32.631 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:01:33.442 INFO:teuthology.orchestra.run.smithi045.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T18:01:33.447 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/544 2023-10-08T18:01:33.448 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/544 2023-10-08T18:01:33.448 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:01:33.450 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:01:33.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:01:33.497 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-10-08T18:01:33.867 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:01:33.873 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:01:33.874 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:01:33.876 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:01:33.877 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:01:34.522 INFO:teuthology.orchestra.run.smithi045.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-10-08T18:01:34.532 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/545 2023-10-08T18:01:34.533 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/545 2023-10-08T18:01:34.533 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:01:34.534 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:01:34.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:01:34.583 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-10-08T18:01:34.920 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:01:34.927 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:01:34.927 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:01:34.929 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:01:34.929 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:01:35.457 INFO:teuthology.orchestra.run.smithi045.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T18:01:35.464 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/546 2023-10-08T18:01:35.464 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/546 2023-10-08T18:01:35.464 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:01:35.467 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:01:35.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:01:35.525 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-10-08T18:01:35.942 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:01:35.950 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:01:35.950 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:01:35.951 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:01:35.952 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:01:36.500 INFO:teuthology.orchestra.run.smithi045.stdout:generic/547 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T18:01:36.509 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/547 2023-10-08T18:01:36.509 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/547 2023-10-08T18:01:36.510 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:01:36.512 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:01:36.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:01:36.539 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-10-08T18:01:36.881 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:01:36.896 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:01:36.897 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:01:36.898 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:01:36.898 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:01:37.778 INFO:teuthology.orchestra.run.smithi045.stdout:generic/548 [not run] kernel does not support ceph encryption 2023-10-08T18:01:37.803 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/548 2023-10-08T18:01:37.804 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/548 2023-10-08T18:01:37.804 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:01:37.806 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:01:37.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:01:37.841 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-10-08T18:01:38.189 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:01:38.203 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:01:38.205 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:01:38.210 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:01:38.211 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:01:39.105 INFO:teuthology.orchestra.run.smithi045.stdout:generic/549 [not run] kernel does not support ceph encryption 2023-10-08T18:01:39.131 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/549 2023-10-08T18:01:39.131 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/549 2023-10-08T18:01:39.132 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:01:39.134 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:01:39.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:01:39.174 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-10-08T18:01:39.511 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:01:39.514 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:01:39.557 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:01:39.564 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:01:39.570 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:01:39.570 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:01:39.571 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:01:40.440 INFO:teuthology.orchestra.run.smithi045.stdout:generic/550 [not run] kernel does not support ceph encryption 2023-10-08T18:01:40.469 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/550 2023-10-08T18:01:40.469 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/550 2023-10-08T18:01:40.469 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:01:40.471 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:01:40.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:01:40.499 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-10-08T18:01:40.832 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:01:40.840 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:01:40.841 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:01:40.842 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:01:40.842 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:02:09.653 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:02:09.659 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:02:39.855 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:02:39.862 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:03:09.934 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:03:09.942 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:03:40.027 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:03:40.030 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:04:10.107 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:04:10.147 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:04:40.578 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:04:40.582 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:05:10.669 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:05:10.671 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:05:40.759 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:05:40.768 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:06:10.847 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:06:10.850 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:06:40.928 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:06:40.937 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:07:11.051 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:07:11.054 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:07:41.249 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:07:41.252 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:08:11.329 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:08:11.332 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:08:41.516 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:08:41.518 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:09:11.603 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:09:11.606 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:09:41.705 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:09:41.708 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:10:12.146 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:10:12.149 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:10:42.285 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:10:42.288 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:11:12.559 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:11:12.562 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:11:42.854 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:11:42.856 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:12:12.960 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:12:12.970 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:12:43.048 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:12:43.051 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:13:13.196 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:13:13.199 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:13:43.296 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:13:43.310 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:14:13.384 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:14:13.387 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:14:43.460 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:14:43.518 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:15:13.613 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:15:13.616 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:15:43.943 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:15:44.044 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:16:14.119 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:16:14.126 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:16:44.222 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:16:44.467 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:17:14.541 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:17:14.639 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:17:14.722 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-10-08T18:17:14.721+0000 7eff1a006700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127547) UID: 0 2023-10-08T18:17:14.723 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-10-08T18:17:14.721+0000 7f3991658700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127547) UID: 0 2023-10-08T18:17:14.723 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T18:17:14.722+0000 7ff165866700 -1 Fail to open '/proc/127547/cmdline' error = (2) No such file or directory 2023-10-08T18:17:14.723 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T18:17:14.722+0000 7ff165866700 -1 received signal: Hangup from (PID: 127547) UID: 0 2023-10-08T18:17:14.724 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-10-08T18:17:14.721+0000 7f0d20ed4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127547) UID: 0 2023-10-08T18:18:29.451 INFO:teuthology.orchestra.run.smithi045.stdout:generic/551 1008s 2023-10-08T18:18:29.547 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/551 2023-10-08T18:18:29.547 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:18:29.547 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:29.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:18:29.547 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2023-10-08T18:18:30.098 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:18:30.221 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:18:30.222 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:18:30.222 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:18:30.222 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:30.764 INFO:teuthology.orchestra.run.smithi045.stdout:generic/552 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T18:18:30.800 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/552 2023-10-08T18:18:30.801 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/552 2023-10-08T18:18:30.801 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:18:30.801 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:30.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:18:30.928 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2023-10-08T18:18:31.611 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:18:31.868 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:18:31.869 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:18:31.869 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:18:31.869 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:32.208 INFO:teuthology.orchestra.run.smithi045.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs?) 2023-10-08T18:18:32.221 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/553 2023-10-08T18:18:32.322 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/553 2023-10-08T18:18:32.323 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:18:32.324 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:32.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:18:32.324 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2023-10-08T18:18:32.669 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:18:32.676 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:18:32.676 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:18:32.678 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:18:32.678 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:33.677 INFO:teuthology.orchestra.run.smithi045.stdout:generic/554 [not run] swapfiles are not supported 2023-10-08T18:18:33.709 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/554 2023-10-08T18:18:33.709 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/554 2023-10-08T18:18:33.709 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:18:33.709 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:33.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:18:33.737 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2023-10-08T18:18:34.069 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:18:34.120 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:18:34.120 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:18:34.120 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:18:34.120 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:34.693 INFO:teuthology.orchestra.run.smithi045.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs?) 2023-10-08T18:18:34.840 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/555 2023-10-08T18:18:34.840 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/555 2023-10-08T18:18:34.840 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:18:34.840 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:34.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:18:34.840 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2023-10-08T18:18:35.154 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:18:35.158 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:18:35.159 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:18:35.160 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:18:35.160 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:35.675 INFO:teuthology.orchestra.run.smithi045.stdout:generic/556 [not run] ceph does not support casefold feature 2023-10-08T18:18:35.681 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/556 2023-10-08T18:18:35.681 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/556 2023-10-08T18:18:35.682 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:18:35.685 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:35.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:18:35.722 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2023-10-08T18:18:36.064 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:18:36.068 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:18:36.069 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:18:36.070 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:18:36.070 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:36.597 INFO:teuthology.orchestra.run.smithi045.stdout:generic/557 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T18:18:36.605 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/557 2023-10-08T18:18:36.605 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/557 2023-10-08T18:18:36.605 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:18:36.607 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:36.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:18:36.640 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2023-10-08T18:18:37.016 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:18:37.020 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:18:37.021 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:18:37.022 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:18:37.022 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:37.560 INFO:teuthology.orchestra.run.smithi045.stdout:generic/558 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-08T18:18:37.566 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/558 2023-10-08T18:18:37.566 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/558 2023-10-08T18:18:37.566 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:18:37.568 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:37.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:18:37.605 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2023-10-08T18:18:38.011 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:18:38.018 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:18:38.018 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:18:38.020 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:18:38.020 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:38.507 INFO:teuthology.orchestra.run.smithi045.stdout:generic/559 [not run] duperemove utility required, skipped this test 2023-10-08T18:18:38.513 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/559 2023-10-08T18:18:38.513 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/559 2023-10-08T18:18:38.513 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:18:38.517 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:38.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:18:38.573 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2023-10-08T18:18:38.938 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:18:38.943 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:18:38.949 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:18:38.950 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:18:38.950 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:39.463 INFO:teuthology.orchestra.run.smithi045.stdout:generic/560 [not run] duperemove utility required, skipped this test 2023-10-08T18:18:39.481 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/560 2023-10-08T18:18:39.481 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/560 2023-10-08T18:18:39.481 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:18:39.483 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:39.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:18:39.522 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2023-10-08T18:18:39.919 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:18:39.933 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:18:39.933 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:18:39.934 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:18:39.934 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:40.397 INFO:teuthology.orchestra.run.smithi045.stdout:generic/561 [not run] duperemove utility required, skipped this test 2023-10-08T18:18:40.402 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/561 2023-10-08T18:18:40.402 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/561 2023-10-08T18:18:40.402 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:18:40.404 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:40.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:18:40.455 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2023-10-08T18:18:40.785 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:18:40.790 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:18:40.790 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:18:40.791 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:18:40.791 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:41.711 INFO:teuthology.orchestra.run.smithi045.stdout:generic/562 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T18:18:41.718 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/562 2023-10-08T18:18:41.718 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/562 2023-10-08T18:18:41.718 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:18:41.721 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:41.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:18:41.764 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2023-10-08T18:18:42.129 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:18:42.136 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:18:42.139 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:18:42.142 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:18:42.143 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:42.681 INFO:teuthology.orchestra.run.smithi045.stdout:generic/563 [not run] cgroup2 not mounted on /sys/fs/cgroup 2023-10-08T18:18:42.686 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/563 2023-10-08T18:18:42.687 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/563 2023-10-08T18:18:42.687 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:18:42.690 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:42.723 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:18:42.723 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2023-10-08T18:18:43.144 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:18:43.153 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:18:43.155 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:18:43.155 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:18:43.155 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:43.736 INFO:teuthology.orchestra.run.smithi045.stdout:generic/564 [not run] xfs_io copy_range doesn't support -f 2023-10-08T18:18:43.741 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/564 2023-10-08T18:18:43.741 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/564 2023-10-08T18:18:43.741 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:18:43.744 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:43.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:18:43.845 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2023-10-08T18:18:44.231 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:18:44.240 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:18:44.240 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:18:44.242 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:18:44.242 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:45.174 INFO:teuthology.orchestra.run.smithi045.stdout:generic/565 1s 2023-10-08T18:18:45.180 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/565 2023-10-08T18:18:45.181 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:18:45.183 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:45.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:18:45.240 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2023-10-08T18:18:45.613 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:18:45.622 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:18:45.622 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:18:45.624 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:18:45.624 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:46.123 INFO:teuthology.orchestra.run.smithi045.stdout:generic/566 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-08T18:18:46.127 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/566 2023-10-08T18:18:46.128 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/566 2023-10-08T18:18:46.128 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:18:46.130 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:46.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:18:46.152 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2023-10-08T18:18:46.490 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:18:46.503 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:18:46.503 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:18:46.504 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:18:46.504 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:47.783 INFO:teuthology.orchestra.run.smithi045.stdout:generic/567 1s 2023-10-08T18:18:47.791 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/567 2023-10-08T18:18:47.791 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:18:47.799 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:47.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:18:47.807 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2023-10-08T18:18:48.185 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:18:48.190 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:18:48.191 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:18:48.195 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:18:48.195 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:48.723 INFO:teuthology.orchestra.run.smithi045.stdout:generic/568 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T18:18:48.729 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/568 2023-10-08T18:18:48.729 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/568 2023-10-08T18:18:48.729 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:18:48.732 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:48.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:18:48.788 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2023-10-08T18:18:49.135 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:18:49.139 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:18:49.139 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:18:49.140 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:18:49.140 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:49.628 INFO:teuthology.orchestra.run.smithi045.stdout:generic/569 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T18:18:49.633 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/569 2023-10-08T18:18:49.633 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/569 2023-10-08T18:18:49.633 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:18:49.635 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:49.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:18:49.681 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2023-10-08T18:18:50.028 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:18:50.037 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:18:50.038 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:18:50.039 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:18:50.039 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:50.512 INFO:teuthology.orchestra.run.smithi045.stdout:generic/570 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T18:18:50.520 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/570 2023-10-08T18:18:50.520 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/570 2023-10-08T18:18:50.520 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:18:50.528 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:50.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:18:50.570 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2023-10-08T18:18:50.925 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:18:50.930 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:18:50.930 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:18:50.932 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:18:50.932 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:51.486 INFO:teuthology.orchestra.run.smithi045.stdout:generic/571 [not run] Require fcntl setlease support 2023-10-08T18:18:51.491 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/571 2023-10-08T18:18:51.491 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/571 2023-10-08T18:18:51.491 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:18:51.494 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:51.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:18:51.558 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2023-10-08T18:18:51.905 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:18:51.918 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:18:51.921 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:18:51.922 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:18:51.922 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:52.430 INFO:teuthology.orchestra.run.smithi045.stdout:generic/572 [not run] fsverity utility required, skipped this test 2023-10-08T18:18:52.438 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/572 2023-10-08T18:18:52.438 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/572 2023-10-08T18:18:52.438 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:18:52.441 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:52.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:18:52.514 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2023-10-08T18:18:52.860 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:18:52.865 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:18:52.866 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:18:52.867 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:18:52.867 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:53.368 INFO:teuthology.orchestra.run.smithi045.stdout:generic/573 [not run] fsverity utility required, skipped this test 2023-10-08T18:18:53.373 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/573 2023-10-08T18:18:53.374 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/573 2023-10-08T18:18:53.374 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:18:53.381 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:53.411 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:18:53.412 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2023-10-08T18:18:53.731 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:18:53.737 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:18:53.738 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:18:53.738 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:18:53.738 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:54.244 INFO:teuthology.orchestra.run.smithi045.stdout:generic/574 [not run] fsverity utility required, skipped this test 2023-10-08T18:18:54.249 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/574 2023-10-08T18:18:54.249 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/574 2023-10-08T18:18:54.249 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:18:54.252 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:54.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:18:54.289 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2023-10-08T18:18:54.668 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:18:54.673 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:18:54.673 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:18:54.674 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:18:54.675 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:55.143 INFO:teuthology.orchestra.run.smithi045.stdout:generic/575 [not run] fsverity utility required, skipped this test 2023-10-08T18:18:55.156 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/575 2023-10-08T18:18:55.156 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/575 2023-10-08T18:18:55.156 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:18:55.158 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:55.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:18:55.192 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2023-10-08T18:18:55.554 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:18:55.559 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:18:55.559 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:18:55.561 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:18:55.561 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:56.170 INFO:teuthology.orchestra.run.smithi045.stdout:generic/576 [not run] fsverity utility required, skipped this test 2023-10-08T18:18:56.175 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/576 2023-10-08T18:18:56.175 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/576 2023-10-08T18:18:56.175 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:18:56.177 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:56.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:18:56.216 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2023-10-08T18:18:56.563 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:18:56.568 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:18:56.569 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:18:56.571 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:18:56.571 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:57.215 INFO:teuthology.orchestra.run.smithi045.stdout:generic/577 [not run] fsverity utility required, skipped this test 2023-10-08T18:18:57.220 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/577 2023-10-08T18:18:57.220 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/577 2023-10-08T18:18:57.220 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:18:57.222 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:57.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:18:57.255 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2023-10-08T18:18:57.685 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:18:57.703 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:18:57.703 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:18:57.705 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:18:57.705 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:58.239 INFO:teuthology.orchestra.run.smithi045.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-08T18:18:58.244 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/578 2023-10-08T18:18:58.244 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/578 2023-10-08T18:18:58.244 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:18:58.247 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:58.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:18:58.304 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2023-10-08T18:18:58.639 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:18:58.643 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:18:58.643 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:18:58.644 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:18:58.645 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:59.177 INFO:teuthology.orchestra.run.smithi045.stdout:generic/579 [not run] fsverity utility required, skipped this test 2023-10-08T18:18:59.181 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/579 2023-10-08T18:18:59.182 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/579 2023-10-08T18:18:59.182 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:18:59.184 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:18:59.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:18:59.218 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2023-10-08T18:18:59.579 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:18:59.583 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:18:59.584 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:18:59.585 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:18:59.585 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:00.410 INFO:teuthology.orchestra.run.smithi045.stdout:generic/580 [not run] kernel does not support ceph encryption 2023-10-08T18:19:00.443 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/580 2023-10-08T18:19:00.444 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/580 2023-10-08T18:19:00.444 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:00.449 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:00.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:00.486 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2023-10-08T18:19:00.862 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:00.878 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:00.878 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:00.880 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:00.880 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:02.068 INFO:teuthology.orchestra.run.smithi045.stdout:generic/581 [not run] kernel does not support ceph encryption 2023-10-08T18:19:02.103 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/581 2023-10-08T18:19:02.103 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/581 2023-10-08T18:19:02.103 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:02.110 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:02.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:02.139 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2023-10-08T18:19:02.503 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:02.508 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:02.508 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:02.512 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:02.512 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:03.309 INFO:teuthology.orchestra.run.smithi045.stdout:generic/582 [not run] kernel does not support ceph encryption 2023-10-08T18:19:03.336 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/582 2023-10-08T18:19:03.336 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/582 2023-10-08T18:19:03.337 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:03.339 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:03.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:03.382 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2023-10-08T18:19:03.712 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:03.717 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:03.718 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:03.719 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:03.719 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:04.610 INFO:teuthology.orchestra.run.smithi045.stdout:generic/583 [not run] kernel does not support ceph encryption 2023-10-08T18:19:04.647 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/583 2023-10-08T18:19:04.647 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/583 2023-10-08T18:19:04.647 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:04.650 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:04.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:04.707 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2023-10-08T18:19:05.083 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:05.088 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:05.089 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:05.097 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:05.097 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:05.903 INFO:teuthology.orchestra.run.smithi045.stdout:generic/584 [not run] kernel does not support ceph encryption 2023-10-08T18:19:05.923 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/584 2023-10-08T18:19:05.924 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/584 2023-10-08T18:19:05.924 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:05.926 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:05.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:05.969 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2023-10-08T18:19:06.374 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:06.379 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:06.379 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:06.381 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:06.381 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:06.996 INFO:teuthology.orchestra.run.smithi045.stdout:generic/585 [not run] kernel doesn't support renameat2 syscall 2023-10-08T18:19:07.006 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/585 2023-10-08T18:19:07.006 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/585 2023-10-08T18:19:07.006 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:07.009 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:07.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:07.071 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2023-10-08T18:19:07.433 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:07.438 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:07.438 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:07.439 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:07.439 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:08.043 INFO:teuthology.orchestra.run.smithi045.stdout:generic/586 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T18:19:08.051 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/586 2023-10-08T18:19:08.051 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/586 2023-10-08T18:19:08.051 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:08.065 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:08.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:08.114 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2023-10-08T18:19:08.517 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:08.522 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:08.522 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:08.528 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:08.528 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:09.057 INFO:teuthology.orchestra.run.smithi045.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-08T18:19:09.062 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/587 2023-10-08T18:19:09.062 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/587 2023-10-08T18:19:09.062 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:09.069 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:09.097 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:09.097 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2023-10-08T18:19:09.467 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:09.472 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:09.473 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:09.474 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:09.474 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:10.417 INFO:teuthology.orchestra.run.smithi045.stdout:generic/588 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T18:19:10.421 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/588 2023-10-08T18:19:10.421 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/588 2023-10-08T18:19:10.421 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:10.423 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:10.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:10.470 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2023-10-08T18:19:10.860 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:10.865 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:10.865 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:10.866 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:10.867 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:11.395 INFO:teuthology.orchestra.run.smithi045.stdout:generic/589 [not run] require 172.21.15.45:6789:/scratch to be local device 2023-10-08T18:19:11.400 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/589 2023-10-08T18:19:11.401 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/589 2023-10-08T18:19:11.401 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:11.403 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:11.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:11.442 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2023-10-08T18:19:11.788 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:11.792 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:11.792 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:11.793 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:11.793 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:12.301 INFO:teuthology.orchestra.run.smithi045.stdout:generic/590 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T18:19:12.306 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/590 2023-10-08T18:19:12.306 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/590 2023-10-08T18:19:12.306 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:12.311 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:12.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:12.364 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2023-10-08T18:19:12.715 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:12.720 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:12.720 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:12.721 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:12.721 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:13.502 INFO:teuthology.orchestra.run.smithi045.stdout:generic/591 0s 2023-10-08T18:19:13.508 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/591 2023-10-08T18:19:13.508 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:13.511 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:13.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:13.603 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2023-10-08T18:19:13.988 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:13.998 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:13.998 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:13.999 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:13.999 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:14.859 INFO:teuthology.orchestra.run.smithi045.stdout:generic/592 [not run] kernel does not support ceph encryption 2023-10-08T18:19:14.892 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/592 2023-10-08T18:19:14.892 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/592 2023-10-08T18:19:14.893 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:14.895 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:14.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:14.935 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2023-10-08T18:19:15.298 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:15.303 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:15.303 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:15.305 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:15.305 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:16.179 INFO:teuthology.orchestra.run.smithi045.stdout:generic/593 [not run] kernel does not support ceph encryption 2023-10-08T18:19:16.204 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/593 2023-10-08T18:19:16.204 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/593 2023-10-08T18:19:16.204 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:16.207 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:16.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:16.241 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2023-10-08T18:19:16.617 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:16.622 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:16.622 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:16.625 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:16.625 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:17.139 INFO:teuthology.orchestra.run.smithi045.stdout:generic/594 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-08T18:19:17.144 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/594 2023-10-08T18:19:17.145 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/594 2023-10-08T18:19:17.145 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:17.146 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:17.185 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:17.185 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2023-10-08T18:19:17.519 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:17.525 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:17.525 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:17.527 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:17.527 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:18.367 INFO:teuthology.orchestra.run.smithi045.stdout:generic/595 [not run] kernel does not support ceph encryption 2023-10-08T18:19:18.404 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/595 2023-10-08T18:19:18.404 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/595 2023-10-08T18:19:18.404 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:18.407 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:18.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:18.430 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2023-10-08T18:19:18.780 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:18.791 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:18.791 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:18.792 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:18.792 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:19.429 INFO:teuthology.orchestra.run.smithi045.stdout:generic/596 [not run] file system doesn't support chattr +S 2023-10-08T18:19:19.434 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/596 2023-10-08T18:19:19.434 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/596 2023-10-08T18:19:19.434 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:19.437 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:19.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:19.486 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2023-10-08T18:19:19.863 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:19.867 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:19.868 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:19.871 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:19.871 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:21.030 INFO:teuthology.orchestra.run.smithi045.stdout:generic/597 1s 2023-10-08T18:19:21.036 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/597 2023-10-08T18:19:21.036 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:21.038 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:21.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:21.115 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2023-10-08T18:19:21.517 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:21.521 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:21.522 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:21.523 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:21.523 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:22.592 INFO:teuthology.orchestra.run.smithi045.stdout:generic/598 1s 2023-10-08T18:19:22.600 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/598 2023-10-08T18:19:22.606 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:22.607 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:22.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:22.664 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2023-10-08T18:19:22.992 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:22.999 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:23.001 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:23.004 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:23.004 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:23.717 INFO:teuthology.orchestra.run.smithi045.stdout:generic/599 [not run] ceph does not support shutdown 2023-10-08T18:19:23.752 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/599 2023-10-08T18:19:23.752 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/599 2023-10-08T18:19:23.752 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:23.755 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:23.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:23.805 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2023-10-08T18:19:24.185 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:24.194 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:24.194 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:24.196 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:24.196 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:24.679 INFO:teuthology.orchestra.run.smithi045.stdout:generic/600 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-08T18:19:24.683 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/600 2023-10-08T18:19:24.683 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/600 2023-10-08T18:19:24.683 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:24.685 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:24.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:24.725 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2023-10-08T18:19:25.055 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:25.061 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:25.061 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:25.063 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:25.063 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:25.590 INFO:teuthology.orchestra.run.smithi045.stdout:generic/601 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-08T18:19:25.596 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/601 2023-10-08T18:19:25.596 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/601 2023-10-08T18:19:25.598 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:25.601 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:25.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:25.631 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2023-10-08T18:19:25.953 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:25.966 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:25.967 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:25.968 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:25.968 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:26.749 INFO:teuthology.orchestra.run.smithi045.stdout:generic/602 [not run] kernel does not support ceph encryption 2023-10-08T18:19:26.787 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/602 2023-10-08T18:19:26.787 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/602 2023-10-08T18:19:26.787 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:26.789 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:26.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:26.827 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2023-10-08T18:19:27.194 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:27.201 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:27.201 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:27.204 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:27.204 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:27.744 INFO:teuthology.orchestra.run.smithi045.stdout:generic/603 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-08T18:19:27.748 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/603 2023-10-08T18:19:27.749 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/603 2023-10-08T18:19:27.749 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:27.751 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:27.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:27.787 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2023-10-08T18:19:28.197 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:28.201 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:28.203 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:28.203 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:28.203 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:33.838 INFO:teuthology.orchestra.run.smithi045.stdout:generic/604 5s 2023-10-08T18:19:33.845 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/604 2023-10-08T18:19:33.845 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:33.847 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:33.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:33.861 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2023-10-08T18:19:34.256 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:34.260 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:34.264 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:34.265 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:34.265 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:36.730 INFO:teuthology.orchestra.run.smithi045.stdout:generic/605 [not run] mount 172.21.15.45:6789:/scratch with dax=always failed 2023-10-08T18:19:36.735 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/605 2023-10-08T18:19:36.735 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/605 2023-10-08T18:19:36.735 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:36.737 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:36.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:36.775 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2023-10-08T18:19:37.135 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:37.145 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:37.145 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:37.146 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:37.146 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:37.850 INFO:teuthology.orchestra.run.smithi045.stdout:generic/606 [not run] mount 172.21.15.45:6789:/scratch with dax=always failed 2023-10-08T18:19:37.855 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/606 2023-10-08T18:19:37.855 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/606 2023-10-08T18:19:37.855 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:37.857 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:37.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:37.900 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2023-10-08T18:19:38.267 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:38.276 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:38.276 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:38.277 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:38.277 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:38.821 INFO:teuthology.orchestra.run.smithi045.stdout:generic/607 [not run] xfs_io chattr +x failed (old kernel/wrong fs?) 2023-10-08T18:19:38.825 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/607 2023-10-08T18:19:38.825 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/607 2023-10-08T18:19:38.825 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:38.827 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:38.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:38.875 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2023-10-08T18:19:39.253 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:39.261 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:39.261 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:39.265 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:39.265 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:39.949 INFO:teuthology.orchestra.run.smithi045.stdout:generic/608 [not run] mount 172.21.15.45:6789:/scratch with dax=always failed 2023-10-08T18:19:39.953 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/608 2023-10-08T18:19:39.953 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/608 2023-10-08T18:19:39.953 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:39.956 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:39.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:39.993 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2023-10-08T18:19:40.351 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:40.361 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:40.361 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:40.362 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:40.362 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:41.335 INFO:teuthology.orchestra.run.smithi045.stdout:generic/609 1s 2023-10-08T18:19:41.341 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/609 2023-10-08T18:19:41.341 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:41.350 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:41.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:41.408 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2023-10-08T18:19:41.795 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:41.806 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:41.807 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:41.808 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:41.808 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:42.474 INFO:teuthology.orchestra.run.smithi045.stdout:generic/610 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-08T18:19:42.492 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/610 2023-10-08T18:19:42.492 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/610 2023-10-08T18:19:42.492 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:42.495 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:42.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:42.540 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2023-10-08T18:19:42.914 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:42.924 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:42.925 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:42.926 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:42.926 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:43.968 INFO:teuthology.orchestra.run.smithi045.stdout:generic/611 0s 2023-10-08T18:19:43.984 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/611 2023-10-08T18:19:43.984 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:43.987 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:44.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:44.001 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2023-10-08T18:19:44.380 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:44.385 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:44.385 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:44.386 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:44.386 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:45.010 INFO:teuthology.orchestra.run.smithi045.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T18:19:45.015 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/612 2023-10-08T18:19:45.015 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/612 2023-10-08T18:19:45.015 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:45.017 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:45.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:45.074 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2023-10-08T18:19:45.459 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:45.467 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:45.468 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:45.469 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:45.469 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:46.366 INFO:teuthology.orchestra.run.smithi045.stdout:generic/613 [not run] kernel does not support ceph encryption 2023-10-08T18:19:46.407 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/613 2023-10-08T18:19:46.407 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/613 2023-10-08T18:19:46.408 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:46.410 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:46.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:46.445 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2023-10-08T18:19:46.786 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:46.790 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:46.791 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:46.792 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:46.792 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:47.595 INFO:teuthology.orchestra.run.smithi045.stdout:generic/614 [not run] test requires delayed allocation buffered writes 2023-10-08T18:19:47.634 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/614 2023-10-08T18:19:47.634 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/614 2023-10-08T18:19:47.634 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:19:47.636 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:19:47.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:19:47.687 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2023-10-08T18:19:48.074 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:19:48.079 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:19:48.080 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:19:48.081 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:19:48.081 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:20:07.801 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:20:07.803 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:20:37.933 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:20:37.936 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:21:02.343 INFO:teuthology.orchestra.run.smithi045.stdout:generic/615 74s 2023-10-08T18:21:02.349 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/615 2023-10-08T18:21:02.350 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:21:02.352 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:02.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:21:02.362 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2023-10-08T18:21:02.731 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:21:02.737 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:21:02.737 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:21:02.738 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:21:02.739 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:03.253 INFO:teuthology.orchestra.run.smithi045.stdout:generic/616 [not run] kernel does not support IO_URING 2023-10-08T18:21:03.262 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/616 2023-10-08T18:21:03.262 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/616 2023-10-08T18:21:03.262 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:21:03.265 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:03.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:21:03.297 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2023-10-08T18:21:03.661 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:21:03.667 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:21:03.668 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:21:03.669 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:21:03.669 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:04.292 INFO:teuthology.orchestra.run.smithi045.stdout:generic/617 [not run] kernel does not support IO_URING 2023-10-08T18:21:04.297 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/617 2023-10-08T18:21:04.297 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/617 2023-10-08T18:21:04.297 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:21:04.304 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:04.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:21:04.352 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2023-10-08T18:21:04.726 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:21:04.739 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:21:04.739 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:21:04.740 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:21:04.740 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:05.801 INFO:teuthology.orchestra.run.smithi045.stdout:generic/618 0s 2023-10-08T18:21:05.815 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/618 2023-10-08T18:21:05.815 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:21:05.818 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:05.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:21:05.828 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2023-10-08T18:21:06.160 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:21:06.170 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:21:06.171 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:21:06.172 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:21:06.172 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:06.705 INFO:teuthology.orchestra.run.smithi045.stdout:generic/619 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T18:21:06.711 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/619 2023-10-08T18:21:06.711 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/619 2023-10-08T18:21:06.711 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:21:06.713 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:06.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:21:06.757 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2023-10-08T18:21:07.119 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:21:07.126 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:21:07.127 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:21:07.128 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:21:07.128 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:07.654 INFO:teuthology.orchestra.run.smithi045.stdout:generic/620 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T18:21:07.659 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/620 2023-10-08T18:21:07.660 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/620 2023-10-08T18:21:07.660 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:21:07.663 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:07.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:21:07.698 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2023-10-08T18:21:08.062 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:21:08.071 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:21:08.073 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:21:08.075 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:21:08.075 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:08.238 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:21:08.246 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:21:09.022 INFO:teuthology.orchestra.run.smithi045.stdout:generic/621 [not run] kernel does not support ceph encryption 2023-10-08T18:21:09.045 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/621 2023-10-08T18:21:09.045 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/621 2023-10-08T18:21:09.045 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:21:09.057 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:09.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:21:09.087 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2023-10-08T18:21:09.528 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:21:09.533 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:21:09.533 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:21:09.534 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:21:09.535 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:10.347 INFO:teuthology.orchestra.run.smithi045.stdout:generic/622 [not run] ceph does not support shutdown 2023-10-08T18:21:10.370 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/622 2023-10-08T18:21:10.370 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/622 2023-10-08T18:21:10.370 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:21:10.377 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:10.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:21:10.415 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2023-10-08T18:21:10.787 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:21:10.800 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:21:10.800 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:21:10.802 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:21:10.802 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:11.696 INFO:teuthology.orchestra.run.smithi045.stdout:generic/623 [not run] ceph does not support shutdown 2023-10-08T18:21:11.727 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/623 2023-10-08T18:21:11.727 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/623 2023-10-08T18:21:11.727 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:21:11.729 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:11.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:21:11.758 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2023-10-08T18:21:12.131 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:21:12.137 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:21:12.137 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:21:12.138 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:21:12.138 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:12.680 INFO:teuthology.orchestra.run.smithi045.stdout:generic/624 [not run] fsverity utility required, skipped this test 2023-10-08T18:21:12.691 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/624 2023-10-08T18:21:12.691 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/624 2023-10-08T18:21:12.691 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:21:12.696 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:12.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:21:12.742 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2023-10-08T18:21:13.083 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:21:13.087 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:21:13.088 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:21:13.089 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:21:13.089 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:13.662 INFO:teuthology.orchestra.run.smithi045.stdout:generic/625 [not run] fsverity utility required, skipped this test 2023-10-08T18:21:13.667 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/625 2023-10-08T18:21:13.668 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/625 2023-10-08T18:21:13.668 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:21:13.670 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:13.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:21:13.709 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2023-10-08T18:21:14.085 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:21:14.092 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:21:14.093 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:21:14.094 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:21:14.094 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:14.654 INFO:teuthology.orchestra.run.smithi045.stdout:generic/626 [not run] kernel doesn't support renameat2 syscall 2023-10-08T18:21:14.659 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/626 2023-10-08T18:21:14.659 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/626 2023-10-08T18:21:14.660 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:21:14.662 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:14.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:21:14.724 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2023-10-08T18:21:15.095 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:21:15.103 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:21:15.104 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:21:15.105 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:21:15.105 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:15.715 INFO:teuthology.orchestra.run.smithi045.stdout:generic/627 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T18:21:15.720 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/627 2023-10-08T18:21:15.720 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/627 2023-10-08T18:21:15.721 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:21:15.723 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:15.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:21:15.768 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2023-10-08T18:21:16.126 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:21:16.135 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:21:16.136 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:21:16.137 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:21:16.137 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:17.096 INFO:teuthology.orchestra.run.smithi045.stdout:generic/628 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T18:21:17.101 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/628 2023-10-08T18:21:17.101 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/628 2023-10-08T18:21:17.101 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:21:17.102 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:17.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:21:17.156 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2023-10-08T18:21:17.528 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:21:17.537 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:21:17.540 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:21:17.544 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:21:17.544 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:18.090 INFO:teuthology.orchestra.run.smithi045.stdout:generic/629 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T18:21:18.096 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/629 2023-10-08T18:21:18.097 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/629 2023-10-08T18:21:18.097 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:21:18.099 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:18.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:21:18.139 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2023-10-08T18:21:18.551 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:21:18.563 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:21:18.563 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:21:18.564 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:21:18.564 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:19.321 INFO:teuthology.orchestra.run.smithi045.stdout:generic/630 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-10-08T18:21:19.380 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/630 2023-10-08T18:21:19.380 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/630 2023-10-08T18:21:19.380 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:21:19.383 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:19.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:21:19.439 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2023-10-08T18:21:19.806 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:21:19.811 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:21:19.812 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:21:19.817 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:21:19.817 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:38.373 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:21:38.386 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:21:51.550 INFO:teuthology.orchestra.run.smithi045.stdout:generic/631 - output mismatch (see /tmp/tmp.UxcFNZjwoAxfstests-dev/results//generic/631.out.bad) 2023-10-08T18:21:51.565 INFO:teuthology.orchestra.run.smithi045.stdout: --- tests/generic/631.out 2023-10-08 12:46:34.713308232 +0000 2023-10-08T18:21:51.565 INFO:teuthology.orchestra.run.smithi045.stdout: +++ /tmp/tmp.UxcFNZjwoAxfstests-dev/results//generic/631.out.bad 2023-10-08 18:21:51.527462338 +0000 2023-10-08T18:21:51.565 INFO:teuthology.orchestra.run.smithi045.stdout: @@ -1,2 +1,2330 @@ 2023-10-08T18:21:51.566 INFO:teuthology.orchestra.run.smithi045.stdout: QA output created by 631 2023-10-08T18:21:51.566 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.566 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.566 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.566 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.566 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.566 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.566 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.566 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:51.567 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.567 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.567 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.567 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.567 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.567 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.567 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.567 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.567 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.567 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.568 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.568 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.568 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.568 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.568 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.568 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.568 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.568 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.568 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.568 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.568 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.569 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.569 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.569 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted./tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.569 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:51.569 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.569 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.569 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.569 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.569 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.569 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.570 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.570 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.570 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.570 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.570 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.570 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.570 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.570 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.570 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.570 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.570 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.571 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.571 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.571 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.571 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.571 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.571 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.571 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.571 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.571 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.571 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.571 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.572 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.572 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.572 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.572 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.572 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.572 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.572 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.572 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.572 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.572 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.572 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.573 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.573 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.573 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.573 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.573 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.573 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.573 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.573 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.573 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.573 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.573 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.574 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.574 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.574 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.574 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.574 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.574 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.574 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.574 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.574 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.574 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.628 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.628 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.629 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.629 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.629 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.629 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.629 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.629 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.629 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.629 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.629 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.630 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.630 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.630 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.630 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.630 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.630 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.630 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.630 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.630 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.630 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.631 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.631 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.631 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.631 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.631 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.631 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.631 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.631 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.631 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.631 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.631 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.631 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.632 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.632 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.632 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.632 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.632 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.632 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.632 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.632 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.632 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.632 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.632 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.633 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.633 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.633 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.633 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.633 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.633 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.633 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.633 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.633 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.633 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.633 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.634 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.634 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.634 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.634 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.634 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.634 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.634 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.634 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.634 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.634 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.635 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.635 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.635 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.635 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.635 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.635 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.635 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.635 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.636 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.636 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.636 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.636 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.636 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.636 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.636 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.636 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.636 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.636 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.637 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.637 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.637 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.637 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.637 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.637 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.637 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.637 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.637 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.637 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.637 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.638 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.638 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.638 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.638 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.638 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.638 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.638 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.638 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:51.638 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.638 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.638 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.639 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.639 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.639 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.639 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.639 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.639 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.639 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.639 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.639 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.639 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.639 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.639 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.640 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.640 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.640 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.640 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.640 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.640 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.640 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.640 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.640 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.640 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.640 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.640 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.641 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.641 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.641 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.641 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.641 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.641 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.641 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.641 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.641 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.641 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.642 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.642 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.642 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.642 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.642 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.642 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.642 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.642 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.642 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.642 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.643 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.643 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.643 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.643 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.643 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.643 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.643 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.643 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.643 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.643 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.643 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.644 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.644 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.644 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.644 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.644 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.644 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.644 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.644 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.644 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.644 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.644 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.645 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.645 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.645 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.645 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.645 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.645 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:51.645 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.645 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.645 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.645 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.645 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.646 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.646 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.646 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.646 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.646 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.646 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.646 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.646 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.646 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.646 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.647 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.647 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.647 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.647 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.647 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.647 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.647 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.647 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.647 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.647 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.647 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.648 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.648 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.648 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.648 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.648 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.648 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.648 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.648 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.648 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.648 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.649 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.649 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.649 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.649 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.649 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.649 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.649 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.649 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.649 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.649 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.650 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.650 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.650 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.650 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.650 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.650 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.650 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.650 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.650 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.650 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.651 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.651 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.651 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.651 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.651 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.651 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.651 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.651 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.651 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.651 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.651 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.652 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.652 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.652 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.652 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.652 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.652 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.652 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.652 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.652 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.652 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.652 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.653 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.653 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.653 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.653 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.653 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.653 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: mv: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2023-10-08T18:21:51.653 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:51.653 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.653 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.654 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.654 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.654 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.654 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.654 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.654 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.654 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.654 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.654 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.654 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.654 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.655 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.655 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.655 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.655 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.655 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.655 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.655 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.655 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.655 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.655 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.655 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.656 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.656 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.656 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.656 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.656 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.656 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.656 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.656 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.656 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf'mount: : No such file or directory/tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.656 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:51.656 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.657 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.657 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.657 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.657 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.657 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.657 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.657 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.657 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.657 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.657 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.657 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.658 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.658 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.658 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.658 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.658 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.658 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.658 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.658 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.658 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.658 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.658 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.658 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.659 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.659 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.659 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.659 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.659 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.659 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.659 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.659 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.659 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.659 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.660 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.660 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.660 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.660 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.660 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.660 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.660 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.660 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.660 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.660 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.660 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.660 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.661 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.661 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.661 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.661 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.661 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.661 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.661 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.661 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.661 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.661 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.662 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.662 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.662 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.662 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.662 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.662 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.662 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.662 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.662 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.662 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.663 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.663 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.663 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.663 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.663 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.663 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.663 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.663 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.663 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.663 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.664 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.664 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.664 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.664 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.664 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.664 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.664 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.664 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.664 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.664 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.665 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.665 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.665 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.665 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.665 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.665 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.665 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.665 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.665 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.665 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.666 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.666 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.666 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.666 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.666 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.666 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.666 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.666 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.666 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.666 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.667 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.667 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.667 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.667 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.667 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.667 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.667 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.667 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.667 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.667 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.667 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.668 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.668 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.668 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.668 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.668 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.668 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.668 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.668 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.668 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.668 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.668 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.669 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.669 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.669 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.669 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.669 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.669 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.669 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.669 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.669 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.669 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.669 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.670 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.670 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.670 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.670 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.670 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.670 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.670 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.670 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.670 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.670 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.670 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.671 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.671 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.671 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.671 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.671 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.671 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.671 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.671 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.671 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.671 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.671 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.671 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.672 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.672 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.672 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.672 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.672 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.672 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.672 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.672 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.672 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.672 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.672 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.673 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.673 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.673 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.673 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.673 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.673 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.673 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.673 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.673 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.673 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.673 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.673 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.674 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.674 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.674 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.674 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.674 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.674 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.674 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.674 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.674 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.674 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.674 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.675 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.675 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.675 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.675 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.675 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.675 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.675 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.709 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.709 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.709 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.709 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.709 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.710 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.710 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.710 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.710 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.710 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.710 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.710 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.710 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.710 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.710 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.710 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.711 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.711 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.711 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.711 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.711 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.711 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.711 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:51.711 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.711 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.711 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.711 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.712 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.712 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.712 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.712 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.712 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.712 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.712 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.712 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf' 2023-10-08T18:21:51.712 INFO:teuthology.orchestra.run.smithi045.stdout: +: No such file or directory 2023-10-08T18:21:51.713 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.713 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.713 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.713 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.713 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.713 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.713 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.713 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.713 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.713 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.714 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.714 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.714 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.714 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.714 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.714 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.714 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.714 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.714 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.714 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.714 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.715 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted./tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.715 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:51.715 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.715 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.715 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.715 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.715 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.715 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.715 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.715 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.715 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.716 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.716 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.716 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.716 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.716 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.716 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.716 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.716 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.716 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.716 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.716 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.717 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.717 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.717 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.717 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.717 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.717 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.717 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.717 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.717 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.717 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.718 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.718 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.718 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.718 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.718 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.718 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.718 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.718 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.718 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.718 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.719 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.719 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.719 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.719 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.719 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.719 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.719 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.719 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.719 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.719 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.721 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.721 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.721 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.721 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.721 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.721 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.721 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.721 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.721 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.721 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.721 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.722 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.722 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.722 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.722 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.722 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.722 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.722 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.722 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.722 INFO:teuthology.orchestra.run.smithi045.stdout: +: No such file or directory 2023-10-08T18:21:51.722 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.722 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.722 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.723 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted./tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.723 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:51.723 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.723 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.723 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.723 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.723 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.723 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.723 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.723 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.723 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.723 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.724 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.724 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.724 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.724 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.724 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:51.724 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.724 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.724 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.724 INFO:teuthology.orchestra.run.smithi045.stdout: +cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directorytouch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.724 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:51.724 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.724 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.725 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.725 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.725 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.725 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.725 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.725 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.725 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.725 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.725 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.725 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.725 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.726 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.726 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.726 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.726 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.726 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.726 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.726 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.726 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.726 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.726 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.726 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.726 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.727 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.727 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.727 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.727 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.727 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.727 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.727 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.727 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.727 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.727 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.727 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.728 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.728 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.728 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.728 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.728 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.728 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.728 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.728 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.728 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.728 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.728 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.729 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf' 2023-10-08T18:21:51.729 INFO:teuthology.orchestra.run.smithi045.stdout: +: No such file or directory 2023-10-08T18:21:51.729 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.729 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.729 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.729 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.729 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.729 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.729 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.729 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.729 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.730 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.730 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.730 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.730 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.730 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.730 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.730 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.730 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:51.730 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.730 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.730 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.731 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.731 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.731 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.731 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.731 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.731 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.731 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.731 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.731 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.731 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.731 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.732 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.732 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.732 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.732 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.732 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.732 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.732 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.732 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.732 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.732 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.732 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.732 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.733 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.733 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.733 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.733 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.733 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.733 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.733 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.733 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.733 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.733 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.733 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.734 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.734 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.734 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.734 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.734 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.734 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.734 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.734 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.734 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.734 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.735 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.735 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.735 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.735 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.735 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.735 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.735 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.735 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.735 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.735 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.735 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.736 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.736 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted./tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.736 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:51.736 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.736 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.736 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.736 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.736 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.736 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.736 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.737 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.737 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.737 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.737 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.737 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.737 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.737 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.737 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.737 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf'mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.737 INFO:teuthology.orchestra.run.smithi045.stdout: +: No such file or directory 2023-10-08T18:21:51.737 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.738 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.738 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.738 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.738 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.738 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.738 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.738 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.738 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.738 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.738 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.738 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.739 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: umount: umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted./tmp/tmp.f1V86IqBIQscratch/merged2: not mounted./tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.739 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:51.739 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:51.739 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.739 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.739 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.739 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.739 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.739 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.739 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.739 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.740 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.740 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.740 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.740 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.740 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.740 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.740 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.740 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.740 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.740 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.740 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.741 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.741 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.741 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:51.741 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.741 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.741 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.741 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.741 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.741 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.741 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.742 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.742 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.742 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.742 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.742 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.742 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.742 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.742 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.742 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.742 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.742 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.743 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.743 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.743 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.743 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.743 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.743 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.743 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.743 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.743 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.743 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.744 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.744 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.744 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.744 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.744 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.744 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.744 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.744 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.744 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.744 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.744 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.744 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.745 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.745 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.745 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.745 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.745 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.745 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.745 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.745 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.745 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.745 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.745 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.746 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.746 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.746 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.746 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.746 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.746 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.746 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.746 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.746 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.746 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.746 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.747 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.747 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.747 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.747 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.747 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.747 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:51.747 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.747 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.747 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.747 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.747 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.748 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.748 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.748 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.748 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.748 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.748 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.748 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.748 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.748 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.748 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.748 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.749 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.749 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.749 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.749 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.749 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.749 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.749 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.749 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.749 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.749 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.750 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.750 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.750 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.750 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.750 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.750 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.750 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.750 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.750 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.750 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.751 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.751 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.751 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.751 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.751 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.751 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.751 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.751 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.751 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.751 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.751 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.751 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.752 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.752 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.752 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.752 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.752 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.752 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.752 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.752 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.752 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.752 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.752 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.752 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.753 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.753 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.753 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.753 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.753 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.753 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.753 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.753 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.753 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.753 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.753 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.753 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.754 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.754 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.754 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.754 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.754 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.754 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.754 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.754 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.754 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.754 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.754 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.755 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.755 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.755 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.755 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.755 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.755 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.755 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.755 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.755 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.755 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.755 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.756 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.756 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.756 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.756 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.756 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.756 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.756 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.756 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.756 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.756 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.756 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.756 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.757 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.757 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.757 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.757 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.757 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.757 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.757 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.757 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.757 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.757 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.757 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.757 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.758 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.758 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.758 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.758 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.758 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.758 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.758 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.758 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.758 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.758 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.758 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.759 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.759 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.759 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.759 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.759 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.759 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.759 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.759 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.759 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.759 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.759 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.759 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.760 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.760 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.760 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.760 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.760 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.760 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.760 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.760 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.760 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.760 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.760 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.760 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.761 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.761 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.761 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.761 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.761 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.761 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.761 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.761 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.761 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.761 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.761 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.762 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.762 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.762 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.762 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.762 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.762 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.762 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.762 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.762 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.762 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.762 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.762 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.763 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-10-08T18:21:51.763 INFO:teuthology.orchestra.run.smithi045.stdout: +/tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.763 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.763 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.763 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.763 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.763 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.763 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.763 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.763 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.763 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.764 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.764 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.764 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.764 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.764 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.764 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.764 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.764 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.764 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.764 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.764 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.765 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.765 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.765 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.765 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.765 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.765 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.765 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.765 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.765 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.766 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.766 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.767 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.767 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.767 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.767 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.767 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.767 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.767 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.767 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.767 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.767 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.767 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.767 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.768 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.768 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.768 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.768 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.768 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.768 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.768 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.768 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.768 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.781 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.781 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.781 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.781 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.782 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.782 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.782 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.782 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.782 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.782 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.782 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.782 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.782 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.783 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.783 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.783 INFO:teuthology.orchestra.run.smithi045.stdout: +cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.783 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.783 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.783 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.783 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.783 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.783 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.783 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.783 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.783 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.784 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.784 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.784 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.784 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.784 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.784 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.784 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted./tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.784 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:51.784 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.784 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.784 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.784 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.785 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.785 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.785 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.785 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.785 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.785 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.785 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.785 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.785 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.785 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.785 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.785 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.786 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.786 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.786 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.786 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.786 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.786 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.786 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.786 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.786 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.786 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.786 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.786 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.787 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.787 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.787 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.787 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.787 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.787 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.787 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.787 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.787 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.787 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.787 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.787 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.788 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.788 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.788 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.788 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.788 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.788 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.788 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.788 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.788 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.788 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.788 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.788 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.789 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.789 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.789 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.789 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.789 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.789 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.789 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.789 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.789 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.789 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.789 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.789 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.790 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.790 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.790 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.790 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.790 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.790 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.790 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.790 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.790 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.790 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.791 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.791 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:51.791 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.791 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.791 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.791 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.791 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.791 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.791 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.791 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.791 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.791 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.792 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.792 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.792 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.792 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.792 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.792 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.792 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.792 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.792 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.792 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.792 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directorymv: 2023-10-08T18:21:51.792 INFO:teuthology.orchestra.run.smithi045.stdout: +cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.793 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf'cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2023-10-08T18:21:51.793 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:51.793 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.793 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.793 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.793 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.793 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.793 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.793 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.793 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.793 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.793 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.794 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.794 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf' 2023-10-08T18:21:51.794 INFO:teuthology.orchestra.run.smithi045.stdout: +: No such file or directory 2023-10-08T18:21:51.794 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.794 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.794 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.794 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.794 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.794 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.794 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.794 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.794 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.795 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.795 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.795 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.795 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.795 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.795 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.795 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.795 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.795 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.795 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.795 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.795 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.796 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.796 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.796 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.796 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:51.796 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.796 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.796 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.796 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.796 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.796 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.796 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.797 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.797 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.797 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.797 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.797 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.797 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.797 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.797 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.797 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.797 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.797 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.797 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.798 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.798 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.798 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.798 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.798 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.798 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.798 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.798 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.798 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.798 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.798 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.799 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.799 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.799 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.799 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.799 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.799 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.799 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.799 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.799 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.799 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.799 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.799 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.800 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.800 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.800 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.800 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.800 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.800 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.800 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.800 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.800 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.800 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.800 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.801 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.801 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.801 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.801 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.801 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.801 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.801 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.801 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.801 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.801 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.801 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.801 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.802 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.802 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.802 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.802 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.802 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.802 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.802 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.802 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.802 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.802 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.802 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.803 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.803 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.803 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.803 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.803 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.803 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.803 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.803 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.803 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.803 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.803 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.803 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.803 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.804 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.804 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.804 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.804 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.804 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.804 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.804 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.804 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.804 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.804 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.804 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.804 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.805 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.805 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.805 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.805 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.805 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.805 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.805 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.805 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.805 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.805 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.806 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.806 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.806 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.806 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.806 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.806 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.806 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.806 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.806 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.806 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.806 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.807 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.807 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.807 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.807 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.807 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.807 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.807 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.807 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.807 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.807 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.807 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.808 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.808 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.808 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.808 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.808 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:51.808 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.808 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf' 2023-10-08T18:21:51.808 INFO:teuthology.orchestra.run.smithi045.stdout: +: No such file or directory 2023-10-08T18:21:51.808 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.808 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.808 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.808 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.809 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf' 2023-10-08T18:21:51.809 INFO:teuthology.orchestra.run.smithi045.stdout: +: No such file or directory 2023-10-08T18:21:51.809 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.809 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.809 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.809 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.809 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.809 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.809 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.809 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.809 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.809 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.870 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.870 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.870 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.871 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.871 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.871 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.871 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.871 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.871 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.872 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.872 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.872 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.872 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.872 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.872 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.873 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.873 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.873 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.873 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.873 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.873 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.874 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.874 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.874 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.874 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.874 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.874 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.874 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.875 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.875 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.875 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.875 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.875 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.875 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.876 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.876 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.876 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.876 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.876 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.876 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.877 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.877 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.877 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.877 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.877 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.877 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.878 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.878 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.878 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.878 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.878 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.878 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.878 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.878 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.878 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.879 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.879 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.879 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.879 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.879 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.879 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.879 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.879 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.879 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.879 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.879 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.880 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.880 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.880 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.880 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.880 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.880 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.880 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.880 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.880 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.880 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.880 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.880 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.880 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.881 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.881 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.881 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.881 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.881 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.881 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.881 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.881 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.881 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.881 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.881 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.882 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.882 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.882 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.882 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.882 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.882 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.882 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:51.882 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.883 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.883 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.883 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.883 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.883 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.883 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.883 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.883 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.883 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.883 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.883 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.883 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.884 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.884 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted./tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.884 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:51.884 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.884 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.884 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.884 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.884 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.884 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.884 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.884 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.884 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.885 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.885 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.885 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.885 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.885 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.885 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.885 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.885 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.885 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.885 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.885 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.885 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.886 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.886 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.886 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.886 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.886 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.886 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.886 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.886 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.886 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.886 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.886 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.887 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.887 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.887 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.887 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted./tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.887 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:51.887 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.887 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.887 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.887 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.887 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.887 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.887 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.887 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.888 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.888 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.888 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.890 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.890 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.890 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.890 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.890 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.890 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.890 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.891 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.891 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.891 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.891 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.891 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.891 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.891 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.891 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.891 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.891 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.891 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.892 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.892 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.892 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.892 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.892 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.892 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.893 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.893 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.893 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.893 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.893 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.893 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.893 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.894 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.894 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.894 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.894 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.894 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.894 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.895 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.895 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.895 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.895 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.895 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.895 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.896 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.896 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.937 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.937 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.937 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.937 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.937 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.937 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.937 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.937 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.937 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.937 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.938 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.938 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.938 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.938 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.938 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.938 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.938 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.938 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.938 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.938 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.938 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.939 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.939 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.939 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.939 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.939 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.939 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:51.939 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.939 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.939 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.939 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.940 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.940 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.940 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.940 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.940 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.940 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.940 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.940 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.940 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.940 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.940 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.940 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.941 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.941 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.941 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.941 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.941 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.941 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.941 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.941 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:51.941 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.941 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.941 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.941 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.942 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.942 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.942 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.942 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.942 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.942 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.942 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.942 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.942 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.942 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.942 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.943 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.943 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.943 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:51.943 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.943 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.943 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.943 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.943 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.943 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.943 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.943 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.943 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.944 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.944 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.944 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf' 2023-10-08T18:21:51.944 INFO:teuthology.orchestra.run.smithi045.stdout: +: No such file or directory 2023-10-08T18:21:51.944 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.944 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.944 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.944 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted.umount: 2023-10-08T18:21:51.944 INFO:teuthology.orchestra.run.smithi045.stdout: +/tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.944 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:51.944 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.945 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.945 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.945 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.945 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.945 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:51.945 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:51.945 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.945 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.945 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.945 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.945 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.945 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.946 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.946 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:51.946 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.946 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.946 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.946 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:51.946 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.946 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.946 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:51.998 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.998 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:51.998 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:51.998 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.998 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:51.999 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.999 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:51.999 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:51.999 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:51.999 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.000 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.000 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.000 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.000 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:52.000 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:52.000 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.001 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.001 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.001 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.001 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.001 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.002 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.002 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.002 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.002 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.002 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.003 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.003 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.003 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.003 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.003 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.003 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.003 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.003 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.003 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:52.003 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.004 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:52.004 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:52.004 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.004 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.004 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.004 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:52.004 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.004 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.004 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.004 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:52.004 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.004 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.005 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.005 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:52.005 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:52.005 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.005 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: mount: mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.005 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:52.005 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:52.005 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.005 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.005 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.005 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.005 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.006 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.006 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.006 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.006 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.006 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.006 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.006 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.006 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.006 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.006 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.007 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.007 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.007 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.007 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.007 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.007 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.007 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.007 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.007 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.008 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.008 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.008 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted./tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:52.008 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:52.026 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted./tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:52.026 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:52.026 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:52.026 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:52.026 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.026 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.026 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.026 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.026 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.027 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.027 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.027 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.027 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.027 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.027 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.027 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.027 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.027 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.027 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.027 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.028 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.028 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.028 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.028 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.028 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.028 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.028 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.028 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.028 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.028 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.028 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:52.028 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:52.029 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.029 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:52.029 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:52.029 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.029 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.029 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.029 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:52.029 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:52.029 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.029 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.029 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.029 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.030 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.030 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:52.030 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.030 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.030 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.030 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.030 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.030 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.030 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.030 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:52.030 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.031 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.031 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.031 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.031 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:52.031 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.031 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.031 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.031 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.031 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.031 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.031 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.031 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.032 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:52.032 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.032 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.032 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.032 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:52.032 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.032 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.032 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:52.032 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:52.032 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.032 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.033 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.033 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.033 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.033 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.033 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.033 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:52.033 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.033 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.033 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.033 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.033 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf' 2023-10-08T18:21:52.033 INFO:teuthology.orchestra.run.smithi045.stdout: +: No such file or directory 2023-10-08T18:21:52.034 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.034 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.034 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.034 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.034 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.034 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.034 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.034 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.034 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.034 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:52.034 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.035 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.035 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.035 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:52.035 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.035 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:52.035 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:52.035 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.035 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.035 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.035 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.035 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:52.035 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.036 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.036 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.036 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.036 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.036 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.036 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.036 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:52.036 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.036 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.036 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.036 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.036 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.037 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.037 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.037 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.037 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.037 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.037 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.037 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.037 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.037 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.037 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:52.037 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.038 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:52.038 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.038 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.038 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.038 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.038 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.038 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.038 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.038 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.038 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:52.038 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:52.038 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:52.039 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.039 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.039 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.039 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.039 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.039 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.039 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.039 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.039 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.039 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.039 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.039 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.040 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.040 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.040 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: mv: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2023-10-08T18:21:52.040 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:52.040 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.040 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.040 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directorytouch: 2023-10-08T18:21:52.040 INFO:teuthology.orchestra.run.smithi045.stdout: +cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.040 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted./tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:52.040 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:52.040 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.040 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.040 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.041 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.041 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.041 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.041 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.041 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.041 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.041 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.041 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted.umount: 2023-10-08T18:21:52.041 INFO:teuthology.orchestra.run.smithi045.stdout: +/tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:52.041 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:52.041 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:52.041 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.042 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.042 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.042 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.042 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.042 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.042 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.042 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.042 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf'cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-10-08T18:21:52.042 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:52.042 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.042 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.042 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.043 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.043 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.043 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.043 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.043 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.043 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.043 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.043 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.043 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.043 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.043 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.043 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.044 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:52.044 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.044 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.044 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.044 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.044 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:52.044 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.044 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:52.044 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted.umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:52.044 INFO:teuthology.orchestra.run.smithi045.stdout: +/tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:52.044 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:52.044 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.045 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.045 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.045 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.045 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:52.045 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.045 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.045 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.045 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.045 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.045 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.045 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.046 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.046 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.046 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.046 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:52.046 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.046 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.046 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:52.046 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.046 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.046 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.046 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.046 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:52.047 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.047 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.047 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2023-10-08T18:21:52.047 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:52.047 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.047 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:52.047 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.047 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.047 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.047 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.047 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:52.047 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:52.048 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.048 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.048 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.048 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.048 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.048 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.048 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.048 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.048 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:52.048 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.048 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.048 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:52.049 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.049 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.049 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.049 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.049 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.049 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.049 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.049 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.049 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.049 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.049 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.049 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.050 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf'touch: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directorycannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.050 INFO:teuthology.orchestra.run.smithi045.stdout: +: No such file or directory 2023-10-08T18:21:52.050 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:52.050 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.050 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.050 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.050 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:52.050 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.050 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:52.050 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.050 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:52.051 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:52.051 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.051 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.051 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.051 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.051 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.051 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:52.051 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.051 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.051 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.051 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.051 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.052 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:52.052 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.052 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: mount: mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.099 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:52.099 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:52.099 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-10-08T18:21:52.099 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:52.099 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.099 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.099 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.099 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.100 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.100 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.100 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.100 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.100 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.100 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.100 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.100 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted./tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:52.100 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:52.100 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.100 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.100 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:52.101 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.101 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:52.101 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.101 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.101 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.101 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.101 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged0/etc/access.conf': No such file or directory 2023-10-08T18:21:52.101 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged0: not mounted. 2023-10-08T18:21:52.101 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.101 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.101 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.102 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.102 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.102 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.102 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.102 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.102 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory 2023-10-08T18:21:52.102 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: mv: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-10-08T18:21:52.102 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:52.102 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf'cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2023-10-08T18:21:52.102 INFO:teuthology.orchestra.run.smithi045.stdout: + 2023-10-08T18:21:52.102 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.103 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.103 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.103 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged5/etc/access.conf': No such file or directory 2023-10-08T18:21:52.103 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.103 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged2/etc/access.conf': No such file or directory 2023-10-08T18:21:52.103 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged4: not mounted. 2023-10-08T18:21:52.103 INFO:teuthology.orchestra.run.smithi045.stdout: +mount: /tmp/tmp.f1V86IqBIQscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-10-08T18:21:52.103 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged3/etc/access.conf': No such file or directory 2023-10-08T18:21:52.103 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.103 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged5: not mounted. 2023-10-08T18:21:52.104 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.104 INFO:teuthology.orchestra.run.smithi045.stdout: +mv: cannot stat '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.104 INFO:teuthology.orchestra.run.smithi045.stdout: +touch: cannot touch '/tmp/tmp.f1V86IqBIQscratch/merged1/etc/access.conf': No such file or directory 2023-10-08T18:21:52.104 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged3: not mounted. 2023-10-08T18:21:52.104 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged2: not mounted. 2023-10-08T18:21:52.104 INFO:teuthology.orchestra.run.smithi045.stdout: +umount: /tmp/tmp.f1V86IqBIQscratch/merged1: not mounted. 2023-10-08T18:21:52.104 INFO:teuthology.orchestra.run.smithi045.stdout: Silence is golden. 2023-10-08T18:21:52.104 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:52.104 INFO:teuthology.orchestra.run.smithi045.stdout:HINT: You _MAY_ be missing kernel fix: 2023-10-08T18:21:52.104 INFO:teuthology.orchestra.run.smithi045.stdout: 6da1b4b1ab36 xfs: fix an ABBA deadlock in xfs_rename 2023-10-08T18:21:52.104 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:52.105 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T18:21:52.106 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/631 2023-10-08T18:21:52.106 INFO:teuthology.orchestra.run.smithi045.stdout:Failures: generic/631 2023-10-08T18:21:52.106 INFO:teuthology.orchestra.run.smithi045.stdout:Failed 1 of 1 tests 2023-10-08T18:21:52.106 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:21:52.106 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-08T18:21:52.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-08T18:21:52.107 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2023-10-08T18:21:52.458 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:21:52.469 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:21:52.470 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:21:52.471 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:21:52.471 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:22:08.636 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:22:08.639 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:22:39.037 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:22:39.040 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:23:09.106 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:23:09.109 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:23:16.672 INFO:teuthology.orchestra.run.smithi045.stdout:generic/632 83s 2023-10-08T18:23:16.686 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/632 2023-10-08T18:23:16.687 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:23:16.689 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:23:16.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:23:16.745 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2023-10-08T18:23:17.115 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:23:17.128 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:23:17.128 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:23:17.130 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:23:17.130 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:23:18.203 INFO:teuthology.orchestra.run.smithi045.stdout:generic/633 1s 2023-10-08T18:23:18.254 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/633 2023-10-08T18:23:18.254 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:23:18.255 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:23:18.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:23:18.294 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2023-10-08T18:23:18.699 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:23:18.708 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:23:18.708 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:23:18.710 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:23:18.710 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:23:19.978 INFO:teuthology.orchestra.run.smithi045.stdout:generic/634 1s 2023-10-08T18:23:19.992 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/634 2023-10-08T18:23:19.992 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:23:19.994 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:23:20.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:23:20.008 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2023-10-08T18:23:20.390 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:23:20.397 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:23:20.398 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:23:20.399 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:23:20.399 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:23:21.210 INFO:teuthology.orchestra.run.smithi045.stdout:generic/635 [not run] ceph does not support shutdown 2023-10-08T18:23:21.247 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/635 2023-10-08T18:23:21.247 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/635 2023-10-08T18:23:21.247 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:23:21.250 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:23:21.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:23:21.288 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2023-10-08T18:23:21.639 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:23:21.644 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:23:21.645 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:23:21.646 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:23:21.646 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:23:22.538 INFO:teuthology.orchestra.run.smithi045.stdout:generic/636 [not run] swapfiles are not supported 2023-10-08T18:23:22.543 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/636 2023-10-08T18:23:22.543 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/636 2023-10-08T18:23:22.543 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:23:22.549 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:23:22.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:23:22.597 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2023-10-08T18:23:22.984 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:23:22.998 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:23:22.999 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:23:23.000 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:23:23.000 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:23:24.155 INFO:teuthology.orchestra.run.smithi045.stdout:generic/637 1s 2023-10-08T18:23:24.167 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/637 2023-10-08T18:23:24.168 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:23:24.171 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:23:24.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:23:24.357 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2023-10-08T18:23:24.731 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:23:24.749 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:23:24.751 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:23:24.752 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:23:24.753 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:23:25.345 INFO:teuthology.orchestra.run.smithi045.stdout:generic/638 0s 2023-10-08T18:23:25.352 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/638 2023-10-08T18:23:25.352 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:23:25.355 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:23:25.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:23:25.426 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2023-10-08T18:23:25.785 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:23:25.790 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:23:25.790 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:23:25.791 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:23:25.791 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:23:26.542 INFO:teuthology.orchestra.run.smithi045.stdout:generic/639 0s 2023-10-08T18:23:26.553 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/639 2023-10-08T18:23:26.553 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:23:26.556 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:23:26.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:23:26.599 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2023-10-08T18:23:26.979 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:23:26.984 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:23:26.985 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:23:26.986 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:23:26.986 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:23:27.559 INFO:teuthology.orchestra.run.smithi045.stdout:generic/640 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T18:23:27.566 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/640 2023-10-08T18:23:27.566 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/640 2023-10-08T18:23:27.566 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:23:27.569 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:23:27.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:23:27.595 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2023-10-08T18:23:27.994 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:23:28.001 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:23:28.001 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:23:28.003 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:23:28.003 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:23:28.981 INFO:teuthology.orchestra.run.smithi045.stdout:generic/641 [not run] swapfiles are not supported 2023-10-08T18:23:28.987 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/641 2023-10-08T18:23:28.987 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/641 2023-10-08T18:23:28.987 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:23:28.992 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:23:29.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:23:29.027 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2023-10-08T18:23:29.421 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:23:29.438 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:23:29.439 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:23:29.440 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:23:29.440 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:23:39.177 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:23:39.180 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:24:09.248 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:24:09.250 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:24:39.330 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:24:39.333 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:25:09.669 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:25:09.671 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:25:39.903 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:25:39.910 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:25:40.008 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T18:25:40.007+0000 7fae5722b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 787440) UID: 0 2023-10-08T18:25:40.009 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T18:25:40.009+0000 7f485127c700 -1 Fail to open '/proc/787440/cmdline' error = (2) No such file or directory 2023-10-08T18:25:40.009 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T18:25:40.009+0000 7f485127c700 -1 received signal: Hangup from (PID: 787440) UID: 0 2023-10-08T18:25:40.010 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-08T18:25:40.007+0000 7f850b43a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 787440) UID: 0 2023-10-08T18:25:40.011 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T18:25:40.011+0000 7f12925ec700 -1 Fail to open '/proc/787440/cmdline' error = (2) No such file or directory 2023-10-08T18:25:40.011 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T18:25:40.011+0000 7f12925ec700 -1 received signal: Hangup from (PID: 787440) UID: 0 2023-10-08T18:29:15.542 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:29:15.544 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:29:15.596 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-10-08T18:29:15.595+0000 7f00eeb81700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 787497) UID: 0 2023-10-08T18:29:15.596 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-10-08T18:29:15.595+0000 7fd76dbb2700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 787497) UID: 0 2023-10-08T18:34:00.264 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:34:00.267 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:34:00.381 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-10-08T18:34:00.381+0000 7f3991658700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127996) UID: 0 2023-10-08T18:34:00.382 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-10-08T18:34:00.382+0000 7eff1a006700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127996) UID: 0 2023-10-08T18:34:00.382 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T18:34:00.382+0000 7ff165866700 -1 Fail to open '/proc/127996/cmdline' error = (2) No such file or directory 2023-10-08T18:34:00.382 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T18:34:00.382+0000 7ff165866700 -1 received signal: Hangup from (PID: 127996) UID: 0 2023-10-08T18:34:00.383 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-10-08T18:34:00.382+0000 7f0d20ed4700 -1 Fail to open '/proc/127996/cmdline' error = (2) No such file or directory 2023-10-08T18:34:00.383 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-10-08T18:34:00.382+0000 7f0d20ed4700 -1 received signal: Hangup from (PID: 127996) UID: 0 2023-10-08T18:36:41.944 INFO:teuthology.orchestra.run.smithi045.stdout:generic/642 792s 2023-10-08T18:36:41.975 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/642 2023-10-08T18:36:41.980 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:36:41.982 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:36:42.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:36:42.003 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2023-10-08T18:36:46.716 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:36:46.722 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:36:46.723 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:36:46.724 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:36:46.724 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:36:48.162 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:36:48.165 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:36:48.210 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-10-08T18:36:48.210+0000 7fd76dbb2700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 787910) UID: 0 2023-10-08T18:36:48.211 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-10-08T18:36:48.210+0000 7f00eeb81700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 787910) UID: 0 2023-10-08T18:40:47.413 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T18:40:47.412+0000 7fae5722b700 -1 received signal: Hangup from (PID: 787951) UID: 0 2023-10-08T18:40:47.413 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-08T18:40:47.411+0000 7f850b43a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 787951) UID: 0 2023-10-08T18:40:47.414 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T18:40:47.412+0000 7f485127c700 -1 received signal: Hangup from (PID: 787951) UID: 0 2023-10-08T18:40:47.415 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T18:40:47.412+0000 7f12925ec700 -1 received signal: Hangup from (PID: 787951) UID: 0 2023-10-08T18:42:46.976 INFO:teuthology.orchestra.run.smithi045.stdout:generic/643 [not run] swapfiles are not supported 2023-10-08T18:42:46.980 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/643 2023-10-08T18:42:46.980 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/643 2023-10-08T18:42:46.980 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:42:46.982 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:42:47.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:42:47.009 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2023-10-08T18:42:47.244 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:42:47.248 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:42:47.248 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:42:47.249 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:42:47.250 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:42:47.842 INFO:teuthology.orchestra.run.smithi045.stdout:generic/644 [not run] kernel does not support mount_setattr syscall 2023-10-08T18:42:47.846 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/644 2023-10-08T18:42:47.846 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/644 2023-10-08T18:42:47.847 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:42:47.848 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:42:47.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:42:47.872 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2023-10-08T18:42:48.095 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:42:48.099 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:42:48.100 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:42:48.101 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:42:48.101 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:42:48.474 INFO:teuthology.orchestra.run.smithi045.stdout:generic/645 [not run] kernel does not support mount_setattr syscall 2023-10-08T18:42:48.478 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/645 2023-10-08T18:42:48.478 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/645 2023-10-08T18:42:48.478 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:42:48.480 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:42:48.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:42:48.518 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2023-10-08T18:42:48.739 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:42:48.743 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:42:48.744 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:42:48.745 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:42:48.745 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:42:49.418 INFO:teuthology.orchestra.run.smithi045.stdout:generic/646 [not run] ceph does not support shutdown 2023-10-08T18:42:49.439 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/646 2023-10-08T18:42:49.439 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/646 2023-10-08T18:42:49.439 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:42:49.441 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:42:49.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:42:49.472 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2023-10-08T18:42:49.697 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:42:49.701 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:42:49.701 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:42:49.702 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:42:49.702 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:42:50.748 INFO:teuthology.orchestra.run.smithi045.stdout:generic/647 1s 2023-10-08T18:42:50.825 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/647 2023-10-08T18:42:50.825 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:42:50.827 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:42:50.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:42:50.866 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2023-10-08T18:42:51.089 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:42:51.093 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:42:51.094 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:42:51.095 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:42:51.095 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:42:52.674 INFO:teuthology.orchestra.run.smithi045.stdout:generic/648 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T18:42:52.678 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/648 2023-10-08T18:42:52.678 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/648 2023-10-08T18:42:52.678 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:42:52.680 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:42:52.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:42:52.710 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2023-10-08T18:42:52.939 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:42:52.943 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:42:52.943 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:42:52.944 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:42:52.944 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:42:53.665 INFO:teuthology.orchestra.run.smithi045.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T18:42:53.669 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/649 2023-10-08T18:42:53.670 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/649 2023-10-08T18:42:53.670 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T18:42:53.671 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:42:53.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T18:42:53.725 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2023-10-08T18:42:53.942 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T18:42:53.945 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T18:42:53.946 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T18:42:53.947 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T18:42:53.947 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T18:46:40.341 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:46:40.392 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:46:41.441 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-08T18:46:41.441+0000 7f850b43a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 792695) UID: 0 2023-10-08T18:46:41.444 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T18:46:41.444+0000 7f485127c700 -1 Fail to open '/proc/792695/cmdline' error = (2) No such file or directory 2023-10-08T18:46:41.444 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T18:46:41.444+0000 7f485127c700 -1 received signal: Hangup from (PID: 792695) UID: 0 2023-10-08T18:46:41.444 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T18:46:41.444+0000 7f12925ec700 -1 Fail to open '/proc/792695/cmdline' error = (2) No such file or directory 2023-10-08T18:46:41.445 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T18:46:41.444+0000 7f12925ec700 -1 received signal: Hangup from (PID: 792695) UID: 0 2023-10-08T18:46:41.498 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T18:46:41.444+0000 7fae5722b700 -1 Fail to open '/proc/792695/cmdline' error = (2) No such file or directory 2023-10-08T18:46:41.498 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T18:46:41.492+0000 7fae5722b700 -1 received signal: Hangup from (PID: 792695) UID: 0 2023-10-08T18:55:24.630 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:55:24.768 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T18:55:25.082 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-10-08T18:55:25.082+0000 7eff1a006700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128247) UID: 0 2023-10-08T18:55:25.082 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-10-08T18:55:25.082+0000 7f3991658700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128247) UID: 0 2023-10-08T18:55:25.083 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-10-08T18:55:25.082+0000 7f0d20ed4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128247) UID: 0 2023-10-08T18:55:25.083 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T18:55:25.082+0000 7ff165866700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128247) UID: 0 2023-10-08T18:55:25.635 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-10-08T18:55:25.635+0000 7fd76dbb2700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 795497) UID: 0 2023-10-08T18:55:25.646 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-10-08T18:55:25.635+0000 7f00eeb81700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 795497) UID: 0 2023-10-08T19:04:22.319 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:04:22.437 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:04:54.588 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:04:54.639 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:05:24.992 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:05:25.143 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:05:55.598 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:05:55.994 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:06:26.332 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:06:26.361 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:06:56.973 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:06:56.977 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:07:27.074 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:07:27.299 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:07:58.247 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:07:58.374 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:08:28.473 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:08:28.533 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:08:58.733 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:08:58.743 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:09:28.906 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:09:28.927 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:09:59.345 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:09:59.524 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:10:30.849 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:10:30.954 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:11:01.253 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:11:01.332 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:11:32.549 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:11:32.562 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:12:03.081 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:12:03.097 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:12:33.350 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:12:33.457 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:13:05.153 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:13:05.217 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:13:36.318 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:13:36.370 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:14:07.590 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:14:07.608 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:14:38.089 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:14:38.114 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:15:08.934 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:15:09.031 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:15:39.721 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:15:39.791 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:16:11.069 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:16:11.132 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:16:41.779 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:16:42.000 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:17:14.006 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:17:14.027 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:17:44.336 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:17:44.344 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:18:14.723 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:18:14.826 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:18:44.897 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:18:44.901 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:19:15.570 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:19:15.604 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:19:47.860 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:19:47.876 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:20:18.233 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:20:18.237 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:20:48.324 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:20:48.437 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:21:18.862 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:21:18.940 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:21:50.178 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:21:50.207 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:22:20.665 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:22:20.689 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:22:51.310 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:22:51.314 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:23:21.620 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:23:21.679 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:23:51.837 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:23:51.841 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:24:21.926 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:24:21.929 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:24:21.988 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-10-08T19:24:21.988+0000 7f3991658700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129357) UID: 0 2023-10-08T19:24:21.988 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-10-08T19:24:21.988+0000 7eff1a006700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129357) UID: 0 2023-10-08T19:24:21.988 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-10-08T19:24:21.988+0000 7f0d20ed4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129357) UID: 0 2023-10-08T19:24:21.989 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T19:24:21.988+0000 7ff165866700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129357) UID: 0 2023-10-08T19:24:22.011 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-10-08T19:24:22.011+0000 7fd76dbb2700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 805232) UID: 0 2023-10-08T19:24:22.014 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-10-08T19:24:22.012+0000 7f00eeb81700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 805232) UID: 0 2023-10-08T19:26:07.991 INFO:teuthology.orchestra.run.smithi045.stdout:generic/650 2593s 2023-10-08T19:26:08.021 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/650 2023-10-08T19:26:08.021 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:26:08.024 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:08.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:26:08.096 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/651) 2023-10-08T19:26:08.687 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:26:08.697 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:26:08.698 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:26:08.699 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:26:08.699 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:09.732 INFO:teuthology.orchestra.run.smithi045.stdout:generic/651 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T19:26:09.746 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/651 2023-10-08T19:26:09.747 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/651 2023-10-08T19:26:09.747 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:26:09.757 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:09.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:26:09.830 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/652) 2023-10-08T19:26:10.350 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:26:10.357 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:26:10.358 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:26:10.359 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:26:10.359 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:11.390 INFO:teuthology.orchestra.run.smithi045.stdout:generic/652 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T19:26:11.395 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/652 2023-10-08T19:26:11.395 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/652 2023-10-08T19:26:11.395 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:26:11.398 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:11.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:26:11.455 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/653) 2023-10-08T19:26:11.880 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:26:11.898 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:26:11.898 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:26:11.900 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:26:11.900 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:12.937 INFO:teuthology.orchestra.run.smithi045.stdout:generic/653 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T19:26:12.943 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/653 2023-10-08T19:26:12.943 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/653 2023-10-08T19:26:12.943 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:26:12.946 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:12.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:26:12.997 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/654) 2023-10-08T19:26:13.488 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:26:13.499 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:26:13.500 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:26:13.501 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:26:13.501 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:14.502 INFO:teuthology.orchestra.run.smithi045.stdout:generic/654 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T19:26:14.507 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/654 2023-10-08T19:26:14.507 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/654 2023-10-08T19:26:14.507 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:26:14.513 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:14.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:26:14.555 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/655) 2023-10-08T19:26:15.021 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:26:15.027 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:26:15.028 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:26:15.029 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:26:15.029 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:16.119 INFO:teuthology.orchestra.run.smithi045.stdout:generic/655 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T19:26:16.127 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/655 2023-10-08T19:26:16.127 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/655 2023-10-08T19:26:16.127 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:26:16.130 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:16.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:26:16.180 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/656) 2023-10-08T19:26:16.641 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:26:16.650 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:26:16.650 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:26:16.655 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:26:16.655 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:17.278 INFO:teuthology.orchestra.run.smithi045.stdout:generic/656 [not run] kernel does not support mount_setattr syscall 2023-10-08T19:26:17.283 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/656 2023-10-08T19:26:17.284 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/656 2023-10-08T19:26:17.284 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:26:17.287 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:17.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:26:17.333 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/657) 2023-10-08T19:26:17.824 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:26:17.833 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:26:17.834 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:26:17.835 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:26:17.835 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:18.995 INFO:teuthology.orchestra.run.smithi045.stdout:generic/657 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T19:26:19.000 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/657 2023-10-08T19:26:19.001 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/657 2023-10-08T19:26:19.001 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:26:19.004 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:19.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:26:19.061 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/658) 2023-10-08T19:26:19.512 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:26:19.518 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:26:19.518 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:26:19.527 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:26:19.527 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:20.497 INFO:teuthology.orchestra.run.smithi045.stdout:generic/658 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T19:26:20.507 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/658 2023-10-08T19:26:20.507 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/658 2023-10-08T19:26:20.507 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:26:20.510 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:20.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:26:20.570 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/659) 2023-10-08T19:26:21.034 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:26:21.044 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:26:21.044 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:26:21.048 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:26:21.048 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:22.268 INFO:teuthology.orchestra.run.smithi045.stdout:generic/659 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T19:26:22.276 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/659 2023-10-08T19:26:22.276 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/659 2023-10-08T19:26:22.276 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:26:22.287 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:22.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:26:22.348 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/660) 2023-10-08T19:26:22.786 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:26:22.792 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:26:22.793 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:26:22.798 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:26:22.798 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:23.935 INFO:teuthology.orchestra.run.smithi045.stdout:generic/660 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T19:26:23.942 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/660 2023-10-08T19:26:23.942 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/660 2023-10-08T19:26:23.942 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:26:23.945 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:23.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:26:23.999 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/661) 2023-10-08T19:26:24.506 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:26:24.661 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:26:24.662 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:26:24.662 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:26:24.662 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:25.539 INFO:teuthology.orchestra.run.smithi045.stdout:generic/661 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T19:26:25.544 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/661 2023-10-08T19:26:25.544 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/661 2023-10-08T19:26:25.545 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:26:25.547 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:25.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:26:25.617 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/662) 2023-10-08T19:26:26.052 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:26:26.077 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:26:26.077 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:26:26.078 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:26:26.079 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:27.370 INFO:teuthology.orchestra.run.smithi045.stdout:generic/662 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T19:26:27.376 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/662 2023-10-08T19:26:27.376 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/662 2023-10-08T19:26:27.376 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:26:27.383 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:27.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:26:27.434 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/663) 2023-10-08T19:26:27.881 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:26:27.889 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:26:27.889 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:26:27.891 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:26:27.891 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:28.874 INFO:teuthology.orchestra.run.smithi045.stdout:generic/663 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T19:26:28.880 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/663 2023-10-08T19:26:28.880 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/663 2023-10-08T19:26:28.880 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:26:28.884 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:28.943 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:26:28.943 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/664) 2023-10-08T19:26:29.507 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:26:29.518 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:26:29.518 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:26:29.520 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:26:29.520 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:30.584 INFO:teuthology.orchestra.run.smithi045.stdout:generic/664 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T19:26:30.591 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/664 2023-10-08T19:26:30.591 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/664 2023-10-08T19:26:30.591 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:26:30.594 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:30.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:26:30.649 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/665) 2023-10-08T19:26:31.120 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:26:31.126 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:26:31.127 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:26:31.128 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:26:31.128 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:32.107 INFO:teuthology.orchestra.run.smithi045.stdout:generic/665 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T19:26:32.120 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/665 2023-10-08T19:26:32.121 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/665 2023-10-08T19:26:32.121 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:26:32.121 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:32.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:26:32.169 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/666) 2023-10-08T19:26:32.617 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:26:32.624 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:26:32.626 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:26:32.627 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:26:32.627 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:33.627 INFO:teuthology.orchestra.run.smithi045.stdout:generic/666 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T19:26:33.632 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/666 2023-10-08T19:26:33.632 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/666 2023-10-08T19:26:33.632 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:26:33.636 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:33.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:26:33.688 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/667) 2023-10-08T19:26:34.102 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:26:34.121 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:26:34.122 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:26:34.123 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:26:34.123 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:35.191 INFO:teuthology.orchestra.run.smithi045.stdout:generic/667 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T19:26:35.204 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/667 2023-10-08T19:26:35.204 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/667 2023-10-08T19:26:35.204 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:26:35.207 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:35.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:26:35.262 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/668) 2023-10-08T19:26:35.759 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:26:35.764 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:26:35.765 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:26:35.766 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:26:35.766 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:36.855 INFO:teuthology.orchestra.run.smithi045.stdout:generic/668 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T19:26:36.860 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/668 2023-10-08T19:26:36.860 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/668 2023-10-08T19:26:36.860 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:26:36.863 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:36.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:26:36.900 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/669) 2023-10-08T19:26:37.404 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:26:37.409 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:26:37.409 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:26:37.410 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:26:37.410 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:38.504 INFO:teuthology.orchestra.run.smithi045.stdout:generic/669 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T19:26:38.513 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/669 2023-10-08T19:26:38.513 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/669 2023-10-08T19:26:38.513 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:26:38.517 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:38.557 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:26:38.557 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/670) 2023-10-08T19:26:39.011 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:26:39.024 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:26:39.025 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:26:39.026 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:26:39.026 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:40.067 INFO:teuthology.orchestra.run.smithi045.stdout:generic/670 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T19:26:40.072 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/670 2023-10-08T19:26:40.073 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/670 2023-10-08T19:26:40.073 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:26:40.081 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:40.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:26:40.147 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/671) 2023-10-08T19:26:40.607 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:26:40.613 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:26:40.615 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:26:40.617 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:26:40.617 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:41.714 INFO:teuthology.orchestra.run.smithi045.stdout:generic/671 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T19:26:41.719 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/671 2023-10-08T19:26:41.719 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/671 2023-10-08T19:26:41.719 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:26:41.721 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:41.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:26:41.776 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/672) 2023-10-08T19:26:42.220 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:26:42.231 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:26:42.231 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:26:42.233 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:26:42.233 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:43.370 INFO:teuthology.orchestra.run.smithi045.stdout:generic/672 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T19:26:43.376 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/672 2023-10-08T19:26:43.376 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/672 2023-10-08T19:26:43.376 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:26:43.380 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:43.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:26:43.424 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/673) 2023-10-08T19:26:43.930 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:26:43.935 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:26:43.936 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:26:43.937 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:26:43.937 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:45.421 INFO:teuthology.orchestra.run.smithi045.stdout:generic/673 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T19:26:45.432 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/673 2023-10-08T19:26:45.432 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/673 2023-10-08T19:26:45.433 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:26:45.436 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:45.477 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:26:45.477 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/674) 2023-10-08T19:26:45.944 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:26:45.949 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:26:45.949 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:26:45.951 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:26:45.951 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:47.017 INFO:teuthology.orchestra.run.smithi045.stdout:generic/674 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-10-08T19:26:47.096 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/674 2023-10-08T19:26:47.096 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/674 2023-10-08T19:26:47.096 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:26:47.107 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:47.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:26:47.167 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/675) 2023-10-08T19:26:47.638 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:26:47.646 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:26:47.646 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:26:47.648 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:26:47.648 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:48.751 INFO:teuthology.orchestra.run.smithi045.stdout:generic/675 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T19:26:48.774 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/675 2023-10-08T19:26:48.774 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/675 2023-10-08T19:26:48.774 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:26:48.779 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:26:48.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:26:48.819 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/676) 2023-10-08T19:26:49.265 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:26:49.270 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:26:49.271 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:26:49.276 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:26:49.277 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:28:01.219 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:28:01.222 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:28:31.609 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:28:31.612 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:29:01.703 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:29:01.709 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:29:32.214 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:29:32.217 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:29:32.304 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-08T19:29:32.303+0000 7f850b43a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 818404) UID: 0 2023-10-08T19:29:32.305 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T19:29:32.304+0000 7f485127c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 818404) UID: 0 2023-10-08T19:29:32.306 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T19:29:32.305+0000 7fae5722b700 -1 Fail to open '/proc/818404/cmdline' error = (2) No such file or directory 2023-10-08T19:29:32.306 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T19:29:32.305+0000 7fae5722b700 -1 received signal: Hangup from (PID: 818404) UID: 0 2023-10-08T19:29:32.309 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T19:29:32.305+0000 7f12925ec700 -1 Fail to open '/proc/818404/cmdline' error = (2) No such file or directory 2023-10-08T19:29:32.310 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T19:29:32.305+0000 7f12925ec700 -1 received signal: Hangup from (PID: 818404) UID: 0 2023-10-08T19:33:17.547 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:33:17.550 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:33:17.876 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-10-08T19:33:17.876+0000 7fd76dbb2700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 818464) UID: 0 2023-10-08T19:33:17.876 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-10-08T19:33:17.876+0000 7f00eeb81700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 818464) UID: 0 2023-10-08T19:37:48.257 INFO:teuthology.orchestra.run.smithi045.stdout:generic/676 659s 2023-10-08T19:37:48.366 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/676 2023-10-08T19:37:48.367 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:37:48.369 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:37:48.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:37:48.475 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/677) 2023-10-08T19:37:49.374 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:37:49.388 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:37:49.389 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:37:49.390 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:37:49.390 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:37:50.284 INFO:teuthology.orchestra.run.smithi045.stdout:generic/677 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T19:37:50.291 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/677 2023-10-08T19:37:50.292 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/677 2023-10-08T19:37:50.292 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:37:50.294 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:37:50.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:37:50.331 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/678) 2023-10-08T19:37:50.783 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:37:50.805 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:37:50.806 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:37:50.809 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:37:50.809 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:37:51.537 INFO:teuthology.orchestra.run.smithi045.stdout:generic/678 [not run] kernel does not support IO_URING 2023-10-08T19:37:51.544 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/678 2023-10-08T19:37:51.544 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/678 2023-10-08T19:37:51.544 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:37:51.553 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:37:51.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:37:51.632 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/679) 2023-10-08T19:37:52.096 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:37:52.109 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:37:52.110 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:37:52.111 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:37:52.112 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:37:52.763 INFO:teuthology.orchestra.run.smithi045.stdout:generic/679 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T19:37:52.769 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/679 2023-10-08T19:37:52.769 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/679 2023-10-08T19:37:52.769 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:37:52.772 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:37:52.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:37:52.834 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/680) 2023-10-08T19:37:53.291 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:37:53.301 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:37:53.301 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:37:53.306 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:37:53.306 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:37:57.802 INFO:teuthology.orchestra.run.smithi045.stdout:generic/680 4s 2023-10-08T19:37:57.853 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/680 2023-10-08T19:37:57.854 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:37:57.856 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:37:57.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:37:57.923 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/681) 2023-10-08T19:37:58.450 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:37:58.455 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:37:58.456 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:37:58.457 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:37:58.457 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:37:59.208 INFO:teuthology.orchestra.run.smithi045.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-08T19:37:59.220 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/681 2023-10-08T19:37:59.220 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/681 2023-10-08T19:37:59.221 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:37:59.223 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:37:59.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:37:59.250 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/682) 2023-10-08T19:37:59.707 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:37:59.723 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:37:59.723 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:37:59.724 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:37:59.724 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:00.943 INFO:teuthology.orchestra.run.smithi045.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-08T19:38:00.948 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/682 2023-10-08T19:38:00.949 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/682 2023-10-08T19:38:00.949 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:38:00.951 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:00.984 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:38:00.984 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/683) 2023-10-08T19:38:01.449 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:38:01.464 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:38:01.465 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:38:01.466 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:38:01.466 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:02.299 INFO:teuthology.orchestra.run.smithi045.stdout:generic/683 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T19:38:02.321 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/683 2023-10-08T19:38:02.321 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/683 2023-10-08T19:38:02.321 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:38:02.324 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:02.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:38:02.390 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/684) 2023-10-08T19:38:02.843 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:38:02.849 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:38:02.849 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:38:02.850 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:38:02.850 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:09.321 INFO:teuthology.orchestra.run.smithi045.stdout:generic/684 - output mismatch (see /tmp/tmp.UxcFNZjwoAxfstests-dev/results//generic/684.out.bad) 2023-10-08T19:38:09.324 INFO:teuthology.orchestra.run.smithi045.stdout: --- tests/generic/684.out 2023-10-08 12:46:34.716308186 +0000 2023-10-08T19:38:09.324 INFO:teuthology.orchestra.run.smithi045.stdout: +++ /tmp/tmp.UxcFNZjwoAxfstests-dev/results//generic/684.out.bad 2023-10-08 19:38:09.288433214 +0000 2023-10-08T19:38:09.324 INFO:teuthology.orchestra.run.smithi045.stdout: @@ -1,19 +1,19 @@ 2023-10-08T19:38:09.325 INFO:teuthology.orchestra.run.smithi045.stdout: QA output created by 684 2023-10-08T19:38:09.325 INFO:teuthology.orchestra.run.smithi045.stdout: Test 1 - qa_user, non-exec file fpunch 2023-10-08T19:38:09.325 INFO:teuthology.orchestra.run.smithi045.stdout: 6666 -rwSrwSrw- TEST_DIR/684/a 2023-10-08T19:38:09.325 INFO:teuthology.orchestra.run.smithi045.stdout: -666 -rw-rw-rw- TEST_DIR/684/a 2023-10-08T19:38:09.325 INFO:teuthology.orchestra.run.smithi045.stdout: +6666 -rwSrwSrw- TEST_DIR/684/a 2023-10-08T19:38:09.325 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:09.325 INFO:teuthology.orchestra.run.smithi045.stdout: Test 2 - qa_user, group-exec file fpunch 2023-10-08T19:38:09.325 INFO:teuthology.orchestra.run.smithi045.stdout: 6676 -rwSrwsrw- TEST_DIR/684/a 2023-10-08T19:38:09.325 INFO:teuthology.orchestra.run.smithi045.stdout: -676 -rw-rwxrw- TEST_DIR/684/a 2023-10-08T19:38:09.325 INFO:teuthology.orchestra.run.smithi045.stdout: +6676 -rwSrwsrw- TEST_DIR/684/a 2023-10-08T19:38:09.325 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:09.326 INFO:teuthology.orchestra.run.smithi045.stdout: Test 3 - qa_user, user-exec file fpunch 2023-10-08T19:38:09.326 INFO:teuthology.orchestra.run.smithi045.stdout: 6766 -rwsrwSrw- TEST_DIR/684/a 2023-10-08T19:38:09.326 INFO:teuthology.orchestra.run.smithi045.stdout: -766 -rwxrw-rw- TEST_DIR/684/a 2023-10-08T19:38:09.326 INFO:teuthology.orchestra.run.smithi045.stdout: +6766 -rwsrwSrw- TEST_DIR/684/a 2023-10-08T19:38:09.326 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:09.326 INFO:teuthology.orchestra.run.smithi045.stdout: Test 4 - qa_user, all-exec file fpunch 2023-10-08T19:38:09.326 INFO:teuthology.orchestra.run.smithi045.stdout: 6777 -rwsrwsrwx TEST_DIR/684/a 2023-10-08T19:38:09.326 INFO:teuthology.orchestra.run.smithi045.stdout: -777 -rwxrwxrwx TEST_DIR/684/a 2023-10-08T19:38:09.326 INFO:teuthology.orchestra.run.smithi045.stdout: +6777 -rwsrwsrwx TEST_DIR/684/a 2023-10-08T19:38:09.326 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:09.326 INFO:teuthology.orchestra.run.smithi045.stdout: Test 5 - root, non-exec file fpunch 2023-10-08T19:38:09.326 INFO:teuthology.orchestra.run.smithi045.stdout: 6666 -rwSrwSrw- TEST_DIR/684/a 2023-10-08T19:38:09.327 INFO:teuthology.orchestra.run.smithi045.stdout: @@ -33,9 +33,9 @@ 2023-10-08T19:38:09.327 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:09.327 INFO:teuthology.orchestra.run.smithi045.stdout: Test 9 - qa_user, group-exec file fpunch, only sgid 2023-10-08T19:38:09.327 INFO:teuthology.orchestra.run.smithi045.stdout: 2676 -rw-rwsrw- TEST_DIR/684/a 2023-10-08T19:38:09.327 INFO:teuthology.orchestra.run.smithi045.stdout: -676 -rw-rwxrw- TEST_DIR/684/a 2023-10-08T19:38:09.327 INFO:teuthology.orchestra.run.smithi045.stdout: +2676 -rw-rwsrw- TEST_DIR/684/a 2023-10-08T19:38:09.327 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:09.327 INFO:teuthology.orchestra.run.smithi045.stdout: Test 10 - qa_user, all-exec file fpunch, only sgid 2023-10-08T19:38:09.327 INFO:teuthology.orchestra.run.smithi045.stdout: 2777 -rwxrwsrwx TEST_DIR/684/a 2023-10-08T19:38:09.327 INFO:teuthology.orchestra.run.smithi045.stdout: -777 -rwxrwxrwx TEST_DIR/684/a 2023-10-08T19:38:09.327 INFO:teuthology.orchestra.run.smithi045.stdout: +2777 -rwxrwsrwx TEST_DIR/684/a 2023-10-08T19:38:09.327 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:09.349 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/684 2023-10-08T19:38:09.349 INFO:teuthology.orchestra.run.smithi045.stdout:Failures: generic/684 2023-10-08T19:38:09.350 INFO:teuthology.orchestra.run.smithi045.stdout:Failed 1 of 1 tests 2023-10-08T19:38:09.352 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:09.410 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T19:38:09.410 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-08T19:38:09.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-08T19:38:09.411 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/685) 2023-10-08T19:38:09.921 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:38:09.926 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:38:09.926 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:38:09.928 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:38:09.928 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:10.693 INFO:teuthology.orchestra.run.smithi045.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-08T19:38:10.699 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/685 2023-10-08T19:38:10.699 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/685 2023-10-08T19:38:10.699 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:38:10.702 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:10.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:38:10.783 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/686) 2023-10-08T19:38:11.245 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:38:11.250 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:38:11.250 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:38:11.251 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:38:11.251 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:12.070 INFO:teuthology.orchestra.run.smithi045.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-10-08T19:38:12.079 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/686 2023-10-08T19:38:12.079 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/686 2023-10-08T19:38:12.080 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:38:12.082 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:12.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:38:12.146 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/687) 2023-10-08T19:38:12.582 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:38:12.598 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:38:12.598 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:38:12.600 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:38:12.600 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:13.402 INFO:teuthology.orchestra.run.smithi045.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-10-08T19:38:13.424 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/687 2023-10-08T19:38:13.424 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/687 2023-10-08T19:38:13.424 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:38:13.426 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:13.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:38:13.484 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/688) 2023-10-08T19:38:13.924 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:38:13.930 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:38:13.930 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:38:13.931 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:38:13.931 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:14.644 INFO:teuthology.orchestra.run.smithi045.stdout:generic/688 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T19:38:14.650 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/688 2023-10-08T19:38:14.650 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/688 2023-10-08T19:38:14.650 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:38:14.653 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:14.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:38:14.726 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/689) 2023-10-08T19:38:15.160 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:38:15.186 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:38:15.187 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:38:15.189 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:38:15.189 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:15.786 INFO:teuthology.orchestra.run.smithi045.stdout:generic/689 [not run] kernel does not support mount_setattr syscall 2023-10-08T19:38:15.811 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/689 2023-10-08T19:38:15.811 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/689 2023-10-08T19:38:15.811 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:38:15.815 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:15.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:38:15.844 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/690) 2023-10-08T19:38:16.369 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:38:16.375 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:38:16.376 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:38:16.377 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:38:16.377 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:17.191 INFO:teuthology.orchestra.run.smithi045.stdout:generic/690 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T19:38:17.196 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/690 2023-10-08T19:38:17.197 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/690 2023-10-08T19:38:17.197 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:38:17.201 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:17.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:38:17.252 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/691) 2023-10-08T19:38:17.756 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:38:17.761 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:38:17.761 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:38:17.762 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:38:17.763 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:18.323 INFO:teuthology.orchestra.run.smithi045.stdout:generic/691 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-08T19:38:18.331 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/691 2023-10-08T19:38:18.331 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/691 2023-10-08T19:38:18.331 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:38:18.333 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:18.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:38:18.365 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/692) 2023-10-08T19:38:18.883 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:38:18.893 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:38:18.893 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:38:18.897 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:38:18.897 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:19.606 INFO:teuthology.orchestra.run.smithi045.stdout:generic/692 [not run] fsverity utility required, skipped this test 2023-10-08T19:38:19.615 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/692 2023-10-08T19:38:19.615 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/692 2023-10-08T19:38:19.616 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:38:19.618 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:19.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:38:19.660 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/693) 2023-10-08T19:38:20.057 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:38:20.063 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:38:20.064 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:38:20.065 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:38:20.065 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:21.002 INFO:teuthology.orchestra.run.smithi045.stdout:generic/693 [not run] kernel does not support ceph encryption 2023-10-08T19:38:21.034 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/693 2023-10-08T19:38:21.034 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/693 2023-10-08T19:38:21.034 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:38:21.040 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:21.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:38:21.079 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/694) 2023-10-08T19:38:21.566 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:38:21.571 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:38:21.572 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:38:21.573 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:38:21.573 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:29.071 INFO:teuthology.orchestra.run.smithi045.stdout:generic/694 7s 2023-10-08T19:38:29.088 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/694 2023-10-08T19:38:29.089 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:38:29.092 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:29.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:38:29.160 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/695) 2023-10-08T19:38:29.626 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:38:29.634 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:38:29.635 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:38:29.637 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:38:29.637 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:30.371 INFO:teuthology.orchestra.run.smithi045.stdout:generic/695 [not run] require 172.21.15.45:6789:/scratch to be valid block disk 2023-10-08T19:38:30.378 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/695 2023-10-08T19:38:30.379 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/695 2023-10-08T19:38:30.379 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:38:30.382 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:30.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:38:30.428 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/696) 2023-10-08T19:38:30.842 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:38:30.850 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:38:30.850 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:38:30.852 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:38:30.852 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:32.074 INFO:teuthology.orchestra.run.smithi045.stdout:generic/696 1s 2023-10-08T19:38:32.084 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/696 2023-10-08T19:38:32.084 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:38:32.087 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:32.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:38:32.131 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/697) 2023-10-08T19:38:32.645 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:38:32.650 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:38:32.650 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:38:32.652 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:38:32.652 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:33.449 INFO:teuthology.orchestra.run.smithi045.stdout:generic/697 1s 2023-10-08T19:38:33.457 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/697 2023-10-08T19:38:33.457 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:38:33.461 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:33.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:38:33.555 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/698) 2023-10-08T19:38:34.017 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:38:34.023 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:38:34.023 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:38:34.029 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:38:34.029 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:34.826 INFO:teuthology.orchestra.run.smithi045.stdout:generic/698 [not run] kernel does not support mount_setattr syscall 2023-10-08T19:38:34.831 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/698 2023-10-08T19:38:34.831 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/698 2023-10-08T19:38:34.831 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:38:34.850 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:34.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:38:34.923 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/699) 2023-10-08T19:38:35.349 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:38:35.354 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:38:35.354 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:38:35.355 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:38:35.356 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:36.072 INFO:teuthology.orchestra.run.smithi045.stdout:generic/699 [not run] kernel does not support mount_setattr syscall 2023-10-08T19:38:36.079 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/699 2023-10-08T19:38:36.079 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/699 2023-10-08T19:38:36.079 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:38:36.081 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:36.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:38:36.124 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/700) 2023-10-08T19:38:36.564 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:38:36.571 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:38:36.572 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:38:36.574 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:38:36.574 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:37.409 INFO:teuthology.orchestra.run.smithi045.stdout:generic/700 [not run] kernel doesn't support renameat2 syscall 2023-10-08T19:38:37.417 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/700 2023-10-08T19:38:37.417 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/700 2023-10-08T19:38:37.418 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:38:37.422 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:37.477 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:38:37.477 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/701) 2023-10-08T19:38:37.972 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:38:37.978 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:38:37.979 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:38:37.986 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:38:37.987 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:46.902 INFO:teuthology.orchestra.run.smithi045.stdout:generic/701 8s 2023-10-08T19:38:46.913 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/701 2023-10-08T19:38:46.913 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:38:46.915 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:46.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:38:46.975 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/702) 2023-10-08T19:38:47.445 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:38:47.460 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:38:47.460 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:38:47.461 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:38:47.462 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:48.454 INFO:teuthology.orchestra.run.smithi045.stdout:generic/702 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-08T19:38:48.460 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/702 2023-10-08T19:38:48.460 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/702 2023-10-08T19:38:48.461 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:38:48.467 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:48.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:38:48.530 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/703) 2023-10-08T19:38:48.995 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:38:49.018 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:38:49.019 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:38:49.024 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:38:49.024 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:50.008 INFO:teuthology.orchestra.run.smithi045.stdout:generic/703 [not run] kernel does not support IO_URING 2023-10-08T19:38:50.014 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/703 2023-10-08T19:38:50.015 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/703 2023-10-08T19:38:50.015 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:38:50.017 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:50.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:38:50.116 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/704) 2023-10-08T19:38:50.668 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:38:50.684 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:38:50.684 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:38:50.686 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:38:50.686 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:51.946 INFO:teuthology.orchestra.run.smithi045.stdout:generic/704 [not run] require 172.21.15.45:6789:/test to be valid block disk 2023-10-08T19:38:51.951 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/704 2023-10-08T19:38:51.951 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/704 2023-10-08T19:38:51.951 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:38:51.954 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:51.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:38:51.998 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/705) 2023-10-08T19:38:52.474 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:38:52.480 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:38:52.481 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:38:52.482 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:38:52.483 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:53.404 INFO:teuthology.orchestra.run.smithi045.stdout:generic/705 [not run] ceph does not support shutdown 2023-10-08T19:38:53.437 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/705 2023-10-08T19:38:53.437 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/705 2023-10-08T19:38:53.438 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:38:53.439 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:53.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:38:53.474 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/706) 2023-10-08T19:38:53.931 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:38:53.936 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:38:53.937 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:38:53.938 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:38:53.938 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:56.820 INFO:teuthology.orchestra.run.smithi045.stdout:generic/706 2s 2023-10-08T19:38:56.840 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/706 2023-10-08T19:38:56.841 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T19:38:56.843 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:38:56.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T19:38:56.889 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/707) 2023-10-08T19:38:57.358 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T19:38:57.366 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T19:38:57.367 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T19:38:57.368 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T19:38:57.368 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T19:39:45.328 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:39:45.331 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:39:45.635 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-10-08T19:39:45.634+0000 7fd76dbb2700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 836967) UID: 0 2023-10-08T19:39:45.635 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-10-08T19:39:45.634+0000 7f00eeb81700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 836967) UID: 0 2023-10-08T19:42:52.273 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-08T19:42:52.273+0000 7f850b43a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 846004) UID: 0 2023-10-08T19:42:52.274 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T19:42:52.273+0000 7fae5722b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 846004) UID: 0 2023-10-08T19:42:52.275 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T19:42:52.275+0000 7f12925ec700 -1 Fail to open '/proc/846004/cmdline' error = (2) No such file or directory 2023-10-08T19:42:52.275 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T19:42:52.275+0000 7f12925ec700 -1 received signal: Hangup from (PID: 846004) UID: 0 2023-10-08T19:42:52.275 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T19:42:52.273+0000 7f485127c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 846004) UID: 0 2023-10-08T19:48:57.635 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:48:57.639 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:49:27.747 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:49:27.749 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:49:57.819 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:49:57.822 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:50:27.894 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:50:27.897 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:50:58.289 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:50:58.292 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:51:28.371 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:51:28.420 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:51:58.504 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:51:58.506 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:52:28.577 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:52:28.582 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:52:59.083 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:52:59.087 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:53:29.412 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:53:29.418 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:53:59.493 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:53:59.495 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:54:29.598 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:54:29.605 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:54:59.751 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:54:59.753 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:55:29.903 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:55:29.910 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:55:29.984 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-10-08T19:55:29.984+0000 7f00eeb81700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 885884) UID: 0 2023-10-08T19:55:29.984 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-10-08T19:55:29.984+0000 7fd76dbb2700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 885884) UID: 0 2023-10-08T19:58:39.801 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:58:39.828 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T19:58:39.878 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-10-08T19:58:39.878+0000 7eff1a006700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130308) UID: 0 2023-10-08T19:58:39.879 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-10-08T19:58:39.878+0000 7ff165866700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130308) UID: 0 2023-10-08T19:58:39.879 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-10-08T19:58:39.878+0000 7f3991658700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130308) UID: 0 2023-10-08T19:58:39.879 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-10-08T19:58:39.879+0000 7f0d20ed4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130308) UID: 0 2023-10-08T20:03:50.534 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T20:03:50.537 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T20:04:20.687 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T20:04:20.690 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T20:04:50.795 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T20:04:50.799 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T20:05:20.885 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T20:05:20.897 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T20:05:50.990 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T20:05:50.992 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T20:06:21.076 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T20:06:21.083 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T20:06:51.170 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T20:06:51.173 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T20:07:21.255 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T20:07:21.261 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T20:07:51.333 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T20:07:51.335 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T20:07:51.394 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-08T20:07:51.393+0000 7f850b43a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 926780) UID: 0 2023-10-08T20:07:51.395 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T20:07:51.395+0000 7f485127c700 -1 Fail to open '/proc/926780/cmdline' error = (2) No such file or directory 2023-10-08T20:07:51.395 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-08T20:07:51.395+0000 7f485127c700 -1 received signal: Hangup from (PID: 926780) UID: 0 2023-10-08T20:07:51.402 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T20:07:51.396+0000 7f12925ec700 -1 Fail to open '/proc/926780/cmdline' error = (2) No such file or directory 2023-10-08T20:07:51.403 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-08T20:07:51.396+0000 7f12925ec700 -1 received signal: Hangup from (PID: 926780) UID: 0 2023-10-08T20:07:51.403 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-08T20:07:51.393+0000 7fae5722b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 926780) UID: 0 2023-10-08T20:10:50.245 INFO:teuthology.orchestra.run.smithi045.stdout:generic/707 1913s 2023-10-08T20:10:50.261 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/707 2023-10-08T20:10:50.262 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T20:10:50.264 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:10:50.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T20:10:50.277 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/708) 2023-10-08T20:10:50.771 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T20:10:50.776 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T20:10:50.780 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T20:10:50.781 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T20:10:50.781 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:10:54.712 INFO:teuthology.orchestra.run.smithi045.stdout:generic/708 1s 2023-10-08T20:10:54.743 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/708 2023-10-08T20:10:54.747 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T20:10:54.747 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:10:54.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T20:10:54.843 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/709) 2023-10-08T20:10:55.243 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T20:10:55.248 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T20:10:55.248 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T20:10:55.249 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T20:10:55.250 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:10:56.114 INFO:teuthology.orchestra.run.smithi045.stdout:generic/709 [not run] xfs_io swapext -v vfs not supported on ceph 2023-10-08T20:10:56.127 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/709 2023-10-08T20:10:56.127 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/709 2023-10-08T20:10:56.127 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T20:10:56.130 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:10:56.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T20:10:56.203 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/710) 2023-10-08T20:10:56.651 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T20:10:56.656 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T20:10:56.657 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T20:10:56.658 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T20:10:56.658 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:10:57.273 INFO:teuthology.orchestra.run.smithi045.stdout:generic/710 [not run] xfs_io swapext -v vfs not supported on ceph 2023-10-08T20:10:57.279 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/710 2023-10-08T20:10:57.279 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/710 2023-10-08T20:10:57.279 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T20:10:57.282 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:10:57.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T20:10:57.352 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/711) 2023-10-08T20:10:57.769 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T20:10:57.774 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T20:10:57.774 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T20:10:57.776 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T20:10:57.776 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:10:59.167 INFO:teuthology.orchestra.run.smithi045.stdout:generic/711 [not run] xfs_io swapext -v vfs not supported on ceph 2023-10-08T20:10:59.172 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/711 2023-10-08T20:10:59.172 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/711 2023-10-08T20:10:59.172 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T20:10:59.181 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:10:59.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T20:10:59.242 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/712) 2023-10-08T20:10:59.602 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T20:10:59.607 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T20:10:59.608 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T20:10:59.609 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T20:10:59.609 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:00.145 INFO:teuthology.orchestra.run.smithi045.stdout:generic/712 [not run] xfs_io swapext -v vfs not supported on ceph 2023-10-08T20:11:00.150 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/712 2023-10-08T20:11:00.150 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/712 2023-10-08T20:11:00.150 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T20:11:00.153 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:00.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T20:11:00.262 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/713) 2023-10-08T20:11:00.620 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T20:11:00.630 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T20:11:00.630 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T20:11:00.632 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T20:11:00.632 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:01.186 INFO:teuthology.orchestra.run.smithi045.stdout:generic/713 [not run] xfs_io swapext -v vfs -s 64k -l 64k not supported on ceph 2023-10-08T20:11:01.193 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/713 2023-10-08T20:11:01.194 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/713 2023-10-08T20:11:01.194 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T20:11:01.197 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:01.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T20:11:01.268 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/714) 2023-10-08T20:11:01.693 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T20:11:01.698 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T20:11:01.698 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T20:11:01.700 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T20:11:01.700 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:02.291 INFO:teuthology.orchestra.run.smithi045.stdout:generic/714 [not run] xfs_io swapext -v vfs not supported on ceph 2023-10-08T20:11:02.297 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/714 2023-10-08T20:11:02.297 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/714 2023-10-08T20:11:02.297 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T20:11:02.299 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:02.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T20:11:02.360 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/715) 2023-10-08T20:11:02.732 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T20:11:02.737 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T20:11:02.738 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T20:11:02.739 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T20:11:02.739 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:03.324 INFO:teuthology.orchestra.run.smithi045.stdout:generic/715 [not run] xfs_io swapext -v vfs -s 64k -l 64k not supported on ceph 2023-10-08T20:11:03.329 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/715 2023-10-08T20:11:03.329 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/715 2023-10-08T20:11:03.329 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T20:11:03.332 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:03.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T20:11:03.408 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/716) 2023-10-08T20:11:03.795 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T20:11:03.805 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T20:11:03.805 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T20:11:03.807 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T20:11:03.807 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:04.381 INFO:teuthology.orchestra.run.smithi045.stdout:generic/716 [not run] xfs_io swapext -v vfs not supported on ceph 2023-10-08T20:11:04.391 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/716 2023-10-08T20:11:04.391 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/716 2023-10-08T20:11:04.392 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T20:11:04.394 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:04.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T20:11:04.471 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/717) 2023-10-08T20:11:04.802 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T20:11:04.811 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T20:11:04.812 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T20:11:04.813 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T20:11:04.813 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:05.377 INFO:teuthology.orchestra.run.smithi045.stdout:generic/717 [not run] xfs_io swapext -v vfs not supported on ceph 2023-10-08T20:11:05.380 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/717 2023-10-08T20:11:05.380 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/717 2023-10-08T20:11:05.380 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T20:11:05.383 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:05.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T20:11:05.453 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/718) 2023-10-08T20:11:05.862 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T20:11:05.867 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T20:11:05.868 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T20:11:05.869 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T20:11:05.869 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:06.462 INFO:teuthology.orchestra.run.smithi045.stdout:generic/718 [not run] xfs_io swapext -v vfs not supported on ceph 2023-10-08T20:11:06.469 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/718 2023-10-08T20:11:06.469 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/718 2023-10-08T20:11:06.469 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T20:11:06.473 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:06.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T20:11:06.533 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/719) 2023-10-08T20:11:06.921 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T20:11:06.929 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T20:11:06.932 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T20:11:06.934 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T20:11:06.934 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:07.504 INFO:teuthology.orchestra.run.smithi045.stdout:generic/719 [not run] xfs_io swapext -v vfs not supported on ceph 2023-10-08T20:11:07.509 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/719 2023-10-08T20:11:07.510 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/719 2023-10-08T20:11:07.510 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T20:11:07.521 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:07.579 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T20:11:07.581 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T20:11:07.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T20:11:07.591 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/720) 2023-10-08T20:11:07.652 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-10-08T20:11:07.652+0000 7fd76dbb2700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 941153) UID: 0 2023-10-08T20:11:07.653 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-10-08T20:11:07.653+0000 7f00eeb81700 -1 received signal: Hangup from (PID: 941153) UID: 0 2023-10-08T20:11:08.142 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T20:11:08.149 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T20:11:08.152 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T20:11:08.154 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T20:11:08.154 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:08.811 INFO:teuthology.orchestra.run.smithi045.stdout:generic/720 [not run] xfs_io swapext -v vfs not supported on ceph 2023-10-08T20:11:08.816 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/720 2023-10-08T20:11:08.816 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/720 2023-10-08T20:11:08.816 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T20:11:08.822 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:08.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T20:11:08.927 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/721) 2023-10-08T20:11:09.452 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T20:11:09.475 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T20:11:09.475 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T20:11:09.476 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T20:11:09.477 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:10.161 INFO:teuthology.orchestra.run.smithi045.stdout:generic/721 [not run] xfs_io startupdate support is missing 2023-10-08T20:11:10.179 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/721 2023-10-08T20:11:10.179 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/721 2023-10-08T20:11:10.179 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T20:11:10.182 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:10.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T20:11:10.267 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/722) 2023-10-08T20:11:10.697 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T20:11:10.702 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T20:11:10.703 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T20:11:10.704 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T20:11:10.704 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:11.332 INFO:teuthology.orchestra.run.smithi045.stdout:generic/722 [not run] xfs_io swapext -v vfs -a not supported on ceph 2023-10-08T20:11:11.339 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/722 2023-10-08T20:11:11.339 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/722 2023-10-08T20:11:11.340 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T20:11:11.342 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:11.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T20:11:11.422 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/723) 2023-10-08T20:11:11.909 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T20:11:11.914 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T20:11:11.915 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T20:11:11.917 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T20:11:11.917 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:12.576 INFO:teuthology.orchestra.run.smithi045.stdout:generic/723 [not run] xfs_io swapext -v vfs not supported on ceph 2023-10-08T20:11:12.589 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/723 2023-10-08T20:11:12.589 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/723 2023-10-08T20:11:12.589 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T20:11:12.598 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:12.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T20:11:12.670 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/724) 2023-10-08T20:11:13.110 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T20:11:13.116 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T20:11:13.116 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T20:11:13.118 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T20:11:13.118 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:13.786 INFO:teuthology.orchestra.run.smithi045.stdout:generic/724 [not run] xfs_io swapext -v vfs -a not supported on ceph 2023-10-08T20:11:13.790 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/724 2023-10-08T20:11:13.791 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/724 2023-10-08T20:11:13.791 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T20:11:13.793 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:13.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T20:11:13.856 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/725) 2023-10-08T20:11:14.306 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T20:11:14.320 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T20:11:14.320 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T20:11:14.322 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T20:11:14.322 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:14.931 INFO:teuthology.orchestra.run.smithi045.stdout:generic/725 [not run] xfs_io swapext -v vfs -a not supported on ceph 2023-10-08T20:11:14.938 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/725 2023-10-08T20:11:14.938 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/725 2023-10-08T20:11:14.938 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T20:11:14.946 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:15.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T20:11:15.019 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/726) 2023-10-08T20:11:15.512 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T20:11:15.518 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T20:11:15.519 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T20:11:15.520 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T20:11:15.520 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:16.909 INFO:teuthology.orchestra.run.smithi045.stdout:generic/726 [not run] xfs_io swapext -v vfs -a not supported on ceph 2023-10-08T20:11:16.924 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/726 2023-10-08T20:11:16.924 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/726 2023-10-08T20:11:16.925 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T20:11:16.934 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:17.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T20:11:17.022 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/727) 2023-10-08T20:11:17.487 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T20:11:17.494 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T20:11:17.494 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T20:11:17.495 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T20:11:17.495 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:18.217 INFO:teuthology.orchestra.run.smithi045.stdout:generic/727 [not run] xfs_io swapext -v vfs -a not supported on ceph 2023-10-08T20:11:18.226 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/727 2023-10-08T20:11:18.226 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/727 2023-10-08T20:11:18.226 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T20:11:18.229 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:18.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T20:11:18.297 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/728) 2023-10-08T20:11:18.843 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T20:11:18.849 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T20:11:18.849 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T20:11:18.850 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T20:11:18.850 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:23.653 INFO:teuthology.orchestra.run.smithi045.stdout:generic/728 4s 2023-10-08T20:11:23.661 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/728 2023-10-08T20:11:23.661 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T20:11:23.664 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:23.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T20:11:23.733 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/729) 2023-10-08T20:11:24.179 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T20:11:24.187 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T20:11:24.188 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T20:11:24.189 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T20:11:24.189 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:25.521 INFO:teuthology.orchestra.run.smithi045.stdout:generic/729 1s 2023-10-08T20:11:25.601 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/729 2023-10-08T20:11:25.601 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T20:11:25.611 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:25.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T20:11:25.666 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/730) 2023-10-08T20:11:26.122 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T20:11:26.127 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T20:11:26.127 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T20:11:26.128 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T20:11:26.128 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:26.893 INFO:teuthology.orchestra.run.smithi045.stdout:generic/730 [not run] require 172.21.15.45:6789:/test to be valid block disk 2023-10-08T20:11:26.904 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/730 2023-10-08T20:11:26.904 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/730 2023-10-08T20:11:26.904 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T20:11:26.906 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:26.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T20:11:26.948 DEBUG:teuthology.orchestra.run.smithi045:> (cd /tmp/tmp.UxcFNZjwoAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/731) 2023-10-08T20:11:27.424 INFO:teuthology.orchestra.run.smithi045.stdout:FSTYP -- ceph 2023-10-08T20:11:27.429 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM -- Linux/x86_64 smithi045 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-08T20:11:27.429 INFO:teuthology.orchestra.run.smithi045.stdout:MKFS_OPTIONS -- 172.21.15.45:6789:/scratch 2023-10-08T20:11:27.430 INFO:teuthology.orchestra.run.smithi045.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAypCJlqoRsJBAAbBf15jM5AUdH6PoiO/bDkA== -o context=system_u:object_r:root_t:s0 172.21.15.45:6789:/scratch /tmp/tmp.f1V86IqBIQscratch 2023-10-08T20:11:27.430 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:28.030 INFO:teuthology.orchestra.run.smithi045.stdout:generic/731 [not run] require 172.21.15.45:6789:/test to be valid block disk 2023-10-08T20:11:28.039 INFO:teuthology.orchestra.run.smithi045.stdout:Ran: generic/731 2023-10-08T20:11:28.039 INFO:teuthology.orchestra.run.smithi045.stdout:Not run: generic/731 2023-10-08T20:11:28.040 INFO:teuthology.orchestra.run.smithi045.stdout:Passed all 1 tests 2023-10-08T20:11:28.043 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:28.092 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T20:11:28.092 INFO:tasks.cephfs.xfstests_dev:=========================================================Total number of tests failed = 2========================================================= 2023-10-08T20:11:28.092 DEBUG:teuthology.orchestra.run.smithi045:> sudo userdel --force --remove fsgqa 2023-10-08T20:11:32.773 DEBUG:teuthology.orchestra.run.smithi045:> sudo userdel --force --remove 123456-fsgqa 2023-10-08T20:11:33.994 DEBUG:teuthology.orchestra.run.smithi045:> sudo groupdel fsgqa 2023-10-08T20:11:34.167 INFO:teuthology.orchestra.run.smithi045.stderr:groupdel: group 'fsgqa' does not exist 2023-10-08T20:11:34.169 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T20:11:34.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T20:11:34.170 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.UxcFNZjwoAxfstests-dev/results) 2023-10-08T20:11:34.262 INFO:teuthology.orchestra.run.smithi045.stdout: File: /tmp/tmp.UxcFNZjwoAxfstests-dev/results 2023-10-08T20:11:34.262 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 4096 Blocks: 8 IO Block: 4096 directory 2023-10-08T20:11:34.262 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 801h/2049d Inode: 403156 Links: 3 2023-10-08T20:11:34.262 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T20:11:34.262 INFO:teuthology.orchestra.run.smithi045.stdout:Context: unconfined_u:object_r:user_tmp_t:s0 2023-10-08T20:11:34.262 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-10-08 12:47:51.414130901 +0000 2023-10-08T20:11:34.262 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-10-08 20:11:25.598681570 +0000 2023-10-08T20:11:34.262 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-10-08 20:11:25.598681570 +0000 2023-10-08T20:11:34.262 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2023-10-08 12:47:51.414130901 +0000 2023-10-08T20:11:34.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T20:11:34.264 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p /var/log/ceph/xfstests-dev-results) 2023-10-08T20:11:34.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T20:11:34.427 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp -r /tmp/tmp.UxcFNZjwoAxfstests-dev/results /var/log/ceph/xfstests-dev-results) 2023-10-08T20:11:36.092 INFO:tasks.cephfs.xfstests_dev:results dir from xfstests-dev has been saved; it was copied from /tmp/tmp.UxcFNZjwoAxfstests-dev to /var/log/ceph. 2023-10-08T20:11:36.092 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf /tmp/tmp.UxcFNZjwoAxfstests-dev 2023-10-08T20:11:36.755 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T20:11:36.755 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T20:11:37.036 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T20:11:37.150 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T20:11:37.150 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T20:11:37.150 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T20:11:37.243 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T20:11:37.243 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T20:11:37.307 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T20:11:39.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.047+0000 7fbf1cdfa700 1 -- 172.21.15.45:0/187311390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf1815c750 msgr2=0x7fbf181416a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:39.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.047+0000 7fbf1cdfa700 1 --2- 172.21.15.45:0/187311390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf1815c750 0x7fbf181416a0 secure :-1 s=READY pgs=3244 cs=0 l=1 rev1=1 crypto rx=0x7fbf10009fd0 tx=0x7fbf1000b380 comp rx=0 tx=0).stop 2023-10-08T20:11:39.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.047+0000 7fbf1cdfa700 1 -- 172.21.15.45:0/187311390 shutdown_connections 2023-10-08T20:11:39.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.047+0000 7fbf1cdfa700 1 --2- 172.21.15.45:0/187311390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf1815c750 0x7fbf181416a0 unknown :-1 s=CLOSED pgs=3244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:39.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.047+0000 7fbf1cdfa700 1 -- 172.21.15.45:0/187311390 >> 172.21.15.45:0/187311390 conn(0x7fbf1806e010 msgr2=0x7fbf1806e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:39.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.052+0000 7fbf1cdfa700 1 -- 172.21.15.45:0/187311390 shutdown_connections 2023-10-08T20:11:39.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.055+0000 7fbf1cdfa700 1 -- 172.21.15.45:0/187311390 wait complete. 2023-10-08T20:11:39.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.057+0000 7fbf1cdfa700 1 Processor -- start 2023-10-08T20:11:39.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.057+0000 7fbf1cdfa700 1 -- start start 2023-10-08T20:11:39.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.058+0000 7fbf1cdfa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf1813ec20 0x7fbf181f1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:39.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.058+0000 7fbf1cdfa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf1815c750 0x7fbf180adef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:39.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.058+0000 7fbf1cdfa700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf1815e5a0 0x7fbf18140210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:39.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.058+0000 7fbf1cdfa700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1813b900 con 0x7fbf1813ec20 2023-10-08T20:11:39.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.058+0000 7fbf1cdfa700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf181f2240 con 0x7fbf1815c750 2023-10-08T20:11:39.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.058+0000 7fbf1cdfa700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf180ae7f0 con 0x7fbf1815e5a0 2023-10-08T20:11:39.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.058+0000 7fbf1659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf1813ec20 0x7fbf181f1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:39.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.058+0000 7fbf1659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf1813ec20 0x7fbf181f1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51204/0 (socket says 172.21.15.45:51204) 2023-10-08T20:11:39.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.058+0000 7fbf1659c700 1 -- 172.21.15.45:0/3512631066 learned_addr learned my addr 172.21.15.45:0/3512631066 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:11:39.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.059+0000 7fbf1659c700 1 -- 172.21.15.45:0/3512631066 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf1815e5a0 msgr2=0x7fbf18140210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T20:11:39.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.059+0000 7fbf1659c700 1 --2- 172.21.15.45:0/3512631066 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf1815e5a0 0x7fbf18140210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:39.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.059+0000 7fbf1659c700 1 -- 172.21.15.45:0/3512631066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf1815c750 msgr2=0x7fbf180adef0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T20:11:39.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.059+0000 7fbf1659c700 1 --2- 172.21.15.45:0/3512631066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf1815c750 0x7fbf180adef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:39.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.059+0000 7fbf1659c700 1 -- 172.21.15.45:0/3512631066 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf10009d00 con 0x7fbf1813ec20 2023-10-08T20:11:39.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.059+0000 7fbf1659c700 1 --2- 172.21.15.45:0/3512631066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf1813ec20 0x7fbf181f1d00 secure :-1 s=READY pgs=3245 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00c4d0 tx=0x7fbf0c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:39.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.065+0000 7fbf06ffd700 1 -- 172.21.15.45:0/3512631066 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c011790 con 0x7fbf1813ec20 2023-10-08T20:11:39.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.065+0000 7fbf06ffd700 1 -- 172.21.15.45:0/3512631066 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbf0c0119e0 con 0x7fbf1813ec20 2023-10-08T20:11:39.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.065+0000 7fbf06ffd700 1 -- 172.21.15.45:0/3512631066 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c011df0 con 0x7fbf1813ec20 2023-10-08T20:11:39.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.069+0000 7fbf1cdfa700 1 -- 172.21.15.45:0/3512631066 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf180aead0 con 0x7fbf1813ec20 2023-10-08T20:11:39.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.069+0000 7fbf1cdfa700 1 -- 172.21.15.45:0/3512631066 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf180af090 con 0x7fbf1813ec20 2023-10-08T20:11:39.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.075+0000 7fbf06ffd700 1 -- 172.21.15.45:0/3512631066 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbf0c01c460 con 0x7fbf1813ec20 2023-10-08T20:11:39.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.075+0000 7fbf06ffd700 1 --2- 172.21.15.45:0/3512631066 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fbef806afa0 0x7fbef806d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:39.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.075+0000 7fbf06ffd700 1 -- 172.21.15.45:0/3512631066 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf0c089610 con 0x7fbf1813ec20 2023-10-08T20:11:39.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.077+0000 7fbf1cdfa700 1 -- 172.21.15.45:0/3512631066 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf181f2380 con 0x7fbf1813ec20 2023-10-08T20:11:39.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.079+0000 7fbf15d9b700 1 --2- 172.21.15.45:0/3512631066 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fbef806afa0 0x7fbef806d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:39.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.079+0000 7fbf15d9b700 1 --2- 172.21.15.45:0/3512631066 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fbef806afa0 0x7fbef806d460 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fbf1815e460 tx=0x7fbf08006c20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:39.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.094+0000 7fbf06ffd700 1 -- 172.21.15.45:0/3512631066 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbf0c0546a0 con 0x7fbf1813ec20 2023-10-08T20:11:39.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.536+0000 7fbf1cdfa700 1 -- 172.21.15.45:0/3512631066 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf1804e4c0 con 0x7fbf1813ec20 2023-10-08T20:11:39.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.704+0000 7fbf06ffd700 1 -- 172.21.15.45:0/3512631066 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16521 (secure 0 0 0) 0x7fbf0c057cc0 con 0x7fbf1813ec20 2023-10-08T20:11:39.711 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:39.712 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":33,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:46:27.627861+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:45:19.183651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:46:24.050213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T12:46:25.003094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.412453+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.351925+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.428025+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.437246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.441119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.388608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.415524+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.401835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T20:11:39.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.721+0000 7fbf1cdfa700 1 -- 172.21.15.45:0/3512631066 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fbef806afa0 msgr2=0x7fbef806d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:39.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.721+0000 7fbf1cdfa700 1 --2- 172.21.15.45:0/3512631066 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fbef806afa0 0x7fbef806d460 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fbf1815e460 tx=0x7fbf08006c20 comp rx=0 tx=0).stop 2023-10-08T20:11:39.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.721+0000 7fbf1cdfa700 1 -- 172.21.15.45:0/3512631066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf1813ec20 msgr2=0x7fbf181f1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:39.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.721+0000 7fbf1cdfa700 1 --2- 172.21.15.45:0/3512631066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf1813ec20 0x7fbf181f1d00 secure :-1 s=READY pgs=3245 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00c4d0 tx=0x7fbf0c00c890 comp rx=0 tx=0).stop 2023-10-08T20:11:39.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.721+0000 7fbf1cdfa700 1 -- 172.21.15.45:0/3512631066 shutdown_connections 2023-10-08T20:11:39.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.721+0000 7fbf1cdfa700 1 --2- 172.21.15.45:0/3512631066 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fbef806afa0 0x7fbef806d460 secure :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fbf1815e460 tx=0x7fbf08006c20 comp rx=0 tx=0).stop 2023-10-08T20:11:39.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.721+0000 7fbf1cdfa700 1 --2- 172.21.15.45:0/3512631066 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf1815e5a0 0x7fbf18140210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:39.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.721+0000 7fbf1cdfa700 1 --2- 172.21.15.45:0/3512631066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf1813ec20 0x7fbf181f1d00 secure :-1 s=CLOSED pgs=3245 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00c4d0 tx=0x7fbf0c00c890 comp rx=0 tx=0).stop 2023-10-08T20:11:39.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.721+0000 7fbf1cdfa700 1 --2- 172.21.15.45:0/3512631066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf1815c750 0x7fbf180adef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:39.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.721+0000 7fbf1cdfa700 1 -- 172.21.15.45:0/3512631066 >> 172.21.15.45:0/3512631066 conn(0x7fbf1806e010 msgr2=0x7fbf180cc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:39.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.735+0000 7fbf1cdfa700 1 -- 172.21.15.45:0/3512631066 shutdown_connections 2023-10-08T20:11:39.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.735+0000 7fbf1cdfa700 1 -- 172.21.15.45:0/3512631066 wait complete. 2023-10-08T20:11:39.763 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:45:19.183651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:46:24.050213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:46:25.003094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T20:11:39.764 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T20:11:39.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.974+0000 7f38b5291700 1 -- 172.21.15.45:0/168057765 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f38b00b2540 msgr2=0x7f38b0097a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:39.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.974+0000 7f38b5291700 1 --2- 172.21.15.45:0/168057765 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f38b00b2540 0x7f38b0097a20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f38a8009f60 tx=0x7f38a8009f90 comp rx=0 tx=0).stop 2023-10-08T20:11:39.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.974+0000 7f38b5291700 1 -- 172.21.15.45:0/168057765 shutdown_connections 2023-10-08T20:11:39.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.974+0000 7f38b5291700 1 --2- 172.21.15.45:0/168057765 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f38b00b2540 0x7f38b0097a20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:39.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.974+0000 7f38b5291700 1 --2- 172.21.15.45:0/168057765 >> v2:172.21.15.78:3300/0 conn(0x7f38b015d3d0 0x7f38b00cdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:39.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.974+0000 7f38b5291700 1 -- 172.21.15.45:0/168057765 >> 172.21.15.45:0/168057765 conn(0x7f38b00b11e0 msgr2=0x7f38b00b15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:39.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.978+0000 7f38b5291700 1 -- 172.21.15.45:0/168057765 shutdown_connections 2023-10-08T20:11:39.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.978+0000 7f38b5291700 1 -- 172.21.15.45:0/168057765 wait complete. 2023-10-08T20:11:39.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.980+0000 7f38b5291700 1 Processor -- start 2023-10-08T20:11:39.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.980+0000 7f38b5291700 1 -- start start 2023-10-08T20:11:39.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.981+0000 7f38b5291700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38b00b2540 0x7f38b0150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:39.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.981+0000 7f38b5291700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38b015cff0 0x7f38b00c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:39.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.981+0000 7f38b5291700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f38b015d3d0 0x7f38b00c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:39.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.981+0000 7f38b5291700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b0151390 con 0x7f38b015cff0 2023-10-08T20:11:39.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.981+0000 7f38b5291700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b00c6d00 con 0x7f38b00b2540 2023-10-08T20:11:39.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.981+0000 7f38b5291700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b00ce490 con 0x7f38b015d3d0 2023-10-08T20:11:39.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.981+0000 7f38ae7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38b015cff0 0x7f38b00c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:39.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.981+0000 7f38ae7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38b015cff0 0x7f38b00c67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51216/0 (socket says 172.21.15.45:51216) 2023-10-08T20:11:39.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.982+0000 7f38ae7fc700 1 -- 172.21.15.45:0/4111565453 learned_addr learned my addr 172.21.15.45:0/4111565453 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:11:39.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.982+0000 7f38aeffd700 1 --2- 172.21.15.45:0/4111565453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38b00b2540 0x7f38b0150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:39.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.982+0000 7f38af7fe700 1 --2- 172.21.15.45:0/4111565453 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f38b015d3d0 0x7f38b00c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:39.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.982+0000 7f38aeffd700 1 -- 172.21.15.45:0/4111565453 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f38b015d3d0 msgr2=0x7f38b00c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:39.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.982+0000 7f38aeffd700 1 --2- 172.21.15.45:0/4111565453 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f38b015d3d0 0x7f38b00c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:39.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.982+0000 7f38aeffd700 1 -- 172.21.15.45:0/4111565453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38b015cff0 msgr2=0x7f38b00c67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:39.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.982+0000 7f38aeffd700 1 --2- 172.21.15.45:0/4111565453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38b015cff0 0x7f38b00c67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:39.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.982+0000 7f38aeffd700 1 -- 172.21.15.45:0/4111565453 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a8009c40 con 0x7f38b00b2540 2023-10-08T20:11:39.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.982+0000 7f38af7fe700 1 --2- 172.21.15.45:0/4111565453 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f38b015d3d0 0x7f38b00c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T20:11:39.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.982+0000 7f38ae7fc700 1 --2- 172.21.15.45:0/4111565453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38b015cff0 0x7f38b00c67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T20:11:39.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.982+0000 7f38aeffd700 1 --2- 172.21.15.45:0/4111565453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38b00b2540 0x7f38b0150e50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f38a000c450 tx=0x7f38a000c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:39.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.982+0000 7f38977fe700 1 -- 172.21.15.45:0/4111565453 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a0011790 con 0x7f38b00b2540 2023-10-08T20:11:39.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.982+0000 7f38977fe700 1 -- 172.21.15.45:0/4111565453 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f38a00119e0 con 0x7f38b00b2540 2023-10-08T20:11:39.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.982+0000 7f38b5291700 1 -- 172.21.15.45:0/4111565453 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38b00cdbf0 con 0x7f38b00b2540 2023-10-08T20:11:39.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.982+0000 7f38977fe700 1 -- 172.21.15.45:0/4111565453 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a0011df0 con 0x7f38b00b2540 2023-10-08T20:11:39.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.983+0000 7f38b5291700 1 -- 172.21.15.45:0/4111565453 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38b00ce1b0 con 0x7f38b00b2540 2023-10-08T20:11:39.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.984+0000 7f38b5291700 1 -- 172.21.15.45:0/4111565453 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38b0066850 con 0x7f38b00b2540 2023-10-08T20:11:39.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.984+0000 7f38977fe700 1 -- 172.21.15.45:0/4111565453 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f38a001c460 con 0x7f38b00b2540 2023-10-08T20:11:39.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.985+0000 7f38977fe700 1 --2- 172.21.15.45:0/4111565453 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f389c06aed0 0x7f389c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:39.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.985+0000 7f38977fe700 1 -- 172.21.15.45:0/4111565453 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38a00894a0 con 0x7f38b00b2540 2023-10-08T20:11:39.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.985+0000 7f38ae7fc700 1 --2- 172.21.15.45:0/4111565453 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f389c06aed0 0x7f389c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:39.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.986+0000 7f38ae7fc700 1 --2- 172.21.15.45:0/4111565453 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f389c06aed0 0x7f389c06d390 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f38b0152280 tx=0x7f38a400b460 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:39.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:39.993+0000 7f38977fe700 1 -- 172.21.15.45:0/4111565453 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f38a0054610 con 0x7f38b00b2540 2023-10-08T20:11:40.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.362+0000 7f38b5291700 1 -- 172.21.15.45:0/4111565453 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f38b01e6890 con 0x7f38b00b2540 2023-10-08T20:11:40.429 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-08T20:11:40.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.426+0000 7f38977fe700 1 -- 172.21.15.45:0/4111565453 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7f38a000ce60 con 0x7f38b00b2540 2023-10-08T20:11:40.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.434+0000 7f38b5291700 1 -- 172.21.15.45:0/4111565453 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f389c06aed0 msgr2=0x7f389c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:40.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.434+0000 7f38b5291700 1 --2- 172.21.15.45:0/4111565453 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f389c06aed0 0x7f389c06d390 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f38b0152280 tx=0x7f38a400b460 comp rx=0 tx=0).stop 2023-10-08T20:11:40.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.434+0000 7f38b5291700 1 -- 172.21.15.45:0/4111565453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38b00b2540 msgr2=0x7f38b0150e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:40.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.434+0000 7f38b5291700 1 --2- 172.21.15.45:0/4111565453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38b00b2540 0x7f38b0150e50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f38a000c450 tx=0x7f38a000c760 comp rx=0 tx=0).stop 2023-10-08T20:11:40.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.435+0000 7f38b5291700 1 -- 172.21.15.45:0/4111565453 shutdown_connections 2023-10-08T20:11:40.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.435+0000 7f38b5291700 1 --2- 172.21.15.45:0/4111565453 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f389c06aed0 0x7f389c06d390 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:40.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.435+0000 7f38b5291700 1 --2- 172.21.15.45:0/4111565453 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f38b015d3d0 0x7f38b00c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:40.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.435+0000 7f38b5291700 1 --2- 172.21.15.45:0/4111565453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38b00b2540 0x7f38b0150e50 secure :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f38a000c450 tx=0x7f38a000c760 comp rx=0 tx=0).stop 2023-10-08T20:11:40.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.435+0000 7f38b5291700 1 --2- 172.21.15.45:0/4111565453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38b015cff0 0x7f38b00c67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:40.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.435+0000 7f38b5291700 1 -- 172.21.15.45:0/4111565453 >> 172.21.15.45:0/4111565453 conn(0x7f38b00b11e0 msgr2=0x7f38b015d810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:40.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.436+0000 7f38b5291700 1 -- 172.21.15.45:0/4111565453 shutdown_connections 2023-10-08T20:11:40.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.436+0000 7f38b5291700 1 -- 172.21.15.45:0/4111565453 wait complete. 2023-10-08T20:11:40.460 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T20:11:40.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.720+0000 7f29ccd00700 1 -- 172.21.15.45:0/1182401829 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f29c815bbf0 msgr2=0x7f29c80d14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:40.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.720+0000 7f29ccd00700 1 --2- 172.21.15.45:0/1182401829 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f29c815bbf0 0x7f29c80d14c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f29b8005fd0 tx=0x7f29b8009c70 comp rx=0 tx=0).stop 2023-10-08T20:11:40.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.720+0000 7f29ccd00700 1 -- 172.21.15.45:0/1182401829 shutdown_connections 2023-10-08T20:11:40.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.720+0000 7f29ccd00700 1 --2- 172.21.15.45:0/1182401829 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f29c815bbf0 0x7f29c80d14c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:40.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.720+0000 7f29ccd00700 1 --2- 172.21.15.45:0/1182401829 >> v2:172.21.15.78:3300/0 conn(0x7f29c80cee20 0x7f29c80cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:40.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.720+0000 7f29ccd00700 1 -- 172.21.15.45:0/1182401829 >> 172.21.15.45:0/1182401829 conn(0x7f29c8071940 msgr2=0x7f29c8071d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:40.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.720+0000 7f29ccd00700 1 -- 172.21.15.45:0/1182401829 shutdown_connections 2023-10-08T20:11:40.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.720+0000 7f29ccd00700 1 -- 172.21.15.45:0/1182401829 wait complete. 2023-10-08T20:11:40.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.723+0000 7f29ccd00700 1 Processor -- start 2023-10-08T20:11:40.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.723+0000 7f29ccd00700 1 -- start start 2023-10-08T20:11:40.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.724+0000 7f29ccd00700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f29c80cc6d0 0x7f29c81e5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:40.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.724+0000 7f29ccd00700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29c80cee20 0x7f29c82020d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:40.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.724+0000 7f29ccd00700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29c815bbf0 0x7f29c80b1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:40.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.724+0000 7f29ccd00700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c80cb920 con 0x7f29c815bbf0 2023-10-08T20:11:40.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.724+0000 7f29ccd00700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c81e5ca0 con 0x7f29c80cee20 2023-10-08T20:11:40.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.724+0000 7f29ccd00700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c81e5f20 con 0x7f29c80cc6d0 2023-10-08T20:11:40.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.724+0000 7f29c659c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f29c80cc6d0 0x7f29c81e5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:40.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.724+0000 7f29c5d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29c80cee20 0x7f29c82020d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:40.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.724+0000 7f29c659c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f29c80cc6d0 0x7f29c81e5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.45:53074/0 (socket says 172.21.15.45:53074) 2023-10-08T20:11:40.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.724+0000 7f29c659c700 1 -- 172.21.15.45:0/831220212 learned_addr learned my addr 172.21.15.45:0/831220212 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:11:40.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.724+0000 7f29c6d9d700 1 --2- 172.21.15.45:0/831220212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29c815bbf0 0x7f29c80b1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:40.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.725+0000 7f29c6d9d700 1 -- 172.21.15.45:0/831220212 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f29c80cc6d0 msgr2=0x7f29c81e5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:40.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.725+0000 7f29c6d9d700 1 --2- 172.21.15.45:0/831220212 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f29c80cc6d0 0x7f29c81e5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:40.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.725+0000 7f29c6d9d700 1 -- 172.21.15.45:0/831220212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29c80cee20 msgr2=0x7f29c82020d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:40.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.725+0000 7f29c6d9d700 1 --2- 172.21.15.45:0/831220212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29c80cee20 0x7f29c82020d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:40.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.725+0000 7f29c6d9d700 1 -- 172.21.15.45:0/831220212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc009520 con 0x7f29c815bbf0 2023-10-08T20:11:40.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.725+0000 7f29c5d9b700 1 --2- 172.21.15.45:0/831220212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29c80cee20 0x7f29c82020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T20:11:40.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.725+0000 7f29c6d9d700 1 --2- 172.21.15.45:0/831220212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29c815bbf0 0x7f29c80b1360 secure :-1 s=READY pgs=3247 cs=0 l=1 rev1=1 crypto rx=0x7f29c000cb10 tx=0x7f29c000ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:40.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.725+0000 7f29b6ffd700 1 -- 172.21.15.45:0/831220212 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c000a9e0 con 0x7f29c815bbf0 2023-10-08T20:11:40.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.725+0000 7f29b6ffd700 1 -- 172.21.15.45:0/831220212 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f29c000ac30 con 0x7f29c815bbf0 2023-10-08T20:11:40.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.726+0000 7f29b6ffd700 1 -- 172.21.15.45:0/831220212 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c0012420 con 0x7f29c815bbf0 2023-10-08T20:11:40.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.726+0000 7f29ccd00700 1 -- 172.21.15.45:0/831220212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b80095f0 con 0x7f29c815bbf0 2023-10-08T20:11:40.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.726+0000 7f29ccd00700 1 -- 172.21.15.45:0/831220212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c81e67c0 con 0x7f29c815bbf0 2023-10-08T20:11:40.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.727+0000 7f29b6ffd700 1 -- 172.21.15.45:0/831220212 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f29c001a3b0 con 0x7f29c815bbf0 2023-10-08T20:11:40.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.728+0000 7f29b6ffd700 1 --2- 172.21.15.45:0/831220212 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f29a806af00 0x7f29a806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:40.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.728+0000 7f29b6ffd700 1 -- 172.21.15.45:0/831220212 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29c0089a40 con 0x7f29c815bbf0 2023-10-08T20:11:40.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.728+0000 7f29c659c700 1 --2- 172.21.15.45:0/831220212 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f29a806af00 0x7f29a806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:40.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.730+0000 7f29ccd00700 1 -- 172.21.15.45:0/831220212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c8066850 con 0x7f29c815bbf0 2023-10-08T20:11:40.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.739+0000 7f29b6ffd700 1 -- 172.21.15.45:0/831220212 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f29c0054b00 con 0x7f29c815bbf0 2023-10-08T20:11:40.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:40.740+0000 7f29c659c700 1 --2- 172.21.15.45:0/831220212 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f29a806af00 0x7f29a806d3c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f29b80098e0 tx=0x7f29b8019040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:41.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.100+0000 7f29ccd00700 1 -- 172.21.15.45:0/831220212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f29c806a530 con 0x7f29c815bbf0 2023-10-08T20:11:41.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.101+0000 7f29b6ffd700 1 -- 172.21.15.45:0/831220212 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) v1 ==== 104+0+11 (secure 0 0 0) 0x7f29c0016020 con 0x7f29c815bbf0 2023-10-08T20:11:41.101 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-08T20:11:41.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.104+0000 7f29ccd00700 1 -- 172.21.15.45:0/831220212 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f29a806af00 msgr2=0x7f29a806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:41.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.104+0000 7f29ccd00700 1 --2- 172.21.15.45:0/831220212 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f29a806af00 0x7f29a806d3c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f29b80098e0 tx=0x7f29b8019040 comp rx=0 tx=0).stop 2023-10-08T20:11:41.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.104+0000 7f29ccd00700 1 -- 172.21.15.45:0/831220212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29c815bbf0 msgr2=0x7f29c80b1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:41.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.104+0000 7f29ccd00700 1 --2- 172.21.15.45:0/831220212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29c815bbf0 0x7f29c80b1360 secure :-1 s=READY pgs=3247 cs=0 l=1 rev1=1 crypto rx=0x7f29c000cb10 tx=0x7f29c000ce20 comp rx=0 tx=0).stop 2023-10-08T20:11:41.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.104+0000 7f29ccd00700 1 -- 172.21.15.45:0/831220212 shutdown_connections 2023-10-08T20:11:41.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.104+0000 7f29ccd00700 1 --2- 172.21.15.45:0/831220212 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f29a806af00 0x7f29a806d3c0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:41.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.104+0000 7f29ccd00700 1 --2- 172.21.15.45:0/831220212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29c815bbf0 0x7f29c80b1360 unknown :-1 s=CLOSED pgs=3247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:41.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.104+0000 7f29ccd00700 1 --2- 172.21.15.45:0/831220212 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f29c80cc6d0 0x7f29c81e5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:41.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.104+0000 7f29ccd00700 1 --2- 172.21.15.45:0/831220212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29c80cee20 0x7f29c82020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:41.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.104+0000 7f29ccd00700 1 -- 172.21.15.45:0/831220212 >> 172.21.15.45:0/831220212 conn(0x7f29c8071940 msgr2=0x7f29c80d2390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:41.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.107+0000 7f29ccd00700 1 -- 172.21.15.45:0/831220212 shutdown_connections 2023-10-08T20:11:41.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.107+0000 7f29ccd00700 1 -- 172.21.15.45:0/831220212 wait complete. 2023-10-08T20:11:41.130 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T20:11:41.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.346+0000 7f88087d9700 1 -- 172.21.15.45:0/785771192 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f88000cafc0 msgr2=0x7f88000cb3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:41.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.346+0000 7f88087d9700 1 --2- 172.21.15.45:0/785771192 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f88000cafc0 0x7f88000cb3f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f87f8009f60 tx=0x7f87f8009f90 comp rx=0 tx=0).stop 2023-10-08T20:11:41.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.346+0000 7f88087d9700 1 -- 172.21.15.45:0/785771192 shutdown_connections 2023-10-08T20:11:41.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.346+0000 7f88087d9700 1 --2- 172.21.15.45:0/785771192 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f88000cafc0 0x7f88000cb3f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:41.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.346+0000 7f88087d9700 1 --2- 172.21.15.45:0/785771192 >> v2:172.21.15.45:3300/0 conn(0x7f880015d0c0 0x7f8800097a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:41.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.346+0000 7f88087d9700 1 -- 172.21.15.45:0/785771192 >> 172.21.15.45:0/785771192 conn(0x7f88000b1290 msgr2=0x7f88000b16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:41.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.346+0000 7f88087d9700 1 -- 172.21.15.45:0/785771192 shutdown_connections 2023-10-08T20:11:41.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.346+0000 7f88087d9700 1 -- 172.21.15.45:0/785771192 wait complete. 2023-10-08T20:11:41.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.348+0000 7f88087d9700 1 Processor -- start 2023-10-08T20:11:41.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.348+0000 7f88087d9700 1 -- start start 2023-10-08T20:11:41.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.349+0000 7f88087d9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88000b06d0 0x7f880006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:41.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.349+0000 7f88087d9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88000cafc0 0x7f880006b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:41.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.349+0000 7f88087d9700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f880015d0c0 0x7f880006b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:41.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.349+0000 7f88087d9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88000c6bc0 con 0x7f88000b06d0 2023-10-08T20:11:41.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.349+0000 7f88087d9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88000c9bc0 con 0x7f88000cafc0 2023-10-08T20:11:41.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.349+0000 7f88087d9700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88000b2830 con 0x7f880015d0c0 2023-10-08T20:11:41.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.349+0000 7f8806575700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88000b06d0 0x7f880006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:41.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.349+0000 7f8806575700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88000b06d0 0x7f880006cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51242/0 (socket says 172.21.15.45:51242) 2023-10-08T20:11:41.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.349+0000 7f8806575700 1 -- 172.21.15.45:0/2510630398 learned_addr learned my addr 172.21.15.45:0/2510630398 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:11:41.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.349+0000 7f8805d74700 1 --2- 172.21.15.45:0/2510630398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88000cafc0 0x7f880006b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:41.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.349+0000 7f8806d76700 1 --2- 172.21.15.45:0/2510630398 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f880015d0c0 0x7f880006b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:41.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.349+0000 7f8806575700 1 -- 172.21.15.45:0/2510630398 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f880015d0c0 msgr2=0x7f880006b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:41.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.350+0000 7f8806575700 1 --2- 172.21.15.45:0/2510630398 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f880015d0c0 0x7f880006b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:41.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.350+0000 7f8806575700 1 -- 172.21.15.45:0/2510630398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88000cafc0 msgr2=0x7f880006b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:41.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.350+0000 7f8806575700 1 --2- 172.21.15.45:0/2510630398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88000cafc0 0x7f880006b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:41.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.350+0000 7f8806575700 1 -- 172.21.15.45:0/2510630398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f8009c40 con 0x7f88000b06d0 2023-10-08T20:11:41.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.350+0000 7f8806575700 1 --2- 172.21.15.45:0/2510630398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88000b06d0 0x7f880006cd20 secure :-1 s=READY pgs=3249 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00e9f0 tx=0x7f87fc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:41.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.350+0000 7f87f6ffd700 1 -- 172.21.15.45:0/2510630398 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc00c9c0 con 0x7f88000b06d0 2023-10-08T20:11:41.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.350+0000 7f87f6ffd700 1 -- 172.21.15.45:0/2510630398 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f87fc00cc10 con 0x7f88000b06d0 2023-10-08T20:11:41.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.350+0000 7f88087d9700 1 -- 172.21.15.45:0/2510630398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88000b2b10 con 0x7f88000b06d0 2023-10-08T20:11:41.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.350+0000 7f87f6ffd700 1 -- 172.21.15.45:0/2510630398 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc010430 con 0x7f88000b06d0 2023-10-08T20:11:41.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.350+0000 7f88087d9700 1 -- 172.21.15.45:0/2510630398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88000b30d0 con 0x7f88000b06d0 2023-10-08T20:11:41.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.351+0000 7f88087d9700 1 -- 172.21.15.45:0/2510630398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8800066850 con 0x7f88000b06d0 2023-10-08T20:11:41.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.352+0000 7f87f6ffd700 1 -- 172.21.15.45:0/2510630398 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f87fc010590 con 0x7f88000b06d0 2023-10-08T20:11:41.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.353+0000 7f87f6ffd700 1 --2- 172.21.15.45:0/2510630398 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f87e406aed0 0x7f87e406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:41.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.353+0000 7f87f6ffd700 1 -- 172.21.15.45:0/2510630398 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87fc014070 con 0x7f88000b06d0 2023-10-08T20:11:41.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.357+0000 7f8805d74700 1 --2- 172.21.15.45:0/2510630398 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f87e406aed0 0x7f87e406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:41.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.357+0000 7f8805d74700 1 --2- 172.21.15.45:0/2510630398 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f87e406aed0 0x7f87e406d390 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f88000b50f0 tx=0x7f87f0007db0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:41.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.363+0000 7f87f6ffd700 1 -- 172.21.15.45:0/2510630398 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f87fc051ca0 con 0x7f88000b06d0 2023-10-08T20:11:41.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.690+0000 7f88087d9700 1 -- 172.21.15.45:0/2510630398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f88000b1fd0 con 0x7f88000b06d0 2023-10-08T20:11:41.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.690+0000 7f87f6ffd700 1 -- 172.21.15.45:0/2510630398 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) v1 ==== 100+0+11 (secure 0 0 0) 0x7f87fc054f20 con 0x7f88000b06d0 2023-10-08T20:11:41.691 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-08T20:11:41.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.693+0000 7f88087d9700 1 -- 172.21.15.45:0/2510630398 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f87e406aed0 msgr2=0x7f87e406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:41.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.693+0000 7f88087d9700 1 --2- 172.21.15.45:0/2510630398 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f87e406aed0 0x7f87e406d390 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f88000b50f0 tx=0x7f87f0007db0 comp rx=0 tx=0).stop 2023-10-08T20:11:41.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.693+0000 7f88087d9700 1 -- 172.21.15.45:0/2510630398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88000b06d0 msgr2=0x7f880006cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:41.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.693+0000 7f88087d9700 1 --2- 172.21.15.45:0/2510630398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88000b06d0 0x7f880006cd20 secure :-1 s=READY pgs=3249 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00e9f0 tx=0x7f87fc00ed00 comp rx=0 tx=0).stop 2023-10-08T20:11:41.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.694+0000 7f88087d9700 1 -- 172.21.15.45:0/2510630398 shutdown_connections 2023-10-08T20:11:41.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.694+0000 7f88087d9700 1 --2- 172.21.15.45:0/2510630398 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f87e406aed0 0x7f87e406d390 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:41.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.694+0000 7f88087d9700 1 --2- 172.21.15.45:0/2510630398 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f880015d0c0 0x7f880006b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:41.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.694+0000 7f88087d9700 1 --2- 172.21.15.45:0/2510630398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88000b06d0 0x7f880006cd20 unknown :-1 s=CLOSED pgs=3249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:41.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.694+0000 7f88087d9700 1 --2- 172.21.15.45:0/2510630398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88000cafc0 0x7f880006b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:41.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.694+0000 7f88087d9700 1 -- 172.21.15.45:0/2510630398 >> 172.21.15.45:0/2510630398 conn(0x7f88000b1290 msgr2=0x7f8800158bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:41.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.694+0000 7f88087d9700 1 -- 172.21.15.45:0/2510630398 shutdown_connections 2023-10-08T20:11:41.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.694+0000 7f88087d9700 1 -- 172.21.15.45:0/2510630398 wait complete. 2023-10-08T20:11:41.717 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-08T20:11:41.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.940+0000 7f8f23dd8700 1 -- 172.21.15.45:0/3676748158 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f1c0ccd70 msgr2=0x7f8f1c0d1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:41.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.940+0000 7f8f23dd8700 1 --2- 172.21.15.45:0/3676748158 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f1c0ccd70 0x7f8f1c0d1800 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c0098f0 tx=0x7f8f0c009c00 comp rx=0 tx=0).stop 2023-10-08T20:11:41.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.940+0000 7f8f23dd8700 1 -- 172.21.15.45:0/3676748158 shutdown_connections 2023-10-08T20:11:41.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.940+0000 7f8f23dd8700 1 --2- 172.21.15.45:0/3676748158 >> v2:172.21.15.78:3300/0 conn(0x7f8f1c0cc990 0x7f8f1c0d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:41.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.940+0000 7f8f23dd8700 1 --2- 172.21.15.45:0/3676748158 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f1c0ccd70 0x7f8f1c0d1800 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:41.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.940+0000 7f8f23dd8700 1 -- 172.21.15.45:0/3676748158 >> 172.21.15.45:0/3676748158 conn(0x7f8f1c071940 msgr2=0x7f8f1c071d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:41.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.941+0000 7f8f23dd8700 1 -- 172.21.15.45:0/3676748158 shutdown_connections 2023-10-08T20:11:41.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.941+0000 7f8f23dd8700 1 -- 172.21.15.45:0/3676748158 wait complete. 2023-10-08T20:11:41.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.943+0000 7f8f23dd8700 1 Processor -- start 2023-10-08T20:11:41.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.943+0000 7f8f23dd8700 1 -- start start 2023-10-08T20:11:41.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.944+0000 7f8f23dd8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f1c0cc990 0x7f8f1c152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:41.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.944+0000 7f8f23dd8700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f1c0ccd70 0x7f8f1c0c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:41.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.944+0000 7f8f23dd8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f1c0d1d40 0x7f8f1c143610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:41.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.944+0000 7f8f23dd8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c0c8380 con 0x7f8f1c0d1d40 2023-10-08T20:11:41.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.944+0000 7f8f23dd8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c143b50 con 0x7f8f1c0cc990 2023-10-08T20:11:41.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.944+0000 7f8f23dd8700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c152fd0 con 0x7f8f1c0ccd70 2023-10-08T20:11:41.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.944+0000 7f8f21373700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f1c0ccd70 0x7f8f1c0c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:41.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.944+0000 7f8f22375700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f1c0d1d40 0x7f8f1c143610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:41.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.944+0000 7f8f21373700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f1c0ccd70 0x7f8f1c0c7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.45:53104/0 (socket says 172.21.15.45:53104) 2023-10-08T20:11:41.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.944+0000 7f8f21373700 1 -- 172.21.15.45:0/523827948 learned_addr learned my addr 172.21.15.45:0/523827948 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:11:41.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.944+0000 7f8f21b74700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f1c0cc990 0x7f8f1c152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:41.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.945+0000 7f8f21373700 1 -- 172.21.15.45:0/523827948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f1c0cc990 msgr2=0x7f8f1c152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:41.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.945+0000 7f8f21373700 1 --2- 172.21.15.45:0/523827948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f1c0cc990 0x7f8f1c152930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:41.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.945+0000 7f8f21373700 1 -- 172.21.15.45:0/523827948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f1c0d1d40 msgr2=0x7f8f1c143610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:41.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.945+0000 7f8f21373700 1 --2- 172.21.15.45:0/523827948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f1c0d1d40 0x7f8f1c143610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:41.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.945+0000 7f8f21373700 1 -- 172.21.15.45:0/523827948 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f0c009520 con 0x7f8f1c0ccd70 2023-10-08T20:11:41.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.945+0000 7f8f22375700 1 --2- 172.21.15.45:0/523827948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f1c0d1d40 0x7f8f1c143610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T20:11:41.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.945+0000 7f8f21373700 1 --2- 172.21.15.45:0/523827948 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f1c0ccd70 0x7f8f1c0c7e40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c0d2390 tx=0x7f8f0c004260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:41.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.945+0000 7f8f127fc700 1 -- 172.21.15.45:0/523827948 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c01c070 con 0x7f8f1c0ccd70 2023-10-08T20:11:41.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.945+0000 7f8f127fc700 1 -- 172.21.15.45:0/523827948 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8f0c004830 con 0x7f8f1c0ccd70 2023-10-08T20:11:41.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.945+0000 7f8f23dd8700 1 -- 172.21.15.45:0/523827948 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f1c1532b0 con 0x7f8f1c0ccd70 2023-10-08T20:11:41.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.945+0000 7f8f127fc700 1 -- 172.21.15.45:0/523827948 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c004c40 con 0x7f8f1c0ccd70 2023-10-08T20:11:41.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.945+0000 7f8f23dd8700 1 -- 172.21.15.45:0/523827948 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f1c153870 con 0x7f8f1c0ccd70 2023-10-08T20:11:41.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.948+0000 7f8f127fc700 1 -- 172.21.15.45:0/523827948 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8f0c020070 con 0x7f8f1c0ccd70 2023-10-08T20:11:41.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.948+0000 7f8f127fc700 1 --2- 172.21.15.45:0/523827948 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f8f0006aed0 0x7f8f0006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:41.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.948+0000 7f8f127fc700 1 -- 172.21.15.45:0/523827948 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f0c08a660 con 0x7f8f1c0ccd70 2023-10-08T20:11:41.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.949+0000 7f8f23dd8700 1 -- 172.21.15.45:0/523827948 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f1c140b70 con 0x7f8f1c0ccd70 2023-10-08T20:11:41.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.950+0000 7f8f21b74700 1 --2- 172.21.15.45:0/523827948 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f8f0006aed0 0x7f8f0006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:41.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.950+0000 7f8f21b74700 1 --2- 172.21.15.45:0/523827948 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f8f0006aed0 0x7f8f0006d390 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f8f18006fd0 tx=0x7f8f18009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:41.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:41.960+0000 7f8f127fc700 1 -- 172.21.15.45:0/523827948 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8f0c0557a0 con 0x7f8f1c0ccd70 2023-10-08T20:11:42.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.334+0000 7f8f23dd8700 1 -- 172.21.15.45:0/523827948 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8f1c04e4c0 con 0x7f8f1c0ccd70 2023-10-08T20:11:42.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.336+0000 7f8f127fc700 1 -- 172.21.15.45:0/523827948 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v33) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8f0c058dc0 con 0x7f8f1c0ccd70 2023-10-08T20:11:42.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.352+0000 7f8f23dd8700 1 -- 172.21.15.45:0/523827948 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f8f0006aed0 msgr2=0x7f8f0006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:42.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.352+0000 7f8f23dd8700 1 --2- 172.21.15.45:0/523827948 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f8f0006aed0 0x7f8f0006d390 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f8f18006fd0 tx=0x7f8f18009190 comp rx=0 tx=0).stop 2023-10-08T20:11:42.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.352+0000 7f8f23dd8700 1 -- 172.21.15.45:0/523827948 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f1c0ccd70 msgr2=0x7f8f1c0c7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:42.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.352+0000 7f8f23dd8700 1 --2- 172.21.15.45:0/523827948 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f1c0ccd70 0x7f8f1c0c7e40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c0d2390 tx=0x7f8f0c004260 comp rx=0 tx=0).stop 2023-10-08T20:11:42.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.359+0000 7f8f23dd8700 1 -- 172.21.15.45:0/523827948 shutdown_connections 2023-10-08T20:11:42.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.359+0000 7f8f23dd8700 1 --2- 172.21.15.45:0/523827948 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f8f0006aed0 0x7f8f0006d390 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:42.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.359+0000 7f8f23dd8700 1 --2- 172.21.15.45:0/523827948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f1c0d1d40 0x7f8f1c143610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:42.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.359+0000 7f8f23dd8700 1 --2- 172.21.15.45:0/523827948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f1c0cc990 0x7f8f1c152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:42.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.359+0000 7f8f23dd8700 1 --2- 172.21.15.45:0/523827948 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f1c0ccd70 0x7f8f1c0c7e40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:42.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.359+0000 7f8f23dd8700 1 -- 172.21.15.45:0/523827948 >> 172.21.15.45:0/523827948 conn(0x7f8f1c071940 msgr2=0x7f8f1c159260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:42.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.361+0000 7f8f23dd8700 1 -- 172.21.15.45:0/523827948 shutdown_connections 2023-10-08T20:11:42.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.361+0000 7f8f23dd8700 1 -- 172.21.15.45:0/523827948 wait complete. 2023-10-08T20:11:42.364 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-10-08T20:11:42.384 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T20:11:42.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T20:11:42.385 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T20:11:42.480 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-10-08T20:11:42.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T20:11:42.481 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T20:11:42.550 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T20:11:42.550 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T20:11:42.580 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15220 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-08T20:11:42.581 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T20:11:42.581 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T20:11:42.622 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=31,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12995 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-08T20:11:42.622 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T20:11:42.622 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T20:11:42.641 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15220 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-08T20:11:42.641 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T20:11:42.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.907+0000 7f1c27549700 1 -- 172.21.15.45:0/238114418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c200ccdc0 msgr2=0x7f1c20155590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:42.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.907+0000 7f1c27549700 1 --2- 172.21.15.45:0/238114418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c200ccdc0 0x7f1c20155590 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009f60 tx=0x7f1c18009f90 comp rx=0 tx=0).stop 2023-10-08T20:11:42.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.910+0000 7f1c27549700 1 -- 172.21.15.45:0/238114418 shutdown_connections 2023-10-08T20:11:42.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.910+0000 7f1c27549700 1 --2- 172.21.15.45:0/238114418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c200ccdc0 0x7f1c20155590 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:42.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.910+0000 7f1c27549700 1 -- 172.21.15.45:0/238114418 >> 172.21.15.45:0/238114418 conn(0x7f1c200b0430 msgr2=0x7f1c200b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:42.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.910+0000 7f1c27549700 1 -- 172.21.15.45:0/238114418 shutdown_connections 2023-10-08T20:11:42.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.910+0000 7f1c27549700 1 -- 172.21.15.45:0/238114418 wait complete. 2023-10-08T20:11:42.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.911+0000 7f1c27549700 1 Processor -- start 2023-10-08T20:11:42.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.911+0000 7f1c27549700 1 -- start start 2023-10-08T20:11:42.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.913+0000 7f1c27549700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c2006a480 0x7f1c2014fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:42.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.913+0000 7f1c27549700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c2006a860 0x7f1c200c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:42.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.913+0000 7f1c27549700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c200ccdc0 0x7f1c2015e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:42.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.913+0000 7f1c27549700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c20150150 con 0x7f1c2006a860 2023-10-08T20:11:42.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.913+0000 7f1c27549700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c20151440 con 0x7f1c200ccdc0 2023-10-08T20:11:42.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.913+0000 7f1c27549700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c20151720 con 0x7f1c2006a480 2023-10-08T20:11:42.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.913+0000 7f1c252e5700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c2006a480 0x7f1c2014fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:42.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.913+0000 7f1c252e5700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c2006a480 0x7f1c2014fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.45:53116/0 (socket says 172.21.15.45:53116) 2023-10-08T20:11:42.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.913+0000 7f1c252e5700 1 -- 172.21.15.45:0/4360066 learned_addr learned my addr 172.21.15.45:0/4360066 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:11:42.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.913+0000 7f1c252e5700 1 -- 172.21.15.45:0/4360066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c200ccdc0 msgr2=0x7f1c2015e1f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T20:11:42.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.913+0000 7f1c252e5700 1 --2- 172.21.15.45:0/4360066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c200ccdc0 0x7f1c2015e1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:42.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.913+0000 7f1c252e5700 1 -- 172.21.15.45:0/4360066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c2006a860 msgr2=0x7f1c200c8080 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T20:11:42.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.913+0000 7f1c252e5700 1 --2- 172.21.15.45:0/4360066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c2006a860 0x7f1c200c8080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:42.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.913+0000 7f1c252e5700 1 -- 172.21.15.45:0/4360066 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c18009c40 con 0x7f1c2006a480 2023-10-08T20:11:42.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.914+0000 7f1c252e5700 1 --2- 172.21.15.45:0/4360066 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c2006a480 0x7f1c2014fc10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c00c700 tx=0x7f1c1c00cac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:42.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.914+0000 7f1c11ffb700 1 -- 172.21.15.45:0/4360066 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c005230 con 0x7f1c2006a480 2023-10-08T20:11:42.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.914+0000 7f1c11ffb700 1 -- 172.21.15.45:0/4360066 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1c1c005480 con 0x7f1c2006a480 2023-10-08T20:11:42.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.914+0000 7f1c27549700 1 -- 172.21.15.45:0/4360066 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c20151a00 con 0x7f1c2006a480 2023-10-08T20:11:42.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.914+0000 7f1c11ffb700 1 -- 172.21.15.45:0/4360066 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c004970 con 0x7f1c2006a480 2023-10-08T20:11:42.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.914+0000 7f1c27549700 1 -- 172.21.15.45:0/4360066 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c20151fc0 con 0x7f1c2006a480 2023-10-08T20:11:42.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.916+0000 7f1c11ffb700 1 -- 172.21.15.45:0/4360066 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1c1c004ad0 con 0x7f1c2006a480 2023-10-08T20:11:42.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.917+0000 7f1c11ffb700 1 --2- 172.21.15.45:0/4360066 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f1c0408cee0 0x7f1c0408f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:42.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.917+0000 7f1c11ffb700 1 -- 172.21.15.45:0/4360066 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c1c08adc0 con 0x7f1c2006a480 2023-10-08T20:11:42.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.919+0000 7f1c24ae4700 1 --2- 172.21.15.45:0/4360066 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f1c0408cee0 0x7f1c0408f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:42.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.919+0000 7f1c24ae4700 1 --2- 172.21.15.45:0/4360066 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f1c0408cee0 0x7f1c0408f3a0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f1c14000f60 tx=0x7f1c14007a40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:42.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.921+0000 7f1c27549700 1 -- 172.21.15.45:0/4360066 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c201521e0 con 0x7f1c2006a480 2023-10-08T20:11:42.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:42.932+0000 7f1c11ffb700 1 -- 172.21.15.45:0/4360066 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1c1c08e060 con 0x7f1c2006a480 2023-10-08T20:11:43.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.353+0000 7f1c27549700 1 -- 172.21.15.45:0/4360066 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c20151860 con 0x7f1c2006a480 2023-10-08T20:11:43.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.353+0000 7f1c11ffb700 1 -- 172.21.15.45:0/4360066 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4907 (secure 0 0 0) 0x7f1c20151860 con 0x7f1c2006a480 2023-10-08T20:11:43.354 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:43.354 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4775,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/415745376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":415745376},{"type":"v1","addr":"172.21.15.78:6836","nonce":415745376}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/4017051943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":4017051943},{"type":"v1","addr":"172.21.15.78:6837","nonce":4017051943}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4784,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2071345881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2071345881},{"type":"v1","addr":"172.21.15.45:6835","nonce":2071345881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T12:46:26.025761+0000","modified":"2023-10-08T12:46:29.062189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5041},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5041":{"gid":5041,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6834/328442803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":328442803},{"type":"v1","addr":"172.21.15.45:6834","nonce":328442803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-08T20:11:43.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.358+0000 7f1c27549700 1 -- 172.21.15.45:0/4360066 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f1c0408cee0 msgr2=0x7f1c0408f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:43.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.358+0000 7f1c27549700 1 --2- 172.21.15.45:0/4360066 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f1c0408cee0 0x7f1c0408f3a0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f1c14000f60 tx=0x7f1c14007a40 comp rx=0 tx=0).stop 2023-10-08T20:11:43.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.358+0000 7f1c27549700 1 -- 172.21.15.45:0/4360066 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c2006a480 msgr2=0x7f1c2014fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:43.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.358+0000 7f1c27549700 1 --2- 172.21.15.45:0/4360066 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c2006a480 0x7f1c2014fc10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c00c700 tx=0x7f1c1c00cac0 comp rx=0 tx=0).stop 2023-10-08T20:11:43.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.367+0000 7f1c27549700 1 -- 172.21.15.45:0/4360066 shutdown_connections 2023-10-08T20:11:43.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.367+0000 7f1c27549700 1 --2- 172.21.15.45:0/4360066 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f1c0408cee0 0x7f1c0408f3a0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:43.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.367+0000 7f1c27549700 1 --2- 172.21.15.45:0/4360066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c200ccdc0 0x7f1c2015e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:43.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.367+0000 7f1c27549700 1 --2- 172.21.15.45:0/4360066 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c2006a480 0x7f1c2014fc10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:43.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.367+0000 7f1c27549700 1 --2- 172.21.15.45:0/4360066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c2006a860 0x7f1c200c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:43.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.367+0000 7f1c27549700 1 -- 172.21.15.45:0/4360066 >> 172.21.15.45:0/4360066 conn(0x7f1c200b0430 msgr2=0x7f1c200afa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:43.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.367+0000 7f1c27549700 1 -- 172.21.15.45:0/4360066 shutdown_connections 2023-10-08T20:11:43.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.367+0000 7f1c27549700 1 -- 172.21.15.45:0/4360066 wait complete. 2023-10-08T20:11:43.369 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2023-10-08T20:11:43.388 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T20:11:43.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.620+0000 7f014c10e700 1 -- 172.21.15.45:0/1598338560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0144158950 msgr2=0x7f01440cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:43.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.620+0000 7f014c10e700 1 --2- 172.21.15.45:0/1598338560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0144158950 0x7f01440cdf60 secure :-1 s=READY pgs=3252 cs=0 l=1 rev1=1 crypto rx=0x7f014406d490 tx=0x7f0140009c70 comp rx=0 tx=0).stop 2023-10-08T20:11:43.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.620+0000 7f014c10e700 1 -- 172.21.15.45:0/1598338560 shutdown_connections 2023-10-08T20:11:43.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.620+0000 7f014c10e700 1 --2- 172.21.15.45:0/1598338560 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01440724c0 0x7f01440c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:43.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.620+0000 7f014c10e700 1 --2- 172.21.15.45:0/1598338560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0144158950 0x7f01440cdf60 unknown :-1 s=CLOSED pgs=3252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:43.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.620+0000 7f014c10e700 1 --2- 172.21.15.45:0/1598338560 >> v2:172.21.15.78:3300/0 conn(0x7f014415c320 0x7f0144071f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:43.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.620+0000 7f014c10e700 1 -- 172.21.15.45:0/1598338560 >> 172.21.15.45:0/1598338560 conn(0x7f01440b0430 msgr2=0x7f01440b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:43.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.620+0000 7f014c10e700 1 -- 172.21.15.45:0/1598338560 shutdown_connections 2023-10-08T20:11:43.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.620+0000 7f014c10e700 1 -- 172.21.15.45:0/1598338560 wait complete. 2023-10-08T20:11:43.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.622+0000 7f014c10e700 1 Processor -- start 2023-10-08T20:11:43.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.622+0000 7f014c10e700 1 -- start start 2023-10-08T20:11:43.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.623+0000 7f014c10e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01440724c0 0x7f01441544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:43.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.623+0000 7f014c10e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0144158950 0x7f01440aa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:43.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.623+0000 7f014c10e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f014415c320 0x7f014406a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:43.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.623+0000 7f014c10e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01440c69b0 con 0x7f0144158950 2023-10-08T20:11:43.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.623+0000 7f014c10e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0144158ec0 con 0x7f01440724c0 2023-10-08T20:11:43.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.623+0000 7f014c10e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0144159160 con 0x7f014415c320 2023-10-08T20:11:43.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.623+0000 7f0149eaa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01440724c0 0x7f01441544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:43.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.623+0000 7f0149eaa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01440724c0 0x7f01441544c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.45:34500/0 (socket says 172.21.15.45:34500) 2023-10-08T20:11:43.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.623+0000 7f0149eaa700 1 -- 172.21.15.45:0/1728933832 learned_addr learned my addr 172.21.15.45:0/1728933832 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:11:43.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.623+0000 7f0149eaa700 1 -- 172.21.15.45:0/1728933832 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f014415c320 msgr2=0x7f014406a210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T20:11:43.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.623+0000 7f0149eaa700 1 --2- 172.21.15.45:0/1728933832 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f014415c320 0x7f014406a210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:43.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.623+0000 7f0149eaa700 1 -- 172.21.15.45:0/1728933832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0144158950 msgr2=0x7f01440aa8a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T20:11:43.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.623+0000 7f0149eaa700 1 --2- 172.21.15.45:0/1728933832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0144158950 0x7f01440aa8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:43.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.623+0000 7f0149eaa700 1 -- 172.21.15.45:0/1728933832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01400095f0 con 0x7f01440724c0 2023-10-08T20:11:43.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.624+0000 7f0149eaa700 1 --2- 172.21.15.45:0/1728933832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01440724c0 0x7f01441544c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0144070420 tx=0x7f0140004310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:43.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.624+0000 7f013a7fc700 1 -- 172.21.15.45:0/1728933832 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014001d070 con 0x7f01440724c0 2023-10-08T20:11:43.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.624+0000 7f013a7fc700 1 -- 172.21.15.45:0/1728933832 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0140003890 con 0x7f01440724c0 2023-10-08T20:11:43.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.624+0000 7f013a7fc700 1 -- 172.21.15.45:0/1728933832 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0140003c80 con 0x7f01440724c0 2023-10-08T20:11:43.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.625+0000 7f014c10e700 1 -- 172.21.15.45:0/1728933832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0144159440 con 0x7f01440724c0 2023-10-08T20:11:43.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.625+0000 7f014c10e700 1 -- 172.21.15.45:0/1728933832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01440c87e0 con 0x7f01440724c0 2023-10-08T20:11:43.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.627+0000 7f013a7fc700 1 -- 172.21.15.45:0/1728933832 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0140022470 con 0x7f01440724c0 2023-10-08T20:11:43.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.628+0000 7f013a7fc700 1 --2- 172.21.15.45:0/1728933832 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f012806af20 0x7f012806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:43.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.628+0000 7f013a7fc700 1 -- 172.21.15.45:0/1728933832 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f014008af70 con 0x7f01440724c0 2023-10-08T20:11:43.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.629+0000 7f014c10e700 1 -- 172.21.15.45:0/1728933832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01440c6af0 con 0x7f01440724c0 2023-10-08T20:11:43.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.630+0000 7f01496a9700 1 --2- 172.21.15.45:0/1728933832 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f012806af20 0x7f012806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:43.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.634+0000 7f01496a9700 1 --2- 172.21.15.45:0/1728933832 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f012806af20 0x7f012806d3e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f0144154a00 tx=0x7f0134006c10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:43.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.634+0000 7f013a7fc700 1 -- 172.21.15.45:0/1728933832 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f01440c6af0 con 0x7f01440724c0 2023-10-08T20:11:43.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.989+0000 7f014c10e700 1 -- 172.21.15.45:0/1728933832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01440c6af0 con 0x7f01440724c0 2023-10-08T20:11:43.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:43.996+0000 7f013a7fc700 1 -- 172.21.15.45:0/1728933832 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f0140056090 con 0x7f01440724c0 2023-10-08T20:11:44.005 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:44.005 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":33,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:46:27.627861+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:45:19.183651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:46:24.050213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T12:46:25.003094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.412453+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.351925+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.428025+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.437246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.441119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.388608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.415524+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.401835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T20:11:44.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.006+0000 7f014c10e700 1 -- 172.21.15.45:0/1728933832 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f012806af20 msgr2=0x7f012806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:44.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.006+0000 7f014c10e700 1 --2- 172.21.15.45:0/1728933832 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f012806af20 0x7f012806d3e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f0144154a00 tx=0x7f0134006c10 comp rx=0 tx=0).stop 2023-10-08T20:11:44.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.006+0000 7f014c10e700 1 -- 172.21.15.45:0/1728933832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01440724c0 msgr2=0x7f01441544c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:44.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.006+0000 7f014c10e700 1 --2- 172.21.15.45:0/1728933832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01440724c0 0x7f01441544c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0144070420 tx=0x7f0140004310 comp rx=0 tx=0).stop 2023-10-08T20:11:44.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.006+0000 7f014c10e700 1 -- 172.21.15.45:0/1728933832 shutdown_connections 2023-10-08T20:11:44.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.006+0000 7f014c10e700 1 --2- 172.21.15.45:0/1728933832 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f012806af20 0x7f012806d3e0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:44.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.006+0000 7f014c10e700 1 --2- 172.21.15.45:0/1728933832 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f014415c320 0x7f014406a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:44.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.006+0000 7f014c10e700 1 --2- 172.21.15.45:0/1728933832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01440724c0 0x7f01441544c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:44.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.006+0000 7f014c10e700 1 --2- 172.21.15.45:0/1728933832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0144158950 0x7f01440aa8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:44.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.006+0000 7f014c10e700 1 -- 172.21.15.45:0/1728933832 >> 172.21.15.45:0/1728933832 conn(0x7f01440b0430 msgr2=0x7f0144156da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:44.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.006+0000 7f014c10e700 1 -- 172.21.15.45:0/1728933832 shutdown_connections 2023-10-08T20:11:44.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.006+0000 7f014c10e700 1 -- 172.21.15.45:0/1728933832 wait complete. 2023-10-08T20:11:44.029 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:45:19.183651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:46:24.050213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:46:25.003094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T20:11:44.029 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T20:11:44.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.276+0000 7fdab072a700 1 -- 172.21.15.45:0/306507125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda94003a30 msgr2=0x7fda94003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:44.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.276+0000 7fdab072a700 1 --2- 172.21.15.45:0/306507125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda94003a30 0x7fda94003e50 secure :-1 s=READY pgs=3254 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400c310 tx=0x7fda94005880 comp rx=0 tx=0).stop 2023-10-08T20:11:44.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.276+0000 7fdaaecc7700 1 -- 172.21.15.45:0/306507125 reap_dead start 2023-10-08T20:11:44.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.276+0000 7fdab072a700 1 -- 172.21.15.45:0/306507125 shutdown_connections 2023-10-08T20:11:44.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.276+0000 7fdab072a700 1 -- 172.21.15.45:0/306507125 >> 172.21.15.45:0/306507125 conn(0x7fdaa8097a20 msgr2=0x7fdaa80ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:44.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.276+0000 7fdab072a700 1 -- 172.21.15.45:0/306507125 shutdown_connections 2023-10-08T20:11:44.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.276+0000 7fdab072a700 1 -- 172.21.15.45:0/306507125 wait complete. 2023-10-08T20:11:44.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.278+0000 7fdab072a700 1 Processor -- start 2023-10-08T20:11:44.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.278+0000 7fdab072a700 1 -- start start 2023-10-08T20:11:44.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.279+0000 7fdab072a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda94003a30 0x7fdaa80abd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:44.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.279+0000 7fdab072a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdaa80ae030 0x7fdaa815b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:44.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.279+0000 7fdab072a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaa815a830 0x7fdaa815acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:44.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.279+0000 7fdab072a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa80ad0b0 con 0x7fdaa815a830 2023-10-08T20:11:44.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.279+0000 7fdab072a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa80ac240 con 0x7fda94003a30 2023-10-08T20:11:44.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.279+0000 7fdab072a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa80ac430 con 0x7fdaa80ae030 2023-10-08T20:11:44.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.279+0000 7fdaae4c6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda94003a30 0x7fdaa80abd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:44.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.279+0000 7fdaae4c6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda94003a30 0x7fdaa80abd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.45:34516/0 (socket says 172.21.15.45:34516) 2023-10-08T20:11:44.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.279+0000 7fdaae4c6700 1 -- 172.21.15.45:0/2807668101 learned_addr learned my addr 172.21.15.45:0/2807668101 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:11:44.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.279+0000 7fdaae4c6700 1 -- 172.21.15.45:0/2807668101 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdaa80ae030 msgr2=0x7fdaa815b800 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T20:11:44.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.279+0000 7fdaae4c6700 1 --2- 172.21.15.45:0/2807668101 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdaa80ae030 0x7fdaa815b800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:44.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.280+0000 7fdaae4c6700 1 -- 172.21.15.45:0/2807668101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaa815a830 msgr2=0x7fdaa815acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:44.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.280+0000 7fdaae4c6700 1 --2- 172.21.15.45:0/2807668101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaa815a830 0x7fdaa815acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:44.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.280+0000 7fdaae4c6700 1 -- 172.21.15.45:0/2807668101 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa80ac710 con 0x7fda94003a30 2023-10-08T20:11:44.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.280+0000 7fdaae4c6700 1 --2- 172.21.15.45:0/2807668101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda94003a30 0x7fdaa80abd00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4001930 tx=0x7fdaa4001b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:44.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.280+0000 7fda9effd700 1 -- 172.21.15.45:0/2807668101 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4003880 con 0x7fda94003a30 2023-10-08T20:11:44.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.280+0000 7fda9effd700 1 -- 172.21.15.45:0/2807668101 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdaa4003ad0 con 0x7fda94003a30 2023-10-08T20:11:44.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.280+0000 7fdab072a700 1 -- 172.21.15.45:0/2807668101 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa80ac9f0 con 0x7fda94003a30 2023-10-08T20:11:44.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.280+0000 7fdab072a700 1 -- 172.21.15.45:0/2807668101 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa815b1f0 con 0x7fda94003a30 2023-10-08T20:11:44.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.281+0000 7fda9effd700 1 -- 172.21.15.45:0/2807668101 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4001640 con 0x7fda94003a30 2023-10-08T20:11:44.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.282+0000 7fda9effd700 1 -- 172.21.15.45:0/2807668101 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdaa4022070 con 0x7fda94003a30 2023-10-08T20:11:44.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.283+0000 7fda9effd700 1 --2- 172.21.15.45:0/2807668101 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fda8c06aed0 0x7fda8c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:44.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.283+0000 7fda9effd700 1 -- 172.21.15.45:0/2807668101 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdaa408b7e0 con 0x7fda94003a30 2023-10-08T20:11:44.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.284+0000 7fdab072a700 1 -- 172.21.15.45:0/2807668101 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda900052f0 con 0x7fda94003a30 2023-10-08T20:11:44.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.286+0000 7fdaadcc5700 1 --2- 172.21.15.45:0/2807668101 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fda8c06aed0 0x7fda8c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:44.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.287+0000 7fdaadcc5700 1 --2- 172.21.15.45:0/2807668101 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fda8c06aed0 0x7fda8c06d390 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80c6bd0 tx=0x7fda9800b2e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:44.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.290+0000 7fda9effd700 1 -- 172.21.15.45:0/2807668101 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdaa40569a0 con 0x7fda94003a30 2023-10-08T20:11:44.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.713+0000 7fdab072a700 1 -- 172.21.15.45:0/2807668101 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fda90005b20 con 0x7fda94003a30 2023-10-08T20:11:44.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.717+0000 7fda9effd700 1 -- 172.21.15.45:0/2807668101 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdaa4059fc0 con 0x7fda94003a30 2023-10-08T20:11:44.717 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-08T20:11:44.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.725+0000 7fdab072a700 1 -- 172.21.15.45:0/2807668101 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fda8c06aed0 msgr2=0x7fda8c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:44.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.725+0000 7fdab072a700 1 --2- 172.21.15.45:0/2807668101 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fda8c06aed0 0x7fda8c06d390 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80c6bd0 tx=0x7fda9800b2e0 comp rx=0 tx=0).stop 2023-10-08T20:11:44.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.725+0000 7fdab072a700 1 -- 172.21.15.45:0/2807668101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda94003a30 msgr2=0x7fdaa80abd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:44.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.725+0000 7fdab072a700 1 --2- 172.21.15.45:0/2807668101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda94003a30 0x7fdaa80abd00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4001930 tx=0x7fdaa4001b90 comp rx=0 tx=0).stop 2023-10-08T20:11:44.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.725+0000 7fdab072a700 1 -- 172.21.15.45:0/2807668101 shutdown_connections 2023-10-08T20:11:44.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.725+0000 7fdab072a700 1 --2- 172.21.15.45:0/2807668101 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fda8c06aed0 0x7fda8c06d390 secure :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80c6bd0 tx=0x7fda9800b2e0 comp rx=0 tx=0).stop 2023-10-08T20:11:44.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.725+0000 7fdab072a700 1 --2- 172.21.15.45:0/2807668101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaa815a830 0x7fdaa815acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:44.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.726+0000 7fdab072a700 1 --2- 172.21.15.45:0/2807668101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda94003a30 0x7fdaa80abd00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:44.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.726+0000 7fdab072a700 1 --2- 172.21.15.45:0/2807668101 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdaa80ae030 0x7fdaa815b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:44.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.726+0000 7fdab072a700 1 -- 172.21.15.45:0/2807668101 >> 172.21.15.45:0/2807668101 conn(0x7fdaa8097a20 msgr2=0x7fdaa80c4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:44.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.729+0000 7fdab072a700 1 -- 172.21.15.45:0/2807668101 shutdown_connections 2023-10-08T20:11:44.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:44.733+0000 7fdab072a700 1 -- 172.21.15.45:0/2807668101 wait complete. 2023-10-08T20:11:44.765 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T20:11:45.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.028+0000 7f3545b8c700 1 -- 172.21.15.45:0/1740775376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35400cd210 msgr2=0x7f3540071b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:45.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.028+0000 7f3545b8c700 1 --2- 172.21.15.45:0/1740775376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35400cd210 0x7f3540071b30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3528005fd0 tx=0x7f3528009c70 comp rx=0 tx=0).stop 2023-10-08T20:11:45.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.029+0000 7f3545b8c700 1 -- 172.21.15.45:0/1740775376 shutdown_connections 2023-10-08T20:11:45.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.029+0000 7f3545b8c700 1 --2- 172.21.15.45:0/1740775376 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3540159ef0 0x7f354015a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:45.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.029+0000 7f3545b8c700 1 --2- 172.21.15.45:0/1740775376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35400cd210 0x7f3540071b30 secure :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3528005fd0 tx=0x7f3528009c70 comp rx=0 tx=0).stop 2023-10-08T20:11:45.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.029+0000 7f3545b8c700 1 -- 172.21.15.45:0/1740775376 >> 172.21.15.45:0/1740775376 conn(0x7f35400cddc0 msgr2=0x7f35400ce1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:45.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.035+0000 7f3545b8c700 1 -- 172.21.15.45:0/1740775376 shutdown_connections 2023-10-08T20:11:45.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.038+0000 7f3545b8c700 1 -- 172.21.15.45:0/1740775376 wait complete. 2023-10-08T20:11:45.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.039+0000 7f3545b8c700 1 Processor -- start 2023-10-08T20:11:45.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.039+0000 7f3545b8c700 1 -- start start 2023-10-08T20:11:45.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.040+0000 7f3545b8c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f354006b6b0 0x7f35401ef980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:45.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.040+0000 7f3545b8c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3540159ef0 0x7f354014e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:45.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.040+0000 7f3545b8c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f354015b770 0x7f3540150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:45.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.040+0000 7f3545b8c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354015c820 con 0x7f354015b770 2023-10-08T20:11:45.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.040+0000 7f3545b8c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3540153160 con 0x7f354006b6b0 2023-10-08T20:11:45.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.040+0000 7f3545b8c700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3540152e30 con 0x7f3540159ef0 2023-10-08T20:11:45.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.040+0000 7f353f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f354006b6b0 0x7f35401ef980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:45.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.040+0000 7f353f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f354006b6b0 0x7f35401ef980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.45:34530/0 (socket says 172.21.15.45:34530) 2023-10-08T20:11:45.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.040+0000 7f353f7fe700 1 -- 172.21.15.45:0/3307128197 learned_addr learned my addr 172.21.15.45:0/3307128197 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:11:45.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.041+0000 7f353f7fe700 1 -- 172.21.15.45:0/3307128197 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3540159ef0 msgr2=0x7f354014e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:45.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.041+0000 7f353f7fe700 1 --2- 172.21.15.45:0/3307128197 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3540159ef0 0x7f354014e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:45.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.041+0000 7f353f7fe700 1 -- 172.21.15.45:0/3307128197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f354015b770 msgr2=0x7f3540150df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:45.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.041+0000 7f353f7fe700 1 --2- 172.21.15.45:0/3307128197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f354015b770 0x7f3540150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:45.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.041+0000 7f353f7fe700 1 -- 172.21.15.45:0/3307128197 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35280095f0 con 0x7f354006b6b0 2023-10-08T20:11:45.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.041+0000 7f353f7fe700 1 --2- 172.21.15.45:0/3307128197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f354006b6b0 0x7f35401ef980 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3528000c00 tx=0x7f3528004310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:45.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.041+0000 7f3537fff700 1 -- 172.21.15.45:0/3307128197 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352801d070 con 0x7f354006b6b0 2023-10-08T20:11:45.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.041+0000 7f3537fff700 1 -- 172.21.15.45:0/3307128197 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3528009eb0 con 0x7f354006b6b0 2023-10-08T20:11:45.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.041+0000 7f3537fff700 1 -- 172.21.15.45:0/3307128197 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3528003ad0 con 0x7f354006b6b0 2023-10-08T20:11:45.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.041+0000 7f3545b8c700 1 -- 172.21.15.45:0/3307128197 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f354015bf80 con 0x7f354006b6b0 2023-10-08T20:11:45.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.041+0000 7f3545b8c700 1 -- 172.21.15.45:0/3307128197 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f354015c540 con 0x7f354006b6b0 2023-10-08T20:11:45.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.043+0000 7f3545b8c700 1 -- 172.21.15.45:0/3307128197 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3540067470 con 0x7f354006b6b0 2023-10-08T20:11:45.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.043+0000 7f3537fff700 1 -- 172.21.15.45:0/3307128197 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3528003c30 con 0x7f354006b6b0 2023-10-08T20:11:45.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.044+0000 7f3537fff700 1 --2- 172.21.15.45:0/3307128197 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f352006aed0 0x7f352006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:45.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.044+0000 7f3537fff700 1 -- 172.21.15.45:0/3307128197 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f352808ac50 con 0x7f354006b6b0 2023-10-08T20:11:45.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.044+0000 7f353effd700 1 --2- 172.21.15.45:0/3307128197 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f352006aed0 0x7f352006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:45.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.044+0000 7f353effd700 1 --2- 172.21.15.45:0/3307128197 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f352006aed0 0x7f352006d390 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f354014e030 tx=0x7f3530007a40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:45.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.051+0000 7f3537fff700 1 -- 172.21.15.45:0/3307128197 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3528090020 con 0x7f354006b6b0 2023-10-08T20:11:45.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.388+0000 7f3545b8c700 1 -- 172.21.15.45:0/3307128197 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f354014eb80 con 0x7f354006b6b0 2023-10-08T20:11:45.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.388+0000 7f3537fff700 1 -- 172.21.15.45:0/3307128197 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3528055eb0 con 0x7f354006b6b0 2023-10-08T20:11:45.390 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-08T20:11:45.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.397+0000 7f3545b8c700 1 -- 172.21.15.45:0/3307128197 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f352006aed0 msgr2=0x7f352006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:45.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.397+0000 7f3545b8c700 1 --2- 172.21.15.45:0/3307128197 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f352006aed0 0x7f352006d390 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f354014e030 tx=0x7f3530007a40 comp rx=0 tx=0).stop 2023-10-08T20:11:45.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.397+0000 7f3545b8c700 1 -- 172.21.15.45:0/3307128197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f354006b6b0 msgr2=0x7f35401ef980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:45.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.397+0000 7f3545b8c700 1 --2- 172.21.15.45:0/3307128197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f354006b6b0 0x7f35401ef980 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3528000c00 tx=0x7f3528004310 comp rx=0 tx=0).stop 2023-10-08T20:11:45.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.398+0000 7f3545b8c700 1 -- 172.21.15.45:0/3307128197 shutdown_connections 2023-10-08T20:11:45.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.398+0000 7f3545b8c700 1 --2- 172.21.15.45:0/3307128197 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f352006aed0 0x7f352006d390 secure :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f354014e030 tx=0x7f3530007a40 comp rx=0 tx=0).stop 2023-10-08T20:11:45.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.398+0000 7f3545b8c700 1 --2- 172.21.15.45:0/3307128197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f354015b770 0x7f3540150df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:45.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.398+0000 7f3545b8c700 1 --2- 172.21.15.45:0/3307128197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f354006b6b0 0x7f35401ef980 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:45.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.398+0000 7f3545b8c700 1 --2- 172.21.15.45:0/3307128197 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3540159ef0 0x7f354014e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:45.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.398+0000 7f3545b8c700 1 -- 172.21.15.45:0/3307128197 >> 172.21.15.45:0/3307128197 conn(0x7f35400cddc0 msgr2=0x7f35400ca730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:45.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.404+0000 7f3545b8c700 1 -- 172.21.15.45:0/3307128197 shutdown_connections 2023-10-08T20:11:45.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.404+0000 7f3545b8c700 1 -- 172.21.15.45:0/3307128197 wait complete. 2023-10-08T20:11:45.427 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T20:11:45.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.670+0000 7f810f6c7700 1 -- 172.21.15.45:0/3167484840 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f810806d170 msgr2=0x7f81080acf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:45.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.670+0000 7f810f6c7700 1 --2- 172.21.15.45:0/3167484840 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f810806d170 0x7f81080acf90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f81040098c0 tx=0x7f8104009bd0 comp rx=0 tx=0).stop 2023-10-08T20:11:45.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.674+0000 7f810f6c7700 1 -- 172.21.15.45:0/3167484840 shutdown_connections 2023-10-08T20:11:45.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.674+0000 7f810f6c7700 1 --2- 172.21.15.45:0/3167484840 >> v2:172.21.15.45:3300/0 conn(0x7f81080b23e0 0x7f81080b2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:45.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.674+0000 7f810f6c7700 1 --2- 172.21.15.45:0/3167484840 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f810806d170 0x7f81080acf90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:45.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.674+0000 7f810f6c7700 1 -- 172.21.15.45:0/3167484840 >> 172.21.15.45:0/3167484840 conn(0x7f81080cddc0 msgr2=0x7f81080ce1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:45.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.675+0000 7f810f6c7700 1 -- 172.21.15.45:0/3167484840 shutdown_connections 2023-10-08T20:11:45.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.675+0000 7f810f6c7700 1 -- 172.21.15.45:0/3167484840 wait complete. 2023-10-08T20:11:45.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.677+0000 7f810f6c7700 1 Processor -- start 2023-10-08T20:11:45.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.682+0000 7f810f6c7700 1 -- start start 2023-10-08T20:11:45.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.683+0000 7f810f6c7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f810806d170 0x7f81081e2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:45.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.683+0000 7f810f6c7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81080b23e0 0x7f81081fee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:45.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.683+0000 7f810f6c7700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f81081589f0 0x7f8108155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:45.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.683+0000 7f810f6c7700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81081ff810 con 0x7f81080b23e0 2023-10-08T20:11:45.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.683+0000 7f810f6c7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81081ffaf0 con 0x7f810806d170 2023-10-08T20:11:45.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.683+0000 7f810f6c7700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81081ffdd0 con 0x7f81081589f0 2023-10-08T20:11:45.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.683+0000 7f810cc62700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81080b23e0 0x7f81081fee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:45.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.683+0000 7f810cc62700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81080b23e0 0x7f81081fee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51324/0 (socket says 172.21.15.45:51324) 2023-10-08T20:11:45.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.683+0000 7f810cc62700 1 -- 172.21.15.45:0/1068606683 learned_addr learned my addr 172.21.15.45:0/1068606683 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:11:45.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.683+0000 7f810d463700 1 --2- 172.21.15.45:0/1068606683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f810806d170 0x7f81081e2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:45.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.683+0000 7f810dc64700 1 --2- 172.21.15.45:0/1068606683 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f81081589f0 0x7f8108155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:45.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.684+0000 7f810cc62700 1 -- 172.21.15.45:0/1068606683 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f81081589f0 msgr2=0x7f8108155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:45.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.684+0000 7f810cc62700 1 --2- 172.21.15.45:0/1068606683 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f81081589f0 0x7f8108155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:45.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.684+0000 7f810cc62700 1 -- 172.21.15.45:0/1068606683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f810806d170 msgr2=0x7f81081e2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:45.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.684+0000 7f810cc62700 1 --2- 172.21.15.45:0/1068606683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f810806d170 0x7f81081e2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:45.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.684+0000 7f810cc62700 1 -- 172.21.15.45:0/1068606683 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8104009520 con 0x7f81080b23e0 2023-10-08T20:11:45.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.684+0000 7f810cc62700 1 --2- 172.21.15.45:0/1068606683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81080b23e0 0x7f81081fee40 secure :-1 s=READY pgs=3256 cs=0 l=1 rev1=1 crypto rx=0x7f8108158f10 tx=0x7f8104004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:45.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.684+0000 7f80fdffb700 1 -- 172.21.15.45:0/1068606683 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810401c070 con 0x7f81080b23e0 2023-10-08T20:11:45.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.684+0000 7f80fdffb700 1 -- 172.21.15.45:0/1068606683 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f810400b6f0 con 0x7f81080b23e0 2023-10-08T20:11:45.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.684+0000 7f810f6c7700 1 -- 172.21.15.45:0/1068606683 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8108200460 con 0x7f81080b23e0 2023-10-08T20:11:45.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.684+0000 7f80fdffb700 1 -- 172.21.15.45:0/1068606683 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810400bae0 con 0x7f81080b23e0 2023-10-08T20:11:45.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.685+0000 7f810f6c7700 1 -- 172.21.15.45:0/1068606683 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81081ff380 con 0x7f81080b23e0 2023-10-08T20:11:45.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.686+0000 7f80fdffb700 1 -- 172.21.15.45:0/1068606683 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f810400bc40 con 0x7f81080b23e0 2023-10-08T20:11:45.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.687+0000 7f80fdffb700 1 --2- 172.21.15.45:0/1068606683 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f80ec06aed0 0x7f80ec06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:45.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.687+0000 7f80fdffb700 1 -- 172.21.15.45:0/1068606683 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f810408af60 con 0x7f81080b23e0 2023-10-08T20:11:45.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.688+0000 7f810f6c7700 1 -- 172.21.15.45:0/1068606683 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81082002c0 con 0x7f81080b23e0 2023-10-08T20:11:45.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.690+0000 7f810d463700 1 --2- 172.21.15.45:0/1068606683 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f80ec06aed0 0x7f80ec06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:45.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.691+0000 7f810d463700 1 --2- 172.21.15.45:0/1068606683 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f80ec06aed0 0x7f80ec06d390 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f80f8007fd0 tx=0x7f80f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:45.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:45.695+0000 7f80fdffb700 1 -- 172.21.15.45:0/1068606683 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f81082002c0 con 0x7f81080b23e0 2023-10-08T20:11:46.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.053+0000 7f810f6c7700 1 -- 172.21.15.45:0/1068606683 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f81082002c0 con 0x7f81080b23e0 2023-10-08T20:11:46.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.059+0000 7f80fdffb700 1 -- 172.21.15.45:0/1068606683 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) v1 ==== 100+0+11 (secure 0 0 0) 0x7f81082002c0 con 0x7f81080b23e0 2023-10-08T20:11:46.059 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-08T20:11:46.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.063+0000 7f810f6c7700 1 -- 172.21.15.45:0/1068606683 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f80ec06aed0 msgr2=0x7f80ec06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:46.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.063+0000 7f810f6c7700 1 --2- 172.21.15.45:0/1068606683 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f80ec06aed0 0x7f80ec06d390 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f80f8007fd0 tx=0x7f80f8009040 comp rx=0 tx=0).stop 2023-10-08T20:11:46.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.063+0000 7f810f6c7700 1 -- 172.21.15.45:0/1068606683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81080b23e0 msgr2=0x7f81081fee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:46.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.063+0000 7f810f6c7700 1 --2- 172.21.15.45:0/1068606683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81080b23e0 0x7f81081fee40 secure :-1 s=READY pgs=3256 cs=0 l=1 rev1=1 crypto rx=0x7f8108158f10 tx=0x7f8104004260 comp rx=0 tx=0).stop 2023-10-08T20:11:46.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.063+0000 7f810f6c7700 1 -- 172.21.15.45:0/1068606683 shutdown_connections 2023-10-08T20:11:46.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.063+0000 7f810f6c7700 1 --2- 172.21.15.45:0/1068606683 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f80ec06aed0 0x7f80ec06d390 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:46.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.063+0000 7f810f6c7700 1 --2- 172.21.15.45:0/1068606683 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f81081589f0 0x7f8108155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:46.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.063+0000 7f810f6c7700 1 --2- 172.21.15.45:0/1068606683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f810806d170 0x7f81081e2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:46.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.063+0000 7f810f6c7700 1 --2- 172.21.15.45:0/1068606683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81080b23e0 0x7f81081fee40 unknown :-1 s=CLOSED pgs=3256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:46.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.063+0000 7f810f6c7700 1 -- 172.21.15.45:0/1068606683 >> 172.21.15.45:0/1068606683 conn(0x7f81080cddc0 msgr2=0x7f81080ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:46.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.063+0000 7f810f6c7700 1 -- 172.21.15.45:0/1068606683 shutdown_connections 2023-10-08T20:11:46.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.063+0000 7f810f6c7700 1 -- 172.21.15.45:0/1068606683 wait complete. 2023-10-08T20:11:46.084 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T20:11:46.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.303+0000 7f7981743700 1 -- 172.21.15.45:0/1351107215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f797c06f3d0 msgr2=0x7f797c0cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:46.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.303+0000 7f7981743700 1 --2- 172.21.15.45:0/1351107215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f797c06f3d0 0x7f797c0cc160 secure :-1 s=READY pgs=3257 cs=0 l=1 rev1=1 crypto rx=0x7f796c005fd0 tx=0x7f796c009c70 comp rx=0 tx=0).stop 2023-10-08T20:11:46.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.303+0000 7f7981743700 1 -- 172.21.15.45:0/1351107215 shutdown_connections 2023-10-08T20:11:46.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.304+0000 7f7981743700 1 --2- 172.21.15.45:0/1351107215 >> v2:172.21.15.78:3300/0 conn(0x7f797c0cc6a0 0x7f797c0ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:46.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.304+0000 7f7981743700 1 --2- 172.21.15.45:0/1351107215 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f797c1599f0 0x7f797c06ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:46.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.304+0000 7f7981743700 1 --2- 172.21.15.45:0/1351107215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f797c06f3d0 0x7f797c0cc160 unknown :-1 s=CLOSED pgs=3257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:46.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.304+0000 7f7981743700 1 -- 172.21.15.45:0/1351107215 >> 172.21.15.45:0/1351107215 conn(0x7f797c0cf750 msgr2=0x7f797c0cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:46.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.304+0000 7f7981743700 1 -- 172.21.15.45:0/1351107215 shutdown_connections 2023-10-08T20:11:46.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.304+0000 7f7981743700 1 -- 172.21.15.45:0/1351107215 wait complete. 2023-10-08T20:11:46.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.305+0000 7f7981743700 1 Processor -- start 2023-10-08T20:11:46.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.306+0000 7f7981743700 1 -- start start 2023-10-08T20:11:46.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.306+0000 7f7981743700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f797c06f3d0 0x7f797c06b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:46.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.306+0000 7f7981743700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f797c0cc6a0 0x7f797c0c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:46.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.306+0000 7f7981743700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f797c1599f0 0x7f797c150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:46.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.306+0000 7f7981743700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0c9f60 con 0x7f797c1599f0 2023-10-08T20:11:46.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.306+0000 7f7981743700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c06ba20 con 0x7f797c06f3d0 2023-10-08T20:11:46.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.306+0000 7f7981743700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797c06bd00 con 0x7f797c0cc6a0 2023-10-08T20:11:46.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.307+0000 7f797b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f797c1599f0 0x7f797c150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:46.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.307+0000 7f797affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f797c06f3d0 0x7f797c06b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:46.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.307+0000 7f797affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f797c06f3d0 0x7f797c06b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.45:34554/0 (socket says 172.21.15.45:34554) 2023-10-08T20:11:46.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.307+0000 7f797affd700 1 -- 172.21.15.45:0/2048819262 learned_addr learned my addr 172.21.15.45:0/2048819262 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:11:46.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.307+0000 7f797a7fc700 1 --2- 172.21.15.45:0/2048819262 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f797c0cc6a0 0x7f797c0c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:46.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.307+0000 7f797affd700 1 -- 172.21.15.45:0/2048819262 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f797c0cc6a0 msgr2=0x7f797c0c9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:46.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.307+0000 7f797affd700 1 --2- 172.21.15.45:0/2048819262 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f797c0cc6a0 0x7f797c0c9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:46.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.307+0000 7f797affd700 1 -- 172.21.15.45:0/2048819262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f797c1599f0 msgr2=0x7f797c150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:46.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.307+0000 7f797affd700 1 --2- 172.21.15.45:0/2048819262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f797c1599f0 0x7f797c150bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:46.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.307+0000 7f797affd700 1 -- 172.21.15.45:0/2048819262 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796c0095f0 con 0x7f797c06f3d0 2023-10-08T20:11:46.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.307+0000 7f797a7fc700 1 --2- 172.21.15.45:0/2048819262 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f797c0cc6a0 0x7f797c0c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T20:11:46.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.307+0000 7f797b7fe700 1 --2- 172.21.15.45:0/2048819262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f797c1599f0 0x7f797c150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T20:11:46.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.307+0000 7f797affd700 1 --2- 172.21.15.45:0/2048819262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f797c06f3d0 0x7f797c06b320 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f797000ea20 tx=0x7f797000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:46.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.308+0000 7f79637fe700 1 -- 172.21.15.45:0/2048819262 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7970009610 con 0x7f797c06f3d0 2023-10-08T20:11:46.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.308+0000 7f7981743700 1 -- 172.21.15.45:0/2048819262 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797c06bfe0 con 0x7f797c06f3d0 2023-10-08T20:11:46.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.308+0000 7f7981743700 1 -- 172.21.15.45:0/2048819262 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f797c06c5a0 con 0x7f797c06f3d0 2023-10-08T20:11:46.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.308+0000 7f79637fe700 1 -- 172.21.15.45:0/2048819262 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f797000cab0 con 0x7f797c06f3d0 2023-10-08T20:11:46.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.308+0000 7f79637fe700 1 -- 172.21.15.45:0/2048819262 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797000cea0 con 0x7f797c06f3d0 2023-10-08T20:11:46.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.310+0000 7f79637fe700 1 -- 172.21.15.45:0/2048819262 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7970010430 con 0x7f797c06f3d0 2023-10-08T20:11:46.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.310+0000 7f7981743700 1 -- 172.21.15.45:0/2048819262 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f795c0052f0 con 0x7f797c06f3d0 2023-10-08T20:11:46.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.311+0000 7f79637fe700 1 --2- 172.21.15.45:0/2048819262 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f796806aed0 0x7f796806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:46.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.311+0000 7f79637fe700 1 -- 172.21.15.45:0/2048819262 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7970014070 con 0x7f797c06f3d0 2023-10-08T20:11:46.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.311+0000 7f797a7fc700 1 --2- 172.21.15.45:0/2048819262 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f796806aed0 0x7f796806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:46.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.311+0000 7f797a7fc700 1 --2- 172.21.15.45:0/2048819262 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f796806aed0 0x7f796806d390 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f796c0098e0 tx=0x7f796c0047c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:46.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.317+0000 7f79637fe700 1 -- 172.21.15.45:0/2048819262 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7970051ca0 con 0x7f797c06f3d0 2023-10-08T20:11:46.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.755+0000 7f7981743700 1 -- 172.21.15.45:0/2048819262 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f795c0055a0 con 0x7f797c06f3d0 2023-10-08T20:11:46.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.756+0000 7f79637fe700 1 -- 172.21.15.45:0/2048819262 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4907 (secure 0 0 0) 0x7f79700588d0 con 0x7f797c06f3d0 2023-10-08T20:11:46.760 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:46.760 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4775,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/415745376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":415745376},{"type":"v1","addr":"172.21.15.78:6836","nonce":415745376}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/4017051943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":4017051943},{"type":"v1","addr":"172.21.15.78:6837","nonce":4017051943}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4784,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2071345881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2071345881},{"type":"v1","addr":"172.21.15.45:6835","nonce":2071345881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T12:46:26.025761+0000","modified":"2023-10-08T12:46:29.062189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5041},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5041":{"gid":5041,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6834/328442803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":328442803},{"type":"v1","addr":"172.21.15.45:6834","nonce":328442803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-08T20:11:46.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.763+0000 7f7981743700 1 -- 172.21.15.45:0/2048819262 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f796806aed0 msgr2=0x7f796806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:46.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.763+0000 7f7981743700 1 --2- 172.21.15.45:0/2048819262 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f796806aed0 0x7f796806d390 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f796c0098e0 tx=0x7f796c0047c0 comp rx=0 tx=0).stop 2023-10-08T20:11:46.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.763+0000 7f7981743700 1 -- 172.21.15.45:0/2048819262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f797c06f3d0 msgr2=0x7f797c06b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:46.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.763+0000 7f7981743700 1 --2- 172.21.15.45:0/2048819262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f797c06f3d0 0x7f797c06b320 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f797000ea20 tx=0x7f797000ed30 comp rx=0 tx=0).stop 2023-10-08T20:11:46.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.763+0000 7f7981743700 1 -- 172.21.15.45:0/2048819262 shutdown_connections 2023-10-08T20:11:46.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.763+0000 7f7981743700 1 --2- 172.21.15.45:0/2048819262 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f796806aed0 0x7f796806d390 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:46.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.763+0000 7f7981743700 1 --2- 172.21.15.45:0/2048819262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f797c1599f0 0x7f797c150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:46.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.763+0000 7f7981743700 1 --2- 172.21.15.45:0/2048819262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f797c06f3d0 0x7f797c06b320 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:46.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.763+0000 7f7981743700 1 --2- 172.21.15.45:0/2048819262 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f797c0cc6a0 0x7f797c0c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:46.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.763+0000 7f7981743700 1 -- 172.21.15.45:0/2048819262 >> 172.21.15.45:0/2048819262 conn(0x7f797c0cf750 msgr2=0x7f797c0ce7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:46.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.763+0000 7f7981743700 1 -- 172.21.15.45:0/2048819262 shutdown_connections 2023-10-08T20:11:46.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.763+0000 7f7981743700 1 -- 172.21.15.45:0/2048819262 wait complete. 2023-10-08T20:11:46.767 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2023-10-08T20:11:46.784 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T20:11:46.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.991+0000 7fcdbc8ac700 1 -- 172.21.15.45:0/4154747296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcda0004290 msgr2=0x7fcda0004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:46.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.991+0000 7fcdbc8ac700 1 --2- 172.21.15.45:0/4154747296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcda0004290 0x7fcda0004850 secure :-1 s=READY pgs=3258 cs=0 l=1 rev1=1 crypto rx=0x7fcdac00c790 tx=0x7fcda0005880 comp rx=0 tx=0).stop 2023-10-08T20:11:46.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.991+0000 7fcdb6d9d700 1 -- 172.21.15.45:0/4154747296 reap_dead start 2023-10-08T20:11:46.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.991+0000 7fcdbc8ac700 1 -- 172.21.15.45:0/4154747296 shutdown_connections 2023-10-08T20:11:46.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.991+0000 7fcdbc8ac700 1 -- 172.21.15.45:0/4154747296 >> 172.21.15.45:0/4154747296 conn(0x7fcdb80afda0 msgr2=0x7fcdb80cd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:46.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.991+0000 7fcdbc8ac700 1 -- 172.21.15.45:0/4154747296 shutdown_connections 2023-10-08T20:11:46.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.991+0000 7fcdbc8ac700 1 -- 172.21.15.45:0/4154747296 wait complete. 2023-10-08T20:11:46.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.993+0000 7fcdbc8ac700 1 Processor -- start 2023-10-08T20:11:46.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.993+0000 7fcdbc8ac700 1 -- start start 2023-10-08T20:11:46.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.995+0000 7fcdbc8ac700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcda0004290 0x7fcdb8145ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:46.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.995+0000 7fcdbc8ac700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcdb8141500 0x7fcdb814b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:46.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.995+0000 7fcdbc8ac700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdb814b720 0x7fcdb8150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:46.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.995+0000 7fcdbc8ac700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb8149130 con 0x7fcda0004290 2023-10-08T20:11:46.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.995+0000 7fcdbc8ac700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb814bba0 con 0x7fcdb814b720 2023-10-08T20:11:46.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.995+0000 7fcdbc8ac700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb81487d0 con 0x7fcdb8141500 2023-10-08T20:11:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.996+0000 7fcdb6d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdb814b720 0x7fcdb8150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.996+0000 7fcdb6d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdb814b720 0x7fcdb8150860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.45:34576/0 (socket says 172.21.15.45:34576) 2023-10-08T20:11:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.996+0000 7fcdb6d9d700 1 -- 172.21.15.45:0/1978615299 learned_addr learned my addr 172.21.15.45:0/1978615299 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:11:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.996+0000 7fcdb5d9b700 1 --2- 172.21.15.45:0/1978615299 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcdb8141500 0x7fcdb814b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.996+0000 7fcdb6d9d700 1 -- 172.21.15.45:0/1978615299 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcdb8141500 msgr2=0x7fcdb814b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.996+0000 7fcdb6d9d700 1 --2- 172.21.15.45:0/1978615299 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcdb8141500 0x7fcdb814b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.996+0000 7fcdb6d9d700 1 -- 172.21.15.45:0/1978615299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcda0004290 msgr2=0x7fcdb8145ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.996+0000 7fcdb6d9d700 1 --2- 172.21.15.45:0/1978615299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcda0004290 0x7fcdb8145ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.996+0000 7fcdb6d9d700 1 -- 172.21.15.45:0/1978615299 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb81515b0 con 0x7fcdb814b720 2023-10-08T20:11:46.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.996+0000 7fcdb6d9d700 1 --2- 172.21.15.45:0/1978615299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdb814b720 0x7fcdb8150860 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcdb806e800 tx=0x7fcdb000be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:46.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.996+0000 7fcda6ffd700 1 -- 172.21.15.45:0/1978615299 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb000c9d0 con 0x7fcdb814b720 2023-10-08T20:11:46.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.997+0000 7fcda6ffd700 1 -- 172.21.15.45:0/1978615299 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcdb000cc20 con 0x7fcdb814b720 2023-10-08T20:11:46.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.997+0000 7fcda6ffd700 1 -- 172.21.15.45:0/1978615299 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0015470 con 0x7fcdb814b720 2023-10-08T20:11:46.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.997+0000 7fcdbc8ac700 1 -- 172.21.15.45:0/1978615299 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb8148a70 con 0x7fcdb814b720 2023-10-08T20:11:46.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.997+0000 7fcdbc8ac700 1 -- 172.21.15.45:0/1978615299 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb8141980 con 0x7fcdb814b720 2023-10-08T20:11:46.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.999+0000 7fcda6ffd700 1 -- 172.21.15.45:0/1978615299 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcdb0012070 con 0x7fcdb814b720 2023-10-08T20:11:47.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.999+0000 7fcdbc8ac700 1 -- 172.21.15.45:0/1978615299 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb8149270 con 0x7fcdb814b720 2023-10-08T20:11:47.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:46.999+0000 7fcda6ffd700 1 --2- 172.21.15.45:0/1978615299 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fcd9806aed0 0x7fcd9806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:47.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.000+0000 7fcda6ffd700 1 -- 172.21.15.45:0/1978615299 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcdb0088d50 con 0x7fcdb814b720 2023-10-08T20:11:47.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.000+0000 7fcdb659c700 1 --2- 172.21.15.45:0/1978615299 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fcd9806aed0 0x7fcd9806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:47.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.000+0000 7fcdb659c700 1 --2- 172.21.15.45:0/1978615299 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fcd9806aed0 0x7fcd9806d390 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fcdac00c790 tx=0x7fcdac000fb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:47.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.007+0000 7fcda6ffd700 1 -- 172.21.15.45:0/1978615299 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcdb8149270 con 0x7fcdb814b720 2023-10-08T20:11:47.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.350+0000 7fcdbc8ac700 1 -- 172.21.15.45:0/1978615299 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcdb8149270 con 0x7fcdb814b720 2023-10-08T20:11:47.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.353+0000 7fcda6ffd700 1 -- 172.21.15.45:0/1978615299 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16521 (secure 0 0 0) 0x7fcdb8149270 con 0x7fcdb814b720 2023-10-08T20:11:47.360 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:47.360 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":33,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:46:27.627861+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:45:19.183651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:46:24.050213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T12:46:25.003094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.412453+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.351925+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.428025+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.437246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.441119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.388608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.415524+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.401835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T20:11:47.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.362+0000 7fcdbc8ac700 1 -- 172.21.15.45:0/1978615299 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fcd9806aed0 msgr2=0x7fcd9806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:47.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.362+0000 7fcdbc8ac700 1 --2- 172.21.15.45:0/1978615299 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fcd9806aed0 0x7fcd9806d390 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fcdac00c790 tx=0x7fcdac000fb0 comp rx=0 tx=0).stop 2023-10-08T20:11:47.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.362+0000 7fcdbc8ac700 1 -- 172.21.15.45:0/1978615299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdb814b720 msgr2=0x7fcdb8150860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:47.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.362+0000 7fcdbc8ac700 1 --2- 172.21.15.45:0/1978615299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdb814b720 0x7fcdb8150860 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcdb806e800 tx=0x7fcdb000be50 comp rx=0 tx=0).stop 2023-10-08T20:11:47.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.363+0000 7fcdbc8ac700 1 -- 172.21.15.45:0/1978615299 shutdown_connections 2023-10-08T20:11:47.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.363+0000 7fcdbc8ac700 1 --2- 172.21.15.45:0/1978615299 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fcd9806aed0 0x7fcd9806d390 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:47.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.363+0000 7fcdbc8ac700 1 --2- 172.21.15.45:0/1978615299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdb814b720 0x7fcdb8150860 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:47.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.363+0000 7fcdbc8ac700 1 --2- 172.21.15.45:0/1978615299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcda0004290 0x7fcdb8145ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:47.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.363+0000 7fcdbc8ac700 1 --2- 172.21.15.45:0/1978615299 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcdb8141500 0x7fcdb814b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:47.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.363+0000 7fcdbc8ac700 1 -- 172.21.15.45:0/1978615299 >> 172.21.15.45:0/1978615299 conn(0x7fcdb80afda0 msgr2=0x7fcdb80b0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:47.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.368+0000 7fcdbc8ac700 1 -- 172.21.15.45:0/1978615299 shutdown_connections 2023-10-08T20:11:47.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.368+0000 7fcdbc8ac700 1 -- 172.21.15.45:0/1978615299 wait complete. 2023-10-08T20:11:47.394 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T20:11:47.394 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T20:11:47.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.615+0000 7f30e1820700 1 -- 172.21.15.45:0/3129093246 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f30dc1688d0 msgr2=0x7f30dc16c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:47.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.615+0000 7f30e1820700 1 --2- 172.21.15.45:0/3129093246 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f30dc1688d0 0x7f30dc16c290 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009990 tx=0x7f30cc009ca0 comp rx=0 tx=0).stop 2023-10-08T20:11:47.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.615+0000 7f30e1820700 1 -- 172.21.15.45:0/3129093246 shutdown_connections 2023-10-08T20:11:47.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.615+0000 7f30e1820700 1 --2- 172.21.15.45:0/3129093246 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f30dc1688d0 0x7f30dc16c290 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:47.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.615+0000 7f30e1820700 1 -- 172.21.15.45:0/3129093246 >> 172.21.15.45:0/3129093246 conn(0x7f30dc06e010 msgr2=0x7f30dc06e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:47.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.615+0000 7f30e1820700 1 -- 172.21.15.45:0/3129093246 shutdown_connections 2023-10-08T20:11:47.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.615+0000 7f30e1820700 1 -- 172.21.15.45:0/3129093246 wait complete. 2023-10-08T20:11:47.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.617+0000 7f30e1820700 1 Processor -- start 2023-10-08T20:11:47.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.617+0000 7f30e1820700 1 -- start start 2023-10-08T20:11:47.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.618+0000 7f30e1820700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f30dc071b30 0x7f30dc167880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:47.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.618+0000 7f30e1820700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30dc1688d0 0x7f30dc162ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:47.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.618+0000 7f30e1820700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30dc16c7d0 0x7f30dc0a8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:47.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.618+0000 7f30e1820700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc0a7b90 con 0x7f30dc16c7d0 2023-10-08T20:11:47.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.618+0000 7f30e1820700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc163780 con 0x7f30dc1688d0 2023-10-08T20:11:47.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.618+0000 7f30e1820700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc165720 con 0x7f30dc071b30 2023-10-08T20:11:47.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.618+0000 7f30db7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30dc16c7d0 0x7f30dc0a8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:47.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.619+0000 7f30db7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30dc16c7d0 0x7f30dc0a8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51368/0 (socket says 172.21.15.45:51368) 2023-10-08T20:11:47.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.619+0000 7f30db7fe700 1 -- 172.21.15.45:0/22492367 learned_addr learned my addr 172.21.15.45:0/22492367 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:11:47.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.619+0000 7f30da7fc700 1 --2- 172.21.15.45:0/22492367 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30dc1688d0 0x7f30dc162ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:47.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.619+0000 7f30da7fc700 1 -- 172.21.15.45:0/22492367 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f30dc071b30 msgr2=0x7f30dc167880 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T20:11:47.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.619+0000 7f30da7fc700 1 --2- 172.21.15.45:0/22492367 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f30dc071b30 0x7f30dc167880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:47.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.619+0000 7f30da7fc700 1 -- 172.21.15.45:0/22492367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30dc16c7d0 msgr2=0x7f30dc0a8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:47.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.619+0000 7f30da7fc700 1 --2- 172.21.15.45:0/22492367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30dc16c7d0 0x7f30dc0a8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:47.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.619+0000 7f30da7fc700 1 -- 172.21.15.45:0/22492367 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30cc0095f0 con 0x7f30dc1688d0 2023-10-08T20:11:47.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.619+0000 7f30db7fe700 1 --2- 172.21.15.45:0/22492367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30dc16c7d0 0x7f30dc0a8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T20:11:47.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.619+0000 7f30da7fc700 1 --2- 172.21.15.45:0/22492367 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30dc1688d0 0x7f30dc162ee0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f30d00017d0 tx=0x7f30d0001ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:47.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.619+0000 7f30c3fff700 1 -- 172.21.15.45:0/22492367 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d0013070 con 0x7f30dc1688d0 2023-10-08T20:11:47.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.620+0000 7f30c3fff700 1 -- 172.21.15.45:0/22492367 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f30d000e2e0 con 0x7f30dc1688d0 2023-10-08T20:11:47.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.620+0000 7f30c3fff700 1 -- 172.21.15.45:0/22492367 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d0005330 con 0x7f30dc1688d0 2023-10-08T20:11:47.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.620+0000 7f30e1820700 1 -- 172.21.15.45:0/22492367 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30dc165a00 con 0x7f30dc1688d0 2023-10-08T20:11:47.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.620+0000 7f30e1820700 1 -- 172.21.15.45:0/22492367 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30dc165fc0 con 0x7f30dc1688d0 2023-10-08T20:11:47.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.621+0000 7f30c3fff700 1 -- 172.21.15.45:0/22492367 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f30d0003680 con 0x7f30dc1688d0 2023-10-08T20:11:47.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.622+0000 7f30c3fff700 1 --2- 172.21.15.45:0/22492367 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f30c806aed0 0x7f30c806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:47.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.622+0000 7f30c3fff700 1 -- 172.21.15.45:0/22492367 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f30d008c940 con 0x7f30dc1688d0 2023-10-08T20:11:47.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.623+0000 7f30daffd700 1 --2- 172.21.15.45:0/22492367 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f30c806aed0 0x7f30c806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:47.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.623+0000 7f30daffd700 1 --2- 172.21.15.45:0/22492367 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f30c806aed0 0x7f30c806d390 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f30cc006010 tx=0x7f30cc0047c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:47.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.624+0000 7f30e1820700 1 -- 172.21.15.45:0/22492367 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30dc04e4c0 con 0x7f30dc1688d0 2023-10-08T20:11:47.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:47.632+0000 7f30c3fff700 1 -- 172.21.15.45:0/22492367 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f30d00579f0 con 0x7f30dc1688d0 2023-10-08T20:11:48.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.060+0000 7f30e1820700 1 -- 172.21.15.45:0/22492367 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30dc0b0a60 con 0x7f30dc1688d0 2023-10-08T20:11:48.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.061+0000 7f30c3fff700 1 -- 172.21.15.45:0/22492367 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4907 (secure 0 0 0) 0x7f30d005b010 con 0x7f30dc1688d0 2023-10-08T20:11:48.062 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:48.062 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4775,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/415745376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":415745376},{"type":"v1","addr":"172.21.15.78:6836","nonce":415745376}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/4017051943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":4017051943},{"type":"v1","addr":"172.21.15.78:6837","nonce":4017051943}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4784,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2071345881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2071345881},{"type":"v1","addr":"172.21.15.45:6835","nonce":2071345881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T12:46:26.025761+0000","modified":"2023-10-08T12:46:29.062189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5041},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5041":{"gid":5041,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6834/328442803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":328442803},{"type":"v1","addr":"172.21.15.45:6834","nonce":328442803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-08T20:11:48.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.065+0000 7f30e1820700 1 -- 172.21.15.45:0/22492367 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f30c806aed0 msgr2=0x7f30c806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:48.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.065+0000 7f30e1820700 1 --2- 172.21.15.45:0/22492367 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f30c806aed0 0x7f30c806d390 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f30cc006010 tx=0x7f30cc0047c0 comp rx=0 tx=0).stop 2023-10-08T20:11:48.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.065+0000 7f30e1820700 1 -- 172.21.15.45:0/22492367 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30dc1688d0 msgr2=0x7f30dc162ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:48.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.065+0000 7f30e1820700 1 --2- 172.21.15.45:0/22492367 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30dc1688d0 0x7f30dc162ee0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f30d00017d0 tx=0x7f30d0001ae0 comp rx=0 tx=0).stop 2023-10-08T20:11:48.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.065+0000 7f30e1820700 1 -- 172.21.15.45:0/22492367 shutdown_connections 2023-10-08T20:11:48.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.065+0000 7f30e1820700 1 --2- 172.21.15.45:0/22492367 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f30c806aed0 0x7f30c806d390 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:48.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.065+0000 7f30e1820700 1 --2- 172.21.15.45:0/22492367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30dc16c7d0 0x7f30dc0a8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:48.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.065+0000 7f30e1820700 1 --2- 172.21.15.45:0/22492367 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f30dc071b30 0x7f30dc167880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:48.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.065+0000 7f30e1820700 1 --2- 172.21.15.45:0/22492367 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30dc1688d0 0x7f30dc162ee0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:48.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.065+0000 7f30e1820700 1 -- 172.21.15.45:0/22492367 >> 172.21.15.45:0/22492367 conn(0x7f30dc06e010 msgr2=0x7f30dc0b28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:48.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.066+0000 7f30e1820700 1 -- 172.21.15.45:0/22492367 shutdown_connections 2023-10-08T20:11:48.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.066+0000 7f30e1820700 1 -- 172.21.15.45:0/22492367 wait complete. 2023-10-08T20:11:48.067 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2023-10-08T20:11:48.085 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T20:11:48.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.285+0000 7fdae514f700 1 -- 172.21.15.45:0/3169775235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdae006eea0 msgr2=0x7fdae00b08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:48.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.285+0000 7fdae514f700 1 --2- 172.21.15.45:0/3169775235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdae006eea0 0x7fdae00b08b0 secure :-1 s=READY pgs=3260 cs=0 l=1 rev1=1 crypto rx=0x7fdad8009f60 tx=0x7fdad8009f90 comp rx=0 tx=0).stop 2023-10-08T20:11:48.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.285+0000 7fdae514f700 1 -- 172.21.15.45:0/3169775235 shutdown_connections 2023-10-08T20:11:48.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.285+0000 7fdae514f700 1 --2- 172.21.15.45:0/3169775235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdae006eea0 0x7fdae00b08b0 unknown :-1 s=CLOSED pgs=3260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:48.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.285+0000 7fdae514f700 1 --2- 172.21.15.45:0/3169775235 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdae00cc650 0x7fdae006e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:48.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.285+0000 7fdae514f700 1 -- 172.21.15.45:0/3169775235 >> 172.21.15.45:0/3169775235 conn(0x7fdae00afda0 msgr2=0x7fdae00cd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:48.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.289+0000 7fdae514f700 1 -- 172.21.15.45:0/3169775235 shutdown_connections 2023-10-08T20:11:48.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.289+0000 7fdae514f700 1 -- 172.21.15.45:0/3169775235 wait complete. 2023-10-08T20:11:48.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.291+0000 7fdae514f700 1 Processor -- start 2023-10-08T20:11:48.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.291+0000 7fdae514f700 1 -- start start 2023-10-08T20:11:48.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.292+0000 7fdae514f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdae006eea0 0x7fdae014d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:48.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.292+0000 7fdae514f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdae00b20c0 0x7fdae015a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:48.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.292+0000 7fdae514f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdae00cc650 0x7fdae0149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:48.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.292+0000 7fdae514f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae015bc80 con 0x7fdae006eea0 2023-10-08T20:11:48.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.292+0000 7fdae514f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae015b7f0 con 0x7fdae00b20c0 2023-10-08T20:11:48.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.292+0000 7fdae514f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae015abe0 con 0x7fdae00cc650 2023-10-08T20:11:48.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.292+0000 7fdaded9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdae006eea0 0x7fdae014d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:48.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.292+0000 7fdaded9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdae006eea0 0x7fdae014d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51380/0 (socket says 172.21.15.45:51380) 2023-10-08T20:11:48.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.292+0000 7fdaded9d700 1 -- 172.21.15.45:0/1515244875 learned_addr learned my addr 172.21.15.45:0/1515244875 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:11:48.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.292+0000 7fdade59c700 1 --2- 172.21.15.45:0/1515244875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdae00b20c0 0x7fdae015a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:48.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.292+0000 7fdadf59e700 1 --2- 172.21.15.45:0/1515244875 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdae00cc650 0x7fdae0149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:48.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.292+0000 7fdadf59e700 1 -- 172.21.15.45:0/1515244875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdae00b20c0 msgr2=0x7fdae015a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:48.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.292+0000 7fdadf59e700 1 --2- 172.21.15.45:0/1515244875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdae00b20c0 0x7fdae015a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:48.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.292+0000 7fdadf59e700 1 -- 172.21.15.45:0/1515244875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdae006eea0 msgr2=0x7fdae014d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:48.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.292+0000 7fdadf59e700 1 --2- 172.21.15.45:0/1515244875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdae006eea0 0x7fdae014d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:48.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.292+0000 7fdadf59e700 1 -- 172.21.15.45:0/1515244875 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad8009c40 con 0x7fdae00cc650 2023-10-08T20:11:48.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.292+0000 7fdaded9d700 1 --2- 172.21.15.45:0/1515244875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdae006eea0 0x7fdae014d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T20:11:48.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.293+0000 7fdadf59e700 1 --2- 172.21.15.45:0/1515244875 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdae00cc650 0x7fdae0149560 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdad8015000 tx=0x7fdad8007870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:48.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.299+0000 7fdac77fe700 1 -- 172.21.15.45:0/1515244875 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad800e040 con 0x7fdae00cc650 2023-10-08T20:11:48.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.299+0000 7fdac77fe700 1 -- 172.21.15.45:0/1515244875 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdad8007cd0 con 0x7fdae00cc650 2023-10-08T20:11:48.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.299+0000 7fdac77fe700 1 -- 172.21.15.45:0/1515244875 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad801b6b0 con 0x7fdae00cc650 2023-10-08T20:11:48.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.301+0000 7fdae514f700 1 -- 172.21.15.45:0/1515244875 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae00cbf00 con 0x7fdae00cc650 2023-10-08T20:11:48.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.301+0000 7fdae514f700 1 -- 172.21.15.45:0/1515244875 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae015b1a0 con 0x7fdae00cc650 2023-10-08T20:11:48.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.303+0000 7fdac77fe700 1 -- 172.21.15.45:0/1515244875 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdad801b810 con 0x7fdae00cc650 2023-10-08T20:11:48.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.303+0000 7fdac77fe700 1 --2- 172.21.15.45:0/1515244875 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fdacc06af20 0x7fdacc06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:48.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.304+0000 7fdac77fe700 1 -- 172.21.15.45:0/1515244875 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdad8093970 con 0x7fdae00cc650 2023-10-08T20:11:48.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.305+0000 7fdaded9d700 1 --2- 172.21.15.45:0/1515244875 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fdacc06af20 0x7fdacc06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:48.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.306+0000 7fdae514f700 1 -- 172.21.15.45:0/1515244875 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae006e7d0 con 0x7fdae00cc650 2023-10-08T20:11:48.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.307+0000 7fdaded9d700 1 --2- 172.21.15.45:0/1515244875 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fdacc06af20 0x7fdacc06d3e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fdad0001cc0 tx=0x7fdad0001120 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:48.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.314+0000 7fdac77fe700 1 -- 172.21.15.45:0/1515244875 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdad8028080 con 0x7fdae00cc650 2023-10-08T20:11:48.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.833+0000 7fdae514f700 1 -- 172.21.15.45:0/1515244875 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdae00ca930 con 0x7fdae00cc650 2023-10-08T20:11:48.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.834+0000 7fdac77fe700 1 -- 172.21.15.45:0/1515244875 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4907 (secure 0 0 0) 0x7fdad805eb10 con 0x7fdae00cc650 2023-10-08T20:11:48.835 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:48.835 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4775,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/415745376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":415745376},{"type":"v1","addr":"172.21.15.78:6836","nonce":415745376}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/4017051943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":4017051943},{"type":"v1","addr":"172.21.15.78:6837","nonce":4017051943}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4784,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2071345881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2071345881},{"type":"v1","addr":"172.21.15.45:6835","nonce":2071345881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T12:46:26.025761+0000","modified":"2023-10-08T12:46:29.062189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5041},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5041":{"gid":5041,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6834/328442803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":328442803},{"type":"v1","addr":"172.21.15.45:6834","nonce":328442803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-08T20:11:48.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.838+0000 7fdae514f700 1 -- 172.21.15.45:0/1515244875 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fdacc06af20 msgr2=0x7fdacc06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:48.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.838+0000 7fdae514f700 1 --2- 172.21.15.45:0/1515244875 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fdacc06af20 0x7fdacc06d3e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fdad0001cc0 tx=0x7fdad0001120 comp rx=0 tx=0).stop 2023-10-08T20:11:48.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.838+0000 7fdae514f700 1 -- 172.21.15.45:0/1515244875 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdae00cc650 msgr2=0x7fdae0149560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:48.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.838+0000 7fdae514f700 1 --2- 172.21.15.45:0/1515244875 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdae00cc650 0x7fdae0149560 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdad8015000 tx=0x7fdad8007870 comp rx=0 tx=0).stop 2023-10-08T20:11:48.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.840+0000 7fdae514f700 1 -- 172.21.15.45:0/1515244875 shutdown_connections 2023-10-08T20:11:48.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.840+0000 7fdae514f700 1 --2- 172.21.15.45:0/1515244875 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fdacc06af20 0x7fdacc06d3e0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:48.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.840+0000 7fdae514f700 1 --2- 172.21.15.45:0/1515244875 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdae00cc650 0x7fdae0149560 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:48.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.841+0000 7fdae514f700 1 --2- 172.21.15.45:0/1515244875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdae006eea0 0x7fdae014d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:48.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.841+0000 7fdae514f700 1 --2- 172.21.15.45:0/1515244875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdae00b20c0 0x7fdae015a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:48.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.841+0000 7fdae514f700 1 -- 172.21.15.45:0/1515244875 >> 172.21.15.45:0/1515244875 conn(0x7fdae00afda0 msgr2=0x7fdae0070a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:48.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.843+0000 7fdae514f700 1 -- 172.21.15.45:0/1515244875 shutdown_connections 2023-10-08T20:11:48.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:48.843+0000 7fdae514f700 1 -- 172.21.15.45:0/1515244875 wait complete. 2023-10-08T20:11:48.847 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2023-10-08T20:11:48.868 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T20:11:49.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.118+0000 7f1795a0a700 1 -- 172.21.15.45:0/3829051063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1790141220 msgr2=0x7f1790141600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:49.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.118+0000 7f1795a0a700 1 --2- 172.21.15.45:0/3829051063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1790141220 0x7f1790141600 secure :-1 s=READY pgs=3261 cs=0 l=1 rev1=1 crypto rx=0x7f17900b1ff0 tx=0x7f1784009c70 comp rx=0 tx=0).stop 2023-10-08T20:11:49.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.118+0000 7f1795a0a700 1 -- 172.21.15.45:0/3829051063 shutdown_connections 2023-10-08T20:11:49.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.118+0000 7f1795a0a700 1 --2- 172.21.15.45:0/3829051063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1790141220 0x7f1790141600 unknown :-1 s=CLOSED pgs=3261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:49.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.118+0000 7f1795a0a700 1 --2- 172.21.15.45:0/3829051063 >> v2:172.21.15.78:3300/0 conn(0x7f17900b32e0 0x7f179015c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:49.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.118+0000 7f1795a0a700 1 -- 172.21.15.45:0/3829051063 >> 172.21.15.45:0/3829051063 conn(0x7f179006e010 msgr2=0x7f179006e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:49.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.118+0000 7f1795a0a700 1 -- 172.21.15.45:0/3829051063 shutdown_connections 2023-10-08T20:11:49.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.118+0000 7f1795a0a700 1 -- 172.21.15.45:0/3829051063 wait complete. 2023-10-08T20:11:49.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.120+0000 7f1795a0a700 1 Processor -- start 2023-10-08T20:11:49.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.120+0000 7f1795a0a700 1 -- start start 2023-10-08T20:11:49.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.121+0000 7f1795a0a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17900b32e0 0x7f179013ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:49.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.121+0000 7f1795a0a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1790141220 0x7f1790137060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:49.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.121+0000 7f1795a0a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f179015c580 0x7f17900a72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:49.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.121+0000 7f1795a0a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17901375a0 con 0x7f17900b32e0 2023-10-08T20:11:49.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.121+0000 7f1795a0a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17900a7db0 con 0x7f1790141220 2023-10-08T20:11:49.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.121+0000 7f1795a0a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17900a8000 con 0x7f179015c580 2023-10-08T20:11:49.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.121+0000 7f178effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17900b32e0 0x7f179013ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:49.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.121+0000 7f178effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17900b32e0 0x7f179013ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51394/0 (socket says 172.21.15.45:51394) 2023-10-08T20:11:49.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.121+0000 7f178effd700 1 -- 172.21.15.45:0/3919736707 learned_addr learned my addr 172.21.15.45:0/3919736707 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:11:49.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.121+0000 7f178f7fe700 1 --2- 172.21.15.45:0/3919736707 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f179015c580 0x7f17900a72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:49.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.122+0000 7f178effd700 1 -- 172.21.15.45:0/3919736707 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f179015c580 msgr2=0x7f17900a72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:49.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.122+0000 7f178effd700 1 --2- 172.21.15.45:0/3919736707 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f179015c580 0x7f17900a72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:49.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.122+0000 7f178effd700 1 -- 172.21.15.45:0/3919736707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1790141220 msgr2=0x7f1790137060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:49.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.122+0000 7f178effd700 1 --2- 172.21.15.45:0/3919736707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1790141220 0x7f1790137060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:49.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.122+0000 7f178effd700 1 -- 172.21.15.45:0/3919736707 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17840095f0 con 0x7f17900b32e0 2023-10-08T20:11:49.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.122+0000 7f178effd700 1 --2- 172.21.15.45:0/3919736707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17900b32e0 0x7f179013ac90 secure :-1 s=READY pgs=3262 cs=0 l=1 rev1=1 crypto rx=0x7f1784000c00 tx=0x7f1784004a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:49.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.122+0000 7f1777fff700 1 -- 172.21.15.45:0/3919736707 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178401d070 con 0x7f17900b32e0 2023-10-08T20:11:49.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.122+0000 7f1795a0a700 1 -- 172.21.15.45:0/3919736707 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17900a82e0 con 0x7f17900b32e0 2023-10-08T20:11:49.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.122+0000 7f1777fff700 1 -- 172.21.15.45:0/3919736707 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1784004320 con 0x7f17900b32e0 2023-10-08T20:11:49.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.122+0000 7f1777fff700 1 -- 172.21.15.45:0/3919736707 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1784003680 con 0x7f17900b32e0 2023-10-08T20:11:49.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.122+0000 7f1795a0a700 1 -- 172.21.15.45:0/3919736707 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17900a88a0 con 0x7f17900b32e0 2023-10-08T20:11:49.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.124+0000 7f1795a0a700 1 -- 172.21.15.45:0/3919736707 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f179004e4c0 con 0x7f17900b32e0 2023-10-08T20:11:49.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.125+0000 7f1777fff700 1 -- 172.21.15.45:0/3919736707 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1784003800 con 0x7f17900b32e0 2023-10-08T20:11:49.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.125+0000 7f1777fff700 1 --2- 172.21.15.45:0/3919736707 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f177c06aed0 0x7f177c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:49.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.125+0000 7f1777fff700 1 -- 172.21.15.45:0/3919736707 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f178408ac20 con 0x7f17900b32e0 2023-10-08T20:11:49.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.125+0000 7f178e7fc700 1 --2- 172.21.15.45:0/3919736707 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f177c06aed0 0x7f177c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:49.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.127+0000 7f178e7fc700 1 --2- 172.21.15.45:0/3919736707 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f177c06aed0 0x7f177c06d390 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f17900cc950 tx=0x7f1780006c80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:49.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.133+0000 7f1777fff700 1 -- 172.21.15.45:0/3919736707 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1784055ce0 con 0x7f17900b32e0 2023-10-08T20:11:49.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.470+0000 7f1795a0a700 1 -- 172.21.15.45:0/3919736707 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17900aa9d0 con 0x7f17900b32e0 2023-10-08T20:11:49.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.475+0000 7f1777fff700 1 -- 172.21.15.45:0/3919736707 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f1784059300 con 0x7f17900b32e0 2023-10-08T20:11:49.479 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:49.480 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":33,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T12:46:27.627861+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:45:19.183651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:46:24.050213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T12:46:25.003094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.412453+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.351925+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.428025+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.437246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.441119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.388608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.415524+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.401835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T20:11:49.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.490+0000 7f1795a0a700 1 -- 172.21.15.45:0/3919736707 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f177c06aed0 msgr2=0x7f177c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:49.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.490+0000 7f1795a0a700 1 --2- 172.21.15.45:0/3919736707 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f177c06aed0 0x7f177c06d390 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f17900cc950 tx=0x7f1780006c80 comp rx=0 tx=0).stop 2023-10-08T20:11:49.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.490+0000 7f1795a0a700 1 -- 172.21.15.45:0/3919736707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17900b32e0 msgr2=0x7f179013ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:49.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.490+0000 7f1795a0a700 1 --2- 172.21.15.45:0/3919736707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17900b32e0 0x7f179013ac90 secure :-1 s=READY pgs=3262 cs=0 l=1 rev1=1 crypto rx=0x7f1784000c00 tx=0x7f1784004a60 comp rx=0 tx=0).stop 2023-10-08T20:11:49.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.490+0000 7f1795a0a700 1 -- 172.21.15.45:0/3919736707 shutdown_connections 2023-10-08T20:11:49.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.490+0000 7f1795a0a700 1 --2- 172.21.15.45:0/3919736707 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f177c06aed0 0x7f177c06d390 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:49.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.490+0000 7f1795a0a700 1 --2- 172.21.15.45:0/3919736707 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f179015c580 0x7f17900a72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:49.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.490+0000 7f1795a0a700 1 --2- 172.21.15.45:0/3919736707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17900b32e0 0x7f179013ac90 secure :-1 s=CLOSED pgs=3262 cs=0 l=1 rev1=1 crypto rx=0x7f1784000c00 tx=0x7f1784004a60 comp rx=0 tx=0).stop 2023-10-08T20:11:49.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.490+0000 7f1795a0a700 1 --2- 172.21.15.45:0/3919736707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1790141220 0x7f1790137060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:49.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.490+0000 7f1795a0a700 1 -- 172.21.15.45:0/3919736707 >> 172.21.15.45:0/3919736707 conn(0x7f179006e010 msgr2=0x7f179015d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:49.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.492+0000 7f1795a0a700 1 -- 172.21.15.45:0/3919736707 shutdown_connections 2023-10-08T20:11:49.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.492+0000 7f1795a0a700 1 -- 172.21.15.45:0/3919736707 wait complete. 2023-10-08T20:11:49.525 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T20:11:49.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.746+0000 7f53904ab700 1 -- 172.21.15.45:0/4085380195 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5374003a00 msgr2=0x7f5374003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:49.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.746+0000 7f53904ab700 1 --2- 172.21.15.45:0/4085380195 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5374003a00 0x7f5374003e20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f537800c390 tx=0x7f5374005880 comp rx=0 tx=0).stop 2023-10-08T20:11:49.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.748+0000 7f538ea48700 1 -- 172.21.15.45:0/4085380195 reap_dead start 2023-10-08T20:11:49.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.748+0000 7f53904ab700 1 -- 172.21.15.45:0/4085380195 shutdown_connections 2023-10-08T20:11:49.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.748+0000 7f53904ab700 1 -- 172.21.15.45:0/4085380195 >> 172.21.15.45:0/4085380195 conn(0x7f53880b0430 msgr2=0x7f53880b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:49.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.750+0000 7f53904ab700 1 -- 172.21.15.45:0/4085380195 shutdown_connections 2023-10-08T20:11:49.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.750+0000 7f53904ab700 1 -- 172.21.15.45:0/4085380195 wait complete. 2023-10-08T20:11:49.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.751+0000 7f53904ab700 1 Processor -- start 2023-10-08T20:11:49.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.751+0000 7f53904ab700 1 -- start start 2023-10-08T20:11:49.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.752+0000 7f53904ab700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f53880ad0d0 0x7f5388148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:49.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.752+0000 7f53904ab700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53881459f0 0x7f5388146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:49.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.752+0000 7f53904ab700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5388149420 0x7f5388147490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:49.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.752+0000 7f53904ab700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5388145eb0 con 0x7f53881459f0 2023-10-08T20:11:49.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.752+0000 7f53904ab700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5388146190 con 0x7f5388149420 2023-10-08T20:11:49.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.752+0000 7f53904ab700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5388146470 con 0x7f53880ad0d0 2023-10-08T20:11:49.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.753+0000 7f538ea48700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5388149420 0x7f5388147490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:49.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.753+0000 7f538ea48700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5388149420 0x7f5388147490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.45:34628/0 (socket says 172.21.15.45:34628) 2023-10-08T20:11:49.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.753+0000 7f538ea48700 1 -- 172.21.15.45:0/2442698737 learned_addr learned my addr 172.21.15.45:0/2442698737 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:11:49.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.753+0000 7f538ea48700 1 -- 172.21.15.45:0/2442698737 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f53880ad0d0 msgr2=0x7f5388148ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T20:11:49.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.753+0000 7f538ea48700 1 --2- 172.21.15.45:0/2442698737 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f53880ad0d0 0x7f5388148ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:49.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.753+0000 7f538ea48700 1 -- 172.21.15.45:0/2442698737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53881459f0 msgr2=0x7f5388146f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:49.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.753+0000 7f538ea48700 1 --2- 172.21.15.45:0/2442698737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53881459f0 0x7f5388146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:49.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.753+0000 7f538ea48700 1 -- 172.21.15.45:0/2442698737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5388146750 con 0x7f5388149420 2023-10-08T20:11:49.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.753+0000 7f538ea48700 1 --2- 172.21.15.45:0/2442698737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5388149420 0x7f5388147490 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f53880b1270 tx=0x7f5380009e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:49.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.753+0000 7f537effd700 1 -- 172.21.15.45:0/2442698737 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538000c660 con 0x7f5388149420 2023-10-08T20:11:49.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.754+0000 7f537effd700 1 -- 172.21.15.45:0/2442698737 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f538000c8d0 con 0x7f5388149420 2023-10-08T20:11:49.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.754+0000 7f53904ab700 1 -- 172.21.15.45:0/2442698737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5388146a30 con 0x7f5388149420 2023-10-08T20:11:49.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.754+0000 7f53904ab700 1 -- 172.21.15.45:0/2442698737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53880ad4b0 con 0x7f5388149420 2023-10-08T20:11:49.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.754+0000 7f537effd700 1 -- 172.21.15.45:0/2442698737 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538000cce0 con 0x7f5388149420 2023-10-08T20:11:49.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.755+0000 7f53904ab700 1 -- 172.21.15.45:0/2442698737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f538804e4c0 con 0x7f5388149420 2023-10-08T20:11:49.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.756+0000 7f537effd700 1 -- 172.21.15.45:0/2442698737 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5380012020 con 0x7f5388149420 2023-10-08T20:11:49.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.756+0000 7f537effd700 1 --2- 172.21.15.45:0/2442698737 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f536c06af00 0x7f536c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:49.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.756+0000 7f537effd700 1 -- 172.21.15.45:0/2442698737 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5380088fe0 con 0x7f5388149420 2023-10-08T20:11:49.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.756+0000 7f538e247700 1 --2- 172.21.15.45:0/2442698737 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f536c06af00 0x7f536c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:49.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.757+0000 7f538e247700 1 --2- 172.21.15.45:0/2442698737 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f536c06af00 0x7f536c06d3c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f5378000c00 tx=0x7f5378001a00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:49.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:49.762+0000 7f537effd700 1 -- 172.21.15.45:0/2442698737 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5380057a90 con 0x7f5388149420 2023-10-08T20:11:50.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.283+0000 7f53904ab700 1 -- 172.21.15.45:0/2442698737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f53880b12a0 con 0x7f5388149420 2023-10-08T20:11:50.300 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-10-08T20:11:50.300+0000 7fc212d6d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T20:11:50.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.309+0000 7f537effd700 1 -- 172.21.15.45:0/2442698737 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f538001a020 con 0x7f5388149420 2023-10-08T20:11:50.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.323+0000 7f53904ab700 1 -- 172.21.15.45:0/2442698737 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f536c06af00 msgr2=0x7f536c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:50.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.323+0000 7f53904ab700 1 --2- 172.21.15.45:0/2442698737 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f536c06af00 0x7f536c06d3c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f5378000c00 tx=0x7f5378001a00 comp rx=0 tx=0).stop 2023-10-08T20:11:50.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.323+0000 7f53904ab700 1 -- 172.21.15.45:0/2442698737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5388149420 msgr2=0x7f5388147490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:50.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.323+0000 7f53904ab700 1 --2- 172.21.15.45:0/2442698737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5388149420 0x7f5388147490 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f53880b1270 tx=0x7f5380009e70 comp rx=0 tx=0).stop 2023-10-08T20:11:50.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.326+0000 7f53904ab700 1 -- 172.21.15.45:0/2442698737 shutdown_connections 2023-10-08T20:11:50.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.326+0000 7f53904ab700 1 --2- 172.21.15.45:0/2442698737 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f536c06af00 0x7f536c06d3c0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:50.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.326+0000 7f53904ab700 1 --2- 172.21.15.45:0/2442698737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5388149420 0x7f5388147490 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:50.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.326+0000 7f53904ab700 1 --2- 172.21.15.45:0/2442698737 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f53880ad0d0 0x7f5388148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:50.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.326+0000 7f53904ab700 1 --2- 172.21.15.45:0/2442698737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53881459f0 0x7f5388146f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:50.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.326+0000 7f53904ab700 1 -- 172.21.15.45:0/2442698737 >> 172.21.15.45:0/2442698737 conn(0x7f53880b0430 msgr2=0x7f53880ccf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:50.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.328+0000 7f53904ab700 1 -- 172.21.15.45:0/2442698737 shutdown_connections 2023-10-08T20:11:50.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.328+0000 7f53904ab700 1 -- 172.21.15.45:0/2442698737 wait complete. 2023-10-08T20:11:50.330 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T20:11:50.346 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T20:11:50.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.491+0000 7ff515eb5700 1 -- 172.21.15.45:0/262966908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff51006a210 msgr2=0x7ff5100ca180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:50.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.491+0000 7ff515eb5700 1 --2- 172.21.15.45:0/262966908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff51006a210 0x7ff5100ca180 secure :-1 s=READY pgs=3264 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8005fd0 tx=0x7ff4f8009c70 comp rx=0 tx=0).stop 2023-10-08T20:11:50.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.492+0000 7ff515eb5700 1 -- 172.21.15.45:0/262966908 shutdown_connections 2023-10-08T20:11:50.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.492+0000 7ff515eb5700 1 --2- 172.21.15.45:0/262966908 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff5101574a0 0x7ff510159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:50.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.492+0000 7ff515eb5700 1 --2- 172.21.15.45:0/262966908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff51006a210 0x7ff5100ca180 unknown :-1 s=CLOSED pgs=3264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:50.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.492+0000 7ff515eb5700 1 -- 172.21.15.45:0/262966908 >> 172.21.15.45:0/262966908 conn(0x7ff510097a20 msgr2=0x7ff5100ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:50.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.492+0000 7ff515eb5700 1 -- 172.21.15.45:0/262966908 shutdown_connections 2023-10-08T20:11:50.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.492+0000 7ff515eb5700 1 -- 172.21.15.45:0/262966908 wait complete. 2023-10-08T20:11:50.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.493+0000 7ff515eb5700 1 Processor -- start 2023-10-08T20:11:50.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.493+0000 7ff515eb5700 1 -- start start 2023-10-08T20:11:50.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.494+0000 7ff515eb5700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff51006a210 0x7ff510154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:50.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.494+0000 7ff515eb5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5100ca6c0 0x7ff5100c4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:50.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.494+0000 7ff515eb5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5101574a0 0x7ff5100b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:50.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.494+0000 7ff515eb5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5100cc1c0 con 0x7ff5100ca6c0 2023-10-08T20:11:50.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.494+0000 7ff515eb5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff510155030 con 0x7ff5101574a0 2023-10-08T20:11:50.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.494+0000 7ff515eb5700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5101f5f80 con 0x7ff51006a210 2023-10-08T20:11:50.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.494+0000 7ff506ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5100ca6c0 0x7ff5100c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:50.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.494+0000 7ff506ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5100ca6c0 0x7ff5100c4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51422/0 (socket says 172.21.15.45:51422) 2023-10-08T20:11:50.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.494+0000 7ff506ffd700 1 -- 172.21.15.45:0/1671403046 learned_addr learned my addr 172.21.15.45:0/1671403046 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:11:50.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.494+0000 7ff50f7fe700 1 --2- 172.21.15.45:0/1671403046 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff51006a210 0x7ff510154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:50.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.494+0000 7ff50ffff700 1 --2- 172.21.15.45:0/1671403046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5101574a0 0x7ff5100b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:50.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.494+0000 7ff506ffd700 1 -- 172.21.15.45:0/1671403046 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff51006a210 msgr2=0x7ff510154af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:50.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.494+0000 7ff506ffd700 1 --2- 172.21.15.45:0/1671403046 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff51006a210 0x7ff510154af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:50.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.494+0000 7ff506ffd700 1 -- 172.21.15.45:0/1671403046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5101574a0 msgr2=0x7ff5100b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:50.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.494+0000 7ff506ffd700 1 --2- 172.21.15.45:0/1671403046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5101574a0 0x7ff5100b1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:50.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.495+0000 7ff506ffd700 1 -- 172.21.15.45:0/1671403046 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f80095f0 con 0x7ff5100ca6c0 2023-10-08T20:11:50.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.495+0000 7ff506ffd700 1 --2- 172.21.15.45:0/1671403046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5100ca6c0 0x7ff5100c4020 secure :-1 s=READY pgs=3265 cs=0 l=1 rev1=1 crypto rx=0x7ff5100cc170 tx=0x7ff4f8004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:50.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.495+0000 7ff50cff9700 1 -- 172.21.15.45:0/1671403046 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f801d070 con 0x7ff5100ca6c0 2023-10-08T20:11:50.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.495+0000 7ff50cff9700 1 -- 172.21.15.45:0/1671403046 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff4f800b820 con 0x7ff5100ca6c0 2023-10-08T20:11:50.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.495+0000 7ff515eb5700 1 -- 172.21.15.45:0/1671403046 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5101f6260 con 0x7ff5100ca6c0 2023-10-08T20:11:50.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.495+0000 7ff50cff9700 1 -- 172.21.15.45:0/1671403046 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f80045f0 con 0x7ff5100ca6c0 2023-10-08T20:11:50.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.495+0000 7ff515eb5700 1 -- 172.21.15.45:0/1671403046 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5101f6820 con 0x7ff5100ca6c0 2023-10-08T20:11:50.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.496+0000 7ff515eb5700 1 -- 172.21.15.45:0/1671403046 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff510066850 con 0x7ff5100ca6c0 2023-10-08T20:11:50.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.497+0000 7ff50cff9700 1 -- 172.21.15.45:0/1671403046 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff4f800bc30 con 0x7ff5100ca6c0 2023-10-08T20:11:50.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.497+0000 7ff50cff9700 1 --2- 172.21.15.45:0/1671403046 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7ff4f006aed0 0x7ff4f006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:50.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.497+0000 7ff50cff9700 1 -- 172.21.15.45:0/1671403046 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff4f808ab70 con 0x7ff5100ca6c0 2023-10-08T20:11:50.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.497+0000 7ff50f7fe700 1 --2- 172.21.15.45:0/1671403046 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7ff4f006aed0 0x7ff4f006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:50.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.498+0000 7ff50f7fe700 1 --2- 172.21.15.45:0/1671403046 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7ff4f006aed0 0x7ff4f006d390 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff500009bc0 tx=0x7ff500009260 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:50.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.502+0000 7ff50cff9700 1 -- 172.21.15.45:0/1671403046 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff4f8055c50 con 0x7ff5100ca6c0 2023-10-08T20:11:50.554 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-10-08T20:11:50.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:50.765+0000 7ff515eb5700 1 -- 172.21.15.45:0/1671403046 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff51015a160 con 0x7ff5100ca6c0 2023-10-08T20:11:51.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.476+0000 7ff50cff9700 1 -- 172.21.15.45:0/1671403046 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff4f80260a0 con 0x7ff5100ca6c0 2023-10-08T20:11:51.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.479+0000 7ff515eb5700 1 -- 172.21.15.45:0/1671403046 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7ff4f006aed0 msgr2=0x7ff4f006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:51.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.479+0000 7ff515eb5700 1 --2- 172.21.15.45:0/1671403046 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7ff4f006aed0 0x7ff4f006d390 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff500009bc0 tx=0x7ff500009260 comp rx=0 tx=0).stop 2023-10-08T20:11:51.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.479+0000 7ff515eb5700 1 -- 172.21.15.45:0/1671403046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5100ca6c0 msgr2=0x7ff5100c4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:51.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.479+0000 7ff515eb5700 1 --2- 172.21.15.45:0/1671403046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5100ca6c0 0x7ff5100c4020 secure :-1 s=READY pgs=3265 cs=0 l=1 rev1=1 crypto rx=0x7ff5100cc170 tx=0x7ff4f8004260 comp rx=0 tx=0).stop 2023-10-08T20:11:51.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.479+0000 7ff515eb5700 1 -- 172.21.15.45:0/1671403046 shutdown_connections 2023-10-08T20:11:51.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.479+0000 7ff515eb5700 1 --2- 172.21.15.45:0/1671403046 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7ff4f006aed0 0x7ff4f006d390 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:51.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.479+0000 7ff515eb5700 1 --2- 172.21.15.45:0/1671403046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5101574a0 0x7ff5100b1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:51.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.479+0000 7ff515eb5700 1 --2- 172.21.15.45:0/1671403046 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff51006a210 0x7ff510154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:51.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.479+0000 7ff515eb5700 1 --2- 172.21.15.45:0/1671403046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5100ca6c0 0x7ff5100c4020 unknown :-1 s=CLOSED pgs=3265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:51.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.479+0000 7ff515eb5700 1 -- 172.21.15.45:0/1671403046 >> 172.21.15.45:0/1671403046 conn(0x7ff510097a20 msgr2=0x7ff5100abe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:51.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.479+0000 7ff515eb5700 1 -- 172.21.15.45:0/1671403046 shutdown_connections 2023-10-08T20:11:51.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.479+0000 7ff515eb5700 1 -- 172.21.15.45:0/1671403046 wait complete. 2023-10-08T20:11:51.499 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T20:11:51.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.643+0000 7f8f60309700 1 -- 172.21.15.45:0/3250284548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f5806dca0 msgr2=0x7f8f5806e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:51.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.643+0000 7f8f60309700 1 --2- 172.21.15.45:0/3250284548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f5806dca0 0x7f8f5806e080 secure :-1 s=READY pgs=3268 cs=0 l=1 rev1=1 crypto rx=0x7f8f580cf7b0 tx=0x7f8f54009c70 comp rx=0 tx=0).stop 2023-10-08T20:11:51.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.643+0000 7f8f60309700 1 -- 172.21.15.45:0/3250284548 shutdown_connections 2023-10-08T20:11:51.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.643+0000 7f8f60309700 1 --2- 172.21.15.45:0/3250284548 >> v2:172.21.15.78:3300/0 conn(0x7f8f580c92c0 0x7f8f580c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:51.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.643+0000 7f8f60309700 1 --2- 172.21.15.45:0/3250284548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f5806dca0 0x7f8f5806e080 unknown :-1 s=CLOSED pgs=3268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:51.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.643+0000 7f8f60309700 1 -- 172.21.15.45:0/3250284548 >> 172.21.15.45:0/3250284548 conn(0x7f8f58097a20 msgr2=0x7f8f580ce6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:51.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.643+0000 7f8f60309700 1 -- 172.21.15.45:0/3250284548 shutdown_connections 2023-10-08T20:11:51.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.643+0000 7f8f60309700 1 -- 172.21.15.45:0/3250284548 wait complete. 2023-10-08T20:11:51.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.644+0000 7f8f60309700 1 Processor -- start 2023-10-08T20:11:51.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.644+0000 7f8f60309700 1 -- start start 2023-10-08T20:11:51.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.645+0000 7f8f60309700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f5806dca0 0x7f8f580c4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:51.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.645+0000 7f8f60309700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f580c92c0 0x7f8f58143970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:51.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.645+0000 7f8f60309700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f5815c770 0x7f8f5806a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:51.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.645+0000 7f8f60309700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f58152320 con 0x7f8f580c92c0 2023-10-08T20:11:51.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.645+0000 7f8f60309700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f580c4ec0 con 0x7f8f5806dca0 2023-10-08T20:11:51.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.645+0000 7f8f60309700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f580b23f0 con 0x7f8f5815c770 2023-10-08T20:11:51.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.645+0000 7f8f5d8a4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f580c92c0 0x7f8f58143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:51.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.645+0000 7f8f5d8a4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f580c92c0 0x7f8f58143970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51450/0 (socket says 172.21.15.45:51450) 2023-10-08T20:11:51.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.645+0000 7f8f5d8a4700 1 -- 172.21.15.45:0/3448573773 learned_addr learned my addr 172.21.15.45:0/3448573773 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:11:51.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.645+0000 7f8f5e0a5700 1 --2- 172.21.15.45:0/3448573773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f5806dca0 0x7f8f580c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:51.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.645+0000 7f8f5d8a4700 1 -- 172.21.15.45:0/3448573773 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f5815c770 msgr2=0x7f8f5806a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:51.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.645+0000 7f8f5e8a6700 1 --2- 172.21.15.45:0/3448573773 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f5815c770 0x7f8f5806a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:51.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.645+0000 7f8f5d8a4700 1 --2- 172.21.15.45:0/3448573773 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f5815c770 0x7f8f5806a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:51.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.645+0000 7f8f5d8a4700 1 -- 172.21.15.45:0/3448573773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f5806dca0 msgr2=0x7f8f580c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:51.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.645+0000 7f8f5d8a4700 1 --2- 172.21.15.45:0/3448573773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f5806dca0 0x7f8f580c4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:51.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.645+0000 7f8f5d8a4700 1 -- 172.21.15.45:0/3448573773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f540095f0 con 0x7f8f580c92c0 2023-10-08T20:11:51.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.645+0000 7f8f5d8a4700 1 --2- 172.21.15.45:0/3448573773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f580c92c0 0x7f8f58143970 secure :-1 s=READY pgs=3269 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c00b4a0 tx=0x7f8f4c00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:51.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.646+0000 7f8f4affd700 1 -- 172.21.15.45:0/3448573773 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c011830 con 0x7f8f580c92c0 2023-10-08T20:11:51.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.646+0000 7f8f4affd700 1 -- 172.21.15.45:0/3448573773 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8f4c011a80 con 0x7f8f580c92c0 2023-10-08T20:11:51.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.646+0000 7f8f60309700 1 -- 172.21.15.45:0/3448573773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f580b26d0 con 0x7f8f580c92c0 2023-10-08T20:11:51.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.646+0000 7f8f4affd700 1 -- 172.21.15.45:0/3448573773 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c011e90 con 0x7f8f580c92c0 2023-10-08T20:11:51.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.646+0000 7f8f60309700 1 -- 172.21.15.45:0/3448573773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f580b2c90 con 0x7f8f580c92c0 2023-10-08T20:11:51.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.647+0000 7f8f60309700 1 -- 172.21.15.45:0/3448573773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f580ca7e0 con 0x7f8f580c92c0 2023-10-08T20:11:51.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.647+0000 7f8f4affd700 1 -- 172.21.15.45:0/3448573773 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8f4c01a400 con 0x7f8f580c92c0 2023-10-08T20:11:51.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.648+0000 7f8f4affd700 1 --2- 172.21.15.45:0/3448573773 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f8f3c06aed0 0x7f8f3c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:51.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.648+0000 7f8f4affd700 1 -- 172.21.15.45:0/3448573773 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8f4c089960 con 0x7f8f580c92c0 2023-10-08T20:11:51.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.648+0000 7f8f5e0a5700 1 --2- 172.21.15.45:0/3448573773 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f8f3c06aed0 0x7f8f3c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:51.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.649+0000 7f8f5e0a5700 1 --2- 172.21.15.45:0/3448573773 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f8f3c06aed0 0x7f8f3c06d390 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f8f54000c00 tx=0x7f8f540047c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:51.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.657+0000 7f8f4affd700 1 -- 172.21.15.45:0/3448573773 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8f4c054930 con 0x7f8f580c92c0 2023-10-08T20:11:51.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:51.869+0000 7f8f60309700 1 -- 172.21.15.45:0/3448573773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8f5809c7e0 con 0x7f8f580c92c0 2023-10-08T20:11:52.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.484+0000 7f8f4affd700 1 -- 172.21.15.45:0/3448573773 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v35) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8f4c057f50 con 0x7f8f580c92c0 2023-10-08T20:11:52.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.487+0000 7f8f60309700 1 -- 172.21.15.45:0/3448573773 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f8f3c06aed0 msgr2=0x7f8f3c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:52.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.487+0000 7f8f60309700 1 --2- 172.21.15.45:0/3448573773 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f8f3c06aed0 0x7f8f3c06d390 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f8f54000c00 tx=0x7f8f540047c0 comp rx=0 tx=0).stop 2023-10-08T20:11:52.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.487+0000 7f8f60309700 1 -- 172.21.15.45:0/3448573773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f580c92c0 msgr2=0x7f8f58143970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:52.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.487+0000 7f8f60309700 1 --2- 172.21.15.45:0/3448573773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f580c92c0 0x7f8f58143970 secure :-1 s=READY pgs=3269 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c00b4a0 tx=0x7f8f4c00b860 comp rx=0 tx=0).stop 2023-10-08T20:11:52.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.487+0000 7f8f60309700 1 -- 172.21.15.45:0/3448573773 shutdown_connections 2023-10-08T20:11:52.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.487+0000 7f8f60309700 1 --2- 172.21.15.45:0/3448573773 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f8f3c06aed0 0x7f8f3c06d390 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:52.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.487+0000 7f8f60309700 1 --2- 172.21.15.45:0/3448573773 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f5815c770 0x7f8f5806a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:52.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.487+0000 7f8f60309700 1 --2- 172.21.15.45:0/3448573773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f5806dca0 0x7f8f580c4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:52.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.487+0000 7f8f60309700 1 --2- 172.21.15.45:0/3448573773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f580c92c0 0x7f8f58143970 secure :-1 s=CLOSED pgs=3269 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c00b4a0 tx=0x7f8f4c00b860 comp rx=0 tx=0).stop 2023-10-08T20:11:52.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.487+0000 7f8f60309700 1 -- 172.21.15.45:0/3448573773 >> 172.21.15.45:0/3448573773 conn(0x7f8f58097a20 msgr2=0x7f8f5815cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:52.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.488+0000 7f8f60309700 1 -- 172.21.15.45:0/3448573773 shutdown_connections 2023-10-08T20:11:52.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.488+0000 7f8f60309700 1 -- 172.21.15.45:0/3448573773 wait complete. 2023-10-08T20:11:52.490 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-10-08T20:11:52.505 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T20:11:52.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.663+0000 7f3d4fac9700 1 -- 172.21.15.45:0/333683288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d34004850 msgr2=0x7f3d34004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:52.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.663+0000 7f3d4fac9700 1 --2- 172.21.15.45:0/333683288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d34004850 0x7f3d34004cd0 secure :-1 s=READY pgs=3271 cs=0 l=1 rev1=1 crypto rx=0x7f3d3800c2e0 tx=0x7f3d34005880 comp rx=0 tx=0).stop 2023-10-08T20:11:52.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.663+0000 7f3d4e066700 1 -- 172.21.15.45:0/333683288 reap_dead start 2023-10-08T20:11:52.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.663+0000 7f3d4fac9700 1 -- 172.21.15.45:0/333683288 shutdown_connections 2023-10-08T20:11:52.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.663+0000 7f3d4fac9700 1 -- 172.21.15.45:0/333683288 >> 172.21.15.45:0/333683288 conn(0x7f3d4806bc20 msgr2=0x7f3d48071940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:52.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.663+0000 7f3d4fac9700 1 -- 172.21.15.45:0/333683288 shutdown_connections 2023-10-08T20:11:52.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.663+0000 7f3d4fac9700 1 -- 172.21.15.45:0/333683288 wait complete. 2023-10-08T20:11:52.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.664+0000 7f3d4fac9700 1 Processor -- start 2023-10-08T20:11:52.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.664+0000 7f3d4fac9700 1 -- start start 2023-10-08T20:11:52.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.665+0000 7f3d4fac9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d34004850 0x7f3d480c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:52.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.665+0000 7f3d4fac9700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3d480cb7e0 0x7f3d480caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:52.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.665+0000 7f3d4fac9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d480cb1e0 0x7f3d48149940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:52.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.665+0000 7f3d4fac9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d480c7f20 con 0x7f3d34004850 2023-10-08T20:11:52.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.665+0000 7f3d4fac9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d480c9c00 con 0x7f3d480cb1e0 2023-10-08T20:11:52.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.665+0000 7f3d4fac9700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d480c9ee0 con 0x7f3d480cb7e0 2023-10-08T20:11:52.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.665+0000 7f3d4d865700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d34004850 0x7f3d480c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:52.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.665+0000 7f3d4d865700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d34004850 0x7f3d480c79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51470/0 (socket says 172.21.15.45:51470) 2023-10-08T20:11:52.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.665+0000 7f3d4d865700 1 -- 172.21.15.45:0/3928021239 learned_addr learned my addr 172.21.15.45:0/3928021239 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:11:52.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.665+0000 7f3d4e066700 1 --2- 172.21.15.45:0/3928021239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d480cb1e0 0x7f3d48149940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:52.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.665+0000 7f3d4d064700 1 --2- 172.21.15.45:0/3928021239 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3d480cb7e0 0x7f3d480caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:52.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.666+0000 7f3d4d865700 1 -- 172.21.15.45:0/3928021239 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3d480cb7e0 msgr2=0x7f3d480caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:52.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.666+0000 7f3d4d865700 1 --2- 172.21.15.45:0/3928021239 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3d480cb7e0 0x7f3d480caca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:52.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.666+0000 7f3d4d865700 1 -- 172.21.15.45:0/3928021239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d480cb1e0 msgr2=0x7f3d48149940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:52.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.666+0000 7f3d4d865700 1 --2- 172.21.15.45:0/3928021239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d480cb1e0 0x7f3d48149940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:52.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.666+0000 7f3d4d865700 1 -- 172.21.15.45:0/3928021239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d480ca1c0 con 0x7f3d34004850 2023-10-08T20:11:52.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.666+0000 7f3d4d865700 1 --2- 172.21.15.45:0/3928021239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d34004850 0x7f3d480c79e0 secure :-1 s=READY pgs=3272 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400e7c0 tx=0x7f3d4400ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:52.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.666+0000 7f3d3e7fc700 1 -- 172.21.15.45:0/3928021239 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d44004220 con 0x7f3d34004850 2023-10-08T20:11:52.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.666+0000 7f3d3e7fc700 1 -- 172.21.15.45:0/3928021239 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3d440043a0 con 0x7f3d34004850 2023-10-08T20:11:52.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.666+0000 7f3d3e7fc700 1 -- 172.21.15.45:0/3928021239 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d44010960 con 0x7f3d34004850 2023-10-08T20:11:52.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.666+0000 7f3d4fac9700 1 -- 172.21.15.45:0/3928021239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d480ca4a0 con 0x7f3d34004850 2023-10-08T20:11:52.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.666+0000 7f3d4fac9700 1 -- 172.21.15.45:0/3928021239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d480c98d0 con 0x7f3d34004850 2023-10-08T20:11:52.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.667+0000 7f3d4fac9700 1 -- 172.21.15.45:0/3928021239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d480c84d0 con 0x7f3d34004850 2023-10-08T20:11:52.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.668+0000 7f3d3e7fc700 1 -- 172.21.15.45:0/3928021239 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3d44010ac0 con 0x7f3d34004850 2023-10-08T20:11:52.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.668+0000 7f3d3e7fc700 1 --2- 172.21.15.45:0/3928021239 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3d2c06aed0 0x7f3d2c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:52.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.668+0000 7f3d3e7fc700 1 -- 172.21.15.45:0/3928021239 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f3d44014070 con 0x7f3d34004850 2023-10-08T20:11:52.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.668+0000 7f3d4d064700 1 --2- 172.21.15.45:0/3928021239 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3d2c06aed0 0x7f3d2c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:52.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.669+0000 7f3d4d064700 1 --2- 172.21.15.45:0/3928021239 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3d2c06aed0 0x7f3d2c06d390 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f3d38006040 tx=0x7f3d3800f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:52.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.673+0000 7f3d3e7fc700 1 -- 172.21.15.45:0/3928021239 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3d44054d90 con 0x7f3d34004850 2023-10-08T20:11:52.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:52.885+0000 7f3d4fac9700 1 -- 172.21.15.45:0/3928021239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3d4804e5a0 con 0x7f3d34004850 2023-10-08T20:11:53.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.488+0000 7f3d3e7fc700 1 -- 172.21.15.45:0/3928021239 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v36) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3d440583b0 con 0x7f3d34004850 2023-10-08T20:11:53.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.492+0000 7f3d4fac9700 1 -- 172.21.15.45:0/3928021239 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3d2c06aed0 msgr2=0x7f3d2c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:53.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.492+0000 7f3d4fac9700 1 --2- 172.21.15.45:0/3928021239 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3d2c06aed0 0x7f3d2c06d390 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f3d38006040 tx=0x7f3d3800f000 comp rx=0 tx=0).stop 2023-10-08T20:11:53.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.492+0000 7f3d4fac9700 1 -- 172.21.15.45:0/3928021239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d34004850 msgr2=0x7f3d480c79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:53.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.492+0000 7f3d4fac9700 1 --2- 172.21.15.45:0/3928021239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d34004850 0x7f3d480c79e0 secure :-1 s=READY pgs=3272 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400e7c0 tx=0x7f3d4400ead0 comp rx=0 tx=0).stop 2023-10-08T20:11:53.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.498+0000 7f3d4fac9700 1 -- 172.21.15.45:0/3928021239 shutdown_connections 2023-10-08T20:11:53.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.498+0000 7f3d4fac9700 1 --2- 172.21.15.45:0/3928021239 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f3d2c06aed0 0x7f3d2c06d390 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:53.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.498+0000 7f3d4fac9700 1 --2- 172.21.15.45:0/3928021239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d480cb1e0 0x7f3d48149940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:53.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.498+0000 7f3d4fac9700 1 --2- 172.21.15.45:0/3928021239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d34004850 0x7f3d480c79e0 unknown :-1 s=CLOSED pgs=3272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:53.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.498+0000 7f3d4fac9700 1 --2- 172.21.15.45:0/3928021239 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3d480cb7e0 0x7f3d480caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:53.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.498+0000 7f3d4fac9700 1 -- 172.21.15.45:0/3928021239 >> 172.21.15.45:0/3928021239 conn(0x7f3d4806bc20 msgr2=0x7f3d4815a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:53.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.507+0000 7f3d4fac9700 1 -- 172.21.15.45:0/3928021239 shutdown_connections 2023-10-08T20:11:53.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.515+0000 7f3d4fac9700 1 -- 172.21.15.45:0/3928021239 wait complete. 2023-10-08T20:11:53.523 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-10-08T20:11:53.554 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 30 2023-10-08T20:11:53.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.924+0000 7f19cff08700 1 -- 172.21.15.45:0/371776817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19c80cb250 msgr2=0x7f19c8158d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:53.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.924+0000 7f19cff08700 1 --2- 172.21.15.45:0/371776817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19c80cb250 0x7f19c8158d70 secure :-1 s=READY pgs=3273 cs=0 l=1 rev1=1 crypto rx=0x7f19c4005fd0 tx=0x7f19c4009c70 comp rx=0 tx=0).stop 2023-10-08T20:11:53.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.926+0000 7f19cff08700 1 -- 172.21.15.45:0/371776817 shutdown_connections 2023-10-08T20:11:53.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.926+0000 7f19cff08700 1 --2- 172.21.15.45:0/371776817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19c80cb250 0x7f19c8158d70 secure :-1 s=CLOSED pgs=3273 cs=0 l=1 rev1=1 crypto rx=0x7f19c4005fd0 tx=0x7f19c4009c70 comp rx=0 tx=0).stop 2023-10-08T20:11:53.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.926+0000 7f19cff08700 1 --2- 172.21.15.45:0/371776817 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f19c80ad060 0x7f19c80cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:53.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.926+0000 7f19cff08700 1 -- 172.21.15.45:0/371776817 >> 172.21.15.45:0/371776817 conn(0x7f19c806e010 msgr2=0x7f19c806e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:53.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.933+0000 7f19cff08700 1 -- 172.21.15.45:0/371776817 shutdown_connections 2023-10-08T20:11:53.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.940+0000 7f19cff08700 1 -- 172.21.15.45:0/371776817 wait complete. 2023-10-08T20:11:53.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.942+0000 7f19cff08700 1 Processor -- start 2023-10-08T20:11:53.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.942+0000 7f19cff08700 1 -- start start 2023-10-08T20:11:53.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.943+0000 7f19cff08700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19c80ad060 0x7f19c814c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:53.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.943+0000 7f19cff08700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19c80ccf20 0x7f19c81494d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:53.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.943+0000 7f19cff08700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f19c8145410 0x7f19c81655a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:53.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.943+0000 7f19cff08700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c8149a10 con 0x7f19c80ad060 2023-10-08T20:11:53.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.944+0000 7f19cff08700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c814c8a0 con 0x7f19c80ccf20 2023-10-08T20:11:53.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.944+0000 7f19cff08700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c814d0b0 con 0x7f19c8145410 2023-10-08T20:11:53.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.944+0000 7f19ce4a5700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f19c8145410 0x7f19c81655a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:53.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.944+0000 7f19ce4a5700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f19c8145410 0x7f19c81655a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.45:53330/0 (socket says 172.21.15.45:53330) 2023-10-08T20:11:53.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.944+0000 7f19ce4a5700 1 -- 172.21.15.45:0/1752136847 learned_addr learned my addr 172.21.15.45:0/1752136847 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:11:53.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.945+0000 7f19ce4a5700 1 -- 172.21.15.45:0/1752136847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19c80ccf20 msgr2=0x7f19c81494d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T20:11:53.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.945+0000 7f19ce4a5700 1 --2- 172.21.15.45:0/1752136847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19c80ccf20 0x7f19c81494d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:53.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.945+0000 7f19ce4a5700 1 -- 172.21.15.45:0/1752136847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19c80ad060 msgr2=0x7f19c814c100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T20:11:53.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.945+0000 7f19ce4a5700 1 --2- 172.21.15.45:0/1752136847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19c80ad060 0x7f19c814c100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:53.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.945+0000 7f19ce4a5700 1 -- 172.21.15.45:0/1752136847 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c40095f0 con 0x7f19c8145410 2023-10-08T20:11:53.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.946+0000 7f19ce4a5700 1 --2- 172.21.15.45:0/1752136847 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f19c8145410 0x7f19c81655a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f19c000c7a0 tx=0x7f19c000cb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:53.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.948+0000 7f19be7fc700 1 -- 172.21.15.45:0/1752136847 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c0003e10 con 0x7f19c8145410 2023-10-08T20:11:53.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.948+0000 7f19be7fc700 1 -- 172.21.15.45:0/1752136847 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f19c0005180 con 0x7f19c8145410 2023-10-08T20:11:53.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.948+0000 7f19be7fc700 1 -- 172.21.15.45:0/1752136847 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c0005590 con 0x7f19c8145410 2023-10-08T20:11:53.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.948+0000 7f19cff08700 1 -- 172.21.15.45:0/1752136847 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c814caf0 con 0x7f19c8145410 2023-10-08T20:11:53.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.948+0000 7f19cff08700 1 -- 172.21.15.45:0/1752136847 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c814bbe0 con 0x7f19c8145410 2023-10-08T20:11:53.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.949+0000 7f19cff08700 1 -- 172.21.15.45:0/1752136847 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c814be00 con 0x7f19c8145410 2023-10-08T20:11:53.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.951+0000 7f19be7fc700 1 -- 172.21.15.45:0/1752136847 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f19c00056f0 con 0x7f19c8145410 2023-10-08T20:11:53.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.952+0000 7f19be7fc700 1 --2- 172.21.15.45:0/1752136847 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f19ac06af20 0x7f19ac06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:53.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.952+0000 7f19be7fc700 1 -- 172.21.15.45:0/1752136847 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f19c0089280 con 0x7f19c8145410 2023-10-08T20:11:53.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.957+0000 7f19cdca4700 1 --2- 172.21.15.45:0/1752136847 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f19ac06af20 0x7f19ac06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:53.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.962+0000 7f19cdca4700 1 --2- 172.21.15.45:0/1752136847 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f19ac06af20 0x7f19ac06d3e0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f19c806c2a0 tx=0x7f19c40047c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:53.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:53.968+0000 7f19be7fc700 1 -- 172.21.15.45:0/1752136847 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f19c0054850 con 0x7f19c8145410 2023-10-08T20:11:54.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:54.619+0000 7f19cff08700 1 -- 172.21.15.45:0/1752136847 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "config reset", "num": 30} v 0) v1 -- 0x7f19c804e4c0 con 0x7f19c8145410 2023-10-08T20:11:54.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:54.666+0000 7f19be7fc700 1 -- 172.21.15.45:0/1752136847 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 30}]=0 v32) v1 ==== 71+0+0 (secure 0 0 0) 0x7f19c0017080 con 0x7f19c8145410 2023-10-08T20:11:54.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:54.670+0000 7f19cff08700 1 -- 172.21.15.45:0/1752136847 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f19ac06af20 msgr2=0x7f19ac06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:54.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:54.670+0000 7f19cff08700 1 --2- 172.21.15.45:0/1752136847 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f19ac06af20 0x7f19ac06d3e0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f19c806c2a0 tx=0x7f19c40047c0 comp rx=0 tx=0).stop 2023-10-08T20:11:54.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:54.670+0000 7f19cff08700 1 -- 172.21.15.45:0/1752136847 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f19c8145410 msgr2=0x7f19c81655a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:54.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:54.670+0000 7f19cff08700 1 --2- 172.21.15.45:0/1752136847 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f19c8145410 0x7f19c81655a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f19c000c7a0 tx=0x7f19c000cb60 comp rx=0 tx=0).stop 2023-10-08T20:11:54.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:54.671+0000 7f19cff08700 1 -- 172.21.15.45:0/1752136847 shutdown_connections 2023-10-08T20:11:54.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:54.671+0000 7f19cff08700 1 --2- 172.21.15.45:0/1752136847 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f19ac06af20 0x7f19ac06d3e0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:54.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:54.671+0000 7f19cff08700 1 --2- 172.21.15.45:0/1752136847 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f19c8145410 0x7f19c81655a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:54.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:54.671+0000 7f19cff08700 1 --2- 172.21.15.45:0/1752136847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19c80ad060 0x7f19c814c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:54.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:54.671+0000 7f19cff08700 1 --2- 172.21.15.45:0/1752136847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19c80ccf20 0x7f19c81494d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:54.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:54.671+0000 7f19cff08700 1 -- 172.21.15.45:0/1752136847 >> 172.21.15.45:0/1752136847 conn(0x7f19c806e010 msgr2=0x7f19c8148230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:54.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:54.683+0000 7f19cff08700 1 -- 172.21.15.45:0/1752136847 shutdown_connections 2023-10-08T20:11:54.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:54.683+0000 7f19cff08700 1 -- 172.21.15.45:0/1752136847 wait complete. 2023-10-08T20:11:54.712 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-10-08T20:11:55.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.203+0000 7ff8df3b8700 1 -- 172.21.15.45:0/3414301808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8d80cd980 msgr2=0x7ff8d80c9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:55.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.203+0000 7ff8df3b8700 1 --2- 172.21.15.45:0/3414301808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8d80cd980 0x7ff8d80c9da0 secure :-1 s=READY pgs=3274 cs=0 l=1 rev1=1 crypto rx=0x7ff8d806ee10 tx=0x7ff8c8009c70 comp rx=0 tx=0).stop 2023-10-08T20:11:55.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.204+0000 7ff8df3b8700 1 -- 172.21.15.45:0/3414301808 shutdown_connections 2023-10-08T20:11:55.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.204+0000 7ff8df3b8700 1 --2- 172.21.15.45:0/3414301808 >> v2:172.21.15.78:3300/0 conn(0x7ff8d80c93f0 0x7ff8d80cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:55.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.204+0000 7ff8df3b8700 1 --2- 172.21.15.45:0/3414301808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8d80cd980 0x7ff8d80c9da0 unknown :-1 s=CLOSED pgs=3274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:55.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.204+0000 7ff8df3b8700 1 -- 172.21.15.45:0/3414301808 >> 172.21.15.45:0/3414301808 conn(0x7ff8d8071810 msgr2=0x7ff8d8071c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:55.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.223+0000 7ff8df3b8700 1 -- 172.21.15.45:0/3414301808 shutdown_connections 2023-10-08T20:11:55.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.224+0000 7ff8df3b8700 1 -- 172.21.15.45:0/3414301808 wait complete. 2023-10-08T20:11:55.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.226+0000 7ff8df3b8700 1 Processor -- start 2023-10-08T20:11:55.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.227+0000 7ff8df3b8700 1 -- start start 2023-10-08T20:11:55.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.229+0000 7ff8df3b8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8d80c93f0 0x7ff8d815c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:55.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.229+0000 7ff8df3b8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d80ca2e0 0x7ff8d815df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:55.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.229+0000 7ff8df3b8700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff8d80cd980 0x7ff8d80b1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:55.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.229+0000 7ff8df3b8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d815e970 con 0x7ff8d80c93f0 2023-10-08T20:11:55.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.229+0000 7ff8df3b8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d815ec50 con 0x7ff8d80ca2e0 2023-10-08T20:11:55.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.229+0000 7ff8df3b8700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d815ef30 con 0x7ff8d80cd980 2023-10-08T20:11:55.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.229+0000 7ff8de3b6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8d80c93f0 0x7ff8d815c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:55.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.229+0000 7ff8de3b6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8d80c93f0 0x7ff8d815c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51496/0 (socket says 172.21.15.45:51496) 2023-10-08T20:11:55.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.229+0000 7ff8de3b6700 1 -- 172.21.15.45:0/3040165168 learned_addr learned my addr 172.21.15.45:0/3040165168 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:11:55.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.230+0000 7ff8de3b6700 1 -- 172.21.15.45:0/3040165168 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff8d80cd980 msgr2=0x7ff8d80b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:55.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.230+0000 7ff8de3b6700 1 --2- 172.21.15.45:0/3040165168 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff8d80cd980 0x7ff8d80b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:55.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.230+0000 7ff8de3b6700 1 -- 172.21.15.45:0/3040165168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d80ca2e0 msgr2=0x7ff8d815df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:55.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.230+0000 7ff8de3b6700 1 --2- 172.21.15.45:0/3040165168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d80ca2e0 0x7ff8d815df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:55.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.230+0000 7ff8de3b6700 1 -- 172.21.15.45:0/3040165168 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c80095f0 con 0x7ff8d80c93f0 2023-10-08T20:11:55.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.230+0000 7ff8de3b6700 1 --2- 172.21.15.45:0/3040165168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8d80c93f0 0x7ff8d815c550 secure :-1 s=READY pgs=3275 cs=0 l=1 rev1=1 crypto rx=0x7ff8d400d950 tx=0x7ff8d400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:55.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.231+0000 7ff8ceffd700 1 -- 172.21.15.45:0/3040165168 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d4009930 con 0x7ff8d80c93f0 2023-10-08T20:11:55.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.231+0000 7ff8ceffd700 1 -- 172.21.15.45:0/3040165168 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff8d4009b80 con 0x7ff8d80c93f0 2023-10-08T20:11:55.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.231+0000 7ff8ceffd700 1 -- 172.21.15.45:0/3040165168 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d4010460 con 0x7ff8d80c93f0 2023-10-08T20:11:55.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.233+0000 7ff8df3b8700 1 -- 172.21.15.45:0/3040165168 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d815f210 con 0x7ff8d80c93f0 2023-10-08T20:11:55.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.233+0000 7ff8df3b8700 1 -- 172.21.15.45:0/3040165168 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d815ca90 con 0x7ff8d80c93f0 2023-10-08T20:11:55.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.243+0000 7ff8ceffd700 1 -- 172.21.15.45:0/3040165168 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff8d40105c0 con 0x7ff8d80c93f0 2023-10-08T20:11:55.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.244+0000 7ff8ceffd700 1 --2- 172.21.15.45:0/3040165168 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7ff8c406b160 0x7ff8c406d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:55.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.244+0000 7ff8ceffd700 1 -- 172.21.15.45:0/3040165168 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff8d4089720 con 0x7ff8d80c93f0 2023-10-08T20:11:55.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.245+0000 7ff8ddbb5700 1 --2- 172.21.15.45:0/3040165168 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7ff8c406b160 0x7ff8c406d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:55.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.252+0000 7ff8df3b8700 1 -- 172.21.15.45:0/3040165168 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c00052f0 con 0x7ff8d80c93f0 2023-10-08T20:11:55.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.259+0000 7ff8ddbb5700 1 --2- 172.21.15.45:0/3040165168 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7ff8c406b160 0x7ff8c406d620 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ff8d81f9820 tx=0x7ff8c8004750 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:55.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:55.263+0000 7ff8ceffd700 1 -- 172.21.15.45:0/3040165168 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff8d4021080 con 0x7ff8d80c93f0 2023-10-08T20:11:56.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:56.192+0000 7ff8df3b8700 1 -- 172.21.15.45:0/3040165168 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7ff8c00055a0 con 0x7ff8d80c93f0 2023-10-08T20:11:56.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:56.689+0000 7ff8ceffd700 1 -- 172.21.15.45:0/3040165168 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v13462) v1 ==== 144+0+0 (secure 0 0 0) 0x7ff8d4058540 con 0x7ff8d80c93f0 2023-10-08T20:11:56.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:56.701+0000 7ff8df3b8700 1 -- 172.21.15.45:0/3040165168 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7ff8c406b160 msgr2=0x7ff8c406d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:56.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:56.701+0000 7ff8df3b8700 1 --2- 172.21.15.45:0/3040165168 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7ff8c406b160 0x7ff8c406d620 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ff8d81f9820 tx=0x7ff8c8004750 comp rx=0 tx=0).stop 2023-10-08T20:11:56.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:56.701+0000 7ff8df3b8700 1 -- 172.21.15.45:0/3040165168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8d80c93f0 msgr2=0x7ff8d815c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:56.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:56.701+0000 7ff8df3b8700 1 --2- 172.21.15.45:0/3040165168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8d80c93f0 0x7ff8d815c550 secure :-1 s=READY pgs=3275 cs=0 l=1 rev1=1 crypto rx=0x7ff8d400d950 tx=0x7ff8d400dd10 comp rx=0 tx=0).stop 2023-10-08T20:11:56.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:56.701+0000 7ff8df3b8700 1 -- 172.21.15.45:0/3040165168 shutdown_connections 2023-10-08T20:11:56.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:56.701+0000 7ff8df3b8700 1 --2- 172.21.15.45:0/3040165168 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7ff8c406b160 0x7ff8c406d620 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:56.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:56.701+0000 7ff8df3b8700 1 --2- 172.21.15.45:0/3040165168 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff8d80cd980 0x7ff8d80b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:56.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:56.701+0000 7ff8df3b8700 1 --2- 172.21.15.45:0/3040165168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8d80c93f0 0x7ff8d815c550 unknown :-1 s=CLOSED pgs=3275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:56.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:56.701+0000 7ff8df3b8700 1 --2- 172.21.15.45:0/3040165168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d80ca2e0 0x7ff8d815df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:56.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:56.701+0000 7ff8df3b8700 1 -- 172.21.15.45:0/3040165168 >> 172.21.15.45:0/3040165168 conn(0x7ff8d8071810 msgr2=0x7ff8d80aa110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:56.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:56.702+0000 7ff8df3b8700 1 -- 172.21.15.45:0/3040165168 shutdown_connections 2023-10-08T20:11:56.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:56.702+0000 7ff8df3b8700 1 -- 172.21.15.45:0/3040165168 wait complete. 2023-10-08T20:11:56.881 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... FAIL 2023-10-08T20:11:56.881 INFO:tasks.cephfs_test_runner: 2023-10-08T20:11:56.881 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-08T20:11:56.881 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-08T20:11:56.881 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-08T20:11:56.881 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-08T20:11:56.881 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-10-08T20:11:56.881 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-10-08T20:11:56.881 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/cephfs/xfstests_dev.py", line 387, in run_generic_tests 2023-10-08T20:11:56.882 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-10-08T20:11:56.882 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/cephfs/xfstests_dev.py", line 379, in run_testdir 2023-10-08T20:11:56.882 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2023-10-08T20:11:56.882 INFO:tasks.cephfs_test_runner:AssertionError: 2 != 0 2023-10-08T20:11:56.882 INFO:tasks.cephfs_test_runner: 2023-10-08T20:11:56.882 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-08T20:11:56.882 INFO:tasks.cephfs_test_runner:Ran 1 test in 26757.297s 2023-10-08T20:11:56.882 INFO:tasks.cephfs_test_runner: 2023-10-08T20:11:56.882 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2023-10-08T20:11:56.882 INFO:tasks.cephfs_test_runner: 2023-10-08T20:11:56.882 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-08T20:11:56.882 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-08T20:11:56.883 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-08T20:11:56.883 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-08T20:11:56.883 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-10-08T20:11:56.883 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-10-08T20:11:56.883 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/cephfs/xfstests_dev.py", line 387, in run_generic_tests 2023-10-08T20:11:56.883 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-10-08T20:11:56.883 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/cephfs/xfstests_dev.py", line 379, in run_testdir 2023-10-08T20:11:56.883 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2023-10-08T20:11:56.883 INFO:tasks.cephfs_test_runner:AssertionError: 2 != 0 2023-10-08T20:11:56.883 INFO:tasks.cephfs_test_runner: 2023-10-08T20:11:56.884 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-08T20:11:58.122 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=d3afe7c88191437d8a187db5a991b28f Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-08T20:11:58.123 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-08T20:11:58.134 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-08T20:11:58.178 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-08T20:11:58.179 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T20:11:58.179 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T20:11:58.209 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=31,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12995 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-08T20:11:58.210 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-08T20:11:58.210 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T20:11:58.268 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=31,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12995 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-08T20:11:58.269 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T20:11:58.269 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T20:11:58.290 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15220 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-08T20:11:58.290 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-08T20:11:58.290 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T20:11:58.350 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15220 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-08T20:11:58.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T20:11:58.351 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-10-08T20:11:58.437 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T20:11:58.438 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T20:11:58.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T20:11:58.438 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T20:11:58.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T20:11:58.476 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T20:11:58.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T20:11:58.562 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2023-10-08T20:11:58.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T20:11:58.680 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-10-08T20:11:58.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T20:11:58.699 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2023-10-08T20:11:58.799 INFO:teuthology.orchestra.run.smithi045.stderr:Cannot find device "ceph-brx" 2023-10-08T20:11:58.800 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T20:11:58.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T20:11:58.801 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-10-08T20:11:58.837 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T20:11:58.837 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T20:11:58.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T20:11:58.838 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T20:11:58.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T20:11:58.920 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T20:11:59.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T20:11:59.011 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2023-10-08T20:11:59.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T20:11:59.099 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-10-08T20:11:59.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T20:11:59.117 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2023-10-08T20:11:59.304 INFO:teuthology.orchestra.run.smithi078.stderr:Cannot find device "ceph-brx" 2023-10-08T20:11:59.305 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T20:11:59.306 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-08T20:11:59.315 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-08T20:11:59.315 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T20:11:59.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.455+0000 7fd0511a7700 1 -- 172.21.15.45:0/1144907393 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd04c0cc160 msgr2=0x7fd04c0cc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:59.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.455+0000 7fd0511a7700 1 --2- 172.21.15.45:0/1144907393 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd04c0cc160 0x7fd04c0cc5e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd040009920 tx=0x7fd040009c30 comp rx=0 tx=0).stop 2023-10-08T20:11:59.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.456+0000 7fd0511a7700 1 -- 172.21.15.45:0/1144907393 shutdown_connections 2023-10-08T20:11:59.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.456+0000 7fd0511a7700 1 --2- 172.21.15.45:0/1144907393 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd04c0cc160 0x7fd04c0cc5e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:59.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.456+0000 7fd0511a7700 1 -- 172.21.15.45:0/1144907393 >> 172.21.15.45:0/1144907393 conn(0x7fd04c0cf750 msgr2=0x7fd04c0cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:59.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.456+0000 7fd0511a7700 1 -- 172.21.15.45:0/1144907393 shutdown_connections 2023-10-08T20:11:59.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.456+0000 7fd0511a7700 1 -- 172.21.15.45:0/1144907393 wait complete. 2023-10-08T20:11:59.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.457+0000 7fd0511a7700 1 Processor -- start 2023-10-08T20:11:59.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.457+0000 7fd0511a7700 1 -- start start 2023-10-08T20:11:59.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.458+0000 7fd0511a7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd04c0ae380 0x7fd04c1f0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:59.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.458+0000 7fd0511a7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd04c0cc160 0x7fd04c1efab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:59.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.458+0000 7fd0511a7700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd04c1599f0 0x7fd04c1f1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:59.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.458+0000 7fd0511a7700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c1efff0 con 0x7fd04c0cc160 2023-10-08T20:11:59.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.458+0000 7fd0511a7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c0adfb0 con 0x7fd04c0ae380 2023-10-08T20:11:59.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.458+0000 7fd0511a7700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c0b38b0 con 0x7fd04c1599f0 2023-10-08T20:11:59.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.458+0000 7fd04a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd04c0cc160 0x7fd04c1efab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:59.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.458+0000 7fd04a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd04c0cc160 0x7fd04c1efab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51508/0 (socket says 172.21.15.45:51508) 2023-10-08T20:11:59.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.458+0000 7fd04a59c700 1 -- 172.21.15.45:0/1709062524 learned_addr learned my addr 172.21.15.45:0/1709062524 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:11:59.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.458+0000 7fd04b59e700 1 --2- 172.21.15.45:0/1709062524 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd04c1599f0 0x7fd04c1f1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:59.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.458+0000 7fd04ad9d700 1 --2- 172.21.15.45:0/1709062524 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd04c0ae380 0x7fd04c1f0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:59.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.459+0000 7fd04a59c700 1 -- 172.21.15.45:0/1709062524 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd04c1599f0 msgr2=0x7fd04c1f1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:59.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.459+0000 7fd04a59c700 1 --2- 172.21.15.45:0/1709062524 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd04c1599f0 0x7fd04c1f1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:59.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.459+0000 7fd04a59c700 1 -- 172.21.15.45:0/1709062524 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd04c0ae380 msgr2=0x7fd04c1f0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:59.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.459+0000 7fd04a59c700 1 --2- 172.21.15.45:0/1709062524 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd04c0ae380 0x7fd04c1f0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:59.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.459+0000 7fd04a59c700 1 -- 172.21.15.45:0/1709062524 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd040009520 con 0x7fd04c0cc160 2023-10-08T20:11:59.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.459+0000 7fd04ad9d700 1 --2- 172.21.15.45:0/1709062524 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd04c0ae380 0x7fd04c1f0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T20:11:59.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.459+0000 7fd04a59c700 1 --2- 172.21.15.45:0/1709062524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd04c0cc160 0x7fd04c1efab0 secure :-1 s=READY pgs=3277 cs=0 l=1 rev1=1 crypto rx=0x7fd04c0717b0 tx=0x7fd04000f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:59.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.459+0000 7fd0337fe700 1 -- 172.21.15.45:0/1709062524 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04000fc40 con 0x7fd04c0cc160 2023-10-08T20:11:59.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.459+0000 7fd0337fe700 1 -- 172.21.15.45:0/1709062524 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd04000fda0 con 0x7fd04c0cc160 2023-10-08T20:11:59.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.459+0000 7fd0337fe700 1 -- 172.21.15.45:0/1709062524 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd040017660 con 0x7fd04c0cc160 2023-10-08T20:11:59.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.459+0000 7fd0511a7700 1 -- 172.21.15.45:0/1709062524 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd04c0b3b90 con 0x7fd04c0cc160 2023-10-08T20:11:59.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.459+0000 7fd0511a7700 1 -- 172.21.15.45:0/1709062524 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd04c0b4150 con 0x7fd04c0cc160 2023-10-08T20:11:59.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.460+0000 7fd0511a7700 1 -- 172.21.15.45:0/1709062524 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd04c15c850 con 0x7fd04c0cc160 2023-10-08T20:11:59.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.461+0000 7fd0337fe700 1 -- 172.21.15.45:0/1709062524 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd0400177c0 con 0x7fd04c0cc160 2023-10-08T20:11:59.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.461+0000 7fd0337fe700 1 --2- 172.21.15.45:0/1709062524 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd03806aed0 0x7fd03806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:59.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.461+0000 7fd0337fe700 1 -- 172.21.15.45:0/1709062524 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd04008b020 con 0x7fd04c0cc160 2023-10-08T20:11:59.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.461+0000 7fd04ad9d700 1 --2- 172.21.15.45:0/1709062524 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd03806aed0 0x7fd03806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:59.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.462+0000 7fd04ad9d700 1 --2- 172.21.15.45:0/1709062524 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd03806aed0 0x7fd03806d390 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fd03c0011e0 tx=0x7fd03c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:59.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.466+0000 7fd0337fe700 1 -- 172.21.15.45:0/1709062524 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd040056630 con 0x7fd04c0cc160 2023-10-08T20:11:59.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.687+0000 7fd0511a7700 1 -- 172.21.15.45:0/1709062524 --> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd04c0ca2b0 con 0x7fd03806aed0 2023-10-08T20:11:59.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.690+0000 7fd0337fe700 1 -- 172.21.15.45:0/1709062524 <== mgr.4105 v2:172.21.15.78:6832/3438117854 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49300 (secure 0 0 0) 0x7fd04c0ca2b0 con 0x7fd03806aed0 2023-10-08T20:11:59.691 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:11:59.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.692+0000 7fd0511a7700 1 -- 172.21.15.45:0/1709062524 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd03806aed0 msgr2=0x7fd03806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:59.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.692+0000 7fd0511a7700 1 --2- 172.21.15.45:0/1709062524 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd03806aed0 0x7fd03806d390 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fd03c0011e0 tx=0x7fd03c009040 comp rx=0 tx=0).stop 2023-10-08T20:11:59.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.693+0000 7fd0511a7700 1 -- 172.21.15.45:0/1709062524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd04c0cc160 msgr2=0x7fd04c1efab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:59.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.693+0000 7fd0511a7700 1 --2- 172.21.15.45:0/1709062524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd04c0cc160 0x7fd04c1efab0 secure :-1 s=READY pgs=3277 cs=0 l=1 rev1=1 crypto rx=0x7fd04c0717b0 tx=0x7fd04000f710 comp rx=0 tx=0).stop 2023-10-08T20:11:59.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.693+0000 7fd0511a7700 1 -- 172.21.15.45:0/1709062524 shutdown_connections 2023-10-08T20:11:59.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.693+0000 7fd0511a7700 1 --2- 172.21.15.45:0/1709062524 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fd03806aed0 0x7fd03806d390 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:59.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.693+0000 7fd0511a7700 1 --2- 172.21.15.45:0/1709062524 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd04c1599f0 0x7fd04c1f1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:59.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.693+0000 7fd0511a7700 1 --2- 172.21.15.45:0/1709062524 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd04c0ae380 0x7fd04c1f0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:59.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.693+0000 7fd0511a7700 1 --2- 172.21.15.45:0/1709062524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd04c0cc160 0x7fd04c1efab0 unknown :-1 s=CLOSED pgs=3277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:59.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.693+0000 7fd0511a7700 1 -- 172.21.15.45:0/1709062524 >> 172.21.15.45:0/1709062524 conn(0x7fd04c0cf750 msgr2=0x7fd04c0ae810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:59.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.693+0000 7fd0511a7700 1 -- 172.21.15.45:0/1709062524 shutdown_connections 2023-10-08T20:11:59.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.693+0000 7fd0511a7700 1 -- 172.21.15.45:0/1709062524 wait complete. 2023-10-08T20:11:59.695 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-08T20:11:59.709 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":13423,"stamp":"2023-10-08T20:11:58.796299+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":111,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":25858308,"kb_used_data":14561908,"kb_used_omap":40755,"kb_used_meta":10892236,"kb_avail":729116412,"statfs":{"total":773094113280,"available":746615205888,"internally_reserved":0,"allocated":14911393792,"data_stored":14903159473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41733465,"internal_metadata":11153650343},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":329,"apply_latency_ms":329,"commit_latency_ns":329000000,"apply_latency_ns":329000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-58041868091,"num_objects":-41244,"num_object_clones":0,"num_object_copies":-82488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-41244,"num_whiteouts":0,"num_read":-1527309,"num_read_kb":-340994710,"num_write":-3053259,"num_write_kb":-585405930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-3853,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001772"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":400,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T20:11:52.939414+0000","last_change":"2023-10-08T12:45:21.094571+0000","last_active":"2023-10-08T20:11:52.939414+0000","last_peered":"2023-10-08T20:11:52.939414+0000","last_clean":"2023-10-08T20:11:52.939414+0000","last_became_active":"2023-10-08T12:45:21.093551+0000","last_became_peered":"2023-10-08T12:45:21.093551+0000","last_unstale":"2023-10-08T20:11:52.939414+0000","last_undegraded":"2023-10-08T20:11:52.939414+0000","last_fullsized":"2023-10-08T20:11:52.939414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:19.842786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:19.842786+0000","last_clean_scrub_stamp":"2023-10-08T12:45:19.842786+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:25.041743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580207,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1258236,"kb_used_data":510428,"kb_used_omap":4391,"kb_used_meta":730584,"kb_avail":93113604,"statfs":{"total":96636764160,"available":95348330496,"internally_reserved":0,"allocated":522678272,"data_stored":522198273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4496628,"internal_metadata":748118796},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.105,"15min":1.1879999999999999},"min":{"1min":0.23799999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":8.9909999999999997,"5min":8.9909999999999997,"15min":9.9529999999999994},"last":0.46600000000000003},{"interface":"front","average":{"1min":1.861,"5min":1.4219999999999999,"15min":1.3560000000000001},"min":{"1min":0.36799999999999999,"5min":0.27500000000000002,"15min":0.24199999999999999},"max":{"1min":8.9619999999999997,"5min":9.3420000000000005,"15min":13.359},"last":0.52700000000000002}]},{"osd":1,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":2.9409999999999998,"5min":1.986,"15min":1.7310000000000001},"min":{"1min":0.39600000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":8.8200000000000003,"5min":9.6809999999999992,"15min":9.6809999999999992},"last":0.41999999999999998},{"interface":"front","average":{"1min":2.476,"5min":1.843,"15min":1.591},"min":{"1min":0.377,"5min":0.28000000000000003,"15min":0.26400000000000001},"max":{"1min":8.8900000000000006,"5min":9.6579999999999995,"15min":9.6579999999999995},"last":0.50800000000000001}]},{"osd":2,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":2.9279999999999999,"5min":1.857,"15min":1.8580000000000001},"min":{"1min":0.28799999999999998,"5min":0.28000000000000003,"15min":0.27400000000000002},"max":{"1min":11.789,"5min":11.789,"15min":13.428000000000001},"last":5.4690000000000003},{"interface":"front","average":{"1min":3.177,"5min":2.069,"15min":1.9710000000000001},"min":{"1min":0.35099999999999998,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":12.657,"5min":12.657,"15min":12.657},"last":6.0599999999999996}]},{"osd":3,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":2.0920000000000001,"5min":1.925,"15min":2.149},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.31900000000000001},"max":{"1min":8.3699999999999992,"5min":9.4109999999999996,"15min":13.272},"last":1.972},{"interface":"front","average":{"1min":1.742,"5min":1.76,"15min":2.0369999999999999},"min":{"1min":0.35999999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":5.0679999999999996,"5min":6.6230000000000002,"15min":11.433999999999999},"last":1.802}]},{"osd":4,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":0.94699999999999995,"15min":1.2110000000000001},"min":{"1min":0.29099999999999998,"5min":0.27300000000000002,"15min":0.26500000000000001},"max":{"1min":10.462,"5min":10.462,"15min":10.462},"last":10.462},{"interface":"front","average":{"1min":1.506,"5min":1.1180000000000001,"15min":1.3180000000000001},"min":{"1min":0.35599999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":5.7450000000000001,"5min":9.4420000000000002,"15min":13.114000000000001},"last":5.4299999999999997}]},{"osd":5,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.88500000000000001,"15min":1.2090000000000001},"min":{"1min":0.30299999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":6.1340000000000003,"5min":6.1340000000000003,"15min":9.0440000000000005},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.97599999999999998,"15min":1.3069999999999999},"min":{"1min":0.35599999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":3.653,"5min":6.125,"15min":9.6969999999999992},"last":0.67500000000000004}]},{"osd":6,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":1.028,"15min":1.4379999999999999},"min":{"1min":0.38900000000000001,"5min":0.35399999999999998,"15min":0.34999999999999998},"max":{"1min":4.149,"5min":7.1879999999999997,"15min":15.522},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.161,"15min":1.415},"min":{"1min":0.39900000000000002,"5min":0.375,"15min":0.375},"max":{"1min":5.806,"5min":9.3019999999999996,"15min":13.395},"last":0.80300000000000005}]}]},{"osd":6,"up_from":13,"seq":55834580209,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3857232,"kb_used_data":2072236,"kb_used_omap":3760,"kb_used_meta":1747663,"kb_avail":90514608,"statfs":{"total":96636764160,"available":92686958592,"internally_reserved":0,"allocated":2121969664,"data_stored":2120863463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3851216,"internal_metadata":1789606960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.90500000000000003,"15min":0.93400000000000005},"min":{"1min":0.253,"5min":0.24099999999999999,"15min":0.23799999999999999},"max":{"1min":4.2750000000000004,"5min":7.0650000000000004,"15min":9.6069999999999993},"last":0.48499999999999999},{"interface":"front","average":{"1min":2.1040000000000001,"5min":1.8360000000000001,"15min":1.5960000000000001},"min":{"1min":0.26600000000000001,"5min":0.246,"15min":0.246},"max":{"1min":7.4050000000000002,"5min":7.4050000000000002,"15min":11.526999999999999},"last":0.59899999999999998}]},{"osd":1,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":20.135999999999999,"5min":5.3949999999999996,"15min":3.0649999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.254},"max":{"1min":386.33300000000003,"5min":386.33300000000003,"15min":386.33300000000003},"last":0.55500000000000005},{"interface":"front","average":{"1min":20.344999999999999,"5min":5.2569999999999997,"15min":2.8279999999999998},"min":{"1min":0.28699999999999998,"5min":0.28000000000000003,"15min":0.26600000000000001},"max":{"1min":386.226,"5min":386.226,"15min":386.226},"last":0.625}]},{"osd":2,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":2.0609999999999999,"5min":1.804,"15min":1.931},"min":{"1min":0.35399999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":5.5759999999999996,"5min":6.173,"15min":8.4819999999999993},"last":0.74399999999999999},{"interface":"front","average":{"1min":2.2469999999999999,"5min":2.0030000000000001,"15min":2.0910000000000002},"min":{"1min":0.33300000000000002,"5min":0.32700000000000001,"15min":0.30599999999999999},"max":{"1min":7.0529999999999999,"5min":8.3740000000000006,"15min":8.3740000000000006},"last":0.67700000000000005}]},{"osd":3,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":2.0680000000000001,"5min":1.6830000000000001,"15min":1.875},"min":{"1min":0.371,"5min":0.316,"15min":0.316},"max":{"1min":7.4240000000000004,"5min":10.313000000000001,"15min":10.336},"last":0.71199999999999997},{"interface":"front","average":{"1min":2.6819999999999999,"5min":2.1539999999999999,"15min":2.133},"min":{"1min":0.36499999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":5.609,"5min":5.8639999999999999,"15min":9.8190000000000008},"last":0.82499999999999996}]},{"osd":4,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":0.90400000000000003,"15min":0.90700000000000003},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":5.0800000000000001,"5min":5.0800000000000001,"15min":9.4969999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.246,"5min":1.238,"15min":1.246},"min":{"1min":0.318,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":5.5250000000000004,"5min":5.5250000000000004,"15min":8.5969999999999995},"last":0.78600000000000003}]},{"osd":5,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":1.343,"15min":1.452},"min":{"1min":0.34100000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":5.9260000000000002,"5min":6.8479999999999999,"15min":9.7439999999999998},"last":0.875},{"interface":"front","average":{"1min":1.171,"5min":1.0449999999999999,"15min":1.224},"min":{"1min":0.36699999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":4.3520000000000003,"5min":6.524,"15min":9.5449999999999999},"last":0.90900000000000003}]},{"osd":7,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.2629999999999999,"15min":1.462},"min":{"1min":0.35399999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":5.665,"5min":5.665,"15min":10.858000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.821,"5min":1.387,"15min":1.532},"min":{"1min":0.39300000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":5.8769999999999998,"5min":8.1389999999999993,"15min":9.1669999999999998},"last":0.80000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834580176,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6243532,"kb_used_data":4522884,"kb_used_omap":5594,"kb_used_meta":1715045,"kb_avail":88128308,"statfs":{"total":96636764160,"available":90243387392,"internally_reserved":0,"allocated":4631433216,"data_stored":4629103181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5728863,"internal_metadata":1756206497},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":59,"apply_latency_ms":59,"commit_latency_ns":59000000,"apply_latency_ns":59000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":1.5940000000000001,"15min":1.55},"min":{"1min":0.247,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":3.181,"5min":14.423999999999999,"15min":14.423999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":2.3109999999999999,"5min":1.9419999999999999,"15min":1.8480000000000001},"min":{"1min":0.26100000000000001,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":9.4510000000000005,"5min":10.057,"15min":10.569000000000001},"last":4.3239999999999998}]},{"osd":2,"last update":"Sun Oct 8 20:11:21 2023","interfaces":[{"interface":"back","average":{"1min":3.1739999999999999,"5min":2.3620000000000001,"15min":2.1099999999999999},"min":{"1min":0.32700000000000001,"5min":0.28100000000000003,"15min":0.252},"max":{"1min":13.077,"5min":13.077,"15min":13.077},"last":16.175000000000001},{"interface":"front","average":{"1min":1.321,"5min":1.929,"15min":1.748},"min":{"1min":0.315,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":4.8940000000000001,"5min":14.48,"15min":14.48},"last":5.125}]},{"osd":3,"last update":"Sun Oct 8 20:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.992,"15min":1.76},"min":{"1min":0.33200000000000002,"5min":0.314,"15min":0.29399999999999998},"max":{"1min":8.4570000000000007,"5min":14.521000000000001,"15min":14.521000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":2.133,"5min":1.8200000000000001,"15min":1.8640000000000001},"min":{"1min":0.39000000000000001,"5min":0.29799999999999999,"15min":0.29599999999999999},"max":{"1min":11.058999999999999,"5min":11.663,"15min":11.663},"last":8.7629999999999999}]},{"osd":4,"last update":"Sun Oct 8 20:11:21 2023","interfaces":[{"interface":"back","average":{"1min":2.0939999999999999,"5min":1.621,"15min":1.702},"min":{"1min":0.42399999999999999,"5min":0.35699999999999998,"15min":0.34899999999999998},"max":{"1min":9.3119999999999994,"5min":9.3119999999999994,"15min":10.265000000000001},"last":15.460000000000001},{"interface":"front","average":{"1min":2.0030000000000001,"5min":1.8140000000000001,"15min":1.8500000000000001},"min":{"1min":0.44900000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":6.8209999999999997,"5min":12.164999999999999,"15min":14.638999999999999},"last":7.6280000000000001}]},{"osd":5,"last update":"Sun Oct 8 20:11:21 2023","interfaces":[{"interface":"back","average":{"1min":2.1139999999999999,"5min":2.024,"15min":1.913},"min":{"1min":0.50600000000000001,"5min":0.38800000000000001,"15min":0.36899999999999999},"max":{"1min":6.7320000000000002,"5min":12.220000000000001,"15min":12.220000000000001},"last":7.5209999999999999},{"interface":"front","average":{"1min":1.6220000000000001,"5min":1.5369999999999999,"15min":1.569},"min":{"1min":0.39400000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":13.117000000000001,"5min":13.117000000000001,"15min":14.130000000000001},"last":0.76300000000000001}]},{"osd":6,"last update":"Sun Oct 8 20:11:21 2023","interfaces":[{"interface":"back","average":{"1min":2.4849999999999999,"5min":1.9490000000000001,"15min":1.9710000000000001},"min":{"1min":0.48699999999999999,"5min":0.375,"15min":0.375},"max":{"1min":9.3699999999999992,"5min":9.3699999999999992,"15min":10.470000000000001},"last":8.6839999999999993},{"interface":"front","average":{"1min":1.9570000000000001,"5min":2.0230000000000001,"15min":2.0569999999999999},"min":{"1min":0.54200000000000004,"5min":0.41799999999999998,"15min":0.41199999999999998},"max":{"1min":6.9509999999999996,"5min":12.256,"15min":12.256},"last":7.585}]},{"osd":7,"last update":"Sun Oct 8 20:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":1.6339999999999999,"15min":1.8999999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":4.8369999999999997,"5min":7.8360000000000003,"15min":58.698999999999998},"last":0.83599999999999997},{"interface":"front","average":{"1min":2.093,"5min":1.9890000000000001,"15min":2.2850000000000001},"min":{"1min":0.54200000000000004,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":9.4120000000000008,"5min":11.714,"15min":58.920999999999999},"last":8.8089999999999993}]}]},{"osd":0,"up_from":13,"seq":55834580197,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3829156,"kb_used_data":2114132,"kb_used_omap":1928,"kb_used_meta":1575543,"kb_avail":90542684,"statfs":{"total":96636764160,"available":92715708416,"internally_reserved":0,"allocated":2164871168,"data_stored":2163730382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1974368,"internal_metadata":1613356960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.5509999999999999,"15min":1.4239999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":6.0209999999999999,"5min":9.2059999999999995,"15min":11.839},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.6719999999999999,"5min":1.6990000000000001,"15min":1.696},"min":{"1min":0.26200000000000001,"5min":0.248,"15min":0.248},"max":{"1min":6.4489999999999998,"5min":12.513999999999999,"15min":12.513999999999999},"last":1.7629999999999999}]},{"osd":2,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.508,"15min":1.5860000000000001},"min":{"1min":0.28999999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":8.1050000000000004,"5min":10.564,"15min":11.311999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.821,"5min":1.7869999999999999,"15min":1.9159999999999999},"min":{"1min":0.30399999999999999,"5min":0.28299999999999997,"15min":0.26600000000000001},"max":{"1min":6.327,"5min":8.6829999999999998,"15min":11.891},"last":1.8120000000000001}]},{"osd":3,"last update":"Sun Oct 8 20:10:57 2023","interfaces":[{"interface":"back","average":{"1min":2.9159999999999999,"5min":2.3999999999999999,"15min":2.4089999999999998},"min":{"1min":0.33700000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":12.266,"5min":13.051,"15min":14.238},"last":6.8310000000000004},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.4199999999999999,"15min":1.663},"min":{"1min":0.38800000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":4.0999999999999996,"5min":7.484,"15min":14.106},"last":0.92100000000000004}]},{"osd":4,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.544,"15min":1.6990000000000001},"min":{"1min":0.38800000000000001,"5min":0.313,"15min":0.313},"max":{"1min":6.1779999999999999,"5min":7.6349999999999998,"15min":32.792999999999999},"last":1.8939999999999999},{"interface":"front","average":{"1min":2.3029999999999999,"5min":2.177,"15min":2.2799999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.34100000000000003},"max":{"1min":11.693,"5min":13.108000000000001,"15min":33.149000000000001},"last":6.9530000000000003}]},{"osd":5,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.292,"15min":1.335},"min":{"1min":0.43099999999999999,"5min":0.41199999999999998,"15min":0.35899999999999999},"max":{"1min":4.0599999999999996,"5min":6.484,"15min":8.8439999999999994},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.6830000000000001,"5min":1.7569999999999999,"15min":1.802},"min":{"1min":0.47699999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":6.2800000000000002,"5min":11.464,"15min":14.925000000000001},"last":1.853}]},{"osd":6,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":2.3090000000000002,"5min":2.5830000000000002,"15min":2.3250000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.40400000000000003},"max":{"1min":12.279999999999999,"5min":13.146000000000001,"15min":13.146000000000001},"last":6.9039999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.5820000000000001,"15min":1.544},"min":{"1min":0.48399999999999999,"5min":0.44500000000000001,"15min":0.41299999999999998},"max":{"1min":6.8680000000000003,"5min":7.6219999999999999,"15min":8.8200000000000003},"last":6.8680000000000003}]},{"osd":7,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":1.681,"5min":2.008,"15min":2.016},"min":{"1min":0.56699999999999995,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":6.2320000000000002,"5min":11.125,"15min":11.125},"last":1.7210000000000001},{"interface":"front","average":{"1min":2.3839999999999999,"5min":2.508,"15min":2.48},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.42299999999999999},"max":{"1min":12.909000000000001,"5min":13.183999999999999,"15min":13.183999999999999},"last":6.992}]}]},{"osd":2,"up_from":13,"seq":55834580188,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1798460,"kb_used_data":62896,"kb_used_omap":1956,"kb_used_meta":1733595,"kb_avail":92573380,"statfs":{"total":96636764160,"available":94795141120,"internally_reserved":0,"allocated":64405504,"data_stored":64137524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2003896,"internal_metadata":1775201352},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:19 2023","interfaces":[{"interface":"back","average":{"1min":1.899,"5min":1.673,"15min":1.4079999999999999},"min":{"1min":0.27600000000000002,"5min":0.26100000000000001,"15min":0.24299999999999999},"max":{"1min":12.449,"5min":12.449,"15min":13.276},"last":8.5150000000000006},{"interface":"front","average":{"1min":3.048,"5min":2.3300000000000001,"15min":2.1019999999999999},"min":{"1min":0.41899999999999998,"5min":0.26700000000000002,"15min":0.26000000000000001},"max":{"1min":10.916,"5min":10.916,"15min":12.536},"last":10.643000000000001}]},{"osd":1,"last update":"Sun Oct 8 20:11:19 2023","interfaces":[{"interface":"back","average":{"1min":1.6919999999999999,"5min":1.546,"15min":1.4299999999999999},"min":{"1min":0.32800000000000001,"5min":0.253,"15min":0.253},"max":{"1min":6.1360000000000001,"5min":7.2759999999999998,"15min":13.449999999999999},"last":8.5960000000000001},{"interface":"front","average":{"1min":1.9770000000000001,"5min":2.419,"15min":2.2090000000000001},"min":{"1min":0.32000000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":10.000999999999999,"5min":14.356999999999999,"15min":14.356999999999999},"last":10.722}]},{"osd":3,"last update":"Sun Oct 8 20:11:27 2023","interfaces":[{"interface":"back","average":{"1min":1.9630000000000001,"5min":2.2320000000000002,"15min":2.0139999999999998},"min":{"1min":0.32100000000000001,"5min":0.30599999999999999,"15min":0.29399999999999998},"max":{"1min":7.0910000000000002,"5min":13.281000000000001,"15min":13.281000000000001},"last":8.8089999999999993},{"interface":"front","average":{"1min":1.863,"5min":1.806,"15min":1.677},"min":{"1min":0.41699999999999998,"5min":0.34100000000000003,"15min":0.33900000000000002},"max":{"1min":6.21,"5min":9.7210000000000001,"15min":13.381},"last":8.6549999999999994}]},{"osd":4,"last update":"Sun Oct 8 20:11:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.5589999999999999,"15min":1.7110000000000001},"min":{"1min":0.42199999999999999,"5min":0.371,"15min":0.34699999999999998},"max":{"1min":6.0430000000000001,"5min":8.8629999999999995,"15min":47.850999999999999},"last":8.7400000000000002},{"interface":"front","average":{"1min":1.476,"5min":1.962,"15min":2.069},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.34499999999999997},"max":{"1min":9.9640000000000004,"5min":9.9640000000000004,"15min":47.712000000000003},"last":10.577}]},{"osd":5,"last update":"Sun Oct 8 20:11:19 2023","interfaces":[{"interface":"back","average":{"1min":2.4500000000000002,"5min":2.2000000000000002,"15min":2.0670000000000002},"min":{"1min":0.40999999999999998,"5min":0.40000000000000002,"15min":0.36899999999999999},"max":{"1min":7.7000000000000002,"5min":13.15,"15min":13.15},"last":11.303000000000001},{"interface":"front","average":{"1min":1.788,"5min":1.746,"15min":1.635},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":6.1699999999999999,"5min":8.9269999999999996,"15min":13.416},"last":10.821999999999999}]},{"osd":6,"last update":"Sun Oct 8 20:11:19 2023","interfaces":[{"interface":"back","average":{"1min":1.722,"5min":2.1419999999999999,"15min":2.089},"min":{"1min":0.439,"5min":0.42199999999999999,"15min":0.40100000000000002},"max":{"1min":9.9109999999999996,"5min":9.9109999999999996,"15min":10.101000000000001},"last":10.763999999999999},{"interface":"front","average":{"1min":3.1160000000000001,"5min":2.4940000000000002,"15min":2.2040000000000002},"min":{"1min":0.51200000000000001,"5min":0.45100000000000001,"15min":0.42499999999999999},"max":{"1min":7.2270000000000003,"5min":13.244999999999999,"15min":13.244999999999999},"last":11.351000000000001}]},{"osd":7,"last update":"Sun Oct 8 20:11:19 2023","interfaces":[{"interface":"back","average":{"1min":2.1600000000000001,"5min":2.3570000000000002,"15min":2.2200000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.438},"max":{"1min":9.8680000000000003,"5min":9.8680000000000003,"15min":11.173},"last":10.683999999999999},{"interface":"front","average":{"1min":3.1269999999999998,"5min":2.5739999999999998,"15min":2.2749999999999999},"min":{"1min":0.55800000000000005,"5min":0.45200000000000001,"15min":0.439},"max":{"1min":8.4429999999999996,"5min":13.207000000000001,"15min":13.207000000000001},"last":8.8559999999999999}]}]},{"osd":3,"up_from":13,"seq":55834580170,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4100476,"kb_used_data":2333476,"kb_used_omap":10612,"kb_used_meta":1690315,"kb_avail":90271364,"statfs":{"total":96636764160,"available":92437876736,"internally_reserved":0,"allocated":2389479424,"data_stored":2388273574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10867470,"internal_metadata":1730882802},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":63,"apply_latency_ms":63,"commit_latency_ns":63000000,"apply_latency_ns":63000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":3.1280000000000001,"5min":1.9450000000000001,"15min":1.6240000000000001},"min":{"1min":0.28000000000000003,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":17.279,"5min":17.279,"15min":17.279},"last":3.4239999999999999},{"interface":"front","average":{"1min":2.3849999999999998,"5min":1.8959999999999999,"15min":1.879},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.24399999999999999},"max":{"1min":8.8699999999999992,"5min":8.8699999999999992,"15min":9.6699999999999999},"last":4.2249999999999996}]},{"osd":1,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":8.452,"5min":3.3580000000000001,"15min":2.23},"min":{"1min":0.442,"5min":0.28599999999999998,"15min":0.24299999999999999},"max":{"1min":102.35299999999999,"5min":102.35299999999999,"15min":102.35299999999999},"last":4.5430000000000001},{"interface":"front","average":{"1min":9.2170000000000005,"5min":3.4580000000000002,"15min":2.2999999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.26100000000000001},"max":{"1min":102.66200000000001,"5min":102.66200000000001,"15min":102.66200000000001},"last":3.496}]},{"osd":2,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":2.3180000000000001,"5min":2.2530000000000001,"15min":2.2080000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.28699999999999998},"max":{"1min":8.0169999999999995,"5min":11.678000000000001,"15min":14.084},"last":4.7569999999999997},{"interface":"front","average":{"1min":3.1520000000000001,"5min":2.1960000000000002,"15min":2.024},"min":{"1min":0.36899999999999999,"5min":0.34300000000000003,"15min":0.315},"max":{"1min":17.184999999999999,"5min":17.184999999999999,"15min":17.184999999999999},"last":3.6099999999999999}]},{"osd":4,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":2.153,"5min":1.865,"15min":1.8009999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":13.007,"5min":13.007,"15min":13.007},"last":4.2939999999999996},{"interface":"front","average":{"1min":1.8140000000000001,"5min":1.9790000000000001,"15min":1.8129999999999999},"min":{"1min":0.443,"5min":0.372,"15min":0.33800000000000002},"max":{"1min":7.9409999999999998,"5min":11.074999999999999,"15min":11.074999999999999},"last":4.6130000000000004}]},{"osd":5,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":1.9339999999999999,"5min":2.117,"15min":1.9550000000000001},"min":{"1min":0.53200000000000003,"5min":0.41899999999999998,"15min":0.36599999999999999},"max":{"1min":7.8920000000000003,"5min":11.029,"15min":11.029},"last":4.7130000000000001},{"interface":"front","average":{"1min":2.9529999999999998,"5min":1.944,"15min":1.728},"min":{"1min":0.53100000000000003,"5min":0.36899999999999999,"15min":0.34100000000000003},"max":{"1min":17.315999999999999,"5min":17.315999999999999,"15min":17.315999999999999},"last":3.5750000000000002}]},{"osd":6,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":2.8969999999999998,"5min":2.2109999999999999,"15min":1.8109999999999999},"min":{"1min":0.57799999999999996,"5min":0.40600000000000003,"15min":0.38100000000000001},"max":{"1min":17.350000000000001,"5min":17.350000000000001,"15min":17.350000000000001},"last":3.5379999999999998},{"interface":"front","average":{"1min":2.4060000000000001,"5min":2.2080000000000002,"15min":2.1320000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":12.890000000000001,"5min":12.890000000000001,"15min":12.890000000000001},"last":4.3789999999999996}]},{"osd":7,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":2.6800000000000002,"5min":2.1019999999999999,"15min":2.097},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.42899999999999999},"max":{"1min":12.94,"5min":12.94,"15min":12.94},"last":4.3390000000000004},{"interface":"front","average":{"1min":2.0619999999999998,"5min":2.1720000000000002,"15min":2.125},"min":{"1min":0.57099999999999995,"5min":0.437,"15min":0.437},"max":{"1min":8.0899999999999999,"5min":11.111000000000001,"15min":11.111000000000001},"last":4.6619999999999999}]}]},{"osd":4,"up_from":13,"seq":55834580203,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1468248,"kb_used_data":562956,"kb_used_omap":7607,"kb_used_meta":860040,"kb_avail":92903592,"statfs":{"total":96636764160,"available":95133278208,"internally_reserved":0,"allocated":576466944,"data_stored":575983172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7789817,"internal_metadata":880681735},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":1.111,"15min":1.0620000000000001},"min":{"1min":0.25700000000000001,"5min":0.23499999999999999,"15min":0.22900000000000001},"max":{"1min":11.608000000000001,"5min":11.608000000000001,"15min":11.686999999999999},"last":1.4350000000000001},{"interface":"front","average":{"1min":2.2320000000000002,"5min":1.5760000000000001,"15min":1.7070000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.26100000000000001},"max":{"1min":8.5809999999999995,"5min":8.5809999999999995,"15min":48.774000000000001},"last":2.2149999999999999}]},{"osd":1,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":1.9470000000000001,"5min":1.806,"15min":1.879},"min":{"1min":0.40000000000000002,"5min":0.28599999999999998,"15min":0.27000000000000002},"max":{"1min":5.4870000000000001,"5min":10.792999999999999,"15min":10.792999999999999},"last":25.675000000000001},{"interface":"front","average":{"1min":1.472,"5min":1.3939999999999999,"15min":1.655},"min":{"1min":0.32500000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":5.4749999999999996,"5min":9.6029999999999998,"15min":10.807},"last":34.18}]},{"osd":2,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.2470000000000001,"15min":1.972},"min":{"1min":0.32600000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":5.7380000000000004,"5min":8.7370000000000001,"15min":48.911000000000001},"last":12.522},{"interface":"front","average":{"1min":2.48,"5min":2.3420000000000001,"15min":2.1080000000000001},"min":{"1min":0.49299999999999999,"5min":0.36899999999999999,"15min":0.29799999999999999},"max":{"1min":6.21,"5min":8.0299999999999994,"15min":8.0299999999999994},"last":2.2599999999999998}]},{"osd":3,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":1.8069999999999999,"15min":1.9790000000000001},"min":{"1min":0.38,"5min":0.34200000000000003,"15min":0.33100000000000002},"max":{"1min":3.0630000000000002,"5min":9.6910000000000007,"15min":10.584},"last":48.406999999999996},{"interface":"front","average":{"1min":2.0670000000000002,"5min":1.8879999999999999,"15min":2.198},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.33500000000000002},"max":{"1min":7.3570000000000002,"5min":15.992000000000001,"15min":48.990000000000002},"last":23.311}]},{"osd":5,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94799999999999995,"15min":1.1899999999999999},"min":{"1min":0.27700000000000002,"5min":0.27200000000000002,"15min":0.26800000000000002},"max":{"1min":5.2249999999999996,"5min":5.4459999999999997,"15min":8.9649999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.86199999999999999,"15min":1.0840000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.944,"5min":11.625,"15min":11.625},"last":0.93100000000000005}]},{"osd":6,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.81299999999999994,"15min":1.05},"min":{"1min":0.33700000000000002,"5min":0.32500000000000001,"15min":0.29699999999999999},"max":{"1min":2.1379999999999999,"5min":5.5670000000000002,"15min":11.917},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.137,"15min":1.381},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":5.2670000000000003,"5min":5.7759999999999998,"15min":13.375},"last":1.002}]},{"osd":7,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.92500000000000004,"15min":1.1990000000000001},"min":{"1min":0.36099999999999999,"5min":0.33700000000000002,"15min":0.308},"max":{"1min":2.4020000000000001,"5min":5.4800000000000004,"15min":13.554},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.02,"15min":1.135},"min":{"1min":0.38800000000000001,"5min":0.36699999999999999,"15min":0.36099999999999999},"max":{"1min":6.1580000000000004,"5min":10.102,"15min":12.154},"last":0.98099999999999998}]}]},{"osd":5,"up_from":13,"seq":55834580206,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3302968,"kb_used_data":2382900,"kb_used_omap":4903,"kb_used_meta":839448,"kb_avail":91068872,"statfs":{"total":96636764160,"available":93254524928,"internally_reserved":0,"allocated":2440089600,"data_stored":2438869904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5021207,"internal_metadata":859595241},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":1.0329999999999999,"15min":1.1020000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.22900000000000001},"max":{"1min":1.1879999999999999,"5min":5.4340000000000002,"15min":12.48},"last":9.4610000000000003},{"interface":"front","average":{"1min":0.46899999999999997,"5min":1.363,"15min":1.365},"min":{"1min":0.33100000000000002,"5min":0.26300000000000001,"15min":0.251},"max":{"1min":1.2130000000000001,"5min":9.5899999999999999,"15min":9.5899999999999999},"last":0.84399999999999997}]},{"osd":1,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.4730000000000001,"15min":1.544},"min":{"1min":0.34100000000000003,"5min":0.25600000000000001,"15min":0.245},"max":{"1min":5.5659999999999998,"5min":6.7400000000000002,"15min":7.5590000000000002},"last":0.53600000000000003},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.744,"15min":1.8169999999999999},"min":{"1min":0.313,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":3.8599999999999999,"5min":9.8010000000000002,"15min":14.989000000000001},"last":14.522}]},{"osd":2,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":1.9970000000000001,"15min":1.921},"min":{"1min":0.373,"5min":0.31,"15min":0.27100000000000002},"max":{"1min":3.1019999999999999,"5min":14.433999999999999,"15min":14.433999999999999},"last":9.3659999999999997},{"interface":"front","average":{"1min":1.1439999999999999,"5min":2.0489999999999999,"15min":2.1280000000000001},"min":{"1min":0.375,"5min":0.33600000000000002,"15min":0.28399999999999997},"max":{"1min":3.7989999999999999,"5min":12.173,"15min":12.173},"last":2.0569999999999999}]},{"osd":3,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":2.048,"15min":2.246},"min":{"1min":0.36899999999999999,"5min":0.33500000000000002,"15min":0.33000000000000002},"max":{"1min":3.9929999999999999,"5min":6.1879999999999997,"15min":14.935},"last":19.402999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.996,"15min":2.3359999999999999},"min":{"1min":0.45300000000000001,"5min":0.36299999999999999,"15min":0.32000000000000001},"max":{"1min":4.423,"5min":9.6530000000000005,"15min":10.862},"last":3.9790000000000001}]},{"osd":4,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.872,"15min":1.161},"min":{"1min":0.27600000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.95799999999999996,"5min":5.8659999999999997,"15min":10.701000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.84199999999999997,"15min":1.202},"min":{"1min":0.313,"5min":0.28899999999999998,"15min":0.28699999999999998},"max":{"1min":0.65200000000000002,"5min":6.2389999999999999,"15min":12.531000000000001},"last":3.4950000000000001}]},{"osd":6,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":1.131,"15min":1.329},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.28299999999999997},"max":{"1min":3.7320000000000002,"5min":9.5410000000000004,"15min":12.426},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":1.141,"15min":1.355},"min":{"1min":0.36399999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.75,"5min":6.9409999999999998,"15min":9.3320000000000007},"last":0.495}]},{"osd":7,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.83499999999999996,"15min":1.3300000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":3.3140000000000001,"5min":3.9020000000000001,"15min":15.071},"last":3.5419999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":1.0980000000000001,"15min":1.3839999999999999},"min":{"1min":0.376,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":3.4300000000000002,"5min":10.34,"15min":10.804},"last":2.1080000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T20:11:59.711 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T20:11:59.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.848+0000 7f2374ebc700 1 -- 172.21.15.45:0/1698389943 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23701599f0 msgr2=0x7f237006ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:59.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.848+0000 7f2374ebc700 1 --2- 172.21.15.45:0/1698389943 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23701599f0 0x7f237006ee90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2360005fd0 tx=0x7f2360009c70 comp rx=0 tx=0).stop 2023-10-08T20:11:59.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.849+0000 7f2374ebc700 1 -- 172.21.15.45:0/1698389943 shutdown_connections 2023-10-08T20:11:59.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.849+0000 7f2374ebc700 1 --2- 172.21.15.45:0/1698389943 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f23700cc870 0x7f23700ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:59.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.849+0000 7f2374ebc700 1 --2- 172.21.15.45:0/1698389943 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23701599f0 0x7f237006ee90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:59.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.849+0000 7f2374ebc700 1 -- 172.21.15.45:0/1698389943 >> 172.21.15.45:0/1698389943 conn(0x7f23700cf750 msgr2=0x7f23700cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:11:59.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.849+0000 7f2374ebc700 1 -- 172.21.15.45:0/1698389943 shutdown_connections 2023-10-08T20:11:59.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.849+0000 7f2374ebc700 1 -- 172.21.15.45:0/1698389943 wait complete. 2023-10-08T20:11:59.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.850+0000 7f2374ebc700 1 Processor -- start 2023-10-08T20:11:59.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.850+0000 7f2374ebc700 1 -- start start 2023-10-08T20:11:59.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.851+0000 7f2374ebc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f237006f3d0 0x7f23700b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:59.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.851+0000 7f2374ebc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f23700cc870 0x7f23701f18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:59.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.851+0000 7f2374ebc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23701599f0 0x7f23701f1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:59.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.851+0000 7f2374ebc700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23700b5120 con 0x7f237006f3d0 2023-10-08T20:11:59.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.851+0000 7f2374ebc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23701f0020 con 0x7f23701599f0 2023-10-08T20:11:59.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.851+0000 7f2374ebc700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23700b4e40 con 0x7f23700cc870 2023-10-08T20:11:59.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.851+0000 7f236e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f237006f3d0 0x7f23700b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:59.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.851+0000 7f236e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f237006f3d0 0x7f23700b1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51522/0 (socket says 172.21.15.45:51522) 2023-10-08T20:11:59.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.851+0000 7f236e59c700 1 -- 172.21.15.45:0/1201919081 learned_addr learned my addr 172.21.15.45:0/1201919081 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:11:59.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.851+0000 7f236dd9b700 1 --2- 172.21.15.45:0/1201919081 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f23700cc870 0x7f23701f18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:59.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.851+0000 7f236ed9d700 1 --2- 172.21.15.45:0/1201919081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23701599f0 0x7f23701f1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:59.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.852+0000 7f236e59c700 1 -- 172.21.15.45:0/1201919081 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f23700cc870 msgr2=0x7f23701f18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:59.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.852+0000 7f236e59c700 1 --2- 172.21.15.45:0/1201919081 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f23700cc870 0x7f23701f18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:59.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.852+0000 7f236e59c700 1 -- 172.21.15.45:0/1201919081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23701599f0 msgr2=0x7f23701f1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:11:59.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.852+0000 7f236e59c700 1 --2- 172.21.15.45:0/1201919081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23701599f0 0x7f23701f1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:11:59.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.852+0000 7f236e59c700 1 -- 172.21.15.45:0/1201919081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23600095f0 con 0x7f237006f3d0 2023-10-08T20:11:59.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.852+0000 7f236ed9d700 1 --2- 172.21.15.45:0/1201919081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23701599f0 0x7f23701f1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T20:11:59.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.852+0000 7f236e59c700 1 --2- 172.21.15.45:0/1201919081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f237006f3d0 0x7f23700b1ca0 secure :-1 s=READY pgs=3278 cs=0 l=1 rev1=1 crypto rx=0x7f23700717b0 tx=0x7f2360004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:59.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.852+0000 7f235effd700 1 -- 172.21.15.45:0/1201919081 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236001c070 con 0x7f237006f3d0 2023-10-08T20:11:59.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.852+0000 7f235effd700 1 -- 172.21.15.45:0/1201919081 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f236000b820 con 0x7f237006f3d0 2023-10-08T20:11:59.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.852+0000 7f2374ebc700 1 -- 172.21.15.45:0/1201919081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23701f0dc0 con 0x7f237006f3d0 2023-10-08T20:11:59.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.852+0000 7f235effd700 1 -- 172.21.15.45:0/1201919081 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23600045f0 con 0x7f237006f3d0 2023-10-08T20:11:59.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.852+0000 7f2374ebc700 1 -- 172.21.15.45:0/1201919081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23701f1380 con 0x7f237006f3d0 2023-10-08T20:11:59.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.853+0000 7f2374ebc700 1 -- 172.21.15.45:0/1201919081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23701f0c20 con 0x7f237006f3d0 2023-10-08T20:11:59.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.854+0000 7f235effd700 1 -- 172.21.15.45:0/1201919081 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f236000bc10 con 0x7f237006f3d0 2023-10-08T20:11:59.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.854+0000 7f235effd700 1 --2- 172.21.15.45:0/1201919081 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f235006aed0 0x7f235006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:11:59.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.854+0000 7f235effd700 1 -- 172.21.15.45:0/1201919081 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f236008a860 con 0x7f237006f3d0 2023-10-08T20:11:59.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.854+0000 7f236dd9b700 1 --2- 172.21.15.45:0/1201919081 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f235006aed0 0x7f235006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:11:59.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.855+0000 7f236dd9b700 1 --2- 172.21.15.45:0/1201919081 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f235006aed0 0x7f235006d390 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f2364007fd0 tx=0x7f2364009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:11:59.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:11:59.859+0000 7f235effd700 1 -- 172.21.15.45:0/1201919081 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f23701f0c20 con 0x7f237006f3d0 2023-10-08T20:12:00.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.067+0000 7f2374ebc700 1 -- 172.21.15.45:0/1201919081 --> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f23701f0c20 con 0x7f235006aed0 2023-10-08T20:12:00.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.070+0000 7f235effd700 1 -- 172.21.15.45:0/1201919081 <== mgr.4105 v2:172.21.15.78:6832/3438117854 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49300 (secure 0 0 0) 0x7f23701f0c20 con 0x7f235006aed0 2023-10-08T20:12:00.071 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:12:00.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.072+0000 7f2374ebc700 1 -- 172.21.15.45:0/1201919081 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f235006aed0 msgr2=0x7f235006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:00.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.072+0000 7f2374ebc700 1 --2- 172.21.15.45:0/1201919081 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f235006aed0 0x7f235006d390 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f2364007fd0 tx=0x7f2364009040 comp rx=0 tx=0).stop 2023-10-08T20:12:00.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.072+0000 7f2374ebc700 1 -- 172.21.15.45:0/1201919081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f237006f3d0 msgr2=0x7f23700b1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:00.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.072+0000 7f2374ebc700 1 --2- 172.21.15.45:0/1201919081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f237006f3d0 0x7f23700b1ca0 secure :-1 s=READY pgs=3278 cs=0 l=1 rev1=1 crypto rx=0x7f23700717b0 tx=0x7f2360004260 comp rx=0 tx=0).stop 2023-10-08T20:12:00.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.072+0000 7f2374ebc700 1 -- 172.21.15.45:0/1201919081 shutdown_connections 2023-10-08T20:12:00.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.072+0000 7f2374ebc700 1 --2- 172.21.15.45:0/1201919081 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f235006aed0 0x7f235006d390 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:00.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.072+0000 7f2374ebc700 1 --2- 172.21.15.45:0/1201919081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23701599f0 0x7f23701f1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:00.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.072+0000 7f2374ebc700 1 --2- 172.21.15.45:0/1201919081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f237006f3d0 0x7f23700b1ca0 unknown :-1 s=CLOSED pgs=3278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:00.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.072+0000 7f2374ebc700 1 --2- 172.21.15.45:0/1201919081 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f23700cc870 0x7f23701f18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:00.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.073+0000 7f2374ebc700 1 -- 172.21.15.45:0/1201919081 >> 172.21.15.45:0/1201919081 conn(0x7f23700cf750 msgr2=0x7f23700adbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:00.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.073+0000 7f2374ebc700 1 -- 172.21.15.45:0/1201919081 shutdown_connections 2023-10-08T20:12:00.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.073+0000 7f2374ebc700 1 -- 172.21.15.45:0/1201919081 wait complete. 2023-10-08T20:12:00.075 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-08T20:12:00.088 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":13423,"stamp":"2023-10-08T20:11:58.796299+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":111,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":25858308,"kb_used_data":14561908,"kb_used_omap":40755,"kb_used_meta":10892236,"kb_avail":729116412,"statfs":{"total":773094113280,"available":746615205888,"internally_reserved":0,"allocated":14911393792,"data_stored":14903159473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41733465,"internal_metadata":11153650343},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":329,"apply_latency_ms":329,"commit_latency_ns":329000000,"apply_latency_ns":329000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-58041868091,"num_objects":-41244,"num_object_clones":0,"num_object_copies":-82488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-41244,"num_whiteouts":0,"num_read":-1527309,"num_read_kb":-340994710,"num_write":-3053259,"num_write_kb":-585405930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-3853,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001772"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":400,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T20:11:52.939414+0000","last_change":"2023-10-08T12:45:21.094571+0000","last_active":"2023-10-08T20:11:52.939414+0000","last_peered":"2023-10-08T20:11:52.939414+0000","last_clean":"2023-10-08T20:11:52.939414+0000","last_became_active":"2023-10-08T12:45:21.093551+0000","last_became_peered":"2023-10-08T12:45:21.093551+0000","last_unstale":"2023-10-08T20:11:52.939414+0000","last_undegraded":"2023-10-08T20:11:52.939414+0000","last_fullsized":"2023-10-08T20:11:52.939414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:19.842786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:19.842786+0000","last_clean_scrub_stamp":"2023-10-08T12:45:19.842786+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:25.041743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580207,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1258236,"kb_used_data":510428,"kb_used_omap":4391,"kb_used_meta":730584,"kb_avail":93113604,"statfs":{"total":96636764160,"available":95348330496,"internally_reserved":0,"allocated":522678272,"data_stored":522198273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4496628,"internal_metadata":748118796},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.105,"15min":1.1879999999999999},"min":{"1min":0.23799999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":8.9909999999999997,"5min":8.9909999999999997,"15min":9.9529999999999994},"last":0.46600000000000003},{"interface":"front","average":{"1min":1.861,"5min":1.4219999999999999,"15min":1.3560000000000001},"min":{"1min":0.36799999999999999,"5min":0.27500000000000002,"15min":0.24199999999999999},"max":{"1min":8.9619999999999997,"5min":9.3420000000000005,"15min":13.359},"last":0.52700000000000002}]},{"osd":1,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":2.9409999999999998,"5min":1.986,"15min":1.7310000000000001},"min":{"1min":0.39600000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":8.8200000000000003,"5min":9.6809999999999992,"15min":9.6809999999999992},"last":0.41999999999999998},{"interface":"front","average":{"1min":2.476,"5min":1.843,"15min":1.591},"min":{"1min":0.377,"5min":0.28000000000000003,"15min":0.26400000000000001},"max":{"1min":8.8900000000000006,"5min":9.6579999999999995,"15min":9.6579999999999995},"last":0.50800000000000001}]},{"osd":2,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":2.9279999999999999,"5min":1.857,"15min":1.8580000000000001},"min":{"1min":0.28799999999999998,"5min":0.28000000000000003,"15min":0.27400000000000002},"max":{"1min":11.789,"5min":11.789,"15min":13.428000000000001},"last":5.4690000000000003},{"interface":"front","average":{"1min":3.177,"5min":2.069,"15min":1.9710000000000001},"min":{"1min":0.35099999999999998,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":12.657,"5min":12.657,"15min":12.657},"last":6.0599999999999996}]},{"osd":3,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":2.0920000000000001,"5min":1.925,"15min":2.149},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.31900000000000001},"max":{"1min":8.3699999999999992,"5min":9.4109999999999996,"15min":13.272},"last":1.972},{"interface":"front","average":{"1min":1.742,"5min":1.76,"15min":2.0369999999999999},"min":{"1min":0.35999999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":5.0679999999999996,"5min":6.6230000000000002,"15min":11.433999999999999},"last":1.802}]},{"osd":4,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":0.94699999999999995,"15min":1.2110000000000001},"min":{"1min":0.29099999999999998,"5min":0.27300000000000002,"15min":0.26500000000000001},"max":{"1min":10.462,"5min":10.462,"15min":10.462},"last":10.462},{"interface":"front","average":{"1min":1.506,"5min":1.1180000000000001,"15min":1.3180000000000001},"min":{"1min":0.35599999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":5.7450000000000001,"5min":9.4420000000000002,"15min":13.114000000000001},"last":5.4299999999999997}]},{"osd":5,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.88500000000000001,"15min":1.2090000000000001},"min":{"1min":0.30299999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":6.1340000000000003,"5min":6.1340000000000003,"15min":9.0440000000000005},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.97599999999999998,"15min":1.3069999999999999},"min":{"1min":0.35599999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":3.653,"5min":6.125,"15min":9.6969999999999992},"last":0.67500000000000004}]},{"osd":6,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":1.028,"15min":1.4379999999999999},"min":{"1min":0.38900000000000001,"5min":0.35399999999999998,"15min":0.34999999999999998},"max":{"1min":4.149,"5min":7.1879999999999997,"15min":15.522},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.161,"15min":1.415},"min":{"1min":0.39900000000000002,"5min":0.375,"15min":0.375},"max":{"1min":5.806,"5min":9.3019999999999996,"15min":13.395},"last":0.80300000000000005}]}]},{"osd":6,"up_from":13,"seq":55834580209,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3857232,"kb_used_data":2072236,"kb_used_omap":3760,"kb_used_meta":1747663,"kb_avail":90514608,"statfs":{"total":96636764160,"available":92686958592,"internally_reserved":0,"allocated":2121969664,"data_stored":2120863463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3851216,"internal_metadata":1789606960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.90500000000000003,"15min":0.93400000000000005},"min":{"1min":0.253,"5min":0.24099999999999999,"15min":0.23799999999999999},"max":{"1min":4.2750000000000004,"5min":7.0650000000000004,"15min":9.6069999999999993},"last":0.48499999999999999},{"interface":"front","average":{"1min":2.1040000000000001,"5min":1.8360000000000001,"15min":1.5960000000000001},"min":{"1min":0.26600000000000001,"5min":0.246,"15min":0.246},"max":{"1min":7.4050000000000002,"5min":7.4050000000000002,"15min":11.526999999999999},"last":0.59899999999999998}]},{"osd":1,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":20.135999999999999,"5min":5.3949999999999996,"15min":3.0649999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.254},"max":{"1min":386.33300000000003,"5min":386.33300000000003,"15min":386.33300000000003},"last":0.55500000000000005},{"interface":"front","average":{"1min":20.344999999999999,"5min":5.2569999999999997,"15min":2.8279999999999998},"min":{"1min":0.28699999999999998,"5min":0.28000000000000003,"15min":0.26600000000000001},"max":{"1min":386.226,"5min":386.226,"15min":386.226},"last":0.625}]},{"osd":2,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":2.0609999999999999,"5min":1.804,"15min":1.931},"min":{"1min":0.35399999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":5.5759999999999996,"5min":6.173,"15min":8.4819999999999993},"last":0.74399999999999999},{"interface":"front","average":{"1min":2.2469999999999999,"5min":2.0030000000000001,"15min":2.0910000000000002},"min":{"1min":0.33300000000000002,"5min":0.32700000000000001,"15min":0.30599999999999999},"max":{"1min":7.0529999999999999,"5min":8.3740000000000006,"15min":8.3740000000000006},"last":0.67700000000000005}]},{"osd":3,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":2.0680000000000001,"5min":1.6830000000000001,"15min":1.875},"min":{"1min":0.371,"5min":0.316,"15min":0.316},"max":{"1min":7.4240000000000004,"5min":10.313000000000001,"15min":10.336},"last":0.71199999999999997},{"interface":"front","average":{"1min":2.6819999999999999,"5min":2.1539999999999999,"15min":2.133},"min":{"1min":0.36499999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":5.609,"5min":5.8639999999999999,"15min":9.8190000000000008},"last":0.82499999999999996}]},{"osd":4,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":0.90400000000000003,"15min":0.90700000000000003},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":5.0800000000000001,"5min":5.0800000000000001,"15min":9.4969999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.246,"5min":1.238,"15min":1.246},"min":{"1min":0.318,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":5.5250000000000004,"5min":5.5250000000000004,"15min":8.5969999999999995},"last":0.78600000000000003}]},{"osd":5,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":1.343,"15min":1.452},"min":{"1min":0.34100000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":5.9260000000000002,"5min":6.8479999999999999,"15min":9.7439999999999998},"last":0.875},{"interface":"front","average":{"1min":1.171,"5min":1.0449999999999999,"15min":1.224},"min":{"1min":0.36699999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":4.3520000000000003,"5min":6.524,"15min":9.5449999999999999},"last":0.90900000000000003}]},{"osd":7,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.2629999999999999,"15min":1.462},"min":{"1min":0.35399999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":5.665,"5min":5.665,"15min":10.858000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.821,"5min":1.387,"15min":1.532},"min":{"1min":0.39300000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":5.8769999999999998,"5min":8.1389999999999993,"15min":9.1669999999999998},"last":0.80000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834580176,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6243532,"kb_used_data":4522884,"kb_used_omap":5594,"kb_used_meta":1715045,"kb_avail":88128308,"statfs":{"total":96636764160,"available":90243387392,"internally_reserved":0,"allocated":4631433216,"data_stored":4629103181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5728863,"internal_metadata":1756206497},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":59,"apply_latency_ms":59,"commit_latency_ns":59000000,"apply_latency_ns":59000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":1.5940000000000001,"15min":1.55},"min":{"1min":0.247,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":3.181,"5min":14.423999999999999,"15min":14.423999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":2.3109999999999999,"5min":1.9419999999999999,"15min":1.8480000000000001},"min":{"1min":0.26100000000000001,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":9.4510000000000005,"5min":10.057,"15min":10.569000000000001},"last":4.3239999999999998}]},{"osd":2,"last update":"Sun Oct 8 20:11:21 2023","interfaces":[{"interface":"back","average":{"1min":3.1739999999999999,"5min":2.3620000000000001,"15min":2.1099999999999999},"min":{"1min":0.32700000000000001,"5min":0.28100000000000003,"15min":0.252},"max":{"1min":13.077,"5min":13.077,"15min":13.077},"last":16.175000000000001},{"interface":"front","average":{"1min":1.321,"5min":1.929,"15min":1.748},"min":{"1min":0.315,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":4.8940000000000001,"5min":14.48,"15min":14.48},"last":5.125}]},{"osd":3,"last update":"Sun Oct 8 20:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.992,"15min":1.76},"min":{"1min":0.33200000000000002,"5min":0.314,"15min":0.29399999999999998},"max":{"1min":8.4570000000000007,"5min":14.521000000000001,"15min":14.521000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":2.133,"5min":1.8200000000000001,"15min":1.8640000000000001},"min":{"1min":0.39000000000000001,"5min":0.29799999999999999,"15min":0.29599999999999999},"max":{"1min":11.058999999999999,"5min":11.663,"15min":11.663},"last":8.7629999999999999}]},{"osd":4,"last update":"Sun Oct 8 20:11:21 2023","interfaces":[{"interface":"back","average":{"1min":2.0939999999999999,"5min":1.621,"15min":1.702},"min":{"1min":0.42399999999999999,"5min":0.35699999999999998,"15min":0.34899999999999998},"max":{"1min":9.3119999999999994,"5min":9.3119999999999994,"15min":10.265000000000001},"last":15.460000000000001},{"interface":"front","average":{"1min":2.0030000000000001,"5min":1.8140000000000001,"15min":1.8500000000000001},"min":{"1min":0.44900000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":6.8209999999999997,"5min":12.164999999999999,"15min":14.638999999999999},"last":7.6280000000000001}]},{"osd":5,"last update":"Sun Oct 8 20:11:21 2023","interfaces":[{"interface":"back","average":{"1min":2.1139999999999999,"5min":2.024,"15min":1.913},"min":{"1min":0.50600000000000001,"5min":0.38800000000000001,"15min":0.36899999999999999},"max":{"1min":6.7320000000000002,"5min":12.220000000000001,"15min":12.220000000000001},"last":7.5209999999999999},{"interface":"front","average":{"1min":1.6220000000000001,"5min":1.5369999999999999,"15min":1.569},"min":{"1min":0.39400000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":13.117000000000001,"5min":13.117000000000001,"15min":14.130000000000001},"last":0.76300000000000001}]},{"osd":6,"last update":"Sun Oct 8 20:11:21 2023","interfaces":[{"interface":"back","average":{"1min":2.4849999999999999,"5min":1.9490000000000001,"15min":1.9710000000000001},"min":{"1min":0.48699999999999999,"5min":0.375,"15min":0.375},"max":{"1min":9.3699999999999992,"5min":9.3699999999999992,"15min":10.470000000000001},"last":8.6839999999999993},{"interface":"front","average":{"1min":1.9570000000000001,"5min":2.0230000000000001,"15min":2.0569999999999999},"min":{"1min":0.54200000000000004,"5min":0.41799999999999998,"15min":0.41199999999999998},"max":{"1min":6.9509999999999996,"5min":12.256,"15min":12.256},"last":7.585}]},{"osd":7,"last update":"Sun Oct 8 20:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":1.6339999999999999,"15min":1.8999999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":4.8369999999999997,"5min":7.8360000000000003,"15min":58.698999999999998},"last":0.83599999999999997},{"interface":"front","average":{"1min":2.093,"5min":1.9890000000000001,"15min":2.2850000000000001},"min":{"1min":0.54200000000000004,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":9.4120000000000008,"5min":11.714,"15min":58.920999999999999},"last":8.8089999999999993}]}]},{"osd":0,"up_from":13,"seq":55834580197,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3829156,"kb_used_data":2114132,"kb_used_omap":1928,"kb_used_meta":1575543,"kb_avail":90542684,"statfs":{"total":96636764160,"available":92715708416,"internally_reserved":0,"allocated":2164871168,"data_stored":2163730382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1974368,"internal_metadata":1613356960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.5509999999999999,"15min":1.4239999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":6.0209999999999999,"5min":9.2059999999999995,"15min":11.839},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.6719999999999999,"5min":1.6990000000000001,"15min":1.696},"min":{"1min":0.26200000000000001,"5min":0.248,"15min":0.248},"max":{"1min":6.4489999999999998,"5min":12.513999999999999,"15min":12.513999999999999},"last":1.7629999999999999}]},{"osd":2,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.508,"15min":1.5860000000000001},"min":{"1min":0.28999999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":8.1050000000000004,"5min":10.564,"15min":11.311999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.821,"5min":1.7869999999999999,"15min":1.9159999999999999},"min":{"1min":0.30399999999999999,"5min":0.28299999999999997,"15min":0.26600000000000001},"max":{"1min":6.327,"5min":8.6829999999999998,"15min":11.891},"last":1.8120000000000001}]},{"osd":3,"last update":"Sun Oct 8 20:10:57 2023","interfaces":[{"interface":"back","average":{"1min":2.9159999999999999,"5min":2.3999999999999999,"15min":2.4089999999999998},"min":{"1min":0.33700000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":12.266,"5min":13.051,"15min":14.238},"last":6.8310000000000004},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.4199999999999999,"15min":1.663},"min":{"1min":0.38800000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":4.0999999999999996,"5min":7.484,"15min":14.106},"last":0.92100000000000004}]},{"osd":4,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.544,"15min":1.6990000000000001},"min":{"1min":0.38800000000000001,"5min":0.313,"15min":0.313},"max":{"1min":6.1779999999999999,"5min":7.6349999999999998,"15min":32.792999999999999},"last":1.8939999999999999},{"interface":"front","average":{"1min":2.3029999999999999,"5min":2.177,"15min":2.2799999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.34100000000000003},"max":{"1min":11.693,"5min":13.108000000000001,"15min":33.149000000000001},"last":6.9530000000000003}]},{"osd":5,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.292,"15min":1.335},"min":{"1min":0.43099999999999999,"5min":0.41199999999999998,"15min":0.35899999999999999},"max":{"1min":4.0599999999999996,"5min":6.484,"15min":8.8439999999999994},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.6830000000000001,"5min":1.7569999999999999,"15min":1.802},"min":{"1min":0.47699999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":6.2800000000000002,"5min":11.464,"15min":14.925000000000001},"last":1.853}]},{"osd":6,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":2.3090000000000002,"5min":2.5830000000000002,"15min":2.3250000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.40400000000000003},"max":{"1min":12.279999999999999,"5min":13.146000000000001,"15min":13.146000000000001},"last":6.9039999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.5820000000000001,"15min":1.544},"min":{"1min":0.48399999999999999,"5min":0.44500000000000001,"15min":0.41299999999999998},"max":{"1min":6.8680000000000003,"5min":7.6219999999999999,"15min":8.8200000000000003},"last":6.8680000000000003}]},{"osd":7,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":1.681,"5min":2.008,"15min":2.016},"min":{"1min":0.56699999999999995,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":6.2320000000000002,"5min":11.125,"15min":11.125},"last":1.7210000000000001},{"interface":"front","average":{"1min":2.3839999999999999,"5min":2.508,"15min":2.48},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.42299999999999999},"max":{"1min":12.909000000000001,"5min":13.183999999999999,"15min":13.183999999999999},"last":6.992}]}]},{"osd":2,"up_from":13,"seq":55834580188,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1798460,"kb_used_data":62896,"kb_used_omap":1956,"kb_used_meta":1733595,"kb_avail":92573380,"statfs":{"total":96636764160,"available":94795141120,"internally_reserved":0,"allocated":64405504,"data_stored":64137524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2003896,"internal_metadata":1775201352},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:19 2023","interfaces":[{"interface":"back","average":{"1min":1.899,"5min":1.673,"15min":1.4079999999999999},"min":{"1min":0.27600000000000002,"5min":0.26100000000000001,"15min":0.24299999999999999},"max":{"1min":12.449,"5min":12.449,"15min":13.276},"last":8.5150000000000006},{"interface":"front","average":{"1min":3.048,"5min":2.3300000000000001,"15min":2.1019999999999999},"min":{"1min":0.41899999999999998,"5min":0.26700000000000002,"15min":0.26000000000000001},"max":{"1min":10.916,"5min":10.916,"15min":12.536},"last":10.643000000000001}]},{"osd":1,"last update":"Sun Oct 8 20:11:19 2023","interfaces":[{"interface":"back","average":{"1min":1.6919999999999999,"5min":1.546,"15min":1.4299999999999999},"min":{"1min":0.32800000000000001,"5min":0.253,"15min":0.253},"max":{"1min":6.1360000000000001,"5min":7.2759999999999998,"15min":13.449999999999999},"last":8.5960000000000001},{"interface":"front","average":{"1min":1.9770000000000001,"5min":2.419,"15min":2.2090000000000001},"min":{"1min":0.32000000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":10.000999999999999,"5min":14.356999999999999,"15min":14.356999999999999},"last":10.722}]},{"osd":3,"last update":"Sun Oct 8 20:11:27 2023","interfaces":[{"interface":"back","average":{"1min":1.9630000000000001,"5min":2.2320000000000002,"15min":2.0139999999999998},"min":{"1min":0.32100000000000001,"5min":0.30599999999999999,"15min":0.29399999999999998},"max":{"1min":7.0910000000000002,"5min":13.281000000000001,"15min":13.281000000000001},"last":8.8089999999999993},{"interface":"front","average":{"1min":1.863,"5min":1.806,"15min":1.677},"min":{"1min":0.41699999999999998,"5min":0.34100000000000003,"15min":0.33900000000000002},"max":{"1min":6.21,"5min":9.7210000000000001,"15min":13.381},"last":8.6549999999999994}]},{"osd":4,"last update":"Sun Oct 8 20:11:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.5589999999999999,"15min":1.7110000000000001},"min":{"1min":0.42199999999999999,"5min":0.371,"15min":0.34699999999999998},"max":{"1min":6.0430000000000001,"5min":8.8629999999999995,"15min":47.850999999999999},"last":8.7400000000000002},{"interface":"front","average":{"1min":1.476,"5min":1.962,"15min":2.069},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.34499999999999997},"max":{"1min":9.9640000000000004,"5min":9.9640000000000004,"15min":47.712000000000003},"last":10.577}]},{"osd":5,"last update":"Sun Oct 8 20:11:19 2023","interfaces":[{"interface":"back","average":{"1min":2.4500000000000002,"5min":2.2000000000000002,"15min":2.0670000000000002},"min":{"1min":0.40999999999999998,"5min":0.40000000000000002,"15min":0.36899999999999999},"max":{"1min":7.7000000000000002,"5min":13.15,"15min":13.15},"last":11.303000000000001},{"interface":"front","average":{"1min":1.788,"5min":1.746,"15min":1.635},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":6.1699999999999999,"5min":8.9269999999999996,"15min":13.416},"last":10.821999999999999}]},{"osd":6,"last update":"Sun Oct 8 20:11:19 2023","interfaces":[{"interface":"back","average":{"1min":1.722,"5min":2.1419999999999999,"15min":2.089},"min":{"1min":0.439,"5min":0.42199999999999999,"15min":0.40100000000000002},"max":{"1min":9.9109999999999996,"5min":9.9109999999999996,"15min":10.101000000000001},"last":10.763999999999999},{"interface":"front","average":{"1min":3.1160000000000001,"5min":2.4940000000000002,"15min":2.2040000000000002},"min":{"1min":0.51200000000000001,"5min":0.45100000000000001,"15min":0.42499999999999999},"max":{"1min":7.2270000000000003,"5min":13.244999999999999,"15min":13.244999999999999},"last":11.351000000000001}]},{"osd":7,"last update":"Sun Oct 8 20:11:19 2023","interfaces":[{"interface":"back","average":{"1min":2.1600000000000001,"5min":2.3570000000000002,"15min":2.2200000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.438},"max":{"1min":9.8680000000000003,"5min":9.8680000000000003,"15min":11.173},"last":10.683999999999999},{"interface":"front","average":{"1min":3.1269999999999998,"5min":2.5739999999999998,"15min":2.2749999999999999},"min":{"1min":0.55800000000000005,"5min":0.45200000000000001,"15min":0.439},"max":{"1min":8.4429999999999996,"5min":13.207000000000001,"15min":13.207000000000001},"last":8.8559999999999999}]}]},{"osd":3,"up_from":13,"seq":55834580170,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4100476,"kb_used_data":2333476,"kb_used_omap":10612,"kb_used_meta":1690315,"kb_avail":90271364,"statfs":{"total":96636764160,"available":92437876736,"internally_reserved":0,"allocated":2389479424,"data_stored":2388273574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10867470,"internal_metadata":1730882802},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":63,"apply_latency_ms":63,"commit_latency_ns":63000000,"apply_latency_ns":63000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":3.1280000000000001,"5min":1.9450000000000001,"15min":1.6240000000000001},"min":{"1min":0.28000000000000003,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":17.279,"5min":17.279,"15min":17.279},"last":3.4239999999999999},{"interface":"front","average":{"1min":2.3849999999999998,"5min":1.8959999999999999,"15min":1.879},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.24399999999999999},"max":{"1min":8.8699999999999992,"5min":8.8699999999999992,"15min":9.6699999999999999},"last":4.2249999999999996}]},{"osd":1,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":8.452,"5min":3.3580000000000001,"15min":2.23},"min":{"1min":0.442,"5min":0.28599999999999998,"15min":0.24299999999999999},"max":{"1min":102.35299999999999,"5min":102.35299999999999,"15min":102.35299999999999},"last":4.5430000000000001},{"interface":"front","average":{"1min":9.2170000000000005,"5min":3.4580000000000002,"15min":2.2999999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.26100000000000001},"max":{"1min":102.66200000000001,"5min":102.66200000000001,"15min":102.66200000000001},"last":3.496}]},{"osd":2,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":2.3180000000000001,"5min":2.2530000000000001,"15min":2.2080000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.28699999999999998},"max":{"1min":8.0169999999999995,"5min":11.678000000000001,"15min":14.084},"last":4.7569999999999997},{"interface":"front","average":{"1min":3.1520000000000001,"5min":2.1960000000000002,"15min":2.024},"min":{"1min":0.36899999999999999,"5min":0.34300000000000003,"15min":0.315},"max":{"1min":17.184999999999999,"5min":17.184999999999999,"15min":17.184999999999999},"last":3.6099999999999999}]},{"osd":4,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":2.153,"5min":1.865,"15min":1.8009999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":13.007,"5min":13.007,"15min":13.007},"last":4.2939999999999996},{"interface":"front","average":{"1min":1.8140000000000001,"5min":1.9790000000000001,"15min":1.8129999999999999},"min":{"1min":0.443,"5min":0.372,"15min":0.33800000000000002},"max":{"1min":7.9409999999999998,"5min":11.074999999999999,"15min":11.074999999999999},"last":4.6130000000000004}]},{"osd":5,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":1.9339999999999999,"5min":2.117,"15min":1.9550000000000001},"min":{"1min":0.53200000000000003,"5min":0.41899999999999998,"15min":0.36599999999999999},"max":{"1min":7.8920000000000003,"5min":11.029,"15min":11.029},"last":4.7130000000000001},{"interface":"front","average":{"1min":2.9529999999999998,"5min":1.944,"15min":1.728},"min":{"1min":0.53100000000000003,"5min":0.36899999999999999,"15min":0.34100000000000003},"max":{"1min":17.315999999999999,"5min":17.315999999999999,"15min":17.315999999999999},"last":3.5750000000000002}]},{"osd":6,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":2.8969999999999998,"5min":2.2109999999999999,"15min":1.8109999999999999},"min":{"1min":0.57799999999999996,"5min":0.40600000000000003,"15min":0.38100000000000001},"max":{"1min":17.350000000000001,"5min":17.350000000000001,"15min":17.350000000000001},"last":3.5379999999999998},{"interface":"front","average":{"1min":2.4060000000000001,"5min":2.2080000000000002,"15min":2.1320000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":12.890000000000001,"5min":12.890000000000001,"15min":12.890000000000001},"last":4.3789999999999996}]},{"osd":7,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":2.6800000000000002,"5min":2.1019999999999999,"15min":2.097},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.42899999999999999},"max":{"1min":12.94,"5min":12.94,"15min":12.94},"last":4.3390000000000004},{"interface":"front","average":{"1min":2.0619999999999998,"5min":2.1720000000000002,"15min":2.125},"min":{"1min":0.57099999999999995,"5min":0.437,"15min":0.437},"max":{"1min":8.0899999999999999,"5min":11.111000000000001,"15min":11.111000000000001},"last":4.6619999999999999}]}]},{"osd":4,"up_from":13,"seq":55834580203,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1468248,"kb_used_data":562956,"kb_used_omap":7607,"kb_used_meta":860040,"kb_avail":92903592,"statfs":{"total":96636764160,"available":95133278208,"internally_reserved":0,"allocated":576466944,"data_stored":575983172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7789817,"internal_metadata":880681735},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":1.111,"15min":1.0620000000000001},"min":{"1min":0.25700000000000001,"5min":0.23499999999999999,"15min":0.22900000000000001},"max":{"1min":11.608000000000001,"5min":11.608000000000001,"15min":11.686999999999999},"last":1.4350000000000001},{"interface":"front","average":{"1min":2.2320000000000002,"5min":1.5760000000000001,"15min":1.7070000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.26100000000000001},"max":{"1min":8.5809999999999995,"5min":8.5809999999999995,"15min":48.774000000000001},"last":2.2149999999999999}]},{"osd":1,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":1.9470000000000001,"5min":1.806,"15min":1.879},"min":{"1min":0.40000000000000002,"5min":0.28599999999999998,"15min":0.27000000000000002},"max":{"1min":5.4870000000000001,"5min":10.792999999999999,"15min":10.792999999999999},"last":25.675000000000001},{"interface":"front","average":{"1min":1.472,"5min":1.3939999999999999,"15min":1.655},"min":{"1min":0.32500000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":5.4749999999999996,"5min":9.6029999999999998,"15min":10.807},"last":34.18}]},{"osd":2,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.2470000000000001,"15min":1.972},"min":{"1min":0.32600000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":5.7380000000000004,"5min":8.7370000000000001,"15min":48.911000000000001},"last":12.522},{"interface":"front","average":{"1min":2.48,"5min":2.3420000000000001,"15min":2.1080000000000001},"min":{"1min":0.49299999999999999,"5min":0.36899999999999999,"15min":0.29799999999999999},"max":{"1min":6.21,"5min":8.0299999999999994,"15min":8.0299999999999994},"last":2.2599999999999998}]},{"osd":3,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":1.8069999999999999,"15min":1.9790000000000001},"min":{"1min":0.38,"5min":0.34200000000000003,"15min":0.33100000000000002},"max":{"1min":3.0630000000000002,"5min":9.6910000000000007,"15min":10.584},"last":48.406999999999996},{"interface":"front","average":{"1min":2.0670000000000002,"5min":1.8879999999999999,"15min":2.198},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.33500000000000002},"max":{"1min":7.3570000000000002,"5min":15.992000000000001,"15min":48.990000000000002},"last":23.311}]},{"osd":5,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94799999999999995,"15min":1.1899999999999999},"min":{"1min":0.27700000000000002,"5min":0.27200000000000002,"15min":0.26800000000000002},"max":{"1min":5.2249999999999996,"5min":5.4459999999999997,"15min":8.9649999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.86199999999999999,"15min":1.0840000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.944,"5min":11.625,"15min":11.625},"last":0.93100000000000005}]},{"osd":6,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.81299999999999994,"15min":1.05},"min":{"1min":0.33700000000000002,"5min":0.32500000000000001,"15min":0.29699999999999999},"max":{"1min":2.1379999999999999,"5min":5.5670000000000002,"15min":11.917},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.137,"15min":1.381},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":5.2670000000000003,"5min":5.7759999999999998,"15min":13.375},"last":1.002}]},{"osd":7,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.92500000000000004,"15min":1.1990000000000001},"min":{"1min":0.36099999999999999,"5min":0.33700000000000002,"15min":0.308},"max":{"1min":2.4020000000000001,"5min":5.4800000000000004,"15min":13.554},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.02,"15min":1.135},"min":{"1min":0.38800000000000001,"5min":0.36699999999999999,"15min":0.36099999999999999},"max":{"1min":6.1580000000000004,"5min":10.102,"15min":12.154},"last":0.98099999999999998}]}]},{"osd":5,"up_from":13,"seq":55834580206,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3302968,"kb_used_data":2382900,"kb_used_omap":4903,"kb_used_meta":839448,"kb_avail":91068872,"statfs":{"total":96636764160,"available":93254524928,"internally_reserved":0,"allocated":2440089600,"data_stored":2438869904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5021207,"internal_metadata":859595241},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":1.0329999999999999,"15min":1.1020000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.22900000000000001},"max":{"1min":1.1879999999999999,"5min":5.4340000000000002,"15min":12.48},"last":9.4610000000000003},{"interface":"front","average":{"1min":0.46899999999999997,"5min":1.363,"15min":1.365},"min":{"1min":0.33100000000000002,"5min":0.26300000000000001,"15min":0.251},"max":{"1min":1.2130000000000001,"5min":9.5899999999999999,"15min":9.5899999999999999},"last":0.84399999999999997}]},{"osd":1,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.4730000000000001,"15min":1.544},"min":{"1min":0.34100000000000003,"5min":0.25600000000000001,"15min":0.245},"max":{"1min":5.5659999999999998,"5min":6.7400000000000002,"15min":7.5590000000000002},"last":0.53600000000000003},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.744,"15min":1.8169999999999999},"min":{"1min":0.313,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":3.8599999999999999,"5min":9.8010000000000002,"15min":14.989000000000001},"last":14.522}]},{"osd":2,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":1.9970000000000001,"15min":1.921},"min":{"1min":0.373,"5min":0.31,"15min":0.27100000000000002},"max":{"1min":3.1019999999999999,"5min":14.433999999999999,"15min":14.433999999999999},"last":9.3659999999999997},{"interface":"front","average":{"1min":1.1439999999999999,"5min":2.0489999999999999,"15min":2.1280000000000001},"min":{"1min":0.375,"5min":0.33600000000000002,"15min":0.28399999999999997},"max":{"1min":3.7989999999999999,"5min":12.173,"15min":12.173},"last":2.0569999999999999}]},{"osd":3,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":2.048,"15min":2.246},"min":{"1min":0.36899999999999999,"5min":0.33500000000000002,"15min":0.33000000000000002},"max":{"1min":3.9929999999999999,"5min":6.1879999999999997,"15min":14.935},"last":19.402999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.996,"15min":2.3359999999999999},"min":{"1min":0.45300000000000001,"5min":0.36299999999999999,"15min":0.32000000000000001},"max":{"1min":4.423,"5min":9.6530000000000005,"15min":10.862},"last":3.9790000000000001}]},{"osd":4,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.872,"15min":1.161},"min":{"1min":0.27600000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.95799999999999996,"5min":5.8659999999999997,"15min":10.701000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.84199999999999997,"15min":1.202},"min":{"1min":0.313,"5min":0.28899999999999998,"15min":0.28699999999999998},"max":{"1min":0.65200000000000002,"5min":6.2389999999999999,"15min":12.531000000000001},"last":3.4950000000000001}]},{"osd":6,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":1.131,"15min":1.329},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.28299999999999997},"max":{"1min":3.7320000000000002,"5min":9.5410000000000004,"15min":12.426},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":1.141,"15min":1.355},"min":{"1min":0.36399999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.75,"5min":6.9409999999999998,"15min":9.3320000000000007},"last":0.495}]},{"osd":7,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.83499999999999996,"15min":1.3300000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":3.3140000000000001,"5min":3.9020000000000001,"15min":15.071},"last":3.5419999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":1.0980000000000001,"15min":1.3839999999999999},"min":{"1min":0.376,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":3.4300000000000002,"5min":10.34,"15min":10.804},"last":2.1080000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T20:12:00.090 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-08T20:12:00.090 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T20:12:00.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.227+0000 7faed2b47700 1 -- 172.21.15.45:0/3302250749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faecc0cc160 msgr2=0x7faecc0cc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:00.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.227+0000 7faed2b47700 1 --2- 172.21.15.45:0/3302250749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faecc0cc160 0x7faecc0cc5e0 secure :-1 s=READY pgs=3280 cs=0 l=1 rev1=1 crypto rx=0x7faeb80098c0 tx=0x7faeb8009bd0 comp rx=0 tx=0).stop 2023-10-08T20:12:00.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.227+0000 7faed2b47700 1 -- 172.21.15.45:0/3302250749 shutdown_connections 2023-10-08T20:12:00.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.227+0000 7faed2b47700 1 --2- 172.21.15.45:0/3302250749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faecc0cc160 0x7faecc0cc5e0 unknown :-1 s=CLOSED pgs=3280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:00.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.227+0000 7faed2b47700 1 -- 172.21.15.45:0/3302250749 >> 172.21.15.45:0/3302250749 conn(0x7faecc0cf750 msgr2=0x7faecc0cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:00.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.227+0000 7faed2b47700 1 -- 172.21.15.45:0/3302250749 shutdown_connections 2023-10-08T20:12:00.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.227+0000 7faed2b47700 1 -- 172.21.15.45:0/3302250749 wait complete. 2023-10-08T20:12:00.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.229+0000 7faed2b47700 1 Processor -- start 2023-10-08T20:12:00.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.229+0000 7faed2b47700 1 -- start start 2023-10-08T20:12:00.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.230+0000 7faed2b47700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faecc0ae380 0x7faecc0c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:00.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.230+0000 7faed2b47700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faecc0cc160 0x7faecc0b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:00.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.230+0000 7faed2b47700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faecc1599f0 0x7faecc0b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:00.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.230+0000 7faed2b47700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc0b4cb0 con 0x7faecc0cc160 2023-10-08T20:12:00.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.230+0000 7faed2b47700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc0b50d0 con 0x7faecc0ae380 2023-10-08T20:12:00.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.230+0000 7faed2b47700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faecc0b4030 con 0x7faecc1599f0 2023-10-08T20:12:00.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.230+0000 7faecbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faecc0cc160 0x7faecc0b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:00.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.230+0000 7faecbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faecc0cc160 0x7faecc0b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51538/0 (socket says 172.21.15.45:51538) 2023-10-08T20:12:00.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.230+0000 7faecbfff700 1 -- 172.21.15.45:0/262191062 learned_addr learned my addr 172.21.15.45:0/262191062 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:12:00.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.230+0000 7faed08e3700 1 --2- 172.21.15.45:0/262191062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faecc0ae380 0x7faecc0c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:00.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.230+0000 7faed10e4700 1 --2- 172.21.15.45:0/262191062 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faecc1599f0 0x7faecc0b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:00.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.230+0000 7faecbfff700 1 -- 172.21.15.45:0/262191062 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faecc1599f0 msgr2=0x7faecc0b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:00.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.230+0000 7faecbfff700 1 --2- 172.21.15.45:0/262191062 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faecc1599f0 0x7faecc0b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:00.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.230+0000 7faecbfff700 1 -- 172.21.15.45:0/262191062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faecc0ae380 msgr2=0x7faecc0c5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:00.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.230+0000 7faecbfff700 1 --2- 172.21.15.45:0/262191062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faecc0ae380 0x7faecc0c5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:00.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.230+0000 7faecbfff700 1 -- 172.21.15.45:0/262191062 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb8009520 con 0x7faecc0cc160 2023-10-08T20:12:00.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.230+0000 7faed10e4700 1 --2- 172.21.15.45:0/262191062 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faecc1599f0 0x7faecc0b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T20:12:00.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.230+0000 7faecbfff700 1 --2- 172.21.15.45:0/262191062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faecc0cc160 0x7faecc0b34b0 secure :-1 s=READY pgs=3281 cs=0 l=1 rev1=1 crypto rx=0x7faecc0717b0 tx=0x7faeb8017750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:00.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.230+0000 7faec97fa700 1 -- 172.21.15.45:0/262191062 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb801c070 con 0x7faecc0cc160 2023-10-08T20:12:00.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.231+0000 7faec97fa700 1 -- 172.21.15.45:0/262191062 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7faeb8017d00 con 0x7faecc0cc160 2023-10-08T20:12:00.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.231+0000 7faed2b47700 1 -- 172.21.15.45:0/262191062 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faecc0b4310 con 0x7faecc0cc160 2023-10-08T20:12:00.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.231+0000 7faec97fa700 1 -- 172.21.15.45:0/262191062 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb8004280 con 0x7faecc0cc160 2023-10-08T20:12:00.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.231+0000 7faed2b47700 1 -- 172.21.15.45:0/262191062 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faecc0b48d0 con 0x7faecc0cc160 2023-10-08T20:12:00.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.232+0000 7faed2b47700 1 -- 172.21.15.45:0/262191062 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faecc0b4df0 con 0x7faecc0cc160 2023-10-08T20:12:00.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.232+0000 7faec97fa700 1 -- 172.21.15.45:0/262191062 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7faeb80043e0 con 0x7faecc0cc160 2023-10-08T20:12:00.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.233+0000 7faec97fa700 1 --2- 172.21.15.45:0/262191062 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7faeb006aed0 0x7faeb006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:00.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.233+0000 7faec97fa700 1 -- 172.21.15.45:0/262191062 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7faeb808abe0 con 0x7faecc0cc160 2023-10-08T20:12:00.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.233+0000 7faed08e3700 1 --2- 172.21.15.45:0/262191062 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7faeb006aed0 0x7faeb006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:00.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.234+0000 7faed08e3700 1 --2- 172.21.15.45:0/262191062 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7faeb006aed0 0x7faeb006d390 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7faec0000f60 tx=0x7faec0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:00.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.237+0000 7faec97fa700 1 -- 172.21.15.45:0/262191062 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faecc0b4df0 con 0x7faecc0cc160 2023-10-08T20:12:00.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.443+0000 7faed2b47700 1 -- 172.21.15.45:0/262191062 --> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faecc159dd0 con 0x7faeb006aed0 2023-10-08T20:12:00.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.446+0000 7faec97fa700 1 -- 172.21.15.45:0/262191062 <== mgr.4105 v2:172.21.15.78:6832/3438117854 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49300 (secure 0 0 0) 0x7faec00013f0 con 0x7faeb006aed0 2023-10-08T20:12:00.447 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:12:00.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.448+0000 7faed2b47700 1 -- 172.21.15.45:0/262191062 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7faeb006aed0 msgr2=0x7faeb006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:00.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.448+0000 7faed2b47700 1 --2- 172.21.15.45:0/262191062 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7faeb006aed0 0x7faeb006d390 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7faec0000f60 tx=0x7faec0009040 comp rx=0 tx=0).stop 2023-10-08T20:12:00.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.448+0000 7faed2b47700 1 -- 172.21.15.45:0/262191062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faecc0cc160 msgr2=0x7faecc0b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:00.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.448+0000 7faed2b47700 1 --2- 172.21.15.45:0/262191062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faecc0cc160 0x7faecc0b34b0 secure :-1 s=READY pgs=3281 cs=0 l=1 rev1=1 crypto rx=0x7faecc0717b0 tx=0x7faeb8017750 comp rx=0 tx=0).stop 2023-10-08T20:12:00.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.448+0000 7faed2b47700 1 -- 172.21.15.45:0/262191062 shutdown_connections 2023-10-08T20:12:00.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.448+0000 7faed2b47700 1 --2- 172.21.15.45:0/262191062 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7faeb006aed0 0x7faeb006d390 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:00.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.448+0000 7faed2b47700 1 --2- 172.21.15.45:0/262191062 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faecc1599f0 0x7faecc0b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:00.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.448+0000 7faed2b47700 1 --2- 172.21.15.45:0/262191062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faecc0ae380 0x7faecc0c5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:00.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.448+0000 7faed2b47700 1 --2- 172.21.15.45:0/262191062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faecc0cc160 0x7faecc0b34b0 unknown :-1 s=CLOSED pgs=3281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:00.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.448+0000 7faed2b47700 1 -- 172.21.15.45:0/262191062 >> 172.21.15.45:0/262191062 conn(0x7faecc0cf750 msgr2=0x7faecc06ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:00.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.449+0000 7faed2b47700 1 -- 172.21.15.45:0/262191062 shutdown_connections 2023-10-08T20:12:00.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.449+0000 7faed2b47700 1 -- 172.21.15.45:0/262191062 wait complete. 2023-10-08T20:12:00.451 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-08T20:12:00.463 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":13423,"stamp":"2023-10-08T20:11:58.796299+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":111,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":25858308,"kb_used_data":14561908,"kb_used_omap":40755,"kb_used_meta":10892236,"kb_avail":729116412,"statfs":{"total":773094113280,"available":746615205888,"internally_reserved":0,"allocated":14911393792,"data_stored":14903159473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41733465,"internal_metadata":11153650343},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":329,"apply_latency_ms":329,"commit_latency_ns":329000000,"apply_latency_ns":329000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-58041868091,"num_objects":-41244,"num_object_clones":0,"num_object_copies":-82488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-41244,"num_whiteouts":0,"num_read":-1527309,"num_read_kb":-340994710,"num_write":-3053259,"num_write_kb":-585405930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-3853,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001772"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":400,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T20:11:52.939414+0000","last_change":"2023-10-08T12:45:21.094571+0000","last_active":"2023-10-08T20:11:52.939414+0000","last_peered":"2023-10-08T20:11:52.939414+0000","last_clean":"2023-10-08T20:11:52.939414+0000","last_became_active":"2023-10-08T12:45:21.093551+0000","last_became_peered":"2023-10-08T12:45:21.093551+0000","last_unstale":"2023-10-08T20:11:52.939414+0000","last_undegraded":"2023-10-08T20:11:52.939414+0000","last_fullsized":"2023-10-08T20:11:52.939414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:19.842786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:19.842786+0000","last_clean_scrub_stamp":"2023-10-08T12:45:19.842786+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:25.041743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580207,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1258236,"kb_used_data":510428,"kb_used_omap":4391,"kb_used_meta":730584,"kb_avail":93113604,"statfs":{"total":96636764160,"available":95348330496,"internally_reserved":0,"allocated":522678272,"data_stored":522198273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4496628,"internal_metadata":748118796},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.105,"15min":1.1879999999999999},"min":{"1min":0.23799999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":8.9909999999999997,"5min":8.9909999999999997,"15min":9.9529999999999994},"last":0.46600000000000003},{"interface":"front","average":{"1min":1.861,"5min":1.4219999999999999,"15min":1.3560000000000001},"min":{"1min":0.36799999999999999,"5min":0.27500000000000002,"15min":0.24199999999999999},"max":{"1min":8.9619999999999997,"5min":9.3420000000000005,"15min":13.359},"last":0.52700000000000002}]},{"osd":1,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":2.9409999999999998,"5min":1.986,"15min":1.7310000000000001},"min":{"1min":0.39600000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":8.8200000000000003,"5min":9.6809999999999992,"15min":9.6809999999999992},"last":0.41999999999999998},{"interface":"front","average":{"1min":2.476,"5min":1.843,"15min":1.591},"min":{"1min":0.377,"5min":0.28000000000000003,"15min":0.26400000000000001},"max":{"1min":8.8900000000000006,"5min":9.6579999999999995,"15min":9.6579999999999995},"last":0.50800000000000001}]},{"osd":2,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":2.9279999999999999,"5min":1.857,"15min":1.8580000000000001},"min":{"1min":0.28799999999999998,"5min":0.28000000000000003,"15min":0.27400000000000002},"max":{"1min":11.789,"5min":11.789,"15min":13.428000000000001},"last":5.4690000000000003},{"interface":"front","average":{"1min":3.177,"5min":2.069,"15min":1.9710000000000001},"min":{"1min":0.35099999999999998,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":12.657,"5min":12.657,"15min":12.657},"last":6.0599999999999996}]},{"osd":3,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":2.0920000000000001,"5min":1.925,"15min":2.149},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.31900000000000001},"max":{"1min":8.3699999999999992,"5min":9.4109999999999996,"15min":13.272},"last":1.972},{"interface":"front","average":{"1min":1.742,"5min":1.76,"15min":2.0369999999999999},"min":{"1min":0.35999999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":5.0679999999999996,"5min":6.6230000000000002,"15min":11.433999999999999},"last":1.802}]},{"osd":4,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":0.94699999999999995,"15min":1.2110000000000001},"min":{"1min":0.29099999999999998,"5min":0.27300000000000002,"15min":0.26500000000000001},"max":{"1min":10.462,"5min":10.462,"15min":10.462},"last":10.462},{"interface":"front","average":{"1min":1.506,"5min":1.1180000000000001,"15min":1.3180000000000001},"min":{"1min":0.35599999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":5.7450000000000001,"5min":9.4420000000000002,"15min":13.114000000000001},"last":5.4299999999999997}]},{"osd":5,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.88500000000000001,"15min":1.2090000000000001},"min":{"1min":0.30299999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":6.1340000000000003,"5min":6.1340000000000003,"15min":9.0440000000000005},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.97599999999999998,"15min":1.3069999999999999},"min":{"1min":0.35599999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":3.653,"5min":6.125,"15min":9.6969999999999992},"last":0.67500000000000004}]},{"osd":6,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":1.028,"15min":1.4379999999999999},"min":{"1min":0.38900000000000001,"5min":0.35399999999999998,"15min":0.34999999999999998},"max":{"1min":4.149,"5min":7.1879999999999997,"15min":15.522},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.161,"15min":1.415},"min":{"1min":0.39900000000000002,"5min":0.375,"15min":0.375},"max":{"1min":5.806,"5min":9.3019999999999996,"15min":13.395},"last":0.80300000000000005}]}]},{"osd":6,"up_from":13,"seq":55834580209,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3857232,"kb_used_data":2072236,"kb_used_omap":3760,"kb_used_meta":1747663,"kb_avail":90514608,"statfs":{"total":96636764160,"available":92686958592,"internally_reserved":0,"allocated":2121969664,"data_stored":2120863463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3851216,"internal_metadata":1789606960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.90500000000000003,"15min":0.93400000000000005},"min":{"1min":0.253,"5min":0.24099999999999999,"15min":0.23799999999999999},"max":{"1min":4.2750000000000004,"5min":7.0650000000000004,"15min":9.6069999999999993},"last":0.48499999999999999},{"interface":"front","average":{"1min":2.1040000000000001,"5min":1.8360000000000001,"15min":1.5960000000000001},"min":{"1min":0.26600000000000001,"5min":0.246,"15min":0.246},"max":{"1min":7.4050000000000002,"5min":7.4050000000000002,"15min":11.526999999999999},"last":0.59899999999999998}]},{"osd":1,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":20.135999999999999,"5min":5.3949999999999996,"15min":3.0649999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.254},"max":{"1min":386.33300000000003,"5min":386.33300000000003,"15min":386.33300000000003},"last":0.55500000000000005},{"interface":"front","average":{"1min":20.344999999999999,"5min":5.2569999999999997,"15min":2.8279999999999998},"min":{"1min":0.28699999999999998,"5min":0.28000000000000003,"15min":0.26600000000000001},"max":{"1min":386.226,"5min":386.226,"15min":386.226},"last":0.625}]},{"osd":2,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":2.0609999999999999,"5min":1.804,"15min":1.931},"min":{"1min":0.35399999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":5.5759999999999996,"5min":6.173,"15min":8.4819999999999993},"last":0.74399999999999999},{"interface":"front","average":{"1min":2.2469999999999999,"5min":2.0030000000000001,"15min":2.0910000000000002},"min":{"1min":0.33300000000000002,"5min":0.32700000000000001,"15min":0.30599999999999999},"max":{"1min":7.0529999999999999,"5min":8.3740000000000006,"15min":8.3740000000000006},"last":0.67700000000000005}]},{"osd":3,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":2.0680000000000001,"5min":1.6830000000000001,"15min":1.875},"min":{"1min":0.371,"5min":0.316,"15min":0.316},"max":{"1min":7.4240000000000004,"5min":10.313000000000001,"15min":10.336},"last":0.71199999999999997},{"interface":"front","average":{"1min":2.6819999999999999,"5min":2.1539999999999999,"15min":2.133},"min":{"1min":0.36499999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":5.609,"5min":5.8639999999999999,"15min":9.8190000000000008},"last":0.82499999999999996}]},{"osd":4,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":0.90400000000000003,"15min":0.90700000000000003},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":5.0800000000000001,"5min":5.0800000000000001,"15min":9.4969999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.246,"5min":1.238,"15min":1.246},"min":{"1min":0.318,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":5.5250000000000004,"5min":5.5250000000000004,"15min":8.5969999999999995},"last":0.78600000000000003}]},{"osd":5,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":1.343,"15min":1.452},"min":{"1min":0.34100000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":5.9260000000000002,"5min":6.8479999999999999,"15min":9.7439999999999998},"last":0.875},{"interface":"front","average":{"1min":1.171,"5min":1.0449999999999999,"15min":1.224},"min":{"1min":0.36699999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":4.3520000000000003,"5min":6.524,"15min":9.5449999999999999},"last":0.90900000000000003}]},{"osd":7,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.2629999999999999,"15min":1.462},"min":{"1min":0.35399999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":5.665,"5min":5.665,"15min":10.858000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.821,"5min":1.387,"15min":1.532},"min":{"1min":0.39300000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":5.8769999999999998,"5min":8.1389999999999993,"15min":9.1669999999999998},"last":0.80000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834580176,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6243532,"kb_used_data":4522884,"kb_used_omap":5594,"kb_used_meta":1715045,"kb_avail":88128308,"statfs":{"total":96636764160,"available":90243387392,"internally_reserved":0,"allocated":4631433216,"data_stored":4629103181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5728863,"internal_metadata":1756206497},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":59,"apply_latency_ms":59,"commit_latency_ns":59000000,"apply_latency_ns":59000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":1.5940000000000001,"15min":1.55},"min":{"1min":0.247,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":3.181,"5min":14.423999999999999,"15min":14.423999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":2.3109999999999999,"5min":1.9419999999999999,"15min":1.8480000000000001},"min":{"1min":0.26100000000000001,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":9.4510000000000005,"5min":10.057,"15min":10.569000000000001},"last":4.3239999999999998}]},{"osd":2,"last update":"Sun Oct 8 20:11:21 2023","interfaces":[{"interface":"back","average":{"1min":3.1739999999999999,"5min":2.3620000000000001,"15min":2.1099999999999999},"min":{"1min":0.32700000000000001,"5min":0.28100000000000003,"15min":0.252},"max":{"1min":13.077,"5min":13.077,"15min":13.077},"last":16.175000000000001},{"interface":"front","average":{"1min":1.321,"5min":1.929,"15min":1.748},"min":{"1min":0.315,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":4.8940000000000001,"5min":14.48,"15min":14.48},"last":5.125}]},{"osd":3,"last update":"Sun Oct 8 20:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.992,"15min":1.76},"min":{"1min":0.33200000000000002,"5min":0.314,"15min":0.29399999999999998},"max":{"1min":8.4570000000000007,"5min":14.521000000000001,"15min":14.521000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":2.133,"5min":1.8200000000000001,"15min":1.8640000000000001},"min":{"1min":0.39000000000000001,"5min":0.29799999999999999,"15min":0.29599999999999999},"max":{"1min":11.058999999999999,"5min":11.663,"15min":11.663},"last":8.7629999999999999}]},{"osd":4,"last update":"Sun Oct 8 20:11:21 2023","interfaces":[{"interface":"back","average":{"1min":2.0939999999999999,"5min":1.621,"15min":1.702},"min":{"1min":0.42399999999999999,"5min":0.35699999999999998,"15min":0.34899999999999998},"max":{"1min":9.3119999999999994,"5min":9.3119999999999994,"15min":10.265000000000001},"last":15.460000000000001},{"interface":"front","average":{"1min":2.0030000000000001,"5min":1.8140000000000001,"15min":1.8500000000000001},"min":{"1min":0.44900000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":6.8209999999999997,"5min":12.164999999999999,"15min":14.638999999999999},"last":7.6280000000000001}]},{"osd":5,"last update":"Sun Oct 8 20:11:21 2023","interfaces":[{"interface":"back","average":{"1min":2.1139999999999999,"5min":2.024,"15min":1.913},"min":{"1min":0.50600000000000001,"5min":0.38800000000000001,"15min":0.36899999999999999},"max":{"1min":6.7320000000000002,"5min":12.220000000000001,"15min":12.220000000000001},"last":7.5209999999999999},{"interface":"front","average":{"1min":1.6220000000000001,"5min":1.5369999999999999,"15min":1.569},"min":{"1min":0.39400000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":13.117000000000001,"5min":13.117000000000001,"15min":14.130000000000001},"last":0.76300000000000001}]},{"osd":6,"last update":"Sun Oct 8 20:11:21 2023","interfaces":[{"interface":"back","average":{"1min":2.4849999999999999,"5min":1.9490000000000001,"15min":1.9710000000000001},"min":{"1min":0.48699999999999999,"5min":0.375,"15min":0.375},"max":{"1min":9.3699999999999992,"5min":9.3699999999999992,"15min":10.470000000000001},"last":8.6839999999999993},{"interface":"front","average":{"1min":1.9570000000000001,"5min":2.0230000000000001,"15min":2.0569999999999999},"min":{"1min":0.54200000000000004,"5min":0.41799999999999998,"15min":0.41199999999999998},"max":{"1min":6.9509999999999996,"5min":12.256,"15min":12.256},"last":7.585}]},{"osd":7,"last update":"Sun Oct 8 20:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":1.6339999999999999,"15min":1.8999999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":4.8369999999999997,"5min":7.8360000000000003,"15min":58.698999999999998},"last":0.83599999999999997},{"interface":"front","average":{"1min":2.093,"5min":1.9890000000000001,"15min":2.2850000000000001},"min":{"1min":0.54200000000000004,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":9.4120000000000008,"5min":11.714,"15min":58.920999999999999},"last":8.8089999999999993}]}]},{"osd":0,"up_from":13,"seq":55834580197,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3829156,"kb_used_data":2114132,"kb_used_omap":1928,"kb_used_meta":1575543,"kb_avail":90542684,"statfs":{"total":96636764160,"available":92715708416,"internally_reserved":0,"allocated":2164871168,"data_stored":2163730382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1974368,"internal_metadata":1613356960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.5509999999999999,"15min":1.4239999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":6.0209999999999999,"5min":9.2059999999999995,"15min":11.839},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.6719999999999999,"5min":1.6990000000000001,"15min":1.696},"min":{"1min":0.26200000000000001,"5min":0.248,"15min":0.248},"max":{"1min":6.4489999999999998,"5min":12.513999999999999,"15min":12.513999999999999},"last":1.7629999999999999}]},{"osd":2,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.508,"15min":1.5860000000000001},"min":{"1min":0.28999999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":8.1050000000000004,"5min":10.564,"15min":11.311999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.821,"5min":1.7869999999999999,"15min":1.9159999999999999},"min":{"1min":0.30399999999999999,"5min":0.28299999999999997,"15min":0.26600000000000001},"max":{"1min":6.327,"5min":8.6829999999999998,"15min":11.891},"last":1.8120000000000001}]},{"osd":3,"last update":"Sun Oct 8 20:10:57 2023","interfaces":[{"interface":"back","average":{"1min":2.9159999999999999,"5min":2.3999999999999999,"15min":2.4089999999999998},"min":{"1min":0.33700000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":12.266,"5min":13.051,"15min":14.238},"last":6.8310000000000004},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.4199999999999999,"15min":1.663},"min":{"1min":0.38800000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":4.0999999999999996,"5min":7.484,"15min":14.106},"last":0.92100000000000004}]},{"osd":4,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.544,"15min":1.6990000000000001},"min":{"1min":0.38800000000000001,"5min":0.313,"15min":0.313},"max":{"1min":6.1779999999999999,"5min":7.6349999999999998,"15min":32.792999999999999},"last":1.8939999999999999},{"interface":"front","average":{"1min":2.3029999999999999,"5min":2.177,"15min":2.2799999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.34100000000000003},"max":{"1min":11.693,"5min":13.108000000000001,"15min":33.149000000000001},"last":6.9530000000000003}]},{"osd":5,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.292,"15min":1.335},"min":{"1min":0.43099999999999999,"5min":0.41199999999999998,"15min":0.35899999999999999},"max":{"1min":4.0599999999999996,"5min":6.484,"15min":8.8439999999999994},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.6830000000000001,"5min":1.7569999999999999,"15min":1.802},"min":{"1min":0.47699999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":6.2800000000000002,"5min":11.464,"15min":14.925000000000001},"last":1.853}]},{"osd":6,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":2.3090000000000002,"5min":2.5830000000000002,"15min":2.3250000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.40400000000000003},"max":{"1min":12.279999999999999,"5min":13.146000000000001,"15min":13.146000000000001},"last":6.9039999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.5820000000000001,"15min":1.544},"min":{"1min":0.48399999999999999,"5min":0.44500000000000001,"15min":0.41299999999999998},"max":{"1min":6.8680000000000003,"5min":7.6219999999999999,"15min":8.8200000000000003},"last":6.8680000000000003}]},{"osd":7,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":1.681,"5min":2.008,"15min":2.016},"min":{"1min":0.56699999999999995,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":6.2320000000000002,"5min":11.125,"15min":11.125},"last":1.7210000000000001},{"interface":"front","average":{"1min":2.3839999999999999,"5min":2.508,"15min":2.48},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.42299999999999999},"max":{"1min":12.909000000000001,"5min":13.183999999999999,"15min":13.183999999999999},"last":6.992}]}]},{"osd":2,"up_from":13,"seq":55834580188,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1798460,"kb_used_data":62896,"kb_used_omap":1956,"kb_used_meta":1733595,"kb_avail":92573380,"statfs":{"total":96636764160,"available":94795141120,"internally_reserved":0,"allocated":64405504,"data_stored":64137524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2003896,"internal_metadata":1775201352},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:19 2023","interfaces":[{"interface":"back","average":{"1min":1.899,"5min":1.673,"15min":1.4079999999999999},"min":{"1min":0.27600000000000002,"5min":0.26100000000000001,"15min":0.24299999999999999},"max":{"1min":12.449,"5min":12.449,"15min":13.276},"last":8.5150000000000006},{"interface":"front","average":{"1min":3.048,"5min":2.3300000000000001,"15min":2.1019999999999999},"min":{"1min":0.41899999999999998,"5min":0.26700000000000002,"15min":0.26000000000000001},"max":{"1min":10.916,"5min":10.916,"15min":12.536},"last":10.643000000000001}]},{"osd":1,"last update":"Sun Oct 8 20:11:19 2023","interfaces":[{"interface":"back","average":{"1min":1.6919999999999999,"5min":1.546,"15min":1.4299999999999999},"min":{"1min":0.32800000000000001,"5min":0.253,"15min":0.253},"max":{"1min":6.1360000000000001,"5min":7.2759999999999998,"15min":13.449999999999999},"last":8.5960000000000001},{"interface":"front","average":{"1min":1.9770000000000001,"5min":2.419,"15min":2.2090000000000001},"min":{"1min":0.32000000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":10.000999999999999,"5min":14.356999999999999,"15min":14.356999999999999},"last":10.722}]},{"osd":3,"last update":"Sun Oct 8 20:11:27 2023","interfaces":[{"interface":"back","average":{"1min":1.9630000000000001,"5min":2.2320000000000002,"15min":2.0139999999999998},"min":{"1min":0.32100000000000001,"5min":0.30599999999999999,"15min":0.29399999999999998},"max":{"1min":7.0910000000000002,"5min":13.281000000000001,"15min":13.281000000000001},"last":8.8089999999999993},{"interface":"front","average":{"1min":1.863,"5min":1.806,"15min":1.677},"min":{"1min":0.41699999999999998,"5min":0.34100000000000003,"15min":0.33900000000000002},"max":{"1min":6.21,"5min":9.7210000000000001,"15min":13.381},"last":8.6549999999999994}]},{"osd":4,"last update":"Sun Oct 8 20:11:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.5589999999999999,"15min":1.7110000000000001},"min":{"1min":0.42199999999999999,"5min":0.371,"15min":0.34699999999999998},"max":{"1min":6.0430000000000001,"5min":8.8629999999999995,"15min":47.850999999999999},"last":8.7400000000000002},{"interface":"front","average":{"1min":1.476,"5min":1.962,"15min":2.069},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.34499999999999997},"max":{"1min":9.9640000000000004,"5min":9.9640000000000004,"15min":47.712000000000003},"last":10.577}]},{"osd":5,"last update":"Sun Oct 8 20:11:19 2023","interfaces":[{"interface":"back","average":{"1min":2.4500000000000002,"5min":2.2000000000000002,"15min":2.0670000000000002},"min":{"1min":0.40999999999999998,"5min":0.40000000000000002,"15min":0.36899999999999999},"max":{"1min":7.7000000000000002,"5min":13.15,"15min":13.15},"last":11.303000000000001},{"interface":"front","average":{"1min":1.788,"5min":1.746,"15min":1.635},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":6.1699999999999999,"5min":8.9269999999999996,"15min":13.416},"last":10.821999999999999}]},{"osd":6,"last update":"Sun Oct 8 20:11:19 2023","interfaces":[{"interface":"back","average":{"1min":1.722,"5min":2.1419999999999999,"15min":2.089},"min":{"1min":0.439,"5min":0.42199999999999999,"15min":0.40100000000000002},"max":{"1min":9.9109999999999996,"5min":9.9109999999999996,"15min":10.101000000000001},"last":10.763999999999999},{"interface":"front","average":{"1min":3.1160000000000001,"5min":2.4940000000000002,"15min":2.2040000000000002},"min":{"1min":0.51200000000000001,"5min":0.45100000000000001,"15min":0.42499999999999999},"max":{"1min":7.2270000000000003,"5min":13.244999999999999,"15min":13.244999999999999},"last":11.351000000000001}]},{"osd":7,"last update":"Sun Oct 8 20:11:19 2023","interfaces":[{"interface":"back","average":{"1min":2.1600000000000001,"5min":2.3570000000000002,"15min":2.2200000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.438},"max":{"1min":9.8680000000000003,"5min":9.8680000000000003,"15min":11.173},"last":10.683999999999999},{"interface":"front","average":{"1min":3.1269999999999998,"5min":2.5739999999999998,"15min":2.2749999999999999},"min":{"1min":0.55800000000000005,"5min":0.45200000000000001,"15min":0.439},"max":{"1min":8.4429999999999996,"5min":13.207000000000001,"15min":13.207000000000001},"last":8.8559999999999999}]}]},{"osd":3,"up_from":13,"seq":55834580170,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4100476,"kb_used_data":2333476,"kb_used_omap":10612,"kb_used_meta":1690315,"kb_avail":90271364,"statfs":{"total":96636764160,"available":92437876736,"internally_reserved":0,"allocated":2389479424,"data_stored":2388273574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10867470,"internal_metadata":1730882802},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":63,"apply_latency_ms":63,"commit_latency_ns":63000000,"apply_latency_ns":63000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":3.1280000000000001,"5min":1.9450000000000001,"15min":1.6240000000000001},"min":{"1min":0.28000000000000003,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":17.279,"5min":17.279,"15min":17.279},"last":3.4239999999999999},{"interface":"front","average":{"1min":2.3849999999999998,"5min":1.8959999999999999,"15min":1.879},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.24399999999999999},"max":{"1min":8.8699999999999992,"5min":8.8699999999999992,"15min":9.6699999999999999},"last":4.2249999999999996}]},{"osd":1,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":8.452,"5min":3.3580000000000001,"15min":2.23},"min":{"1min":0.442,"5min":0.28599999999999998,"15min":0.24299999999999999},"max":{"1min":102.35299999999999,"5min":102.35299999999999,"15min":102.35299999999999},"last":4.5430000000000001},{"interface":"front","average":{"1min":9.2170000000000005,"5min":3.4580000000000002,"15min":2.2999999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.26100000000000001},"max":{"1min":102.66200000000001,"5min":102.66200000000001,"15min":102.66200000000001},"last":3.496}]},{"osd":2,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":2.3180000000000001,"5min":2.2530000000000001,"15min":2.2080000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.28699999999999998},"max":{"1min":8.0169999999999995,"5min":11.678000000000001,"15min":14.084},"last":4.7569999999999997},{"interface":"front","average":{"1min":3.1520000000000001,"5min":2.1960000000000002,"15min":2.024},"min":{"1min":0.36899999999999999,"5min":0.34300000000000003,"15min":0.315},"max":{"1min":17.184999999999999,"5min":17.184999999999999,"15min":17.184999999999999},"last":3.6099999999999999}]},{"osd":4,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":2.153,"5min":1.865,"15min":1.8009999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":13.007,"5min":13.007,"15min":13.007},"last":4.2939999999999996},{"interface":"front","average":{"1min":1.8140000000000001,"5min":1.9790000000000001,"15min":1.8129999999999999},"min":{"1min":0.443,"5min":0.372,"15min":0.33800000000000002},"max":{"1min":7.9409999999999998,"5min":11.074999999999999,"15min":11.074999999999999},"last":4.6130000000000004}]},{"osd":5,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":1.9339999999999999,"5min":2.117,"15min":1.9550000000000001},"min":{"1min":0.53200000000000003,"5min":0.41899999999999998,"15min":0.36599999999999999},"max":{"1min":7.8920000000000003,"5min":11.029,"15min":11.029},"last":4.7130000000000001},{"interface":"front","average":{"1min":2.9529999999999998,"5min":1.944,"15min":1.728},"min":{"1min":0.53100000000000003,"5min":0.36899999999999999,"15min":0.34100000000000003},"max":{"1min":17.315999999999999,"5min":17.315999999999999,"15min":17.315999999999999},"last":3.5750000000000002}]},{"osd":6,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":2.8969999999999998,"5min":2.2109999999999999,"15min":1.8109999999999999},"min":{"1min":0.57799999999999996,"5min":0.40600000000000003,"15min":0.38100000000000001},"max":{"1min":17.350000000000001,"5min":17.350000000000001,"15min":17.350000000000001},"last":3.5379999999999998},{"interface":"front","average":{"1min":2.4060000000000001,"5min":2.2080000000000002,"15min":2.1320000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":12.890000000000001,"5min":12.890000000000001,"15min":12.890000000000001},"last":4.3789999999999996}]},{"osd":7,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":2.6800000000000002,"5min":2.1019999999999999,"15min":2.097},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.42899999999999999},"max":{"1min":12.94,"5min":12.94,"15min":12.94},"last":4.3390000000000004},{"interface":"front","average":{"1min":2.0619999999999998,"5min":2.1720000000000002,"15min":2.125},"min":{"1min":0.57099999999999995,"5min":0.437,"15min":0.437},"max":{"1min":8.0899999999999999,"5min":11.111000000000001,"15min":11.111000000000001},"last":4.6619999999999999}]}]},{"osd":4,"up_from":13,"seq":55834580203,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1468248,"kb_used_data":562956,"kb_used_omap":7607,"kb_used_meta":860040,"kb_avail":92903592,"statfs":{"total":96636764160,"available":95133278208,"internally_reserved":0,"allocated":576466944,"data_stored":575983172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7789817,"internal_metadata":880681735},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":1.111,"15min":1.0620000000000001},"min":{"1min":0.25700000000000001,"5min":0.23499999999999999,"15min":0.22900000000000001},"max":{"1min":11.608000000000001,"5min":11.608000000000001,"15min":11.686999999999999},"last":1.4350000000000001},{"interface":"front","average":{"1min":2.2320000000000002,"5min":1.5760000000000001,"15min":1.7070000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.26100000000000001},"max":{"1min":8.5809999999999995,"5min":8.5809999999999995,"15min":48.774000000000001},"last":2.2149999999999999}]},{"osd":1,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":1.9470000000000001,"5min":1.806,"15min":1.879},"min":{"1min":0.40000000000000002,"5min":0.28599999999999998,"15min":0.27000000000000002},"max":{"1min":5.4870000000000001,"5min":10.792999999999999,"15min":10.792999999999999},"last":25.675000000000001},{"interface":"front","average":{"1min":1.472,"5min":1.3939999999999999,"15min":1.655},"min":{"1min":0.32500000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":5.4749999999999996,"5min":9.6029999999999998,"15min":10.807},"last":34.18}]},{"osd":2,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.2470000000000001,"15min":1.972},"min":{"1min":0.32600000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":5.7380000000000004,"5min":8.7370000000000001,"15min":48.911000000000001},"last":12.522},{"interface":"front","average":{"1min":2.48,"5min":2.3420000000000001,"15min":2.1080000000000001},"min":{"1min":0.49299999999999999,"5min":0.36899999999999999,"15min":0.29799999999999999},"max":{"1min":6.21,"5min":8.0299999999999994,"15min":8.0299999999999994},"last":2.2599999999999998}]},{"osd":3,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":1.8069999999999999,"15min":1.9790000000000001},"min":{"1min":0.38,"5min":0.34200000000000003,"15min":0.33100000000000002},"max":{"1min":3.0630000000000002,"5min":9.6910000000000007,"15min":10.584},"last":48.406999999999996},{"interface":"front","average":{"1min":2.0670000000000002,"5min":1.8879999999999999,"15min":2.198},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.33500000000000002},"max":{"1min":7.3570000000000002,"5min":15.992000000000001,"15min":48.990000000000002},"last":23.311}]},{"osd":5,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94799999999999995,"15min":1.1899999999999999},"min":{"1min":0.27700000000000002,"5min":0.27200000000000002,"15min":0.26800000000000002},"max":{"1min":5.2249999999999996,"5min":5.4459999999999997,"15min":8.9649999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.86199999999999999,"15min":1.0840000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.944,"5min":11.625,"15min":11.625},"last":0.93100000000000005}]},{"osd":6,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.81299999999999994,"15min":1.05},"min":{"1min":0.33700000000000002,"5min":0.32500000000000001,"15min":0.29699999999999999},"max":{"1min":2.1379999999999999,"5min":5.5670000000000002,"15min":11.917},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.137,"15min":1.381},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":5.2670000000000003,"5min":5.7759999999999998,"15min":13.375},"last":1.002}]},{"osd":7,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.92500000000000004,"15min":1.1990000000000001},"min":{"1min":0.36099999999999999,"5min":0.33700000000000002,"15min":0.308},"max":{"1min":2.4020000000000001,"5min":5.4800000000000004,"15min":13.554},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.02,"15min":1.135},"min":{"1min":0.38800000000000001,"5min":0.36699999999999999,"15min":0.36099999999999999},"max":{"1min":6.1580000000000004,"5min":10.102,"15min":12.154},"last":0.98099999999999998}]}]},{"osd":5,"up_from":13,"seq":55834580206,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3302968,"kb_used_data":2382900,"kb_used_omap":4903,"kb_used_meta":839448,"kb_avail":91068872,"statfs":{"total":96636764160,"available":93254524928,"internally_reserved":0,"allocated":2440089600,"data_stored":2438869904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5021207,"internal_metadata":859595241},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":1.0329999999999999,"15min":1.1020000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.22900000000000001},"max":{"1min":1.1879999999999999,"5min":5.4340000000000002,"15min":12.48},"last":9.4610000000000003},{"interface":"front","average":{"1min":0.46899999999999997,"5min":1.363,"15min":1.365},"min":{"1min":0.33100000000000002,"5min":0.26300000000000001,"15min":0.251},"max":{"1min":1.2130000000000001,"5min":9.5899999999999999,"15min":9.5899999999999999},"last":0.84399999999999997}]},{"osd":1,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.4730000000000001,"15min":1.544},"min":{"1min":0.34100000000000003,"5min":0.25600000000000001,"15min":0.245},"max":{"1min":5.5659999999999998,"5min":6.7400000000000002,"15min":7.5590000000000002},"last":0.53600000000000003},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.744,"15min":1.8169999999999999},"min":{"1min":0.313,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":3.8599999999999999,"5min":9.8010000000000002,"15min":14.989000000000001},"last":14.522}]},{"osd":2,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":1.9970000000000001,"15min":1.921},"min":{"1min":0.373,"5min":0.31,"15min":0.27100000000000002},"max":{"1min":3.1019999999999999,"5min":14.433999999999999,"15min":14.433999999999999},"last":9.3659999999999997},{"interface":"front","average":{"1min":1.1439999999999999,"5min":2.0489999999999999,"15min":2.1280000000000001},"min":{"1min":0.375,"5min":0.33600000000000002,"15min":0.28399999999999997},"max":{"1min":3.7989999999999999,"5min":12.173,"15min":12.173},"last":2.0569999999999999}]},{"osd":3,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":2.048,"15min":2.246},"min":{"1min":0.36899999999999999,"5min":0.33500000000000002,"15min":0.33000000000000002},"max":{"1min":3.9929999999999999,"5min":6.1879999999999997,"15min":14.935},"last":19.402999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.996,"15min":2.3359999999999999},"min":{"1min":0.45300000000000001,"5min":0.36299999999999999,"15min":0.32000000000000001},"max":{"1min":4.423,"5min":9.6530000000000005,"15min":10.862},"last":3.9790000000000001}]},{"osd":4,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.872,"15min":1.161},"min":{"1min":0.27600000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.95799999999999996,"5min":5.8659999999999997,"15min":10.701000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.84199999999999997,"15min":1.202},"min":{"1min":0.313,"5min":0.28899999999999998,"15min":0.28699999999999998},"max":{"1min":0.65200000000000002,"5min":6.2389999999999999,"15min":12.531000000000001},"last":3.4950000000000001}]},{"osd":6,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":1.131,"15min":1.329},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.28299999999999997},"max":{"1min":3.7320000000000002,"5min":9.5410000000000004,"15min":12.426},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":1.141,"15min":1.355},"min":{"1min":0.36399999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.75,"5min":6.9409999999999998,"15min":9.3320000000000007},"last":0.495}]},{"osd":7,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.83499999999999996,"15min":1.3300000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":3.3140000000000001,"5min":3.9020000000000001,"15min":15.071},"last":3.5419999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":1.0980000000000001,"15min":1.3839999999999999},"min":{"1min":0.376,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":3.4300000000000002,"5min":10.34,"15min":10.804},"last":2.1080000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T20:12:00.465 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T20:12:00.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.603+0000 7f53cea77700 1 -- 172.21.15.45:0/3465354817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53c80c9ff0 msgr2=0x7f53c80ca480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:00.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.603+0000 7f53cea77700 1 --2- 172.21.15.45:0/3465354817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53c80c9ff0 0x7f53c80ca480 secure :-1 s=READY pgs=3282 cs=0 l=1 rev1=1 crypto rx=0x7f53c0005fd0 tx=0x7f53c0009c70 comp rx=0 tx=0).stop 2023-10-08T20:12:00.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.603+0000 7f53cea77700 1 -- 172.21.15.45:0/3465354817 shutdown_connections 2023-10-08T20:12:00.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.603+0000 7f53cea77700 1 --2- 172.21.15.45:0/3465354817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53c80c9ff0 0x7f53c80ca480 unknown :-1 s=CLOSED pgs=3282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:00.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.603+0000 7f53cea77700 1 --2- 172.21.15.45:0/3465354817 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f53c80cdf60 0x7f53c815c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:00.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.603+0000 7f53cea77700 1 -- 172.21.15.45:0/3465354817 >> 172.21.15.45:0/3465354817 conn(0x7f53c80b0430 msgr2=0x7f53c80b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:00.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.603+0000 7f53cea77700 1 -- 172.21.15.45:0/3465354817 shutdown_connections 2023-10-08T20:12:00.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.603+0000 7f53cea77700 1 -- 172.21.15.45:0/3465354817 wait complete. 2023-10-08T20:12:00.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.604+0000 7f53cea77700 1 Processor -- start 2023-10-08T20:12:00.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.604+0000 7f53cea77700 1 -- start start 2023-10-08T20:12:00.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.605+0000 7f53cea77700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f53c80c9ff0 0x7f53c80c7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:00.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.605+0000 7f53cea77700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53c80cdf60 0x7f53c81e4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:00.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.605+0000 7f53cea77700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53c8158950 0x7f53c8156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:00.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.605+0000 7f53cea77700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c80ad3f0 con 0x7f53c8158950 2023-10-08T20:12:00.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.605+0000 7f53cea77700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c80c5930 con 0x7f53c80cdf60 2023-10-08T20:12:00.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.605+0000 7f53cea77700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c80c7d90 con 0x7f53c80c9ff0 2023-10-08T20:12:00.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.605+0000 7f53cd014700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53c8158950 0x7f53c8156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:00.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.605+0000 7f53cd014700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53c8158950 0x7f53c8156930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51554/0 (socket says 172.21.15.45:51554) 2023-10-08T20:12:00.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.605+0000 7f53cd014700 1 -- 172.21.15.45:0/2092836267 learned_addr learned my addr 172.21.15.45:0/2092836267 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:12:00.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.605+0000 7f53cc813700 1 --2- 172.21.15.45:0/2092836267 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f53c80c9ff0 0x7f53c80c7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:00.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.605+0000 7f53c7fff700 1 --2- 172.21.15.45:0/2092836267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53c80cdf60 0x7f53c81e4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:00.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.605+0000 7f53cd014700 1 -- 172.21.15.45:0/2092836267 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f53c80c9ff0 msgr2=0x7f53c80c7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:00.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.605+0000 7f53cd014700 1 --2- 172.21.15.45:0/2092836267 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f53c80c9ff0 0x7f53c80c7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:00.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.605+0000 7f53cd014700 1 -- 172.21.15.45:0/2092836267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53c80cdf60 msgr2=0x7f53c81e4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:00.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.605+0000 7f53cd014700 1 --2- 172.21.15.45:0/2092836267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53c80cdf60 0x7f53c81e4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:00.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.605+0000 7f53cd014700 1 -- 172.21.15.45:0/2092836267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c00095f0 con 0x7f53c8158950 2023-10-08T20:12:00.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.606+0000 7f53cd014700 1 --2- 172.21.15.45:0/2092836267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53c8158950 0x7f53c8156930 secure :-1 s=READY pgs=3283 cs=0 l=1 rev1=1 crypto rx=0x7f53c000b540 tx=0x7f53c0004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:00.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.606+0000 7f53c57fa700 1 -- 172.21.15.45:0/2092836267 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c001d070 con 0x7f53c8158950 2023-10-08T20:12:00.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.606+0000 7f53c57fa700 1 -- 172.21.15.45:0/2092836267 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f53c0003890 con 0x7f53c8158950 2023-10-08T20:12:00.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.606+0000 7f53cea77700 1 -- 172.21.15.45:0/2092836267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c80c8070 con 0x7f53c8158950 2023-10-08T20:12:00.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.606+0000 7f53c57fa700 1 -- 172.21.15.45:0/2092836267 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c00045f0 con 0x7f53c8158950 2023-10-08T20:12:00.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.606+0000 7f53cea77700 1 -- 172.21.15.45:0/2092836267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c80c5e60 con 0x7f53c8158950 2023-10-08T20:12:00.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.607+0000 7f53cea77700 1 -- 172.21.15.45:0/2092836267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c804e4c0 con 0x7f53c8158950 2023-10-08T20:12:00.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.607+0000 7f53c57fa700 1 -- 172.21.15.45:0/2092836267 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f53c0003cc0 con 0x7f53c8158950 2023-10-08T20:12:00.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.608+0000 7f53c57fa700 1 --2- 172.21.15.45:0/2092836267 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f53a806aed0 0x7f53a806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:00.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.608+0000 7f53c57fa700 1 -- 172.21.15.45:0/2092836267 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f53c008a990 con 0x7f53c8158950 2023-10-08T20:12:00.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.608+0000 7f53cc813700 1 --2- 172.21.15.45:0/2092836267 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f53a806aed0 0x7f53a806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:00.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.609+0000 7f53cc813700 1 --2- 172.21.15.45:0/2092836267 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f53a806aed0 0x7f53a806d390 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f53b0007fd0 tx=0x7f53b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:00.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.613+0000 7f53c57fa700 1 -- 172.21.15.45:0/2092836267 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f53c0055d50 con 0x7f53c8158950 2023-10-08T20:12:00.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.826+0000 7f53cea77700 1 -- 172.21.15.45:0/2092836267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53c80b12a0 con 0x7f53c8158950 2023-10-08T20:12:00.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.828+0000 7f53c57fa700 1 -- 172.21.15.45:0/2092836267 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+12936 (secure 0 0 0) 0x7f53c0059370 con 0x7f53c8158950 2023-10-08T20:12:00.828 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:12:00.828 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":36,"fsid":"3c5c3516-8181-4382-8205-f21bea7ad4b3","created":"2023-10-08T12:45:07.436892+0000","modified":"2023-10-08T20:11:53.485239+0000","last_up_change":"2023-10-08T12:45:18.622542+0000","last_in_change":"2023-10-08T12:45:11.214453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:45:19.183651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5289f854-c23d-4d4f-b4b1-cccefadf2d4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6817","nonce":2931618923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6819","nonce":2931618923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6823","nonce":2931618923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2931618923},{"type":"v1","addr":"172.21.15.45:6821","nonce":2931618923}]},"public_addr":"172.21.15.45:6817/2931618923","cluster_addr":"172.21.15.45:6819/2931618923","heartbeat_back_addr":"172.21.15.45:6823/2931618923","heartbeat_front_addr":"172.21.15.45:6821/2931618923","state":["exists","up"]},{"osd":1,"uuid":"44e45b02-1124-4bbc-9cd8-d0d95a49f149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6801","nonce":4238026647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6803","nonce":4238026647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6807","nonce":4238026647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4238026647},{"type":"v1","addr":"172.21.15.45:6805","nonce":4238026647}]},"public_addr":"172.21.15.45:6801/4238026647","cluster_addr":"172.21.15.45:6803/4238026647","heartbeat_back_addr":"172.21.15.45:6807/4238026647","heartbeat_front_addr":"172.21.15.45:6805/4238026647","state":["exists","up"]},{"osd":2,"uuid":"f4cac31c-3d7a-4373-b960-fa26a27918e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6809","nonce":3709844603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6811","nonce":3709844603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6815","nonce":3709844603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3709844603},{"type":"v1","addr":"172.21.15.45:6813","nonce":3709844603}]},"public_addr":"172.21.15.45:6809/3709844603","cluster_addr":"172.21.15.45:6811/3709844603","heartbeat_back_addr":"172.21.15.45:6815/3709844603","heartbeat_front_addr":"172.21.15.45:6813/3709844603","state":["exists","up"]},{"osd":3,"uuid":"dfb35345-e091-4243-99ac-68d724d637a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6825","nonce":2255775238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6827","nonce":2255775238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6831","nonce":2255775238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":2255775238},{"type":"v1","addr":"172.21.15.45:6829","nonce":2255775238}]},"public_addr":"172.21.15.45:6825/2255775238","cluster_addr":"172.21.15.45:6827/2255775238","heartbeat_back_addr":"172.21.15.45:6831/2255775238","heartbeat_front_addr":"172.21.15.45:6829/2255775238","state":["exists","up"]},{"osd":4,"uuid":"93d5b66a-f53b-4d06-aebc-62971b279ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6801","nonce":1354746290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6803","nonce":1354746290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6807","nonce":1354746290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1354746290},{"type":"v1","addr":"172.21.15.78:6805","nonce":1354746290}]},"public_addr":"172.21.15.78:6801/1354746290","cluster_addr":"172.21.15.78:6803/1354746290","heartbeat_back_addr":"172.21.15.78:6807/1354746290","heartbeat_front_addr":"172.21.15.78:6805/1354746290","state":["exists","up"]},{"osd":5,"uuid":"a8533314-3df2-48fa-878d-8b889893625b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6825","nonce":1101719457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6827","nonce":1101719457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6831","nonce":1101719457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1101719457},{"type":"v1","addr":"172.21.15.78:6829","nonce":1101719457}]},"public_addr":"172.21.15.78:6825/1101719457","cluster_addr":"172.21.15.78:6827/1101719457","heartbeat_back_addr":"172.21.15.78:6831/1101719457","heartbeat_front_addr":"172.21.15.78:6829/1101719457","state":["exists","up"]},{"osd":6,"uuid":"d1f5a82f-4b2d-4102-99a7-cb66a0ea8286","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6810","nonce":162875330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6813","nonce":162875330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6821","nonce":162875330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6815","nonce":162875330},{"type":"v1","addr":"172.21.15.78:6817","nonce":162875330}]},"public_addr":"172.21.15.78:6810/162875330","cluster_addr":"172.21.15.78:6813/162875330","heartbeat_back_addr":"172.21.15.78:6821/162875330","heartbeat_front_addr":"172.21.15.78:6817/162875330","state":["exists","up"]},{"osd":7,"uuid":"1f5d41b2-6c06-44b0-992b-74e9911b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6811","nonce":3188968439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6816","nonce":3188968439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6823","nonce":3188968439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3188968439},{"type":"v1","addr":"172.21.15.78:6820","nonce":3188968439}]},"public_addr":"172.21.15.78:6811/3188968439","cluster_addr":"172.21.15.78:6816/3188968439","heartbeat_back_addr":"172.21.15.78:6823/3188968439","heartbeat_front_addr":"172.21.15.78:6820/3188968439","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.412453+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.351925+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.428025+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.437246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.441119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.388608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.415524+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:45:16.401835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6834/328442803":"2023-10-09T20:11:50.285606+0000","172.21.15.45:6832/328442803":"2023-10-09T20:11:50.285606+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T20:12:00.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.830+0000 7f53cea77700 1 -- 172.21.15.45:0/2092836267 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f53a806aed0 msgr2=0x7f53a806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:00.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.830+0000 7f53cea77700 1 --2- 172.21.15.45:0/2092836267 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f53a806aed0 0x7f53a806d390 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f53b0007fd0 tx=0x7f53b0009040 comp rx=0 tx=0).stop 2023-10-08T20:12:00.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.830+0000 7f53cea77700 1 -- 172.21.15.45:0/2092836267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53c8158950 msgr2=0x7f53c8156930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:00.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.830+0000 7f53cea77700 1 --2- 172.21.15.45:0/2092836267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53c8158950 0x7f53c8156930 secure :-1 s=READY pgs=3283 cs=0 l=1 rev1=1 crypto rx=0x7f53c000b540 tx=0x7f53c0004260 comp rx=0 tx=0).stop 2023-10-08T20:12:00.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.830+0000 7f53cea77700 1 -- 172.21.15.45:0/2092836267 shutdown_connections 2023-10-08T20:12:00.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.830+0000 7f53cea77700 1 --2- 172.21.15.45:0/2092836267 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f53a806aed0 0x7f53a806d390 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:00.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.830+0000 7f53cea77700 1 --2- 172.21.15.45:0/2092836267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53c8158950 0x7f53c8156930 unknown :-1 s=CLOSED pgs=3283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:00.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.830+0000 7f53cea77700 1 --2- 172.21.15.45:0/2092836267 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f53c80c9ff0 0x7f53c80c7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:00.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.830+0000 7f53cea77700 1 --2- 172.21.15.45:0/2092836267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53c80cdf60 0x7f53c81e4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:00.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.830+0000 7f53cea77700 1 -- 172.21.15.45:0/2092836267 >> 172.21.15.45:0/2092836267 conn(0x7f53c80b0430 msgr2=0x7f53c80b1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:00.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.830+0000 7f53cea77700 1 -- 172.21.15.45:0/2092836267 shutdown_connections 2023-10-08T20:12:00.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:00.830+0000 7f53cea77700 1 -- 172.21.15.45:0/2092836267 wait complete. 2023-10-08T20:12:01.845 INFO:tasks.ceph:Scrubbing osd.0 2023-10-08T20:12:01.846 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-08T20:12:01.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.988+0000 7ff6bad2d700 1 -- 172.21.15.45:0/2929701595 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6b406e740 msgr2=0x7ff6b40ab950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:01.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.988+0000 7ff6bad2d700 1 --2- 172.21.15.45:0/2929701595 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6b406e740 0x7ff6b40ab950 secure :-1 s=READY pgs=3284 cs=0 l=1 rev1=1 crypto rx=0x7ff6b40cf760 tx=0x7ff6ac00b380 comp rx=0 tx=0).stop 2023-10-08T20:12:01.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.988+0000 7ff6bad2d700 1 -- 172.21.15.45:0/2929701595 shutdown_connections 2023-10-08T20:12:01.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.988+0000 7ff6bad2d700 1 --2- 172.21.15.45:0/2929701595 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6b406e740 0x7ff6b40ab950 unknown :-1 s=CLOSED pgs=3284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:01.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.988+0000 7ff6bad2d700 1 --2- 172.21.15.45:0/2929701595 >> v2:172.21.15.78:3300/0 conn(0x7ff6b40cd1c0 0x7ff6b406e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:01.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.988+0000 7ff6bad2d700 1 -- 172.21.15.45:0/2929701595 >> 172.21.15.45:0/2929701595 conn(0x7ff6b4097a20 msgr2=0x7ff6b40ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:01.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.988+0000 7ff6bad2d700 1 -- 172.21.15.45:0/2929701595 shutdown_connections 2023-10-08T20:12:01.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.988+0000 7ff6bad2d700 1 -- 172.21.15.45:0/2929701595 wait complete. 2023-10-08T20:12:01.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.989+0000 7ff6bad2d700 1 Processor -- start 2023-10-08T20:12:01.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.989+0000 7ff6bad2d700 1 -- start start 2023-10-08T20:12:01.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.990+0000 7ff6bad2d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6b406e740 0x7ff6b40c1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:01.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.990+0000 7ff6bad2d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff6b40cd1c0 0x7ff6b406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:01.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.990+0000 7ff6bad2d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6b4158a00 0x7ff6b40c3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:01.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.990+0000 7ff6bad2d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b40c31e0 con 0x7ff6b4158a00 2023-10-08T20:12:01.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.990+0000 7ff6bad2d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b40c25d0 con 0x7ff6b406e740 2023-10-08T20:12:01.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.990+0000 7ff6bad2d700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b40c28b0 con 0x7ff6b40cd1c0 2023-10-08T20:12:01.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.990+0000 7ff6b92ca700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6b4158a00 0x7ff6b40c3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:01.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.990+0000 7ff6b92ca700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6b4158a00 0x7ff6b40c3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51568/0 (socket says 172.21.15.45:51568) 2023-10-08T20:12:01.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.990+0000 7ff6b92ca700 1 -- 172.21.15.45:0/2772826411 learned_addr learned my addr 172.21.15.45:0/2772826411 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:12:01.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.991+0000 7ff6b8ac9700 1 --2- 172.21.15.45:0/2772826411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6b406e740 0x7ff6b40c1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:01.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.991+0000 7ff6abfff700 1 --2- 172.21.15.45:0/2772826411 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff6b40cd1c0 0x7ff6b406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:01.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.991+0000 7ff6b92ca700 1 -- 172.21.15.45:0/2772826411 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff6b40cd1c0 msgr2=0x7ff6b406a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:01.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.991+0000 7ff6b92ca700 1 --2- 172.21.15.45:0/2772826411 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff6b40cd1c0 0x7ff6b406a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:01.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.991+0000 7ff6b92ca700 1 -- 172.21.15.45:0/2772826411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6b406e740 msgr2=0x7ff6b40c1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:01.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.991+0000 7ff6b92ca700 1 --2- 172.21.15.45:0/2772826411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6b406e740 0x7ff6b40c1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:01.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.991+0000 7ff6b92ca700 1 -- 172.21.15.45:0/2772826411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ac009d00 con 0x7ff6b4158a00 2023-10-08T20:12:01.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.991+0000 7ff6b8ac9700 1 --2- 172.21.15.45:0/2772826411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6b406e740 0x7ff6b40c1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T20:12:01.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.991+0000 7ff6abfff700 1 --2- 172.21.15.45:0/2772826411 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff6b40cd1c0 0x7ff6b406a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T20:12:01.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.991+0000 7ff6b92ca700 1 --2- 172.21.15.45:0/2772826411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6b4158a00 0x7ff6b40c3670 secure :-1 s=READY pgs=3285 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac009fd0 tx=0x7ff6ac007c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:01.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.991+0000 7ff6a97fa700 1 -- 172.21.15.45:0/2772826411 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac00e040 con 0x7ff6b4158a00 2023-10-08T20:12:01.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.991+0000 7ff6a97fa700 1 -- 172.21.15.45:0/2772826411 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff6ac01d890 con 0x7ff6b4158a00 2023-10-08T20:12:01.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.991+0000 7ff6bad2d700 1 -- 172.21.15.45:0/2772826411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b40c2b90 con 0x7ff6b4158a00 2023-10-08T20:12:01.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.991+0000 7ff6a97fa700 1 -- 172.21.15.45:0/2772826411 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac01dca0 con 0x7ff6b4158a00 2023-10-08T20:12:01.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.991+0000 7ff6bad2d700 1 -- 172.21.15.45:0/2772826411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b40c2230 con 0x7ff6b4158a00 2023-10-08T20:12:01.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.992+0000 7ff6bad2d700 1 -- 172.21.15.45:0/2772826411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff6b409c710 con 0x7ff6b4158a00 2023-10-08T20:12:01.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.993+0000 7ff6a97fa700 1 -- 172.21.15.45:0/2772826411 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff6ac01b450 con 0x7ff6b4158a00 2023-10-08T20:12:01.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.993+0000 7ff6a97fa700 1 --2- 172.21.15.45:0/2772826411 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7ff6a006aed0 0x7ff6a006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:01.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.993+0000 7ff6a97fa700 1 -- 172.21.15.45:0/2772826411 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff6ac08b560 con 0x7ff6b4158a00 2023-10-08T20:12:01.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.994+0000 7ff6a97fa700 1 --2- 172.21.15.45:0/2772826411 >> [v2:172.21.15.45:6816/2931618923,v1:172.21.15.45:6817/2931618923] conn(0x7ff6a0070d30 0x7ff6a0073150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:01.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.994+0000 7ff6a97fa700 1 -- 172.21.15.45:0/2772826411 --> [v2:172.21.15.45:6816/2931618923,v1:172.21.15.45:6817/2931618923] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff6a0073820 con 0x7ff6a0070d30 2023-10-08T20:12:01.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.994+0000 7ff6a97fa700 1 -- 172.21.15.45:0/2772826411 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6ac08db40 con 0x7ff6b4158a00 2023-10-08T20:12:01.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.994+0000 7ff6b8ac9700 1 --2- 172.21.15.45:0/2772826411 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7ff6a006aed0 0x7ff6a006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:01.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.994+0000 7ff6abfff700 1 --2- 172.21.15.45:0/2772826411 >> [v2:172.21.15.45:6816/2931618923,v1:172.21.15.45:6817/2931618923] conn(0x7ff6a0070d30 0x7ff6a0073150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:01.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.994+0000 7ff6b8ac9700 1 --2- 172.21.15.45:0/2772826411 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7ff6a006aed0 0x7ff6a006d390 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0000f60 tx=0x7ff6b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:01.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.994+0000 7ff6abfff700 1 --2- 172.21.15.45:0/2772826411 >> [v2:172.21.15.45:6816/2931618923,v1:172.21.15.45:6817/2931618923] conn(0x7ff6a0070d30 0x7ff6a0073150 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:01.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:01.995+0000 7ff6a97fa700 1 -- 172.21.15.45:0/2772826411 <== osd.0 v2:172.21.15.45:6816/2931618923 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7ff6a0073820 con 0x7ff6a0070d30 2023-10-08T20:12:02.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.010+0000 7ff6bad2d700 1 -- 172.21.15.45:0/2772826411 --> [v2:172.21.15.45:6816/2931618923,v1:172.21.15.45:6817/2931618923] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff6b40c23c0 con 0x7ff6a0070d30 2023-10-08T20:12:02.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.030+0000 7ff6a97fa700 1 -- 172.21.15.45:0/2772826411 <== osd.0 v2:172.21.15.45:6816/2931618923 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff6b40c23c0 con 0x7ff6a0070d30 2023-10-08T20:12:02.031 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-08T20:12:02.031 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-10-08T20:12:02.032 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-08T20:12:02.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.031+0000 7ff6bad2d700 1 -- 172.21.15.45:0/2772826411 >> [v2:172.21.15.45:6816/2931618923,v1:172.21.15.45:6817/2931618923] conn(0x7ff6a0070d30 msgr2=0x7ff6a0073150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:02.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.031+0000 7ff6bad2d700 1 --2- 172.21.15.45:0/2772826411 >> [v2:172.21.15.45:6816/2931618923,v1:172.21.15.45:6817/2931618923] conn(0x7ff6a0070d30 0x7ff6a0073150 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:02.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.031+0000 7ff6bad2d700 1 -- 172.21.15.45:0/2772826411 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7ff6a006aed0 msgr2=0x7ff6a006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:02.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.031+0000 7ff6bad2d700 1 --2- 172.21.15.45:0/2772826411 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7ff6a006aed0 0x7ff6a006d390 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0000f60 tx=0x7ff6b0009040 comp rx=0 tx=0).stop 2023-10-08T20:12:02.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.031+0000 7ff6bad2d700 1 -- 172.21.15.45:0/2772826411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6b4158a00 msgr2=0x7ff6b40c3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:02.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.031+0000 7ff6bad2d700 1 --2- 172.21.15.45:0/2772826411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6b4158a00 0x7ff6b40c3670 secure :-1 s=READY pgs=3285 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac009fd0 tx=0x7ff6ac007c10 comp rx=0 tx=0).stop 2023-10-08T20:12:02.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.031+0000 7ff6b92ca700 1 -- 172.21.15.45:0/2772826411 reap_dead start 2023-10-08T20:12:02.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.031+0000 7ff6bad2d700 1 -- 172.21.15.45:0/2772826411 shutdown_connections 2023-10-08T20:12:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.031+0000 7ff6bad2d700 1 -- 172.21.15.45:0/2772826411 >> 172.21.15.45:0/2772826411 conn(0x7ff6b4097a20 msgr2=0x7ff6b415a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.031+0000 7ff6bad2d700 1 -- 172.21.15.45:0/2772826411 shutdown_connections 2023-10-08T20:12:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.031+0000 7ff6bad2d700 1 -- 172.21.15.45:0/2772826411 wait complete. 2023-10-08T20:12:02.045 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-08T20:12:02.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.184+0000 7f4870c9c700 1 -- 172.21.15.45:0/1300998480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f486c0b3fb0 msgr2=0x7f486c0b4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:02.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.184+0000 7f4870c9c700 1 --2- 172.21.15.45:0/1300998480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f486c0b3fb0 0x7f486c0b4410 secure :-1 s=READY pgs=3286 cs=0 l=1 rev1=1 crypto rx=0x7f486c070450 tx=0x7f4854009c70 comp rx=0 tx=0).stop 2023-10-08T20:12:02.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.184+0000 7f4870c9c700 1 -- 172.21.15.45:0/1300998480 shutdown_connections 2023-10-08T20:12:02.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.184+0000 7f4870c9c700 1 --2- 172.21.15.45:0/1300998480 >> v2:172.21.15.78:3300/0 conn(0x7f486c06a210 0x7f486c06a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:02.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.184+0000 7f4870c9c700 1 --2- 172.21.15.45:0/1300998480 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f486c159960 0x7f486c0b1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:02.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.184+0000 7f4870c9c700 1 --2- 172.21.15.45:0/1300998480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f486c0b3fb0 0x7f486c0b4410 unknown :-1 s=CLOSED pgs=3286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:02.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.184+0000 7f4870c9c700 1 -- 172.21.15.45:0/1300998480 >> 172.21.15.45:0/1300998480 conn(0x7f486c0b0430 msgr2=0x7f486c0b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:02.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.184+0000 7f4870c9c700 1 -- 172.21.15.45:0/1300998480 shutdown_connections 2023-10-08T20:12:02.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.184+0000 7f4870c9c700 1 -- 172.21.15.45:0/1300998480 wait complete. 2023-10-08T20:12:02.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.186+0000 7f4870c9c700 1 Processor -- start 2023-10-08T20:12:02.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.186+0000 7f4870c9c700 1 -- start start 2023-10-08T20:12:02.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.186+0000 7f4870c9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f486c06a210 0x7f486c157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:02.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.186+0000 7f4870c9c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f486c0b3fb0 0x7f486c145380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:02.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.186+0000 7f4870c9c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f486c159960 0x7f486c1428c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:02.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.186+0000 7f4870c9c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486c1458c0 con 0x7f486c06a210 2023-10-08T20:12:02.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.186+0000 7f4870c9c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486c15b130 con 0x7f486c0b3fb0 2023-10-08T20:12:02.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.186+0000 7f4870c9c700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f486c142e00 con 0x7f486c159960 2023-10-08T20:12:02.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.187+0000 7f486a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f486c06a210 0x7f486c157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:02.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.187+0000 7f486a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f486c06a210 0x7f486c157af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51578/0 (socket says 172.21.15.45:51578) 2023-10-08T20:12:02.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.187+0000 7f486a59c700 1 -- 172.21.15.45:0/2934345800 learned_addr learned my addr 172.21.15.45:0/2934345800 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:12:02.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.187+0000 7f4869d9b700 1 --2- 172.21.15.45:0/2934345800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f486c0b3fb0 0x7f486c145380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:02.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.187+0000 7f486ad9d700 1 --2- 172.21.15.45:0/2934345800 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f486c159960 0x7f486c1428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:02.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.187+0000 7f486a59c700 1 -- 172.21.15.45:0/2934345800 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f486c159960 msgr2=0x7f486c1428c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:02.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.187+0000 7f486a59c700 1 --2- 172.21.15.45:0/2934345800 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f486c159960 0x7f486c1428c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:02.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.187+0000 7f486a59c700 1 -- 172.21.15.45:0/2934345800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f486c0b3fb0 msgr2=0x7f486c145380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:02.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.187+0000 7f486a59c700 1 --2- 172.21.15.45:0/2934345800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f486c0b3fb0 0x7f486c145380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:02.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.187+0000 7f486a59c700 1 -- 172.21.15.45:0/2934345800 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48540095f0 con 0x7f486c06a210 2023-10-08T20:12:02.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.187+0000 7f4869d9b700 1 --2- 172.21.15.45:0/2934345800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f486c0b3fb0 0x7f486c145380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T20:12:02.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.187+0000 7f486a59c700 1 --2- 172.21.15.45:0/2934345800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f486c06a210 0x7f486c157af0 secure :-1 s=READY pgs=3287 cs=0 l=1 rev1=1 crypto rx=0x7f485c00c9a0 tx=0x7f485c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:02.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.187+0000 7f4862ffd700 1 -- 172.21.15.45:0/2934345800 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485c007ac0 con 0x7f486c06a210 2023-10-08T20:12:02.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.187+0000 7f4862ffd700 1 -- 172.21.15.45:0/2934345800 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f485c007d10 con 0x7f486c06a210 2023-10-08T20:12:02.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.187+0000 7f4870c9c700 1 -- 172.21.15.45:0/2934345800 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f486c159f50 con 0x7f486c06a210 2023-10-08T20:12:02.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.187+0000 7f4862ffd700 1 -- 172.21.15.45:0/2934345800 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485c004a90 con 0x7f486c06a210 2023-10-08T20:12:02.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.187+0000 7f4870c9c700 1 -- 172.21.15.45:0/2934345800 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f486c15b380 con 0x7f486c06a210 2023-10-08T20:12:02.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.188+0000 7f4870c9c700 1 -- 172.21.15.45:0/2934345800 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f486c04e4c0 con 0x7f486c06a210 2023-10-08T20:12:02.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.189+0000 7f4862ffd700 1 -- 172.21.15.45:0/2934345800 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f485c004bf0 con 0x7f486c06a210 2023-10-08T20:12:02.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.189+0000 7f4862ffd700 1 --2- 172.21.15.45:0/2934345800 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f484c06aed0 0x7f484c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:02.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.189+0000 7f4862ffd700 1 -- 172.21.15.45:0/2934345800 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f485c0894e0 con 0x7f486c06a210 2023-10-08T20:12:02.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.190+0000 7f4869d9b700 1 --2- 172.21.15.45:0/2934345800 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f484c06aed0 0x7f484c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:02.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.190+0000 7f4869d9b700 1 --2- 172.21.15.45:0/2934345800 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f484c06aed0 0x7f484c06d390 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f48540098e0 tx=0x7f48540047c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:02.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.194+0000 7f4862ffd700 1 -- 172.21.15.45:0/2934345800 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f485c0549e0 con 0x7f486c06a210 2023-10-08T20:12:02.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.403+0000 7f4870c9c700 1 -- 172.21.15.45:0/2934345800 --> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f486c0719a0 con 0x7f484c06aed0 2023-10-08T20:12:02.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.404+0000 7f4862ffd700 1 -- 172.21.15.45:0/2934345800 <== mgr.4105 v2:172.21.15.78:6832/3438117854 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f486c0719a0 con 0x7f484c06aed0 2023-10-08T20:12:02.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.406+0000 7f4870c9c700 1 -- 172.21.15.45:0/2934345800 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f484c06aed0 msgr2=0x7f484c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:02.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.406+0000 7f4870c9c700 1 --2- 172.21.15.45:0/2934345800 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f484c06aed0 0x7f484c06d390 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f48540098e0 tx=0x7f48540047c0 comp rx=0 tx=0).stop 2023-10-08T20:12:02.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.406+0000 7f4870c9c700 1 -- 172.21.15.45:0/2934345800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f486c06a210 msgr2=0x7f486c157af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:02.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.406+0000 7f4870c9c700 1 --2- 172.21.15.45:0/2934345800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f486c06a210 0x7f486c157af0 secure :-1 s=READY pgs=3287 cs=0 l=1 rev1=1 crypto rx=0x7f485c00c9a0 tx=0x7f485c00cd60 comp rx=0 tx=0).stop 2023-10-08T20:12:02.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.406+0000 7f4870c9c700 1 -- 172.21.15.45:0/2934345800 shutdown_connections 2023-10-08T20:12:02.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.406+0000 7f4870c9c700 1 --2- 172.21.15.45:0/2934345800 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f484c06aed0 0x7f484c06d390 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:02.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.406+0000 7f4870c9c700 1 --2- 172.21.15.45:0/2934345800 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f486c159960 0x7f486c1428c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:02.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.406+0000 7f4870c9c700 1 --2- 172.21.15.45:0/2934345800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f486c06a210 0x7f486c157af0 unknown :-1 s=CLOSED pgs=3287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:02.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.406+0000 7f4870c9c700 1 --2- 172.21.15.45:0/2934345800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f486c0b3fb0 0x7f486c145380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:02.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.406+0000 7f4870c9c700 1 -- 172.21.15.45:0/2934345800 >> 172.21.15.45:0/2934345800 conn(0x7f486c0b0430 msgr2=0x7f486c0cf0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:02.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.406+0000 7f4870c9c700 1 -- 172.21.15.45:0/2934345800 shutdown_connections 2023-10-08T20:12:02.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.406+0000 7f4870c9c700 1 -- 172.21.15.45:0/2934345800 wait complete. 2023-10-08T20:12:02.409 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 0 to deep-scrub 2023-10-08T20:12:02.421 INFO:tasks.ceph:Scrubbing osd.1 2023-10-08T20:12:02.422 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-08T20:12:02.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.564+0000 7f00b2872700 1 -- 172.21.15.45:0/1448405804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0098005210 msgr2=0x7f009800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:02.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.564+0000 7f00b2872700 1 --2- 172.21.15.45:0/1448405804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0098005210 0x7f009800ba10 secure :-1 s=READY pgs=3289 cs=0 l=1 rev1=1 crypto rx=0x7f00a400e320 tx=0x7f0098005880 comp rx=0 tx=0).stop 2023-10-08T20:12:02.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.564+0000 7f00b2872700 1 -- 172.21.15.45:0/1448405804 shutdown_connections 2023-10-08T20:12:02.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.564+0000 7f00b2872700 1 --2- 172.21.15.45:0/1448405804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0098005210 0x7f009800ba10 unknown :-1 s=CLOSED pgs=3289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:02.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.564+0000 7f00b2872700 1 -- 172.21.15.45:0/1448405804 >> 172.21.15.45:0/1448405804 conn(0x7f00ac088fb0 msgr2=0x7f00ac0cf810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:02.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.564+0000 7f00b2872700 1 -- 172.21.15.45:0/1448405804 shutdown_connections 2023-10-08T20:12:02.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.564+0000 7f00b2872700 1 -- 172.21.15.45:0/1448405804 wait complete. 2023-10-08T20:12:02.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.566+0000 7f00b2872700 1 Processor -- start 2023-10-08T20:12:02.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.566+0000 7f00b2872700 1 -- start start 2023-10-08T20:12:02.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.567+0000 7f00b2872700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0098005210 0x7f00ac0c5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:02.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.567+0000 7f00b2872700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f00ac0b3d80 0x7f00ac0b4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:02.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.567+0000 7f00b2872700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00ac0c7b60 0x7f00ac0c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:02.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.567+0000 7f00b2872700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ac0b4740 con 0x7f0098005210 2023-10-08T20:12:02.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.567+0000 7f00b2872700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ac0c94f0 con 0x7f00ac0c7b60 2023-10-08T20:12:02.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.567+0000 7f00b2872700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00ac0c88e0 con 0x7f00ac0b3d80 2023-10-08T20:12:02.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.567+0000 7f00abfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0098005210 0x7f00ac0c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:02.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.567+0000 7f00abfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0098005210 0x7f00ac0c5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51598/0 (socket says 172.21.15.45:51598) 2023-10-08T20:12:02.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.567+0000 7f00abfff700 1 -- 172.21.15.45:0/1432251802 learned_addr learned my addr 172.21.15.45:0/1432251802 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:12:02.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.567+0000 7f00b0e0f700 1 --2- 172.21.15.45:0/1432251802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00ac0c7b60 0x7f00ac0c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:02.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.567+0000 7f00ab7fe700 1 --2- 172.21.15.45:0/1432251802 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f00ac0b3d80 0x7f00ac0b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:02.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.567+0000 7f00abfff700 1 -- 172.21.15.45:0/1432251802 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f00ac0b3d80 msgr2=0x7f00ac0b4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:02.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.567+0000 7f00abfff700 1 --2- 172.21.15.45:0/1432251802 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f00ac0b3d80 0x7f00ac0b4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:02.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.567+0000 7f00abfff700 1 -- 172.21.15.45:0/1432251802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00ac0c7b60 msgr2=0x7f00ac0c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:02.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.567+0000 7f00abfff700 1 --2- 172.21.15.45:0/1432251802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00ac0c7b60 0x7f00ac0c7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:02.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.567+0000 7f00abfff700 1 -- 172.21.15.45:0/1432251802 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ac0c8bc0 con 0x7f0098005210 2023-10-08T20:12:02.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.567+0000 7f00abfff700 1 --2- 172.21.15.45:0/1432251802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0098005210 0x7f00ac0c5250 secure :-1 s=READY pgs=3290 cs=0 l=1 rev1=1 crypto rx=0x7f0094006600 tx=0x7f0094003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:02.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.567+0000 7f00a8ff9700 1 -- 172.21.15.45:0/1432251802 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0094011840 con 0x7f0098005210 2023-10-08T20:12:02.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.567+0000 7f00a8ff9700 1 -- 172.21.15.45:0/1432251802 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f00940119a0 con 0x7f0098005210 2023-10-08T20:12:02.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.567+0000 7f00b2872700 1 -- 172.21.15.45:0/1432251802 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00ac0c8ea0 con 0x7f0098005210 2023-10-08T20:12:02.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.567+0000 7f00a8ff9700 1 -- 172.21.15.45:0/1432251802 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0094011d70 con 0x7f0098005210 2023-10-08T20:12:02.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.568+0000 7f00b2872700 1 -- 172.21.15.45:0/1432251802 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00ac0c5790 con 0x7f0098005210 2023-10-08T20:12:02.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.568+0000 7f00b2872700 1 -- 172.21.15.45:0/1432251802 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f00ac09d790 con 0x7f0098005210 2023-10-08T20:12:02.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.569+0000 7f00a8ff9700 1 -- 172.21.15.45:0/1432251802 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f00940103c0 con 0x7f0098005210 2023-10-08T20:12:02.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.570+0000 7f00a8ff9700 1 --2- 172.21.15.45:0/1432251802 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f008c06af00 0x7f008c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:02.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.570+0000 7f00a8ff9700 1 -- 172.21.15.45:0/1432251802 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f009408a2d0 con 0x7f0098005210 2023-10-08T20:12:02.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.570+0000 7f00a8ff9700 1 --2- 172.21.15.45:0/1432251802 >> [v2:172.21.15.45:6800/4238026647,v1:172.21.15.45:6801/4238026647] conn(0x7f008c070d60 0x7f008c073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:02.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.570+0000 7f00ab7fe700 1 --2- 172.21.15.45:0/1432251802 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f008c06af00 0x7f008c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:02.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.570+0000 7f00a8ff9700 1 -- 172.21.15.45:0/1432251802 --> [v2:172.21.15.45:6800/4238026647,v1:172.21.15.45:6801/4238026647] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f008c073850 con 0x7f008c070d60 2023-10-08T20:12:02.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.570+0000 7f00a8ff9700 1 -- 172.21.15.45:0/1432251802 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f009408a720 con 0x7f0098005210 2023-10-08T20:12:02.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.570+0000 7f00b0e0f700 1 --2- 172.21.15.45:0/1432251802 >> [v2:172.21.15.45:6800/4238026647,v1:172.21.15.45:6801/4238026647] conn(0x7f008c070d60 0x7f008c073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:02.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.570+0000 7f00ab7fe700 1 --2- 172.21.15.45:0/1432251802 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f008c06af00 0x7f008c06d3c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f00ac157e20 tx=0x7f009c006bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:02.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.571+0000 7f00b0e0f700 1 --2- 172.21.15.45:0/1432251802 >> [v2:172.21.15.45:6800/4238026647,v1:172.21.15.45:6801/4238026647] conn(0x7f008c070d60 0x7f008c073180 crc :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:02.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.571+0000 7f00a8ff9700 1 -- 172.21.15.45:0/1432251802 <== osd.1 v2:172.21.15.45:6800/4238026647 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f008c073850 con 0x7f008c070d60 2023-10-08T20:12:02.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.587+0000 7f00b2872700 1 -- 172.21.15.45:0/1432251802 --> [v2:172.21.15.45:6800/4238026647,v1:172.21.15.45:6801/4238026647] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f00ac04e5a0 con 0x7f008c070d60 2023-10-08T20:12:02.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.587+0000 7f00a8ff9700 1 -- 172.21.15.45:0/1432251802 <== osd.1 v2:172.21.15.45:6800/4238026647 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f00ac04e5a0 con 0x7f008c070d60 2023-10-08T20:12:02.588 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-08T20:12:02.588 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-10-08T20:12:02.588 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-08T20:12:02.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.587+0000 7f00b2872700 1 -- 172.21.15.45:0/1432251802 >> [v2:172.21.15.45:6800/4238026647,v1:172.21.15.45:6801/4238026647] conn(0x7f008c070d60 msgr2=0x7f008c073180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:02.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.587+0000 7f00b2872700 1 --2- 172.21.15.45:0/1432251802 >> [v2:172.21.15.45:6800/4238026647,v1:172.21.15.45:6801/4238026647] conn(0x7f008c070d60 0x7f008c073180 crc :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:02.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.587+0000 7f00b2872700 1 -- 172.21.15.45:0/1432251802 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f008c06af00 msgr2=0x7f008c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:02.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.587+0000 7f00b2872700 1 --2- 172.21.15.45:0/1432251802 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f008c06af00 0x7f008c06d3c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f00ac157e20 tx=0x7f009c006bc0 comp rx=0 tx=0).stop 2023-10-08T20:12:02.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.587+0000 7f00b2872700 1 -- 172.21.15.45:0/1432251802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0098005210 msgr2=0x7f00ac0c5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:02.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.587+0000 7f00b2872700 1 --2- 172.21.15.45:0/1432251802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0098005210 0x7f00ac0c5250 secure :-1 s=READY pgs=3290 cs=0 l=1 rev1=1 crypto rx=0x7f0094006600 tx=0x7f0094003960 comp rx=0 tx=0).stop 2023-10-08T20:12:02.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.587+0000 7f00b0e0f700 1 -- 172.21.15.45:0/1432251802 reap_dead start 2023-10-08T20:12:02.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.587+0000 7f00b2872700 1 -- 172.21.15.45:0/1432251802 shutdown_connections 2023-10-08T20:12:02.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.587+0000 7f00b2872700 1 -- 172.21.15.45:0/1432251802 >> 172.21.15.45:0/1432251802 conn(0x7f00ac088fb0 msgr2=0x7f00ac0b4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:02.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.588+0000 7f00b2872700 1 -- 172.21.15.45:0/1432251802 shutdown_connections 2023-10-08T20:12:02.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.588+0000 7f00b2872700 1 -- 172.21.15.45:0/1432251802 wait complete. 2023-10-08T20:12:02.602 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-08T20:12:02.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.740+0000 7f43eec4f700 1 -- 172.21.15.45:0/3229410959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43e80b1730 msgr2=0x7f43e806a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:02.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.740+0000 7f43eec4f700 1 --2- 172.21.15.45:0/3229410959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43e80b1730 0x7f43e806a210 secure :-1 s=READY pgs=3292 cs=0 l=1 rev1=1 crypto rx=0x7f43e806b240 tx=0x7f43dc009c70 comp rx=0 tx=0).stop 2023-10-08T20:12:02.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.740+0000 7f43eec4f700 1 -- 172.21.15.45:0/3229410959 shutdown_connections 2023-10-08T20:12:02.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.740+0000 7f43eec4f700 1 --2- 172.21.15.45:0/3229410959 >> v2:172.21.15.78:3300/0 conn(0x7f43e806a750 0x7f43e80ce920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:02.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.740+0000 7f43eec4f700 1 --2- 172.21.15.45:0/3229410959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43e80b1730 0x7f43e806a210 unknown :-1 s=CLOSED pgs=3292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:02.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.740+0000 7f43eec4f700 1 -- 172.21.15.45:0/3229410959 >> 172.21.15.45:0/3229410959 conn(0x7f43e80b0430 msgr2=0x7f43e80b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:02.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.740+0000 7f43eec4f700 1 -- 172.21.15.45:0/3229410959 shutdown_connections 2023-10-08T20:12:02.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.740+0000 7f43eec4f700 1 -- 172.21.15.45:0/3229410959 wait complete. 2023-10-08T20:12:02.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.741+0000 7f43eec4f700 1 Processor -- start 2023-10-08T20:12:02.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.742+0000 7f43eec4f700 1 -- start start 2023-10-08T20:12:02.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.742+0000 7f43eec4f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43e806a750 0x7f43e815caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:02.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.742+0000 7f43eec4f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43e80b1730 0x7f43e80c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:02.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.742+0000 7f43eec4f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43e8159960 0x7f43e81556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:02.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.742+0000 7f43eec4f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e8155210 con 0x7f43e8159960 2023-10-08T20:12:02.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.742+0000 7f43eec4f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e8154600 con 0x7f43e806a750 2023-10-08T20:12:02.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.742+0000 7f43eec4f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e81548e0 con 0x7f43e80b1730 2023-10-08T20:12:02.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.743+0000 7f43ed1ec700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43e8159960 0x7f43e81556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:02.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.743+0000 7f43ed1ec700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43e8159960 0x7f43e81556a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51618/0 (socket says 172.21.15.45:51618) 2023-10-08T20:12:02.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.743+0000 7f43ed1ec700 1 -- 172.21.15.45:0/4098580508 learned_addr learned my addr 172.21.15.45:0/4098580508 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:12:02.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.743+0000 7f43ec9eb700 1 --2- 172.21.15.45:0/4098580508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43e806a750 0x7f43e815caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:02.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.743+0000 7f43e7fff700 1 --2- 172.21.15.45:0/4098580508 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43e80b1730 0x7f43e80c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:02.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.743+0000 7f43ed1ec700 1 -- 172.21.15.45:0/4098580508 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43e80b1730 msgr2=0x7f43e80c44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:02.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.743+0000 7f43ed1ec700 1 --2- 172.21.15.45:0/4098580508 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43e80b1730 0x7f43e80c44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:02.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.743+0000 7f43ed1ec700 1 -- 172.21.15.45:0/4098580508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43e806a750 msgr2=0x7f43e815caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:02.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.743+0000 7f43ed1ec700 1 --2- 172.21.15.45:0/4098580508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43e806a750 0x7f43e815caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:02.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.743+0000 7f43ed1ec700 1 -- 172.21.15.45:0/4098580508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc0095f0 con 0x7f43e8159960 2023-10-08T20:12:02.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.743+0000 7f43ed1ec700 1 --2- 172.21.15.45:0/4098580508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43e8159960 0x7f43e81556a0 secure :-1 s=READY pgs=3293 cs=0 l=1 rev1=1 crypto rx=0x7f43e0007ee0 tx=0x7f43e000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:02.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.743+0000 7f43e57fa700 1 -- 172.21.15.45:0/4098580508 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e0017070 con 0x7f43e8159960 2023-10-08T20:12:02.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.743+0000 7f43e57fa700 1 -- 172.21.15.45:0/4098580508 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f43e000f040 con 0x7f43e8159960 2023-10-08T20:12:02.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.743+0000 7f43eec4f700 1 -- 172.21.15.45:0/4098580508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e8154bc0 con 0x7f43e8159960 2023-10-08T20:12:02.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.743+0000 7f43e57fa700 1 -- 172.21.15.45:0/4098580508 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e000de10 con 0x7f43e8159960 2023-10-08T20:12:02.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.743+0000 7f43eec4f700 1 -- 172.21.15.45:0/4098580508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e815cfe0 con 0x7f43e8159960 2023-10-08T20:12:02.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.744+0000 7f43eec4f700 1 -- 172.21.15.45:0/4098580508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e815d170 con 0x7f43e8159960 2023-10-08T20:12:02.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.745+0000 7f43e57fa700 1 -- 172.21.15.45:0/4098580508 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f43e001c410 con 0x7f43e8159960 2023-10-08T20:12:02.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.745+0000 7f43e57fa700 1 --2- 172.21.15.45:0/4098580508 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f43d406aed0 0x7f43d406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:02.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.745+0000 7f43e57fa700 1 -- 172.21.15.45:0/4098580508 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f43e00891b0 con 0x7f43e8159960 2023-10-08T20:12:02.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.746+0000 7f43ec9eb700 1 --2- 172.21.15.45:0/4098580508 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f43d406aed0 0x7f43d406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:02.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.746+0000 7f43ec9eb700 1 --2- 172.21.15.45:0/4098580508 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f43d406aed0 0x7f43d406d390 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f43d8001620 tx=0x7f43d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:02.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.754+0000 7f43e57fa700 1 -- 172.21.15.45:0/4098580508 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f43e815d170 con 0x7f43e8159960 2023-10-08T20:12:02.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.967+0000 7f43eec4f700 1 -- 172.21.15.45:0/4098580508 --> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f43e80b46c0 con 0x7f43d406aed0 2023-10-08T20:12:02.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.967+0000 7f43e57fa700 1 -- 172.21.15.45:0/4098580508 <== mgr.4105 v2:172.21.15.78:6832/3438117854 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f43d80050d0 con 0x7f43d406aed0 2023-10-08T20:12:02.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.970+0000 7f43eec4f700 1 -- 172.21.15.45:0/4098580508 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f43d406aed0 msgr2=0x7f43d406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:02.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.970+0000 7f43eec4f700 1 --2- 172.21.15.45:0/4098580508 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f43d406aed0 0x7f43d406d390 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f43d8001620 tx=0x7f43d8009040 comp rx=0 tx=0).stop 2023-10-08T20:12:02.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.970+0000 7f43eec4f700 1 -- 172.21.15.45:0/4098580508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43e8159960 msgr2=0x7f43e81556a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:02.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.970+0000 7f43eec4f700 1 --2- 172.21.15.45:0/4098580508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43e8159960 0x7f43e81556a0 secure :-1 s=READY pgs=3293 cs=0 l=1 rev1=1 crypto rx=0x7f43e0007ee0 tx=0x7f43e000d3b0 comp rx=0 tx=0).stop 2023-10-08T20:12:02.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.970+0000 7f43eec4f700 1 -- 172.21.15.45:0/4098580508 shutdown_connections 2023-10-08T20:12:02.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.970+0000 7f43eec4f700 1 --2- 172.21.15.45:0/4098580508 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f43d406aed0 0x7f43d406d390 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:02.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.970+0000 7f43eec4f700 1 --2- 172.21.15.45:0/4098580508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43e8159960 0x7f43e81556a0 unknown :-1 s=CLOSED pgs=3293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:02.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.970+0000 7f43eec4f700 1 --2- 172.21.15.45:0/4098580508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43e806a750 0x7f43e815caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:02.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.970+0000 7f43eec4f700 1 --2- 172.21.15.45:0/4098580508 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43e80b1730 0x7f43e80c44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:02.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.970+0000 7f43eec4f700 1 -- 172.21.15.45:0/4098580508 >> 172.21.15.45:0/4098580508 conn(0x7f43e80b0430 msgr2=0x7f43e8158ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:02.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.970+0000 7f43eec4f700 1 -- 172.21.15.45:0/4098580508 shutdown_connections 2023-10-08T20:12:02.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:02.970+0000 7f43eec4f700 1 -- 172.21.15.45:0/4098580508 wait complete. 2023-10-08T20:12:02.972 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 1 to deep-scrub 2023-10-08T20:12:02.984 INFO:tasks.ceph:Scrubbing osd.2 2023-10-08T20:12:02.985 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-08T20:12:03.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.127+0000 7fb0e5aae700 1 -- 172.21.15.45:0/2609264974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0e00c3030 msgr2=0x7fb0e00c9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.127+0000 7fb0e5aae700 1 --2- 172.21.15.45:0/2609264974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0e00c3030 0x7fb0e00c9e60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8009f60 tx=0x7fb0d8009f90 comp rx=0 tx=0).stop 2023-10-08T20:12:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.127+0000 7fb0e5aae700 1 -- 172.21.15.45:0/2609264974 shutdown_connections 2023-10-08T20:12:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.127+0000 7fb0e5aae700 1 --2- 172.21.15.45:0/2609264974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0e00c3030 0x7fb0e00c9e60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.127+0000 7fb0e5aae700 1 --2- 172.21.15.45:0/2609264974 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb0e006d8d0 0x7fb0e006d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.127+0000 7fb0e5aae700 1 -- 172.21.15.45:0/2609264974 >> 172.21.15.45:0/2609264974 conn(0x7fb0e006a210 msgr2=0x7fb0e006a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.127+0000 7fb0e5aae700 1 -- 172.21.15.45:0/2609264974 shutdown_connections 2023-10-08T20:12:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.127+0000 7fb0e5aae700 1 -- 172.21.15.45:0/2609264974 wait complete. 2023-10-08T20:12:03.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.129+0000 7fb0e5aae700 1 Processor -- start 2023-10-08T20:12:03.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.129+0000 7fb0e5aae700 1 -- start start 2023-10-08T20:12:03.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.129+0000 7fb0e5aae700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0e006d8d0 0x7fb0e01f4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:03.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.129+0000 7fb0e5aae700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb0e00b29c0 0x7fb0e014b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:03.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.130+0000 7fb0e5aae700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0e00c3030 0x7fb0e013a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:03.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.130+0000 7fb0e5aae700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e014f6d0 con 0x7fb0e00c3030 2023-10-08T20:12:03.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.130+0000 7fb0e5aae700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e013ae80 con 0x7fb0e006d8d0 2023-10-08T20:12:03.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.130+0000 7fb0e5aae700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e014f920 con 0x7fb0e00b29c0 2023-10-08T20:12:03.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.130+0000 7fb0dffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0e00c3030 0x7fb0e013a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:03.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.130+0000 7fb0dffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0e00c3030 0x7fb0e013a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51632/0 (socket says 172.21.15.45:51632) 2023-10-08T20:12:03.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.130+0000 7fb0dffff700 1 -- 172.21.15.45:0/1751126403 learned_addr learned my addr 172.21.15.45:0/1751126403 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:12:03.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.130+0000 7fb0df7fe700 1 --2- 172.21.15.45:0/1751126403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0e006d8d0 0x7fb0e01f4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:03.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.130+0000 7fb0deffd700 1 --2- 172.21.15.45:0/1751126403 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb0e00b29c0 0x7fb0e014b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:03.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.130+0000 7fb0dffff700 1 -- 172.21.15.45:0/1751126403 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb0e00b29c0 msgr2=0x7fb0e014b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:03.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.130+0000 7fb0dffff700 1 --2- 172.21.15.45:0/1751126403 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb0e00b29c0 0x7fb0e014b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:03.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.130+0000 7fb0dffff700 1 -- 172.21.15.45:0/1751126403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0e006d8d0 msgr2=0x7fb0e01f4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:03.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.130+0000 7fb0dffff700 1 --2- 172.21.15.45:0/1751126403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0e006d8d0 0x7fb0e01f4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:03.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.130+0000 7fb0dffff700 1 -- 172.21.15.45:0/1751126403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d0009520 con 0x7fb0e00c3030 2023-10-08T20:12:03.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.130+0000 7fb0deffd700 1 --2- 172.21.15.45:0/1751126403 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb0e00b29c0 0x7fb0e014b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T20:12:03.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.130+0000 7fb0dffff700 1 --2- 172.21.15.45:0/1751126403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0e00c3030 0x7fb0e013a940 secure :-1 s=READY pgs=3295 cs=0 l=1 rev1=1 crypto rx=0x7fb0d800b610 tx=0x7fb0d8007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:03.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.130+0000 7fb0c7fff700 1 -- 172.21.15.45:0/1751126403 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d800e040 con 0x7fb0e00c3030 2023-10-08T20:12:03.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.131+0000 7fb0c7fff700 1 -- 172.21.15.45:0/1751126403 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb0d8012820 con 0x7fb0e00c3030 2023-10-08T20:12:03.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.131+0000 7fb0e5aae700 1 -- 172.21.15.45:0/1751126403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d8009c40 con 0x7fb0e00c3030 2023-10-08T20:12:03.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.131+0000 7fb0c7fff700 1 -- 172.21.15.45:0/1751126403 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d8012c30 con 0x7fb0e00c3030 2023-10-08T20:12:03.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.131+0000 7fb0e5aae700 1 -- 172.21.15.45:0/1751126403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e015d3a0 con 0x7fb0e00c3030 2023-10-08T20:12:03.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.131+0000 7fb0e5aae700 1 -- 172.21.15.45:0/1751126403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb0e0071f10 con 0x7fb0e00c3030 2023-10-08T20:12:03.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.132+0000 7fb0c7fff700 1 -- 172.21.15.45:0/1751126403 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb0d801d480 con 0x7fb0e00c3030 2023-10-08T20:12:03.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.133+0000 7fb0c7fff700 1 --2- 172.21.15.45:0/1751126403 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb0cc06aed0 0x7fb0cc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:03.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.133+0000 7fb0c7fff700 1 -- 172.21.15.45:0/1751126403 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb0d808b9c0 con 0x7fb0e00c3030 2023-10-08T20:12:03.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.133+0000 7fb0c7fff700 1 --2- 172.21.15.45:0/1751126403 >> [v2:172.21.15.45:6808/3709844603,v1:172.21.15.45:6809/3709844603] conn(0x7fb0cc070d30 0x7fb0cc073150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:03.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.133+0000 7fb0c7fff700 1 -- 172.21.15.45:0/1751126403 --> [v2:172.21.15.45:6808/3709844603,v1:172.21.15.45:6809/3709844603] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb0cc073820 con 0x7fb0cc070d30 2023-10-08T20:12:03.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.133+0000 7fb0c7fff700 1 -- 172.21.15.45:0/1751126403 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0d808be10 con 0x7fb0e00c3030 2023-10-08T20:12:03.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.133+0000 7fb0df7fe700 1 --2- 172.21.15.45:0/1751126403 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb0cc06aed0 0x7fb0cc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:03.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.133+0000 7fb0deffd700 1 --2- 172.21.15.45:0/1751126403 >> [v2:172.21.15.45:6808/3709844603,v1:172.21.15.45:6809/3709844603] conn(0x7fb0cc070d30 0x7fb0cc073150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:03.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.133+0000 7fb0deffd700 1 --2- 172.21.15.45:0/1751126403 >> [v2:172.21.15.45:6808/3709844603,v1:172.21.15.45:6809/3709844603] conn(0x7fb0cc070d30 0x7fb0cc073150 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:03.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.133+0000 7fb0df7fe700 1 --2- 172.21.15.45:0/1751126403 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb0cc06aed0 0x7fb0cc06d390 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4001830 tx=0x7fb0d4007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:03.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.134+0000 7fb0c7fff700 1 -- 172.21.15.45:0/1751126403 <== osd.2 v2:172.21.15.45:6808/3709844603 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fb0cc073820 con 0x7fb0cc070d30 2023-10-08T20:12:03.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.150+0000 7fb0e5aae700 1 -- 172.21.15.45:0/1751126403 --> [v2:172.21.15.45:6808/3709844603,v1:172.21.15.45:6809/3709844603] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb0e0067410 con 0x7fb0cc070d30 2023-10-08T20:12:03.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.150+0000 7fb0c7fff700 1 -- 172.21.15.45:0/1751126403 <== osd.2 v2:172.21.15.45:6808/3709844603 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb0e0067410 con 0x7fb0cc070d30 2023-10-08T20:12:03.151 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-08T20:12:03.152 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-10-08T20:12:03.152 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-08T20:12:03.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.151+0000 7fb0e5aae700 1 -- 172.21.15.45:0/1751126403 >> [v2:172.21.15.45:6808/3709844603,v1:172.21.15.45:6809/3709844603] conn(0x7fb0cc070d30 msgr2=0x7fb0cc073150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:03.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.151+0000 7fb0e5aae700 1 --2- 172.21.15.45:0/1751126403 >> [v2:172.21.15.45:6808/3709844603,v1:172.21.15.45:6809/3709844603] conn(0x7fb0cc070d30 0x7fb0cc073150 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:03.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.151+0000 7fb0e5aae700 1 -- 172.21.15.45:0/1751126403 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb0cc06aed0 msgr2=0x7fb0cc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:03.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.151+0000 7fb0e5aae700 1 --2- 172.21.15.45:0/1751126403 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb0cc06aed0 0x7fb0cc06d390 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4001830 tx=0x7fb0d4007d50 comp rx=0 tx=0).stop 2023-10-08T20:12:03.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.151+0000 7fb0e5aae700 1 -- 172.21.15.45:0/1751126403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0e00c3030 msgr2=0x7fb0e013a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:03.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.151+0000 7fb0e5aae700 1 --2- 172.21.15.45:0/1751126403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0e00c3030 0x7fb0e013a940 secure :-1 s=READY pgs=3295 cs=0 l=1 rev1=1 crypto rx=0x7fb0d800b610 tx=0x7fb0d8007b20 comp rx=0 tx=0).stop 2023-10-08T20:12:03.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.151+0000 7fb0dffff700 1 -- 172.21.15.45:0/1751126403 reap_dead start 2023-10-08T20:12:03.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.151+0000 7fb0e5aae700 1 -- 172.21.15.45:0/1751126403 shutdown_connections 2023-10-08T20:12:03.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.151+0000 7fb0e5aae700 1 -- 172.21.15.45:0/1751126403 >> 172.21.15.45:0/1751126403 conn(0x7fb0e006a210 msgr2=0x7fb0e006a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:03.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.151+0000 7fb0e5aae700 1 -- 172.21.15.45:0/1751126403 shutdown_connections 2023-10-08T20:12:03.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.151+0000 7fb0e5aae700 1 -- 172.21.15.45:0/1751126403 wait complete. 2023-10-08T20:12:03.165 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-08T20:12:03.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.306+0000 7f864bc3b700 1 -- 172.21.15.45:0/2648772664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86441593f0 msgr2=0x7f864406a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:03.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.306+0000 7f864bc3b700 1 --2- 172.21.15.45:0/2648772664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86441593f0 0x7f864406a210 secure :-1 s=READY pgs=3296 cs=0 l=1 rev1=1 crypto rx=0x7f864415c070 tx=0x7f8640009c70 comp rx=0 tx=0).stop 2023-10-08T20:12:03.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.306+0000 7f864bc3b700 1 -- 172.21.15.45:0/2648772664 shutdown_connections 2023-10-08T20:12:03.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.306+0000 7f864bc3b700 1 --2- 172.21.15.45:0/2648772664 >> v2:172.21.15.78:3300/0 conn(0x7f86440c8eb0 0x7f864406a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:03.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.306+0000 7f864bc3b700 1 --2- 172.21.15.45:0/2648772664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86441593f0 0x7f864406a210 unknown :-1 s=CLOSED pgs=3296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:03.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.306+0000 7f864bc3b700 1 -- 172.21.15.45:0/2648772664 >> 172.21.15.45:0/2648772664 conn(0x7f86440b0430 msgr2=0x7f86440b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:03.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.306+0000 7f864bc3b700 1 -- 172.21.15.45:0/2648772664 shutdown_connections 2023-10-08T20:12:03.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.306+0000 7f864bc3b700 1 -- 172.21.15.45:0/2648772664 wait complete. 2023-10-08T20:12:03.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.307+0000 7f864bc3b700 1 Processor -- start 2023-10-08T20:12:03.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.307+0000 7f864bc3b700 1 -- start start 2023-10-08T20:12:03.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.308+0000 7f864bc3b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86440c8eb0 0x7f864414bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:03.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.308+0000 7f864bc3b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f86441593f0 0x7f86440b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:03.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.308+0000 7f864bc3b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86441597d0 0x7f86441572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:03.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.308+0000 7f864bc3b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864414c210 con 0x7f86440c8eb0 2023-10-08T20:12:03.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.308+0000 7f864bc3b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86440c9780 con 0x7f86441597d0 2023-10-08T20:12:03.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.308+0000 7f864bc3b700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86440c9a60 con 0x7f86441593f0 2023-10-08T20:12:03.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.308+0000 7f86499d7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86440c8eb0 0x7f864414bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:03.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.308+0000 7f86499d7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86440c8eb0 0x7f864414bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51644/0 (socket says 172.21.15.45:51644) 2023-10-08T20:12:03.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.308+0000 7f86499d7700 1 -- 172.21.15.45:0/3585190793 learned_addr learned my addr 172.21.15.45:0/3585190793 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:12:03.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.308+0000 7f864a1d8700 1 --2- 172.21.15.45:0/3585190793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86441597d0 0x7f86441572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:03.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.308+0000 7f86491d6700 1 --2- 172.21.15.45:0/3585190793 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f86441593f0 0x7f86440b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:03.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.308+0000 7f86499d7700 1 -- 172.21.15.45:0/3585190793 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f86441593f0 msgr2=0x7f86440b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:03.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.308+0000 7f86499d7700 1 --2- 172.21.15.45:0/3585190793 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f86441593f0 0x7f86440b1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:03.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.308+0000 7f86499d7700 1 -- 172.21.15.45:0/3585190793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86441597d0 msgr2=0x7f86441572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:03.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.308+0000 7f86499d7700 1 --2- 172.21.15.45:0/3585190793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86441597d0 0x7f86441572d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:03.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.308+0000 7f86499d7700 1 -- 172.21.15.45:0/3585190793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86400095f0 con 0x7f86440c8eb0 2023-10-08T20:12:03.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.309+0000 7f864a1d8700 1 --2- 172.21.15.45:0/3585190793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86441597d0 0x7f86441572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T20:12:03.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.309+0000 7f86491d6700 1 --2- 172.21.15.45:0/3585190793 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f86441593f0 0x7f86440b1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T20:12:03.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.309+0000 7f86499d7700 1 --2- 172.21.15.45:0/3585190793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86440c8eb0 0x7f864414bcd0 secure :-1 s=READY pgs=3297 cs=0 l=1 rev1=1 crypto rx=0x7f8640005fd0 tx=0x7f8640003d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:03.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.309+0000 7f863a7fc700 1 -- 172.21.15.45:0/3585190793 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864001d070 con 0x7f86440c8eb0 2023-10-08T20:12:03.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.309+0000 7f863a7fc700 1 -- 172.21.15.45:0/3585190793 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8640004830 con 0x7f86440c8eb0 2023-10-08T20:12:03.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.309+0000 7f864bc3b700 1 -- 172.21.15.45:0/3585190793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86440c9d40 con 0x7f86440c8eb0 2023-10-08T20:12:03.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.309+0000 7f863a7fc700 1 -- 172.21.15.45:0/3585190793 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8640004c40 con 0x7f86440c8eb0 2023-10-08T20:12:03.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.309+0000 7f864bc3b700 1 -- 172.21.15.45:0/3585190793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86440ca300 con 0x7f86440c8eb0 2023-10-08T20:12:03.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.310+0000 7f864bc3b700 1 -- 172.21.15.45:0/3585190793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f864404e4c0 con 0x7f86440c8eb0 2023-10-08T20:12:03.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.310+0000 7f863a7fc700 1 -- 172.21.15.45:0/3585190793 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f864000b7b0 con 0x7f86440c8eb0 2023-10-08T20:12:03.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.311+0000 7f863a7fc700 1 --2- 172.21.15.45:0/3585190793 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f862806aed0 0x7f862806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:03.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.311+0000 7f863a7fc700 1 -- 172.21.15.45:0/3585190793 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f864008a970 con 0x7f86440c8eb0 2023-10-08T20:12:03.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.311+0000 7f86491d6700 1 --2- 172.21.15.45:0/3585190793 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f862806aed0 0x7f862806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:03.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.312+0000 7f86491d6700 1 --2- 172.21.15.45:0/3585190793 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f862806aed0 0x7f862806d390 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f86441f6b10 tx=0x7f8634009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:03.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.316+0000 7f863a7fc700 1 -- 172.21.15.45:0/3585190793 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8640055d20 con 0x7f86440c8eb0 2023-10-08T20:12:03.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.529+0000 7f864bc3b700 1 -- 172.21.15.45:0/3585190793 --> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f86440cd240 con 0x7f862806aed0 2023-10-08T20:12:03.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.529+0000 7f863a7fc700 1 -- 172.21.15.45:0/3585190793 <== mgr.4105 v2:172.21.15.78:6832/3438117854 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f86440cd240 con 0x7f862806aed0 2023-10-08T20:12:03.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.532+0000 7f864bc3b700 1 -- 172.21.15.45:0/3585190793 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f862806aed0 msgr2=0x7f862806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:03.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.532+0000 7f864bc3b700 1 --2- 172.21.15.45:0/3585190793 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f862806aed0 0x7f862806d390 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f86441f6b10 tx=0x7f8634009040 comp rx=0 tx=0).stop 2023-10-08T20:12:03.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.532+0000 7f864bc3b700 1 -- 172.21.15.45:0/3585190793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86440c8eb0 msgr2=0x7f864414bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:03.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.532+0000 7f864bc3b700 1 --2- 172.21.15.45:0/3585190793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86440c8eb0 0x7f864414bcd0 secure :-1 s=READY pgs=3297 cs=0 l=1 rev1=1 crypto rx=0x7f8640005fd0 tx=0x7f8640003d70 comp rx=0 tx=0).stop 2023-10-08T20:12:03.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.532+0000 7f864bc3b700 1 -- 172.21.15.45:0/3585190793 shutdown_connections 2023-10-08T20:12:03.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.532+0000 7f864bc3b700 1 --2- 172.21.15.45:0/3585190793 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f862806aed0 0x7f862806d390 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:03.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.532+0000 7f864bc3b700 1 --2- 172.21.15.45:0/3585190793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86441597d0 0x7f86441572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:03.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.532+0000 7f864bc3b700 1 --2- 172.21.15.45:0/3585190793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86440c8eb0 0x7f864414bcd0 unknown :-1 s=CLOSED pgs=3297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:03.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.532+0000 7f864bc3b700 1 --2- 172.21.15.45:0/3585190793 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f86441593f0 0x7f86440b1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:03.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.532+0000 7f864bc3b700 1 -- 172.21.15.45:0/3585190793 >> 172.21.15.45:0/3585190793 conn(0x7f86440b0430 msgr2=0x7f8644159bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:03.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.532+0000 7f864bc3b700 1 -- 172.21.15.45:0/3585190793 shutdown_connections 2023-10-08T20:12:03.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.532+0000 7f864bc3b700 1 -- 172.21.15.45:0/3585190793 wait complete. 2023-10-08T20:12:03.535 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 2 to deep-scrub 2023-10-08T20:12:03.547 INFO:tasks.ceph:Scrubbing osd.3 2023-10-08T20:12:03.547 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-08T20:12:03.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.689+0000 7f24ab11a700 1 -- 172.21.15.45:0/100312887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24a406ea70 msgr2=0x7f24a406f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:03.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.689+0000 7f24ab11a700 1 --2- 172.21.15.45:0/100312887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24a406ea70 0x7f24a406f650 secure :-1 s=READY pgs=3298 cs=0 l=1 rev1=1 crypto rx=0x7f2498005fd0 tx=0x7f2498009c70 comp rx=0 tx=0).stop 2023-10-08T20:12:03.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.689+0000 7f24ab11a700 1 -- 172.21.15.45:0/100312887 shutdown_connections 2023-10-08T20:12:03.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.689+0000 7f24ab11a700 1 --2- 172.21.15.45:0/100312887 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f24a406f270 0x7f24a40d00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:03.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.689+0000 7f24ab11a700 1 --2- 172.21.15.45:0/100312887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24a406ea70 0x7f24a406f650 unknown :-1 s=CLOSED pgs=3298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:03.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.689+0000 7f24ab11a700 1 -- 172.21.15.45:0/100312887 >> 172.21.15.45:0/100312887 conn(0x7f24a4098b60 msgr2=0x7f24a40cf7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:03.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.689+0000 7f24ab11a700 1 -- 172.21.15.45:0/100312887 shutdown_connections 2023-10-08T20:12:03.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.689+0000 7f24ab11a700 1 -- 172.21.15.45:0/100312887 wait complete. 2023-10-08T20:12:03.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.690+0000 7f24ab11a700 1 Processor -- start 2023-10-08T20:12:03.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.690+0000 7f24ab11a700 1 -- start start 2023-10-08T20:12:03.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.691+0000 7f24ab11a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24a406ea70 0x7f24a40c7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:03.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.691+0000 7f24ab11a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f24a406f270 0x7f24a40c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:03.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.691+0000 7f24ab11a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24a40cb3d0 0x7f24a4152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:03.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.691+0000 7f24ab11a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a40c79d0 con 0x7f24a406ea70 2023-10-08T20:12:03.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.691+0000 7f24ab11a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a40c8e70 con 0x7f24a40cb3d0 2023-10-08T20:12:03.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.691+0000 7f24ab11a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a40c69b0 con 0x7f24a406f270 2023-10-08T20:12:03.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.691+0000 7f24a8eb6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24a406ea70 0x7f24a40c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:03.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.691+0000 7f24a8eb6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24a406ea70 0x7f24a40c7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51658/0 (socket says 172.21.15.45:51658) 2023-10-08T20:12:03.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.691+0000 7f24a8eb6700 1 -- 172.21.15.45:0/1601798914 learned_addr learned my addr 172.21.15.45:0/1601798914 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:12:03.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.691+0000 7f24a3fff700 1 --2- 172.21.15.45:0/1601798914 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f24a406f270 0x7f24a40c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:03.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.692+0000 7f24a96b7700 1 --2- 172.21.15.45:0/1601798914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24a40cb3d0 0x7f24a4152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:03.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.692+0000 7f24a8eb6700 1 -- 172.21.15.45:0/1601798914 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f24a406f270 msgr2=0x7f24a40c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:03.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.692+0000 7f24a8eb6700 1 --2- 172.21.15.45:0/1601798914 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f24a406f270 0x7f24a40c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:03.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.692+0000 7f24a8eb6700 1 -- 172.21.15.45:0/1601798914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24a40cb3d0 msgr2=0x7f24a4152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:03.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.692+0000 7f24a8eb6700 1 --2- 172.21.15.45:0/1601798914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24a40cb3d0 0x7f24a4152cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:03.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.692+0000 7f24a8eb6700 1 -- 172.21.15.45:0/1601798914 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24980095f0 con 0x7f24a406ea70 2023-10-08T20:12:03.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.692+0000 7f24a96b7700 1 --2- 172.21.15.45:0/1601798914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24a40cb3d0 0x7f24a4152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T20:12:03.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.692+0000 7f24a8eb6700 1 --2- 172.21.15.45:0/1601798914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24a406ea70 0x7f24a40c7490 secure :-1 s=READY pgs=3299 cs=0 l=1 rev1=1 crypto rx=0x7f249400e9c0 tx=0x7f249400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:03.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.692+0000 7f24a17fa700 1 -- 172.21.15.45:0/1601798914 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24940097b0 con 0x7f24a406ea70 2023-10-08T20:12:03.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.692+0000 7f24a17fa700 1 -- 172.21.15.45:0/1601798914 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f249400cbd0 con 0x7f24a406ea70 2023-10-08T20:12:03.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.692+0000 7f24ab11a700 1 -- 172.21.15.45:0/1601798914 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a40c6c90 con 0x7f24a406ea70 2023-10-08T20:12:03.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.692+0000 7f24a17fa700 1 -- 172.21.15.45:0/1601798914 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2494004830 con 0x7f24a406ea70 2023-10-08T20:12:03.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.692+0000 7f24ab11a700 1 -- 172.21.15.45:0/1601798914 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a40c9150 con 0x7f24a406ea70 2023-10-08T20:12:03.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.693+0000 7f24ab11a700 1 -- 172.21.15.45:0/1601798914 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f24a40cb880 con 0x7f24a406ea70 2023-10-08T20:12:03.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.694+0000 7f24a17fa700 1 -- 172.21.15.45:0/1601798914 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2494021440 con 0x7f24a406ea70 2023-10-08T20:12:03.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.694+0000 7f24a17fa700 1 --2- 172.21.15.45:0/1601798914 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f249006af00 0x7f249006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:03.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.694+0000 7f24a17fa700 1 -- 172.21.15.45:0/1601798914 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2494014070 con 0x7f24a406ea70 2023-10-08T20:12:03.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.694+0000 7f24a17fa700 1 --2- 172.21.15.45:0/1601798914 >> [v2:172.21.15.45:6824/2255775238,v1:172.21.15.45:6825/2255775238] conn(0x7f2490070d60 0x7f2490073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:03.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.694+0000 7f24a17fa700 1 -- 172.21.15.45:0/1601798914 --> [v2:172.21.15.45:6824/2255775238,v1:172.21.15.45:6825/2255775238] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2490073850 con 0x7f2490070d60 2023-10-08T20:12:03.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.694+0000 7f24a17fa700 1 -- 172.21.15.45:0/1601798914 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f249408e2c0 con 0x7f24a406ea70 2023-10-08T20:12:03.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.694+0000 7f24a3fff700 1 --2- 172.21.15.45:0/1601798914 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f249006af00 0x7f249006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:03.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.695+0000 7f24a96b7700 1 --2- 172.21.15.45:0/1601798914 >> [v2:172.21.15.45:6824/2255775238,v1:172.21.15.45:6825/2255775238] conn(0x7f2490070d60 0x7f2490073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:03.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.695+0000 7f24a96b7700 1 --2- 172.21.15.45:0/1601798914 >> [v2:172.21.15.45:6824/2255775238,v1:172.21.15.45:6825/2255775238] conn(0x7f2490070d60 0x7f2490073180 crc :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:03.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.695+0000 7f24a3fff700 1 --2- 172.21.15.45:0/1601798914 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f249006af00 0x7f249006d3c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f2498000c00 tx=0x7f24980047c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:03.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.696+0000 7f24a17fa700 1 -- 172.21.15.45:0/1601798914 <== osd.3 v2:172.21.15.45:6824/2255775238 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f2490073850 con 0x7f2490070d60 2023-10-08T20:12:03.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.712+0000 7f24ab11a700 1 -- 172.21.15.45:0/1601798914 --> [v2:172.21.15.45:6824/2255775238,v1:172.21.15.45:6825/2255775238] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f24a40c71b0 con 0x7f2490070d60 2023-10-08T20:12:03.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.712+0000 7f24a17fa700 1 -- 172.21.15.45:0/1601798914 <== osd.3 v2:172.21.15.45:6824/2255775238 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f24a40c71b0 con 0x7f2490070d60 2023-10-08T20:12:03.713 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-08T20:12:03.713 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-10-08T20:12:03.713 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-08T20:12:03.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.713+0000 7f24ab11a700 1 -- 172.21.15.45:0/1601798914 >> [v2:172.21.15.45:6824/2255775238,v1:172.21.15.45:6825/2255775238] conn(0x7f2490070d60 msgr2=0x7f2490073180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:03.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.713+0000 7f24ab11a700 1 --2- 172.21.15.45:0/1601798914 >> [v2:172.21.15.45:6824/2255775238,v1:172.21.15.45:6825/2255775238] conn(0x7f2490070d60 0x7f2490073180 crc :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:03.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.713+0000 7f24ab11a700 1 -- 172.21.15.45:0/1601798914 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f249006af00 msgr2=0x7f249006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:03.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.713+0000 7f24ab11a700 1 --2- 172.21.15.45:0/1601798914 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f249006af00 0x7f249006d3c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f2498000c00 tx=0x7f24980047c0 comp rx=0 tx=0).stop 2023-10-08T20:12:03.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.713+0000 7f24ab11a700 1 -- 172.21.15.45:0/1601798914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24a406ea70 msgr2=0x7f24a40c7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:03.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.713+0000 7f24ab11a700 1 --2- 172.21.15.45:0/1601798914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24a406ea70 0x7f24a40c7490 secure :-1 s=READY pgs=3299 cs=0 l=1 rev1=1 crypto rx=0x7f249400e9c0 tx=0x7f249400ecd0 comp rx=0 tx=0).stop 2023-10-08T20:12:03.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.713+0000 7f24a96b7700 1 -- 172.21.15.45:0/1601798914 reap_dead start 2023-10-08T20:12:03.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.713+0000 7f24ab11a700 1 -- 172.21.15.45:0/1601798914 shutdown_connections 2023-10-08T20:12:03.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.713+0000 7f24ab11a700 1 -- 172.21.15.45:0/1601798914 >> 172.21.15.45:0/1601798914 conn(0x7f24a4098b60 msgr2=0x7f24a4159110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:03.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.713+0000 7f24ab11a700 1 -- 172.21.15.45:0/1601798914 shutdown_connections 2023-10-08T20:12:03.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.713+0000 7f24ab11a700 1 -- 172.21.15.45:0/1601798914 wait complete. 2023-10-08T20:12:03.727 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-08T20:12:03.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.867+0000 7f6cfab39700 1 -- 172.21.15.45:0/4022539318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cf40c9ff0 msgr2=0x7f6cf40ca480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:03.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.867+0000 7f6cfab39700 1 --2- 172.21.15.45:0/4022539318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cf40c9ff0 0x7f6cf40ca480 secure :-1 s=READY pgs=3301 cs=0 l=1 rev1=1 crypto rx=0x7f6cec009fd0 tx=0x7f6cec00b380 comp rx=0 tx=0).stop 2023-10-08T20:12:03.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.867+0000 7f6cfab39700 1 -- 172.21.15.45:0/4022539318 shutdown_connections 2023-10-08T20:12:03.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.867+0000 7f6cfab39700 1 --2- 172.21.15.45:0/4022539318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cf40c9ff0 0x7f6cf40ca480 unknown :-1 s=CLOSED pgs=3301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:03.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.867+0000 7f6cfab39700 1 --2- 172.21.15.45:0/4022539318 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cf4158950 0x7f6cf40cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:03.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.867+0000 7f6cfab39700 1 -- 172.21.15.45:0/4022539318 >> 172.21.15.45:0/4022539318 conn(0x7f6cf40b0430 msgr2=0x7f6cf40b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:03.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.867+0000 7f6cfab39700 1 -- 172.21.15.45:0/4022539318 shutdown_connections 2023-10-08T20:12:03.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.867+0000 7f6cfab39700 1 -- 172.21.15.45:0/4022539318 wait complete. 2023-10-08T20:12:03.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.868+0000 7f6cfab39700 1 Processor -- start 2023-10-08T20:12:03.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.868+0000 7f6cfab39700 1 -- start start 2023-10-08T20:12:03.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.869+0000 7f6cfab39700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cf40c9ff0 0x7f6cf40acc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:03.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.869+0000 7f6cfab39700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cf4158950 0x7f6cf40cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:03.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.869+0000 7f6cfab39700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cf415c320 0x7f6cf4156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:03.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.869+0000 7f6cfab39700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf40ae890 con 0x7f6cf415c320 2023-10-08T20:12:03.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.869+0000 7f6cfab39700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf40adf30 con 0x7f6cf40c9ff0 2023-10-08T20:12:03.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.869+0000 7f6cfab39700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf40ad250 con 0x7f6cf4158950 2023-10-08T20:12:03.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.869+0000 7f6cf90d6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cf415c320 0x7f6cf4156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:03.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.869+0000 7f6cf90d6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cf415c320 0x7f6cf4156aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51678/0 (socket says 172.21.15.45:51678) 2023-10-08T20:12:03.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.869+0000 7f6cf90d6700 1 -- 172.21.15.45:0/328056604 learned_addr learned my addr 172.21.15.45:0/328056604 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:12:03.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.870+0000 7f6cf88d5700 1 --2- 172.21.15.45:0/328056604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cf40c9ff0 0x7f6cf40acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:03.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.870+0000 7f6cf3fff700 1 --2- 172.21.15.45:0/328056604 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cf4158950 0x7f6cf40cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:03.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.870+0000 7f6cf90d6700 1 -- 172.21.15.45:0/328056604 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cf4158950 msgr2=0x7f6cf40cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:03.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.870+0000 7f6cf90d6700 1 --2- 172.21.15.45:0/328056604 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cf4158950 0x7f6cf40cb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:03.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.870+0000 7f6cf90d6700 1 -- 172.21.15.45:0/328056604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cf40c9ff0 msgr2=0x7f6cf40acc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:03.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.870+0000 7f6cf90d6700 1 --2- 172.21.15.45:0/328056604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cf40c9ff0 0x7f6cf40acc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:03.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.870+0000 7f6cf90d6700 1 -- 172.21.15.45:0/328056604 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cec009d00 con 0x7f6cf415c320 2023-10-08T20:12:03.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.870+0000 7f6cf88d5700 1 --2- 172.21.15.45:0/328056604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cf40c9ff0 0x7f6cf40acc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T20:12:03.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.870+0000 7f6cf90d6700 1 --2- 172.21.15.45:0/328056604 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cf415c320 0x7f6cf4156aa0 secure :-1 s=READY pgs=3302 cs=0 l=1 rev1=1 crypto rx=0x7f6cec00b780 tx=0x7f6cec007c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:03.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.870+0000 7f6cf17fa700 1 -- 172.21.15.45:0/328056604 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec00e040 con 0x7f6cf415c320 2023-10-08T20:12:03.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.870+0000 7f6cf17fa700 1 -- 172.21.15.45:0/328056604 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6cec01d890 con 0x7f6cf415c320 2023-10-08T20:12:03.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.870+0000 7f6cfab39700 1 -- 172.21.15.45:0/328056604 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf40ae1d0 con 0x7f6cf415c320 2023-10-08T20:12:03.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.870+0000 7f6cf17fa700 1 -- 172.21.15.45:0/328056604 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec01dca0 con 0x7f6cf415c320 2023-10-08T20:12:03.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.870+0000 7f6cfab39700 1 -- 172.21.15.45:0/328056604 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf4156fe0 con 0x7f6cf415c320 2023-10-08T20:12:03.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.871+0000 7f6cfab39700 1 -- 172.21.15.45:0/328056604 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cf40ae9d0 con 0x7f6cf415c320 2023-10-08T20:12:03.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.872+0000 7f6cf17fa700 1 -- 172.21.15.45:0/328056604 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6cec01b450 con 0x7f6cf415c320 2023-10-08T20:12:03.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.872+0000 7f6cf17fa700 1 --2- 172.21.15.45:0/328056604 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f6ce006aed0 0x7f6ce006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:03.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.872+0000 7f6cf17fa700 1 -- 172.21.15.45:0/328056604 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6cec08b440 con 0x7f6cf415c320 2023-10-08T20:12:03.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.872+0000 7f6cf88d5700 1 --2- 172.21.15.45:0/328056604 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f6ce006aed0 0x7f6ce006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:03.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.873+0000 7f6cf88d5700 1 --2- 172.21.15.45:0/328056604 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f6ce006aed0 0x7f6ce006d390 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4005950 tx=0x7f6ce40058e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:03.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:03.877+0000 7f6cf17fa700 1 -- 172.21.15.45:0/328056604 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6cf40ae9d0 con 0x7f6cf415c320 2023-10-08T20:12:04.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.085+0000 7f6cfab39700 1 -- 172.21.15.45:0/328056604 --> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f6cf40728a0 con 0x7f6ce006aed0 2023-10-08T20:12:04.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.085+0000 7f6cf17fa700 1 -- 172.21.15.45:0/328056604 <== mgr.4105 v2:172.21.15.78:6832/3438117854 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6ce400b950 con 0x7f6ce006aed0 2023-10-08T20:12:04.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.088+0000 7f6cfab39700 1 -- 172.21.15.45:0/328056604 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f6ce006aed0 msgr2=0x7f6ce006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:04.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.088+0000 7f6cfab39700 1 --2- 172.21.15.45:0/328056604 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f6ce006aed0 0x7f6ce006d390 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4005950 tx=0x7f6ce40058e0 comp rx=0 tx=0).stop 2023-10-08T20:12:04.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.088+0000 7f6cfab39700 1 -- 172.21.15.45:0/328056604 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cf415c320 msgr2=0x7f6cf4156aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:04.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.088+0000 7f6cfab39700 1 --2- 172.21.15.45:0/328056604 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cf415c320 0x7f6cf4156aa0 secure :-1 s=READY pgs=3302 cs=0 l=1 rev1=1 crypto rx=0x7f6cec00b780 tx=0x7f6cec007c10 comp rx=0 tx=0).stop 2023-10-08T20:12:04.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.088+0000 7f6cfab39700 1 -- 172.21.15.45:0/328056604 shutdown_connections 2023-10-08T20:12:04.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.088+0000 7f6cfab39700 1 --2- 172.21.15.45:0/328056604 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f6ce006aed0 0x7f6ce006d390 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:04.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.088+0000 7f6cfab39700 1 --2- 172.21.15.45:0/328056604 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cf415c320 0x7f6cf4156aa0 unknown :-1 s=CLOSED pgs=3302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:04.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.088+0000 7f6cfab39700 1 --2- 172.21.15.45:0/328056604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cf40c9ff0 0x7f6cf40acc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:04.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.088+0000 7f6cfab39700 1 --2- 172.21.15.45:0/328056604 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cf4158950 0x7f6cf40cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:04.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.088+0000 7f6cfab39700 1 -- 172.21.15.45:0/328056604 >> 172.21.15.45:0/328056604 conn(0x7f6cf40b0430 msgr2=0x7f6cf40b1550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:04.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.088+0000 7f6cfab39700 1 -- 172.21.15.45:0/328056604 shutdown_connections 2023-10-08T20:12:04.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.088+0000 7f6cfab39700 1 -- 172.21.15.45:0/328056604 wait complete. 2023-10-08T20:12:04.091 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 3 to deep-scrub 2023-10-08T20:12:04.103 INFO:tasks.ceph:Scrubbing osd.4 2023-10-08T20:12:04.104 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-08T20:12:04.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.246+0000 7f3661313700 1 -- 172.21.15.45:0/478411885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f365c0b7790 msgr2=0x7f365c0cc720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:04.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.246+0000 7f3661313700 1 --2- 172.21.15.45:0/478411885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f365c0b7790 0x7f365c0cc720 secure :-1 s=READY pgs=3304 cs=0 l=1 rev1=1 crypto rx=0x7f3650005fd0 tx=0x7f3650009c70 comp rx=0 tx=0).stop 2023-10-08T20:12:04.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.246+0000 7f3661313700 1 -- 172.21.15.45:0/478411885 shutdown_connections 2023-10-08T20:12:04.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.246+0000 7f3661313700 1 --2- 172.21.15.45:0/478411885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f365c0b7790 0x7f365c0cc720 unknown :-1 s=CLOSED pgs=3304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:04.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.246+0000 7f3661313700 1 -- 172.21.15.45:0/478411885 >> 172.21.15.45:0/478411885 conn(0x7f365c071940 msgr2=0x7f365c071d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:04.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.246+0000 7f3661313700 1 -- 172.21.15.45:0/478411885 shutdown_connections 2023-10-08T20:12:04.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.246+0000 7f3661313700 1 -- 172.21.15.45:0/478411885 wait complete. 2023-10-08T20:12:04.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.247+0000 7f3661313700 1 Processor -- start 2023-10-08T20:12:04.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.247+0000 7f3661313700 1 -- start start 2023-10-08T20:12:04.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.248+0000 7f3661313700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f365c0b7790 0x7f365c15e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:04.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.248+0000 7f3661313700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f365c0ccc60 0x7f365c0b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:04.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.248+0000 7f3661313700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f365c15bcd0 0x7f365c0b2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:04.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.248+0000 7f3661313700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365c0b31d0 con 0x7f365c0ccc60 2023-10-08T20:12:04.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.248+0000 7f3661313700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365c0b2a80 con 0x7f365c15bcd0 2023-10-08T20:12:04.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.248+0000 7f3661313700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f365c0c9b70 con 0x7f365c0b7790 2023-10-08T20:12:04.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.248+0000 7f365a7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f365c0ccc60 0x7f365c0b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:04.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.248+0000 7f365a7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f365c0ccc60 0x7f365c0b1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51690/0 (socket says 172.21.15.45:51690) 2023-10-08T20:12:04.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.248+0000 7f365a7fc700 1 -- 172.21.15.45:0/3267811398 learned_addr learned my addr 172.21.15.45:0/3267811398 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:12:04.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.248+0000 7f365b7fe700 1 --2- 172.21.15.45:0/3267811398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f365c15bcd0 0x7f365c0b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:04.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.248+0000 7f365affd700 1 --2- 172.21.15.45:0/3267811398 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f365c0b7790 0x7f365c15e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:04.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.249+0000 7f365a7fc700 1 -- 172.21.15.45:0/3267811398 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f365c0b7790 msgr2=0x7f365c15e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:04.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.249+0000 7f365a7fc700 1 --2- 172.21.15.45:0/3267811398 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f365c0b7790 0x7f365c15e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:04.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.249+0000 7f365a7fc700 1 -- 172.21.15.45:0/3267811398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f365c15bcd0 msgr2=0x7f365c0b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:04.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.249+0000 7f365a7fc700 1 --2- 172.21.15.45:0/3267811398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f365c15bcd0 0x7f365c0b2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:04.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.249+0000 7f365a7fc700 1 -- 172.21.15.45:0/3267811398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36500095f0 con 0x7f365c0ccc60 2023-10-08T20:12:04.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.249+0000 7f365b7fe700 1 --2- 172.21.15.45:0/3267811398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f365c15bcd0 0x7f365c0b2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T20:12:04.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.249+0000 7f365a7fc700 1 --2- 172.21.15.45:0/3267811398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f365c0ccc60 0x7f365c0b1ec0 secure :-1 s=READY pgs=3305 cs=0 l=1 rev1=1 crypto rx=0x7f3650004000 tx=0x7f365000be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:04.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.249+0000 7f36437fe700 1 -- 172.21.15.45:0/3267811398 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365001d070 con 0x7f365c0ccc60 2023-10-08T20:12:04.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.249+0000 7f36437fe700 1 -- 172.21.15.45:0/3267811398 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3650003890 con 0x7f365c0ccc60 2023-10-08T20:12:04.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.249+0000 7f3661313700 1 -- 172.21.15.45:0/3267811398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f365c0c9e50 con 0x7f365c0ccc60 2023-10-08T20:12:04.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.249+0000 7f36437fe700 1 -- 172.21.15.45:0/3267811398 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3650003c80 con 0x7f365c0ccc60 2023-10-08T20:12:04.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.249+0000 7f3661313700 1 -- 172.21.15.45:0/3267811398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f365c0ca410 con 0x7f365c0ccc60 2023-10-08T20:12:04.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.250+0000 7f3661313700 1 -- 172.21.15.45:0/3267811398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f365c06cae0 con 0x7f365c0ccc60 2023-10-08T20:12:04.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.251+0000 7f36437fe700 1 -- 172.21.15.45:0/3267811398 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f365000f460 con 0x7f365c0ccc60 2023-10-08T20:12:04.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.251+0000 7f36437fe700 1 --2- 172.21.15.45:0/3267811398 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f364806aed0 0x7f364806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:04.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.251+0000 7f36437fe700 1 -- 172.21.15.45:0/3267811398 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f365008ac90 con 0x7f365c0ccc60 2023-10-08T20:12:04.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.251+0000 7f36437fe700 1 --2- 172.21.15.45:0/3267811398 >> [v2:172.21.15.78:6800/1354746290,v1:172.21.15.78:6801/1354746290] conn(0x7f3648070d30 0x7f3648073150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:04.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.251+0000 7f36437fe700 1 -- 172.21.15.45:0/3267811398 --> [v2:172.21.15.78:6800/1354746290,v1:172.21.15.78:6801/1354746290] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3648073820 con 0x7f3648070d30 2023-10-08T20:12:04.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.251+0000 7f36437fe700 1 -- 172.21.15.45:0/3267811398 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f365008d350 con 0x7f365c0ccc60 2023-10-08T20:12:04.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.251+0000 7f365affd700 1 --2- 172.21.15.45:0/3267811398 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f364806aed0 0x7f364806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:04.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.251+0000 7f365b7fe700 1 --2- 172.21.15.45:0/3267811398 >> [v2:172.21.15.78:6800/1354746290,v1:172.21.15.78:6801/1354746290] conn(0x7f3648070d30 0x7f3648073150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:04.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.252+0000 7f365affd700 1 --2- 172.21.15.45:0/3267811398 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f364806aed0 0x7f364806d390 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f364c007fd0 tx=0x7f364c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:04.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.252+0000 7f365b7fe700 1 --2- 172.21.15.45:0/3267811398 >> [v2:172.21.15.78:6800/1354746290,v1:172.21.15.78:6801/1354746290] conn(0x7f3648070d30 0x7f3648073150 crc :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:04.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.253+0000 7f36437fe700 1 -- 172.21.15.45:0/3267811398 <== osd.4 v2:172.21.15.78:6800/1354746290 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f3648073820 con 0x7f3648070d30 2023-10-08T20:12:04.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.268+0000 7f3661313700 1 -- 172.21.15.45:0/3267811398 --> [v2:172.21.15.78:6800/1354746290,v1:172.21.15.78:6801/1354746290] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f365c0ca600 con 0x7f3648070d30 2023-10-08T20:12:04.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.269+0000 7f36437fe700 1 -- 172.21.15.45:0/3267811398 <== osd.4 v2:172.21.15.78:6800/1354746290 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f365c0ca600 con 0x7f3648070d30 2023-10-08T20:12:04.270 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-08T20:12:04.270 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-10-08T20:12:04.270 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-08T20:12:04.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.269+0000 7f3661313700 1 -- 172.21.15.45:0/3267811398 >> [v2:172.21.15.78:6800/1354746290,v1:172.21.15.78:6801/1354746290] conn(0x7f3648070d30 msgr2=0x7f3648073150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:04.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.269+0000 7f3661313700 1 --2- 172.21.15.45:0/3267811398 >> [v2:172.21.15.78:6800/1354746290,v1:172.21.15.78:6801/1354746290] conn(0x7f3648070d30 0x7f3648073150 crc :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:04.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.269+0000 7f3661313700 1 -- 172.21.15.45:0/3267811398 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f364806aed0 msgr2=0x7f364806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:04.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.269+0000 7f3661313700 1 --2- 172.21.15.45:0/3267811398 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f364806aed0 0x7f364806d390 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f364c007fd0 tx=0x7f364c009040 comp rx=0 tx=0).stop 2023-10-08T20:12:04.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.269+0000 7f3661313700 1 -- 172.21.15.45:0/3267811398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f365c0ccc60 msgr2=0x7f365c0b1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:04.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.269+0000 7f3661313700 1 --2- 172.21.15.45:0/3267811398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f365c0ccc60 0x7f365c0b1ec0 secure :-1 s=READY pgs=3305 cs=0 l=1 rev1=1 crypto rx=0x7f3650004000 tx=0x7f365000be10 comp rx=0 tx=0).stop 2023-10-08T20:12:04.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.269+0000 7f365b7fe700 1 -- 172.21.15.45:0/3267811398 reap_dead start 2023-10-08T20:12:04.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.269+0000 7f3661313700 1 -- 172.21.15.45:0/3267811398 shutdown_connections 2023-10-08T20:12:04.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.269+0000 7f3661313700 1 -- 172.21.15.45:0/3267811398 >> 172.21.15.45:0/3267811398 conn(0x7f365c071940 msgr2=0x7f365c156d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:04.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.269+0000 7f3661313700 1 -- 172.21.15.45:0/3267811398 shutdown_connections 2023-10-08T20:12:04.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.269+0000 7f3661313700 1 -- 172.21.15.45:0/3267811398 wait complete. 2023-10-08T20:12:04.283 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-08T20:12:04.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.421+0000 7fcb153b6700 1 -- 172.21.15.45:0/144355664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb100b74d0 msgr2=0x7fcb100cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:04.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.421+0000 7fcb153b6700 1 --2- 172.21.15.45:0/144355664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb100b74d0 0x7fcb100cc680 secure :-1 s=READY pgs=3307 cs=0 l=1 rev1=1 crypto rx=0x7fcb04005fd0 tx=0x7fcb04009c70 comp rx=0 tx=0).stop 2023-10-08T20:12:04.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.421+0000 7fcb153b6700 1 -- 172.21.15.45:0/144355664 shutdown_connections 2023-10-08T20:12:04.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.421+0000 7fcb153b6700 1 --2- 172.21.15.45:0/144355664 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb100ccbc0 0x7fcb100b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:04.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.421+0000 7fcb153b6700 1 --2- 172.21.15.45:0/144355664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb100b74d0 0x7fcb100cc680 unknown :-1 s=CLOSED pgs=3307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:04.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.421+0000 7fcb153b6700 1 -- 172.21.15.45:0/144355664 >> 172.21.15.45:0/144355664 conn(0x7fcb10071d30 msgr2=0x7fcb10072140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:04.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.422+0000 7fcb153b6700 1 -- 172.21.15.45:0/144355664 shutdown_connections 2023-10-08T20:12:04.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.422+0000 7fcb153b6700 1 -- 172.21.15.45:0/144355664 wait complete. 2023-10-08T20:12:04.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.423+0000 7fcb153b6700 1 Processor -- start 2023-10-08T20:12:04.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.423+0000 7fcb153b6700 1 -- start start 2023-10-08T20:12:04.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.424+0000 7fcb153b6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb100b74d0 0x7fcb1015c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:04.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.424+0000 7fcb153b6700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb100ccbc0 0x7fcb1014e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:04.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.424+0000 7fcb153b6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb1015bc10 0x7fcb100cae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:04.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.424+0000 7fcb153b6700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb100b4240 con 0x7fcb1015bc10 2023-10-08T20:12:04.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.424+0000 7fcb153b6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb100b2490 con 0x7fcb100b74d0 2023-10-08T20:12:04.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.424+0000 7fcb153b6700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1015c6c0 con 0x7fcb100ccbc0 2023-10-08T20:12:04.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.424+0000 7fcb0f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb1015bc10 0x7fcb100cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:04.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.424+0000 7fcb0f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb1015bc10 0x7fcb100cae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51708/0 (socket says 172.21.15.45:51708) 2023-10-08T20:12:04.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.424+0000 7fcb0f7fe700 1 -- 172.21.15.45:0/969255452 learned_addr learned my addr 172.21.15.45:0/969255452 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:12:04.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.424+0000 7fcb0effd700 1 --2- 172.21.15.45:0/969255452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb100b74d0 0x7fcb1015c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:04.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.424+0000 7fcb0e7fc700 1 --2- 172.21.15.45:0/969255452 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb100ccbc0 0x7fcb1014e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:04.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.424+0000 7fcb0f7fe700 1 -- 172.21.15.45:0/969255452 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb100ccbc0 msgr2=0x7fcb1014e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:04.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.424+0000 7fcb0f7fe700 1 --2- 172.21.15.45:0/969255452 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb100ccbc0 0x7fcb1014e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:04.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.424+0000 7fcb0f7fe700 1 -- 172.21.15.45:0/969255452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb100b74d0 msgr2=0x7fcb1015c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:04.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.424+0000 7fcb0f7fe700 1 --2- 172.21.15.45:0/969255452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb100b74d0 0x7fcb1015c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:04.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.424+0000 7fcb0f7fe700 1 -- 172.21.15.45:0/969255452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb040095f0 con 0x7fcb1015bc10 2023-10-08T20:12:04.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.424+0000 7fcb0f7fe700 1 --2- 172.21.15.45:0/969255452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb1015bc10 0x7fcb100cae20 secure :-1 s=READY pgs=3308 cs=0 l=1 rev1=1 crypto rx=0x7fcb08007ee0 tx=0x7fcb0800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:04.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.425+0000 7fcaf77fe700 1 -- 172.21.15.45:0/969255452 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb08017070 con 0x7fcb1015bc10 2023-10-08T20:12:04.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.425+0000 7fcaf77fe700 1 -- 172.21.15.45:0/969255452 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcb0800f040 con 0x7fcb1015bc10 2023-10-08T20:12:04.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.425+0000 7fcb153b6700 1 -- 172.21.15.45:0/969255452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb1015c9a0 con 0x7fcb1015bc10 2023-10-08T20:12:04.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.425+0000 7fcaf77fe700 1 -- 172.21.15.45:0/969255452 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0800de10 con 0x7fcb1015bc10 2023-10-08T20:12:04.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.425+0000 7fcb153b6700 1 -- 172.21.15.45:0/969255452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb1015cf60 con 0x7fcb1015bc10 2023-10-08T20:12:04.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.426+0000 7fcb153b6700 1 -- 172.21.15.45:0/969255452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb100b5e90 con 0x7fcb1015bc10 2023-10-08T20:12:04.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.426+0000 7fcaf77fe700 1 -- 172.21.15.45:0/969255452 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcb0801c410 con 0x7fcb1015bc10 2023-10-08T20:12:04.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.427+0000 7fcaf77fe700 1 --2- 172.21.15.45:0/969255452 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fcafc06aed0 0x7fcafc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:04.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.427+0000 7fcaf77fe700 1 -- 172.21.15.45:0/969255452 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fcb08089170 con 0x7fcb1015bc10 2023-10-08T20:12:04.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.427+0000 7fcb0effd700 1 --2- 172.21.15.45:0/969255452 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fcafc06aed0 0x7fcafc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:04.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.427+0000 7fcb0effd700 1 --2- 172.21.15.45:0/969255452 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fcafc06aed0 0x7fcafc06d390 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fcb00000f60 tx=0x7fcb00009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:04.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.432+0000 7fcaf77fe700 1 -- 172.21.15.45:0/969255452 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcb08057f20 con 0x7fcb1015bc10 2023-10-08T20:12:04.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.640+0000 7fcb153b6700 1 -- 172.21.15.45:0/969255452 --> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb1004e4c0 con 0x7fcafc06aed0 2023-10-08T20:12:04.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.641+0000 7fcaf77fe700 1 -- 172.21.15.45:0/969255452 <== mgr.4105 v2:172.21.15.78:6832/3438117854 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcb1004e4c0 con 0x7fcafc06aed0 2023-10-08T20:12:04.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.643+0000 7fcb153b6700 1 -- 172.21.15.45:0/969255452 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fcafc06aed0 msgr2=0x7fcafc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:04.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.643+0000 7fcb153b6700 1 --2- 172.21.15.45:0/969255452 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fcafc06aed0 0x7fcafc06d390 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fcb00000f60 tx=0x7fcb00009040 comp rx=0 tx=0).stop 2023-10-08T20:12:04.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.643+0000 7fcb153b6700 1 -- 172.21.15.45:0/969255452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb1015bc10 msgr2=0x7fcb100cae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:04.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.643+0000 7fcb153b6700 1 --2- 172.21.15.45:0/969255452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb1015bc10 0x7fcb100cae20 secure :-1 s=READY pgs=3308 cs=0 l=1 rev1=1 crypto rx=0x7fcb08007ee0 tx=0x7fcb0800d3b0 comp rx=0 tx=0).stop 2023-10-08T20:12:04.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.643+0000 7fcb153b6700 1 -- 172.21.15.45:0/969255452 shutdown_connections 2023-10-08T20:12:04.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.643+0000 7fcb153b6700 1 --2- 172.21.15.45:0/969255452 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fcafc06aed0 0x7fcafc06d390 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:04.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.643+0000 7fcb153b6700 1 --2- 172.21.15.45:0/969255452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb1015bc10 0x7fcb100cae20 unknown :-1 s=CLOSED pgs=3308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:04.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.643+0000 7fcb153b6700 1 --2- 172.21.15.45:0/969255452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb100b74d0 0x7fcb1015c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:04.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.643+0000 7fcb153b6700 1 --2- 172.21.15.45:0/969255452 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb100ccbc0 0x7fcb1014e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:04.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.643+0000 7fcb153b6700 1 -- 172.21.15.45:0/969255452 >> 172.21.15.45:0/969255452 conn(0x7fcb10071d30 msgr2=0x7fcb10157510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:04.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.643+0000 7fcb153b6700 1 -- 172.21.15.45:0/969255452 shutdown_connections 2023-10-08T20:12:04.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.643+0000 7fcb153b6700 1 -- 172.21.15.45:0/969255452 wait complete. 2023-10-08T20:12:04.646 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 4 to deep-scrub 2023-10-08T20:12:04.657 INFO:tasks.ceph:Scrubbing osd.5 2023-10-08T20:12:04.658 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-08T20:12:04.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.802+0000 7fb01a5ab700 1 -- 172.21.15.45:0/2976819282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0140cd1c0 msgr2=0x7fb01406e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:04.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.802+0000 7fb01a5ab700 1 --2- 172.21.15.45:0/2976819282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0140cd1c0 0x7fb01406e200 secure :-1 s=READY pgs=3310 cs=0 l=1 rev1=1 crypto rx=0x7fb014070d40 tx=0x7fb004009ba0 comp rx=0 tx=0).stop 2023-10-08T20:12:04.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.802+0000 7fb01a5ab700 1 -- 172.21.15.45:0/2976819282 shutdown_connections 2023-10-08T20:12:04.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.802+0000 7fb01a5ab700 1 --2- 172.21.15.45:0/2976819282 >> v2:172.21.15.78:3300/0 conn(0x7fb01406e740 0x7fb0140ab950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:04.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.802+0000 7fb01a5ab700 1 --2- 172.21.15.45:0/2976819282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0140cd1c0 0x7fb01406e200 unknown :-1 s=CLOSED pgs=3310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:04.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.802+0000 7fb01a5ab700 1 -- 172.21.15.45:0/2976819282 >> 172.21.15.45:0/2976819282 conn(0x7fb014097a20 msgr2=0x7fb0140ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:04.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.802+0000 7fb01a5ab700 1 -- 172.21.15.45:0/2976819282 shutdown_connections 2023-10-08T20:12:04.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.802+0000 7fb01a5ab700 1 -- 172.21.15.45:0/2976819282 wait complete. 2023-10-08T20:12:04.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.803+0000 7fb01a5ab700 1 Processor -- start 2023-10-08T20:12:04.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.804+0000 7fb01a5ab700 1 -- start start 2023-10-08T20:12:04.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.804+0000 7fb01a5ab700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb01406e740 0x7fb0141f0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:04.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.804+0000 7fb01a5ab700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0140cd1c0 0x7fb01409bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:04.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.804+0000 7fb01a5ab700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb014158a00 0x7fb0140c2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:04.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.804+0000 7fb01a5ab700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb014098640 con 0x7fb01406e740 2023-10-08T20:12:04.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.804+0000 7fb01a5ab700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb014098920 con 0x7fb0140cd1c0 2023-10-08T20:12:04.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.804+0000 7fb01a5ab700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb014098c00 con 0x7fb014158a00 2023-10-08T20:12:04.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.804+0000 7fb013fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb01406e740 0x7fb0141f0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:04.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.804+0000 7fb013fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb01406e740 0x7fb0141f0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51718/0 (socket says 172.21.15.45:51718) 2023-10-08T20:12:04.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.804+0000 7fb013fff700 1 -- 172.21.15.45:0/2916105941 learned_addr learned my addr 172.21.15.45:0/2916105941 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:12:04.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.805+0000 7fb0137fe700 1 --2- 172.21.15.45:0/2916105941 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0140cd1c0 0x7fb01409bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:04.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.805+0000 7fb018b48700 1 --2- 172.21.15.45:0/2916105941 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb014158a00 0x7fb0140c2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:04.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.805+0000 7fb013fff700 1 -- 172.21.15.45:0/2916105941 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb014158a00 msgr2=0x7fb0140c2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:04.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.805+0000 7fb013fff700 1 --2- 172.21.15.45:0/2916105941 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb014158a00 0x7fb0140c2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:04.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.805+0000 7fb013fff700 1 -- 172.21.15.45:0/2916105941 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0140cd1c0 msgr2=0x7fb01409bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:04.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.805+0000 7fb013fff700 1 --2- 172.21.15.45:0/2916105941 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0140cd1c0 0x7fb01409bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:04.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.805+0000 7fb013fff700 1 -- 172.21.15.45:0/2916105941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb004009520 con 0x7fb01406e740 2023-10-08T20:12:04.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.805+0000 7fb018b48700 1 --2- 172.21.15.45:0/2916105941 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb014158a00 0x7fb0140c2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T20:12:04.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.805+0000 7fb013fff700 1 --2- 172.21.15.45:0/2916105941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb01406e740 0x7fb0141f0550 secure :-1 s=READY pgs=3311 cs=0 l=1 rev1=1 crypto rx=0x7fb00800c450 tx=0x7fb00800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:04.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.805+0000 7fb010ff9700 1 -- 172.21.15.45:0/2916105941 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb008011790 con 0x7fb01406e740 2023-10-08T20:12:04.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.805+0000 7fb010ff9700 1 -- 172.21.15.45:0/2916105941 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb0080118f0 con 0x7fb01406e740 2023-10-08T20:12:04.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.805+0000 7fb01a5ab700 1 -- 172.21.15.45:0/2916105941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb014098ee0 con 0x7fb01406e740 2023-10-08T20:12:04.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.805+0000 7fb010ff9700 1 -- 172.21.15.45:0/2916105941 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb008011ce0 con 0x7fb01406e740 2023-10-08T20:12:04.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.805+0000 7fb01a5ab700 1 -- 172.21.15.45:0/2916105941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0141f0a90 con 0x7fb01406e740 2023-10-08T20:12:04.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.806+0000 7fb01a5ab700 1 -- 172.21.15.45:0/2916105941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb01409c710 con 0x7fb01406e740 2023-10-08T20:12:04.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.807+0000 7fb010ff9700 1 -- 172.21.15.45:0/2916105941 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb00801c460 con 0x7fb01406e740 2023-10-08T20:12:04.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.807+0000 7fb010ff9700 1 --2- 172.21.15.45:0/2916105941 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb00006aed0 0x7fb00006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:04.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.807+0000 7fb010ff9700 1 -- 172.21.15.45:0/2916105941 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb008089b90 con 0x7fb01406e740 2023-10-08T20:12:04.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.808+0000 7fb010ff9700 1 --2- 172.21.15.45:0/2916105941 >> [v2:172.21.15.78:6824/1101719457,v1:172.21.15.78:6825/1101719457] conn(0x7fb000070d30 0x7fb000073150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:04.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.808+0000 7fb010ff9700 1 -- 172.21.15.45:0/2916105941 --> [v2:172.21.15.78:6824/1101719457,v1:172.21.15.78:6825/1101719457] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb000073820 con 0x7fb000070d30 2023-10-08T20:12:04.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.808+0000 7fb010ff9700 1 -- 172.21.15.45:0/2916105941 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb008089fe0 con 0x7fb01406e740 2023-10-08T20:12:04.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.808+0000 7fb0137fe700 1 --2- 172.21.15.45:0/2916105941 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb00006aed0 0x7fb00006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:04.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.808+0000 7fb018b48700 1 --2- 172.21.15.45:0/2916105941 >> [v2:172.21.15.78:6824/1101719457,v1:172.21.15.78:6825/1101719457] conn(0x7fb000070d30 0x7fb000073150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:04.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.808+0000 7fb0137fe700 1 --2- 172.21.15.45:0/2916105941 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb00006aed0 0x7fb00006d390 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fb004009810 tx=0x7fb0040047c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:04.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.808+0000 7fb018b48700 1 --2- 172.21.15.45:0/2916105941 >> [v2:172.21.15.78:6824/1101719457,v1:172.21.15.78:6825/1101719457] conn(0x7fb000070d30 0x7fb000073150 crc :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:04.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.809+0000 7fb010ff9700 1 -- 172.21.15.45:0/2916105941 <== osd.5 v2:172.21.15.78:6824/1101719457 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fb000073820 con 0x7fb000070d30 2023-10-08T20:12:04.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.824+0000 7fb01a5ab700 1 -- 172.21.15.45:0/2916105941 --> [v2:172.21.15.78:6824/1101719457,v1:172.21.15.78:6825/1101719457] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb0140c8c20 con 0x7fb000070d30 2023-10-08T20:12:04.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.825+0000 7fb010ff9700 1 -- 172.21.15.45:0/2916105941 <== osd.5 v2:172.21.15.78:6824/1101719457 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb0140c8c20 con 0x7fb000070d30 2023-10-08T20:12:04.826 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-08T20:12:04.826 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-10-08T20:12:04.826 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-08T20:12:04.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.825+0000 7fb01a5ab700 1 -- 172.21.15.45:0/2916105941 >> [v2:172.21.15.78:6824/1101719457,v1:172.21.15.78:6825/1101719457] conn(0x7fb000070d30 msgr2=0x7fb000073150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:04.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.825+0000 7fb01a5ab700 1 --2- 172.21.15.45:0/2916105941 >> [v2:172.21.15.78:6824/1101719457,v1:172.21.15.78:6825/1101719457] conn(0x7fb000070d30 0x7fb000073150 crc :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:04.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.825+0000 7fb01a5ab700 1 -- 172.21.15.45:0/2916105941 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb00006aed0 msgr2=0x7fb00006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:04.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.825+0000 7fb01a5ab700 1 --2- 172.21.15.45:0/2916105941 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb00006aed0 0x7fb00006d390 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fb004009810 tx=0x7fb0040047c0 comp rx=0 tx=0).stop 2023-10-08T20:12:04.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.825+0000 7fb01a5ab700 1 -- 172.21.15.45:0/2916105941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb01406e740 msgr2=0x7fb0141f0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:04.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.825+0000 7fb01a5ab700 1 --2- 172.21.15.45:0/2916105941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb01406e740 0x7fb0141f0550 secure :-1 s=READY pgs=3311 cs=0 l=1 rev1=1 crypto rx=0x7fb00800c450 tx=0x7fb00800c760 comp rx=0 tx=0).stop 2023-10-08T20:12:04.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.825+0000 7fb018b48700 1 -- 172.21.15.45:0/2916105941 reap_dead start 2023-10-08T20:12:04.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.825+0000 7fb01a5ab700 1 -- 172.21.15.45:0/2916105941 shutdown_connections 2023-10-08T20:12:04.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.825+0000 7fb01a5ab700 1 -- 172.21.15.45:0/2916105941 >> 172.21.15.45:0/2916105941 conn(0x7fb014097a20 msgr2=0x7fb0140c7740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:04.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.825+0000 7fb01a5ab700 1 -- 172.21.15.45:0/2916105941 shutdown_connections 2023-10-08T20:12:04.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.826+0000 7fb01a5ab700 1 -- 172.21.15.45:0/2916105941 wait complete. 2023-10-08T20:12:04.840 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-08T20:12:04.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.979+0000 7f4198abe700 1 -- 172.21.15.45:0/1020046127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41941599f0 msgr2=0x7f419406ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:04.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.979+0000 7f4198abe700 1 --2- 172.21.15.45:0/1020046127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41941599f0 0x7f419406ee90 secure :-1 s=READY pgs=3313 cs=0 l=1 rev1=1 crypto rx=0x7f4194071700 tx=0x7f4184009ba0 comp rx=0 tx=0).stop 2023-10-08T20:12:04.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.979+0000 7f4198abe700 1 -- 172.21.15.45:0/1020046127 shutdown_connections 2023-10-08T20:12:04.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.979+0000 7f4198abe700 1 --2- 172.21.15.45:0/1020046127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41941599f0 0x7f419406ee90 unknown :-1 s=CLOSED pgs=3313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:04.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.979+0000 7f4198abe700 1 --2- 172.21.15.45:0/1020046127 >> v2:172.21.15.78:3300/0 conn(0x7f419406f3d0 0x7f41940cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:04.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.979+0000 7f4198abe700 1 -- 172.21.15.45:0/1020046127 >> 172.21.15.45:0/1020046127 conn(0x7f41940cf750 msgr2=0x7f41940cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:04.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.979+0000 7f4198abe700 1 -- 172.21.15.45:0/1020046127 shutdown_connections 2023-10-08T20:12:04.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.980+0000 7f4198abe700 1 -- 172.21.15.45:0/1020046127 wait complete. 2023-10-08T20:12:04.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.981+0000 7f4198abe700 1 Processor -- start 2023-10-08T20:12:04.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.981+0000 7f4198abe700 1 -- start start 2023-10-08T20:12:04.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.982+0000 7f4198abe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f419406f3d0 0x7f419414b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:04.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.982+0000 7f4198abe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41940cc6a0 0x7f41940c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:04.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.982+0000 7f4198abe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41941599f0 0x7f41940c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:04.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.982+0000 7f4198abe700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41940c3fa0 con 0x7f419406f3d0 2023-10-08T20:12:04.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.982+0000 7f4198abe700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419414b6a0 con 0x7f41940cc6a0 2023-10-08T20:12:04.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.982+0000 7f4198abe700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41940c3390 con 0x7f41941599f0 2023-10-08T20:12:04.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.982+0000 7f419259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f419406f3d0 0x7f419414b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:04.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.982+0000 7f419259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f419406f3d0 0x7f419414b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51734/0 (socket says 172.21.15.45:51734) 2023-10-08T20:12:04.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.982+0000 7f419259c700 1 -- 172.21.15.45:0/2387037489 learned_addr learned my addr 172.21.15.45:0/2387037489 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:12:04.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.982+0000 7f4192d9d700 1 --2- 172.21.15.45:0/2387037489 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41941599f0 0x7f41940c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:04.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.982+0000 7f419259c700 1 -- 172.21.15.45:0/2387037489 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41941599f0 msgr2=0x7f41940c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:04.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.982+0000 7f419259c700 1 --2- 172.21.15.45:0/2387037489 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41941599f0 0x7f41940c8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:04.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.982+0000 7f4191d9b700 1 --2- 172.21.15.45:0/2387037489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41940cc6a0 0x7f41940c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:04.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.982+0000 7f419259c700 1 -- 172.21.15.45:0/2387037489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41940cc6a0 msgr2=0x7f41940c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:04.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.982+0000 7f419259c700 1 --2- 172.21.15.45:0/2387037489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41940cc6a0 0x7f41940c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:04.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.982+0000 7f419259c700 1 -- 172.21.15.45:0/2387037489 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4184009520 con 0x7f419406f3d0 2023-10-08T20:12:04.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.983+0000 7f419259c700 1 --2- 172.21.15.45:0/2387037489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f419406f3d0 0x7f419414b160 secure :-1 s=READY pgs=3314 cs=0 l=1 rev1=1 crypto rx=0x7f4184009ef0 tx=0x7f418400bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:04.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.983+0000 7f4182ffd700 1 -- 172.21.15.45:0/2387037489 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418401b070 con 0x7f419406f3d0 2023-10-08T20:12:04.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.983+0000 7f4182ffd700 1 -- 172.21.15.45:0/2387037489 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f418400fa20 con 0x7f419406f3d0 2023-10-08T20:12:04.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.983+0000 7f4198abe700 1 -- 172.21.15.45:0/2387037489 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41940c3670 con 0x7f419406f3d0 2023-10-08T20:12:04.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.983+0000 7f4182ffd700 1 -- 172.21.15.45:0/2387037489 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418400fe50 con 0x7f419406f3d0 2023-10-08T20:12:04.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.983+0000 7f4198abe700 1 -- 172.21.15.45:0/2387037489 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41940c3c30 con 0x7f419406f3d0 2023-10-08T20:12:04.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.984+0000 7f4198abe700 1 -- 172.21.15.45:0/2387037489 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f419404e4c0 con 0x7f419406f3d0 2023-10-08T20:12:04.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.984+0000 7f4182ffd700 1 -- 172.21.15.45:0/2387037489 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f418401f070 con 0x7f419406f3d0 2023-10-08T20:12:04.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.985+0000 7f4182ffd700 1 --2- 172.21.15.45:0/2387037489 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f417406aed0 0x7f417406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:04.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.985+0000 7f4182ffd700 1 -- 172.21.15.45:0/2387037489 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f418408a570 con 0x7f419406f3d0 2023-10-08T20:12:04.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.985+0000 7f4191d9b700 1 --2- 172.21.15.45:0/2387037489 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f417406aed0 0x7f417406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:04.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.986+0000 7f4191d9b700 1 --2- 172.21.15.45:0/2387037489 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f417406aed0 0x7f417406d390 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f41940d0840 tx=0x7f4188009260 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:04.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:04.994+0000 7f4182ffd700 1 -- 172.21.15.45:0/2387037489 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4184055ad0 con 0x7f419406f3d0 2023-10-08T20:12:05.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.204+0000 7f4198abe700 1 -- 172.21.15.45:0/2387037489 --> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f419415a020 con 0x7f417406aed0 2023-10-08T20:12:05.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.204+0000 7f4182ffd700 1 -- 172.21.15.45:0/2387037489 <== mgr.4105 v2:172.21.15.78:6832/3438117854 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4188010830 con 0x7f417406aed0 2023-10-08T20:12:05.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.207+0000 7f4198abe700 1 -- 172.21.15.45:0/2387037489 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f417406aed0 msgr2=0x7f417406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:05.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.207+0000 7f4198abe700 1 --2- 172.21.15.45:0/2387037489 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f417406aed0 0x7f417406d390 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f41940d0840 tx=0x7f4188009260 comp rx=0 tx=0).stop 2023-10-08T20:12:05.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.207+0000 7f4198abe700 1 -- 172.21.15.45:0/2387037489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f419406f3d0 msgr2=0x7f419414b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:05.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.207+0000 7f4198abe700 1 --2- 172.21.15.45:0/2387037489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f419406f3d0 0x7f419414b160 secure :-1 s=READY pgs=3314 cs=0 l=1 rev1=1 crypto rx=0x7f4184009ef0 tx=0x7f418400bfd0 comp rx=0 tx=0).stop 2023-10-08T20:12:05.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.207+0000 7f4198abe700 1 -- 172.21.15.45:0/2387037489 shutdown_connections 2023-10-08T20:12:05.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.207+0000 7f4198abe700 1 --2- 172.21.15.45:0/2387037489 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f417406aed0 0x7f417406d390 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:05.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.207+0000 7f4198abe700 1 --2- 172.21.15.45:0/2387037489 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41941599f0 0x7f41940c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:05.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.207+0000 7f4198abe700 1 --2- 172.21.15.45:0/2387037489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f419406f3d0 0x7f419414b160 unknown :-1 s=CLOSED pgs=3314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:05.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.207+0000 7f4198abe700 1 --2- 172.21.15.45:0/2387037489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41940cc6a0 0x7f41940c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:05.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.207+0000 7f4198abe700 1 -- 172.21.15.45:0/2387037489 >> 172.21.15.45:0/2387037489 conn(0x7f41940cf750 msgr2=0x7f419415c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:05.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.207+0000 7f4198abe700 1 -- 172.21.15.45:0/2387037489 shutdown_connections 2023-10-08T20:12:05.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.207+0000 7f4198abe700 1 -- 172.21.15.45:0/2387037489 wait complete. 2023-10-08T20:12:05.209 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 5 to deep-scrub 2023-10-08T20:12:05.221 INFO:tasks.ceph:Scrubbing osd.6 2023-10-08T20:12:05.221 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-08T20:12:05.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.363+0000 7fef69fa9700 1 -- 172.21.15.45:0/2496628169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef640c9cc0 msgr2=0x7fef640cb0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:05.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.363+0000 7fef69fa9700 1 --2- 172.21.15.45:0/2496628169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef640c9cc0 0x7fef640cb0e0 secure :-1 s=READY pgs=3316 cs=0 l=1 rev1=1 crypto rx=0x7fef58005fd0 tx=0x7fef58009c70 comp rx=0 tx=0).stop 2023-10-08T20:12:05.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.363+0000 7fef69fa9700 1 -- 172.21.15.45:0/2496628169 shutdown_connections 2023-10-08T20:12:05.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.363+0000 7fef69fa9700 1 --2- 172.21.15.45:0/2496628169 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fef6415bdd0 0x7fef640cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:05.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.363+0000 7fef69fa9700 1 --2- 172.21.15.45:0/2496628169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef640c9cc0 0x7fef640cb0e0 unknown :-1 s=CLOSED pgs=3316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:05.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.363+0000 7fef69fa9700 1 -- 172.21.15.45:0/2496628169 >> 172.21.15.45:0/2496628169 conn(0x7fef64097a20 msgr2=0x7fef640ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:05.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.364+0000 7fef69fa9700 1 -- 172.21.15.45:0/2496628169 shutdown_connections 2023-10-08T20:12:05.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.364+0000 7fef69fa9700 1 -- 172.21.15.45:0/2496628169 wait complete. 2023-10-08T20:12:05.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.365+0000 7fef69fa9700 1 Processor -- start 2023-10-08T20:12:05.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.365+0000 7fef69fa9700 1 -- start start 2023-10-08T20:12:05.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.366+0000 7fef69fa9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef640c9cc0 0x7fef6414ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:05.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.366+0000 7fef69fa9700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fef640cb620 0x7fef641e3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:05.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.366+0000 7fef69fa9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef6415bdd0 0x7fef6415a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:05.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.366+0000 7fef69fa9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6414f2d0 con 0x7fef640c9cc0 2023-10-08T20:12:05.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.366+0000 7fef69fa9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef64155360 con 0x7fef6415bdd0 2023-10-08T20:12:05.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.366+0000 7fef69fa9700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef64155640 con 0x7fef640cb620 2023-10-08T20:12:05.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.366+0000 7fef637fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef640c9cc0 0x7fef6414ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:05.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.366+0000 7fef637fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef640c9cc0 0x7fef6414ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51748/0 (socket says 172.21.15.45:51748) 2023-10-08T20:12:05.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.366+0000 7fef637fe700 1 -- 172.21.15.45:0/1132218287 learned_addr learned my addr 172.21.15.45:0/1132218287 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:12:05.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.366+0000 7fef62ffd700 1 --2- 172.21.15.45:0/1132218287 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fef640cb620 0x7fef641e3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:05.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.366+0000 7fef63fff700 1 --2- 172.21.15.45:0/1132218287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef6415bdd0 0x7fef6415a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:05.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.366+0000 7fef637fe700 1 -- 172.21.15.45:0/1132218287 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fef640cb620 msgr2=0x7fef641e3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:05.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.366+0000 7fef637fe700 1 --2- 172.21.15.45:0/1132218287 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fef640cb620 0x7fef641e3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:05.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.366+0000 7fef637fe700 1 -- 172.21.15.45:0/1132218287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef6415bdd0 msgr2=0x7fef6415a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:05.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.366+0000 7fef637fe700 1 --2- 172.21.15.45:0/1132218287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef6415bdd0 0x7fef6415a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:05.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.366+0000 7fef637fe700 1 -- 172.21.15.45:0/1132218287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef580095f0 con 0x7fef640c9cc0 2023-10-08T20:12:05.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.366+0000 7fef63fff700 1 --2- 172.21.15.45:0/1132218287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef6415bdd0 0x7fef6415a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T20:12:05.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.366+0000 7fef637fe700 1 --2- 172.21.15.45:0/1132218287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef640c9cc0 0x7fef6414ed90 secure :-1 s=READY pgs=3317 cs=0 l=1 rev1=1 crypto rx=0x7fef5400d950 tx=0x7fef5400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:05.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.367+0000 7fef4bfff700 1 -- 172.21.15.45:0/1132218287 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef54009930 con 0x7fef640c9cc0 2023-10-08T20:12:05.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.367+0000 7fef69fa9700 1 -- 172.21.15.45:0/1132218287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef64155920 con 0x7fef640c9cc0 2023-10-08T20:12:05.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.367+0000 7fef4bfff700 1 -- 172.21.15.45:0/1132218287 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fef54009b80 con 0x7fef640c9cc0 2023-10-08T20:12:05.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.367+0000 7fef4bfff700 1 -- 172.21.15.45:0/1132218287 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef54010460 con 0x7fef640c9cc0 2023-10-08T20:12:05.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.367+0000 7fef69fa9700 1 -- 172.21.15.45:0/1132218287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef64155ee0 con 0x7fef640c9cc0 2023-10-08T20:12:05.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.368+0000 7fef69fa9700 1 -- 172.21.15.45:0/1132218287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fef640cce60 con 0x7fef640c9cc0 2023-10-08T20:12:05.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.368+0000 7fef4bfff700 1 -- 172.21.15.45:0/1132218287 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fef540105c0 con 0x7fef640c9cc0 2023-10-08T20:12:05.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.369+0000 7fef4bfff700 1 --2- 172.21.15.45:0/1132218287 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fef5006aed0 0x7fef5006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:05.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.369+0000 7fef4bfff700 1 -- 172.21.15.45:0/1132218287 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fef54089700 con 0x7fef640c9cc0 2023-10-08T20:12:05.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.369+0000 7fef62ffd700 1 --2- 172.21.15.45:0/1132218287 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fef5006aed0 0x7fef5006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:05.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.369+0000 7fef4bfff700 1 --2- 172.21.15.45:0/1132218287 >> [v2:172.21.15.78:6808/162875330,v1:172.21.15.78:6810/162875330] conn(0x7fef50070d30 0x7fef50073150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:05.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.369+0000 7fef4bfff700 1 -- 172.21.15.45:0/1132218287 --> [v2:172.21.15.78:6808/162875330,v1:172.21.15.78:6810/162875330] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fef50073820 con 0x7fef50070d30 2023-10-08T20:12:05.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.369+0000 7fef4bfff700 1 -- 172.21.15.45:0/1132218287 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef5408bdc0 con 0x7fef640c9cc0 2023-10-08T20:12:05.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.369+0000 7fef63fff700 1 --2- 172.21.15.45:0/1132218287 >> [v2:172.21.15.78:6808/162875330,v1:172.21.15.78:6810/162875330] conn(0x7fef50070d30 0x7fef50073150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:05.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.369+0000 7fef62ffd700 1 --2- 172.21.15.45:0/1132218287 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fef5006aed0 0x7fef5006d390 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fef640ca0e0 tx=0x7fef580047c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:05.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.370+0000 7fef63fff700 1 --2- 172.21.15.45:0/1132218287 >> [v2:172.21.15.78:6808/162875330,v1:172.21.15.78:6810/162875330] conn(0x7fef50070d30 0x7fef50073150 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:05.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.370+0000 7fef4bfff700 1 -- 172.21.15.45:0/1132218287 <== osd.6 v2:172.21.15.78:6808/162875330 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fef50073820 con 0x7fef50070d30 2023-10-08T20:12:05.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.386+0000 7fef69fa9700 1 -- 172.21.15.45:0/1132218287 --> [v2:172.21.15.78:6808/162875330,v1:172.21.15.78:6810/162875330] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fef640c6880 con 0x7fef50070d30 2023-10-08T20:12:05.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.386+0000 7fef4bfff700 1 -- 172.21.15.45:0/1132218287 <== osd.6 v2:172.21.15.78:6808/162875330 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fef640c6880 con 0x7fef50070d30 2023-10-08T20:12:05.387 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-08T20:12:05.387 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-10-08T20:12:05.387 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-08T20:12:05.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.386+0000 7fef69fa9700 1 -- 172.21.15.45:0/1132218287 >> [v2:172.21.15.78:6808/162875330,v1:172.21.15.78:6810/162875330] conn(0x7fef50070d30 msgr2=0x7fef50073150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:05.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.386+0000 7fef69fa9700 1 --2- 172.21.15.45:0/1132218287 >> [v2:172.21.15.78:6808/162875330,v1:172.21.15.78:6810/162875330] conn(0x7fef50070d30 0x7fef50073150 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:05.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.387+0000 7fef69fa9700 1 -- 172.21.15.45:0/1132218287 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fef5006aed0 msgr2=0x7fef5006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:05.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.387+0000 7fef69fa9700 1 --2- 172.21.15.45:0/1132218287 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fef5006aed0 0x7fef5006d390 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fef640ca0e0 tx=0x7fef580047c0 comp rx=0 tx=0).stop 2023-10-08T20:12:05.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.387+0000 7fef69fa9700 1 -- 172.21.15.45:0/1132218287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef640c9cc0 msgr2=0x7fef6414ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:05.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.387+0000 7fef69fa9700 1 --2- 172.21.15.45:0/1132218287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef640c9cc0 0x7fef6414ed90 secure :-1 s=READY pgs=3317 cs=0 l=1 rev1=1 crypto rx=0x7fef5400d950 tx=0x7fef5400dd10 comp rx=0 tx=0).stop 2023-10-08T20:12:05.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.387+0000 7fef63fff700 1 -- 172.21.15.45:0/1132218287 reap_dead start 2023-10-08T20:12:05.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.387+0000 7fef69fa9700 1 -- 172.21.15.45:0/1132218287 shutdown_connections 2023-10-08T20:12:05.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.387+0000 7fef69fa9700 1 -- 172.21.15.45:0/1132218287 >> 172.21.15.45:0/1132218287 conn(0x7fef64097a20 msgr2=0x7fef640b09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:05.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.387+0000 7fef69fa9700 1 -- 172.21.15.45:0/1132218287 shutdown_connections 2023-10-08T20:12:05.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.387+0000 7fef69fa9700 1 -- 172.21.15.45:0/1132218287 wait complete. 2023-10-08T20:12:05.401 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-08T20:12:05.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.539+0000 7f79dd813700 1 -- 172.21.15.45:0/956397314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79d81599f0 msgr2=0x7f79d806ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:05.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.539+0000 7f79dd813700 1 --2- 172.21.15.45:0/956397314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79d81599f0 0x7f79d806ee90 secure :-1 s=READY pgs=3319 cs=0 l=1 rev1=1 crypto rx=0x7f79d8071700 tx=0x7f79c8009ba0 comp rx=0 tx=0).stop 2023-10-08T20:12:05.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.539+0000 7f79dd813700 1 -- 172.21.15.45:0/956397314 shutdown_connections 2023-10-08T20:12:05.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.539+0000 7f79dd813700 1 --2- 172.21.15.45:0/956397314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79d81599f0 0x7f79d806ee90 unknown :-1 s=CLOSED pgs=3319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:05.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.539+0000 7f79dd813700 1 --2- 172.21.15.45:0/956397314 >> v2:172.21.15.78:3300/0 conn(0x7f79d806f3d0 0x7f79d80cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:05.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.539+0000 7f79dd813700 1 -- 172.21.15.45:0/956397314 >> 172.21.15.45:0/956397314 conn(0x7f79d80cf750 msgr2=0x7f79d80cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:05.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.539+0000 7f79dd813700 1 -- 172.21.15.45:0/956397314 shutdown_connections 2023-10-08T20:12:05.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.539+0000 7f79dd813700 1 -- 172.21.15.45:0/956397314 wait complete. 2023-10-08T20:12:05.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.540+0000 7f79dd813700 1 Processor -- start 2023-10-08T20:12:05.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.541+0000 7f79dd813700 1 -- start start 2023-10-08T20:12:05.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.541+0000 7f79dd813700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79d806f3d0 0x7f79d814cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:05.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.541+0000 7f79dd813700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79d80cc6a0 0x7f79d80b1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:05.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.541+0000 7f79dd813700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f79d81599f0 0x7f79d80c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:05.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.541+0000 7f79dd813700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d80b4e10 con 0x7f79d80cc6a0 2023-10-08T20:12:05.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.541+0000 7f79dd813700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d8158ad0 con 0x7f79d806f3d0 2023-10-08T20:12:05.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.541+0000 7f79dd813700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d80b4190 con 0x7f79d81599f0 2023-10-08T20:12:05.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.541+0000 7f79d67fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79d80cc6a0 0x7f79d80b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:05.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.542+0000 7f79d67fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79d80cc6a0 0x7f79d80b1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51764/0 (socket says 172.21.15.45:51764) 2023-10-08T20:12:05.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.542+0000 7f79d67fc700 1 -- 172.21.15.45:0/124129777 learned_addr learned my addr 172.21.15.45:0/124129777 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:12:05.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.542+0000 7f79d6ffd700 1 --2- 172.21.15.45:0/124129777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79d806f3d0 0x7f79d814cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:05.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.542+0000 7f79d77fe700 1 --2- 172.21.15.45:0/124129777 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f79d81599f0 0x7f79d80c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:05.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.542+0000 7f79d67fc700 1 -- 172.21.15.45:0/124129777 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f79d81599f0 msgr2=0x7f79d80c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:05.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.542+0000 7f79d67fc700 1 --2- 172.21.15.45:0/124129777 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f79d81599f0 0x7f79d80c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:05.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.542+0000 7f79d67fc700 1 -- 172.21.15.45:0/124129777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79d806f3d0 msgr2=0x7f79d814cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:05.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.542+0000 7f79d67fc700 1 --2- 172.21.15.45:0/124129777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79d806f3d0 0x7f79d814cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:05.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.542+0000 7f79d67fc700 1 -- 172.21.15.45:0/124129777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c8009520 con 0x7f79d80cc6a0 2023-10-08T20:12:05.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.542+0000 7f79d67fc700 1 --2- 172.21.15.45:0/124129777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79d80cc6a0 0x7f79d80b1220 secure :-1 s=READY pgs=3320 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00d980 tx=0x7f79cc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:05.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.542+0000 7f79bffff700 1 -- 172.21.15.45:0/124129777 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc004020 con 0x7f79d80cc6a0 2023-10-08T20:12:05.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.542+0000 7f79bffff700 1 -- 172.21.15.45:0/124129777 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f79cc004270 con 0x7f79d80cc6a0 2023-10-08T20:12:05.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.542+0000 7f79dd813700 1 -- 172.21.15.45:0/124129777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d80b4470 con 0x7f79d80cc6a0 2023-10-08T20:12:05.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.542+0000 7f79bffff700 1 -- 172.21.15.45:0/124129777 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc004830 con 0x7f79d80cc6a0 2023-10-08T20:12:05.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.542+0000 7f79dd813700 1 -- 172.21.15.45:0/124129777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d80b4a30 con 0x7f79d80cc6a0 2023-10-08T20:12:05.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.543+0000 7f79dd813700 1 -- 172.21.15.45:0/124129777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d804e4c0 con 0x7f79d80cc6a0 2023-10-08T20:12:05.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.544+0000 7f79bffff700 1 -- 172.21.15.45:0/124129777 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f79cc004990 con 0x7f79d80cc6a0 2023-10-08T20:12:05.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.544+0000 7f79bffff700 1 --2- 172.21.15.45:0/124129777 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f79c406aed0 0x7f79c406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:05.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.544+0000 7f79bffff700 1 -- 172.21.15.45:0/124129777 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f79cc089360 con 0x7f79d80cc6a0 2023-10-08T20:12:05.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.545+0000 7f79d6ffd700 1 --2- 172.21.15.45:0/124129777 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f79c406aed0 0x7f79c406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:05.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.545+0000 7f79d6ffd700 1 --2- 172.21.15.45:0/124129777 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f79c406aed0 0x7f79c406d390 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f79c8009fd0 tx=0x7f79c8019040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:05.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.549+0000 7f79bffff700 1 -- 172.21.15.45:0/124129777 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f79cc0547c0 con 0x7f79d80cc6a0 2023-10-08T20:12:05.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.761+0000 7f79dd813700 1 -- 172.21.15.45:0/124129777 --> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f79d815a020 con 0x7f79c406aed0 2023-10-08T20:12:05.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.762+0000 7f79bffff700 1 -- 172.21.15.45:0/124129777 <== mgr.4105 v2:172.21.15.78:6832/3438117854 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f79c800bc20 con 0x7f79c406aed0 2023-10-08T20:12:05.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.764+0000 7f79dd813700 1 -- 172.21.15.45:0/124129777 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f79c406aed0 msgr2=0x7f79c406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:05.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.764+0000 7f79dd813700 1 --2- 172.21.15.45:0/124129777 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f79c406aed0 0x7f79c406d390 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f79c8009fd0 tx=0x7f79c8019040 comp rx=0 tx=0).stop 2023-10-08T20:12:05.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.764+0000 7f79dd813700 1 -- 172.21.15.45:0/124129777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79d80cc6a0 msgr2=0x7f79d80b1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:05.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.764+0000 7f79dd813700 1 --2- 172.21.15.45:0/124129777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79d80cc6a0 0x7f79d80b1220 secure :-1 s=READY pgs=3320 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00d980 tx=0x7f79cc00dc90 comp rx=0 tx=0).stop 2023-10-08T20:12:05.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.764+0000 7f79dd813700 1 -- 172.21.15.45:0/124129777 shutdown_connections 2023-10-08T20:12:05.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.764+0000 7f79dd813700 1 --2- 172.21.15.45:0/124129777 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f79c406aed0 0x7f79c406d390 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:05.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.764+0000 7f79dd813700 1 --2- 172.21.15.45:0/124129777 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f79d81599f0 0x7f79d80c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:05.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.764+0000 7f79dd813700 1 --2- 172.21.15.45:0/124129777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79d806f3d0 0x7f79d814cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:05.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.764+0000 7f79dd813700 1 --2- 172.21.15.45:0/124129777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79d80cc6a0 0x7f79d80b1220 unknown :-1 s=CLOSED pgs=3320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:05.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.764+0000 7f79dd813700 1 -- 172.21.15.45:0/124129777 >> 172.21.15.45:0/124129777 conn(0x7f79d80cf750 msgr2=0x7f79d80ad8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:05.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.764+0000 7f79dd813700 1 -- 172.21.15.45:0/124129777 shutdown_connections 2023-10-08T20:12:05.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.764+0000 7f79dd813700 1 -- 172.21.15.45:0/124129777 wait complete. 2023-10-08T20:12:05.767 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 6 to deep-scrub 2023-10-08T20:12:05.779 INFO:tasks.ceph:Scrubbing osd.7 2023-10-08T20:12:05.779 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-08T20:12:05.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.922+0000 7fa0e83d6700 1 -- 172.21.15.45:0/1179558576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e00cfa70 msgr2=0x7fa0e015d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:05.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.922+0000 7fa0e83d6700 1 --2- 172.21.15.45:0/1179558576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e00cfa70 0x7fa0e015d550 secure :-1 s=READY pgs=3321 cs=0 l=1 rev1=1 crypto rx=0x7fa0e00b2360 tx=0x7fa0d800b380 comp rx=0 tx=0).stop 2023-10-08T20:12:05.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.922+0000 7fa0e83d6700 1 -- 172.21.15.45:0/1179558576 shutdown_connections 2023-10-08T20:12:05.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.922+0000 7fa0e83d6700 1 --2- 172.21.15.45:0/1179558576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e00cfa70 0x7fa0e015d550 unknown :-1 s=CLOSED pgs=3321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:05.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.922+0000 7fa0e83d6700 1 --2- 172.21.15.45:0/1179558576 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0e0159b80 0x7fa0e00ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:05.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.922+0000 7fa0e83d6700 1 --2- 172.21.15.45:0/1179558576 >> v2:172.21.15.78:3300/0 conn(0x7fa0e00ccae0 0x7fa0e00cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:05.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.922+0000 7fa0e83d6700 1 -- 172.21.15.45:0/1179558576 >> 172.21.15.45:0/1179558576 conn(0x7fa0e0098b10 msgr2=0x7fa0e0088fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:05.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.922+0000 7fa0e83d6700 1 -- 172.21.15.45:0/1179558576 shutdown_connections 2023-10-08T20:12:05.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.922+0000 7fa0e83d6700 1 -- 172.21.15.45:0/1179558576 wait complete. 2023-10-08T20:12:05.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.923+0000 7fa0e83d6700 1 Processor -- start 2023-10-08T20:12:05.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.923+0000 7fa0e83d6700 1 -- start start 2023-10-08T20:12:05.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.924+0000 7fa0e83d6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e00ccae0 0x7fa0e00ad3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:05.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.924+0000 7fa0e83d6700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0e00cfa70 0x7fa0e01479d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:05.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.924+0000 7fa0e83d6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0e0159b80 0x7fa0e0156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:05.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.924+0000 7fa0e83d6700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e00ada80 con 0x7fa0e00ccae0 2023-10-08T20:12:05.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.924+0000 7fa0e83d6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e00add60 con 0x7fa0e0159b80 2023-10-08T20:12:05.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.924+0000 7fa0e83d6700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e00ae040 con 0x7fa0e00cfa70 2023-10-08T20:12:05.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.924+0000 7fa0e6172700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e00ccae0 0x7fa0e00ad3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:05.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.924+0000 7fa0e6172700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e00ccae0 0x7fa0e00ad3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51776/0 (socket says 172.21.15.45:51776) 2023-10-08T20:12:05.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.924+0000 7fa0e6172700 1 -- 172.21.15.45:0/2910235372 learned_addr learned my addr 172.21.15.45:0/2910235372 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:12:05.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.925+0000 7fa0e5971700 1 --2- 172.21.15.45:0/2910235372 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0e00cfa70 0x7fa0e01479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:05.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.925+0000 7fa0e6973700 1 --2- 172.21.15.45:0/2910235372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0e0159b80 0x7fa0e0156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:05.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.925+0000 7fa0e6172700 1 -- 172.21.15.45:0/2910235372 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0e00cfa70 msgr2=0x7fa0e01479d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:05.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.925+0000 7fa0e6172700 1 --2- 172.21.15.45:0/2910235372 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0e00cfa70 0x7fa0e01479d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:05.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.925+0000 7fa0e6172700 1 -- 172.21.15.45:0/2910235372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0e0159b80 msgr2=0x7fa0e0156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:05.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.925+0000 7fa0e6172700 1 --2- 172.21.15.45:0/2910235372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0e0159b80 0x7fa0e0156da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:05.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.925+0000 7fa0e6172700 1 -- 172.21.15.45:0/2910235372 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d8009d00 con 0x7fa0e00ccae0 2023-10-08T20:12:05.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.925+0000 7fa0e6172700 1 --2- 172.21.15.45:0/2910235372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e00ccae0 0x7fa0e00ad3c0 secure :-1 s=READY pgs=3322 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc00d980 tx=0x7fa0dc00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:05.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.925+0000 7fa0d6ffd700 1 -- 172.21.15.45:0/2910235372 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc004220 con 0x7fa0e00ccae0 2023-10-08T20:12:05.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.925+0000 7fa0d6ffd700 1 -- 172.21.15.45:0/2910235372 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa0dc004470 con 0x7fa0e00ccae0 2023-10-08T20:12:05.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.925+0000 7fa0e83d6700 1 -- 172.21.15.45:0/2910235372 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e00ae320 con 0x7fa0e00ccae0 2023-10-08T20:12:05.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.925+0000 7fa0d6ffd700 1 -- 172.21.15.45:0/2910235372 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc009ba0 con 0x7fa0e00ccae0 2023-10-08T20:12:05.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.925+0000 7fa0e83d6700 1 -- 172.21.15.45:0/2910235372 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e01572e0 con 0x7fa0e00ccae0 2023-10-08T20:12:05.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.926+0000 7fa0e83d6700 1 -- 172.21.15.45:0/2910235372 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa0e00aded0 con 0x7fa0e00ccae0 2023-10-08T20:12:05.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.927+0000 7fa0d6ffd700 1 -- 172.21.15.45:0/2910235372 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa0dc009d00 con 0x7fa0e00ccae0 2023-10-08T20:12:05.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.928+0000 7fa0d6ffd700 1 --2- 172.21.15.45:0/2910235372 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa0c406af00 0x7fa0c406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:05.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.928+0000 7fa0d6ffd700 1 -- 172.21.15.45:0/2910235372 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa0dc089670 con 0x7fa0e00ccae0 2023-10-08T20:12:05.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.928+0000 7fa0d6ffd700 1 --2- 172.21.15.45:0/2910235372 >> [v2:172.21.15.78:6809/3188968439,v1:172.21.15.78:6811/3188968439] conn(0x7fa0c4070d60 0x7fa0c4073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:05.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.928+0000 7fa0d6ffd700 1 -- 172.21.15.45:0/2910235372 --> [v2:172.21.15.78:6809/3188968439,v1:172.21.15.78:6811/3188968439] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa0c4073850 con 0x7fa0c4070d60 2023-10-08T20:12:05.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.928+0000 7fa0d6ffd700 1 -- 172.21.15.45:0/2910235372 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0dc08bd30 con 0x7fa0e00ccae0 2023-10-08T20:12:05.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.928+0000 7fa0e5971700 1 --2- 172.21.15.45:0/2910235372 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa0c406af00 0x7fa0c406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:05.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.928+0000 7fa0e6973700 1 --2- 172.21.15.45:0/2910235372 >> [v2:172.21.15.78:6809/3188968439,v1:172.21.15.78:6811/3188968439] conn(0x7fa0c4070d60 0x7fa0c4073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:05.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.929+0000 7fa0e5971700 1 --2- 172.21.15.45:0/2910235372 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa0c406af00 0x7fa0c406d3c0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0073280 tx=0x7fa0d0009260 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:05.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.929+0000 7fa0e6973700 1 --2- 172.21.15.45:0/2910235372 >> [v2:172.21.15.78:6809/3188968439,v1:172.21.15.78:6811/3188968439] conn(0x7fa0c4070d60 0x7fa0c4073180 crc :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:05.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.929+0000 7fa0d6ffd700 1 -- 172.21.15.45:0/2910235372 <== osd.7 v2:172.21.15.78:6809/3188968439 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fa0c4073850 con 0x7fa0c4070d60 2023-10-08T20:12:05.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.945+0000 7fa0e83d6700 1 -- 172.21.15.45:0/2910235372 --> [v2:172.21.15.78:6809/3188968439,v1:172.21.15.78:6811/3188968439] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa0e00c8410 con 0x7fa0c4070d60 2023-10-08T20:12:05.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.945+0000 7fa0d6ffd700 1 -- 172.21.15.45:0/2910235372 <== osd.7 v2:172.21.15.78:6809/3188968439 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa0e00c8410 con 0x7fa0c4070d60 2023-10-08T20:12:05.946 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-08T20:12:05.946 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-10-08T20:12:05.946 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-08T20:12:05.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.946+0000 7fa0e83d6700 1 -- 172.21.15.45:0/2910235372 >> [v2:172.21.15.78:6809/3188968439,v1:172.21.15.78:6811/3188968439] conn(0x7fa0c4070d60 msgr2=0x7fa0c4073180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:05.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.946+0000 7fa0e83d6700 1 --2- 172.21.15.45:0/2910235372 >> [v2:172.21.15.78:6809/3188968439,v1:172.21.15.78:6811/3188968439] conn(0x7fa0c4070d60 0x7fa0c4073180 crc :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:05.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.946+0000 7fa0e83d6700 1 -- 172.21.15.45:0/2910235372 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa0c406af00 msgr2=0x7fa0c406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:05.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.946+0000 7fa0e83d6700 1 --2- 172.21.15.45:0/2910235372 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa0c406af00 0x7fa0c406d3c0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0073280 tx=0x7fa0d0009260 comp rx=0 tx=0).stop 2023-10-08T20:12:05.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.946+0000 7fa0e83d6700 1 -- 172.21.15.45:0/2910235372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e00ccae0 msgr2=0x7fa0e00ad3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:05.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.946+0000 7fa0e83d6700 1 --2- 172.21.15.45:0/2910235372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e00ccae0 0x7fa0e00ad3c0 secure :-1 s=READY pgs=3322 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc00d980 tx=0x7fa0dc00dd40 comp rx=0 tx=0).stop 2023-10-08T20:12:05.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.946+0000 7fa0e6973700 1 -- 172.21.15.45:0/2910235372 reap_dead start 2023-10-08T20:12:05.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.946+0000 7fa0e83d6700 1 -- 172.21.15.45:0/2910235372 shutdown_connections 2023-10-08T20:12:05.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.946+0000 7fa0e83d6700 1 -- 172.21.15.45:0/2910235372 >> 172.21.15.45:0/2910235372 conn(0x7fa0e0098b10 msgr2=0x7fa0e00af530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:05.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.946+0000 7fa0e83d6700 1 -- 172.21.15.45:0/2910235372 shutdown_connections 2023-10-08T20:12:05.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:05.946+0000 7fa0e83d6700 1 -- 172.21.15.45:0/2910235372 wait complete. 2023-10-08T20:12:05.960 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-08T20:12:06.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.099+0000 7f66564db700 1 -- 172.21.15.45:0/617879627 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66500cc160 msgr2=0x7f66500cc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:06.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.099+0000 7f66564db700 1 --2- 172.21.15.45:0/617879627 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66500cc160 0x7f66500cc5e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6638009920 tx=0x7f6638009c30 comp rx=0 tx=0).stop 2023-10-08T20:12:06.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.099+0000 7f66564db700 1 -- 172.21.15.45:0/617879627 shutdown_connections 2023-10-08T20:12:06.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.099+0000 7f66564db700 1 --2- 172.21.15.45:0/617879627 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66500cc160 0x7f66500cc5e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:06.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.099+0000 7f66564db700 1 -- 172.21.15.45:0/617879627 >> 172.21.15.45:0/617879627 conn(0x7f66500cf750 msgr2=0x7f66500cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:06.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.099+0000 7f66564db700 1 -- 172.21.15.45:0/617879627 shutdown_connections 2023-10-08T20:12:06.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.099+0000 7f66564db700 1 -- 172.21.15.45:0/617879627 wait complete. 2023-10-08T20:12:06.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.100+0000 7f66564db700 1 Processor -- start 2023-10-08T20:12:06.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.101+0000 7f66564db700 1 -- start start 2023-10-08T20:12:06.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.101+0000 7f66564db700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66500ae380 0x7f6650158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:06.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.102+0000 7f66564db700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66500cc160 0x7f665006c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:06.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.102+0000 7f66564db700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66501599f0 0x7f66501f2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:06.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.102+0000 7f66564db700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66501f34b0 con 0x7f66500ae380 2023-10-08T20:12:06.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.102+0000 7f66564db700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665006b650 con 0x7f66501599f0 2023-10-08T20:12:06.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.102+0000 7f66564db700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665006b930 con 0x7f66500cc160 2023-10-08T20:12:06.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.102+0000 7f664ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66500ae380 0x7f6650158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:06.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.102+0000 7f664ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66500ae380 0x7f6650158830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51792/0 (socket says 172.21.15.45:51792) 2023-10-08T20:12:06.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.102+0000 7f664ffff700 1 -- 172.21.15.45:0/3944141603 learned_addr learned my addr 172.21.15.45:0/3944141603 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:12:06.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.102+0000 7f6654a78700 1 --2- 172.21.15.45:0/3944141603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66501599f0 0x7f66501f2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:06.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.102+0000 7f664f7fe700 1 --2- 172.21.15.45:0/3944141603 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66500cc160 0x7f665006c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:06.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.102+0000 7f664ffff700 1 -- 172.21.15.45:0/3944141603 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66500cc160 msgr2=0x7f665006c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:06.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.102+0000 7f664ffff700 1 --2- 172.21.15.45:0/3944141603 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66500cc160 0x7f665006c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:06.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.102+0000 7f664ffff700 1 -- 172.21.15.45:0/3944141603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66501599f0 msgr2=0x7f66501f2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:06.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.102+0000 7f664ffff700 1 --2- 172.21.15.45:0/3944141603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66501599f0 0x7f66501f2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:06.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.102+0000 7f664ffff700 1 -- 172.21.15.45:0/3944141603 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6638009520 con 0x7f66500ae380 2023-10-08T20:12:06.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.103+0000 7f664ffff700 1 --2- 172.21.15.45:0/3944141603 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66500ae380 0x7f6650158830 secure :-1 s=READY pgs=3324 cs=0 l=1 rev1=1 crypto rx=0x7f664000c500 tx=0x7f664000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:06.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.103+0000 7f664cff9700 1 -- 172.21.15.45:0/3944141603 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66400052d0 con 0x7f66500ae380 2023-10-08T20:12:06.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.103+0000 7f664cff9700 1 -- 172.21.15.45:0/3944141603 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6640005540 con 0x7f66500ae380 2023-10-08T20:12:06.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.103+0000 7f66564db700 1 -- 172.21.15.45:0/3944141603 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f665006bc10 con 0x7f66500ae380 2023-10-08T20:12:06.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.103+0000 7f664cff9700 1 -- 172.21.15.45:0/3944141603 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66400038e0 con 0x7f66500ae380 2023-10-08T20:12:06.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.103+0000 7f66564db700 1 -- 172.21.15.45:0/3944141603 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f665006c1d0 con 0x7f66500ae380 2023-10-08T20:12:06.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.104+0000 7f66564db700 1 -- 172.21.15.45:0/3944141603 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f665004e4c0 con 0x7f66500ae380 2023-10-08T20:12:06.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.105+0000 7f664cff9700 1 -- 172.21.15.45:0/3944141603 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6640003a40 con 0x7f66500ae380 2023-10-08T20:12:06.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.105+0000 7f664cff9700 1 --2- 172.21.15.45:0/3944141603 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f663006aed0 0x7f663006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:06.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.105+0000 7f664cff9700 1 -- 172.21.15.45:0/3944141603 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6640088840 con 0x7f66500ae380 2023-10-08T20:12:06.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.105+0000 7f664f7fe700 1 --2- 172.21.15.45:0/3944141603 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f663006aed0 0x7f663006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:06.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.106+0000 7f664f7fe700 1 --2- 172.21.15.45:0/3944141603 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f663006aed0 0x7f663006d390 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6638009230 tx=0x7f6638019040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:06.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.110+0000 7f664cff9700 1 -- 172.21.15.45:0/3944141603 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6640053c80 con 0x7f66500ae380 2023-10-08T20:12:06.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.323+0000 7f66564db700 1 -- 172.21.15.45:0/3944141603 --> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f66500ca2b0 con 0x7f663006aed0 2023-10-08T20:12:06.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.324+0000 7f664cff9700 1 -- 172.21.15.45:0/3944141603 <== mgr.4105 v2:172.21.15.78:6832/3438117854 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f66500ca2b0 con 0x7f663006aed0 2023-10-08T20:12:06.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.326+0000 7f66564db700 1 -- 172.21.15.45:0/3944141603 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f663006aed0 msgr2=0x7f663006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:06.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.326+0000 7f66564db700 1 --2- 172.21.15.45:0/3944141603 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f663006aed0 0x7f663006d390 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6638009230 tx=0x7f6638019040 comp rx=0 tx=0).stop 2023-10-08T20:12:06.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.326+0000 7f66564db700 1 -- 172.21.15.45:0/3944141603 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66500ae380 msgr2=0x7f6650158830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:06.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.326+0000 7f66564db700 1 --2- 172.21.15.45:0/3944141603 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66500ae380 0x7f6650158830 secure :-1 s=READY pgs=3324 cs=0 l=1 rev1=1 crypto rx=0x7f664000c500 tx=0x7f664000c810 comp rx=0 tx=0).stop 2023-10-08T20:12:06.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.326+0000 7f66564db700 1 -- 172.21.15.45:0/3944141603 shutdown_connections 2023-10-08T20:12:06.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.326+0000 7f66564db700 1 --2- 172.21.15.45:0/3944141603 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f663006aed0 0x7f663006d390 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:06.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.326+0000 7f66564db700 1 --2- 172.21.15.45:0/3944141603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66501599f0 0x7f66501f2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:06.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.326+0000 7f66564db700 1 --2- 172.21.15.45:0/3944141603 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66500ae380 0x7f6650158830 unknown :-1 s=CLOSED pgs=3324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:06.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.326+0000 7f66564db700 1 --2- 172.21.15.45:0/3944141603 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66500cc160 0x7f665006c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:06.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.326+0000 7f66564db700 1 -- 172.21.15.45:0/3944141603 >> 172.21.15.45:0/3944141603 conn(0x7f66500cf750 msgr2=0x7f665006ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:06.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.327+0000 7f66564db700 1 -- 172.21.15.45:0/3944141603 shutdown_connections 2023-10-08T20:12:06.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.327+0000 7f66564db700 1 -- 172.21.15.45:0/3944141603 wait complete. 2023-10-08T20:12:06.329 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 7 to deep-scrub 2023-10-08T20:12:06.341 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T20:12:06.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.480+0000 7f8989777700 1 -- 172.21.15.45:0/3051218969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89840ce2f0 msgr2=0x7f89840ce720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:06.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.480+0000 7f8989777700 1 --2- 172.21.15.45:0/3051218969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89840ce2f0 0x7f89840ce720 secure :-1 s=READY pgs=3326 cs=0 l=1 rev1=1 crypto rx=0x7f89840cf110 tx=0x7f897c00b330 comp rx=0 tx=0).stop 2023-10-08T20:12:06.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.480+0000 7f8989777700 1 -- 172.21.15.45:0/3051218969 shutdown_connections 2023-10-08T20:12:06.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.480+0000 7f8989777700 1 --2- 172.21.15.45:0/3051218969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89840ce2f0 0x7f89840ce720 unknown :-1 s=CLOSED pgs=3326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:06.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.480+0000 7f8989777700 1 --2- 172.21.15.45:0/3051218969 >> v2:172.21.15.78:3300/0 conn(0x7f898415b9a0 0x7f89841601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:06.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.480+0000 7f8989777700 1 -- 172.21.15.45:0/3051218969 >> 172.21.15.45:0/3051218969 conn(0x7f8984071940 msgr2=0x7f8984071d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:06.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.480+0000 7f8989777700 1 -- 172.21.15.45:0/3051218969 shutdown_connections 2023-10-08T20:12:06.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.480+0000 7f8989777700 1 -- 172.21.15.45:0/3051218969 wait complete. 2023-10-08T20:12:06.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.482+0000 7f8989777700 1 Processor -- start 2023-10-08T20:12:06.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.482+0000 7f8989777700 1 -- start start 2023-10-08T20:12:06.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.483+0000 7f8989777700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89840cca10 0x7f8984153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:06.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.483+0000 7f8989777700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89840ce2f0 0x7f898415a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:06.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.483+0000 7f8989777700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f898415b9a0 0x7f898415ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:06.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.483+0000 7f8989777700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89840cb7e0 con 0x7f89840ce2f0 2023-10-08T20:12:06.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.483+0000 7f8989777700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898415cb00 con 0x7f898415b9a0 2023-10-08T20:12:06.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.483+0000 7f8989777700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898415cde0 con 0x7f89840cca10 2023-10-08T20:12:06.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.483+0000 7f89827fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89840ce2f0 0x7f898415a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:06.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.483+0000 7f89827fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89840ce2f0 0x7f898415a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51804/0 (socket says 172.21.15.45:51804) 2023-10-08T20:12:06.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.483+0000 7f89827fc700 1 -- 172.21.15.45:0/3918647140 learned_addr learned my addr 172.21.15.45:0/3918647140 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:12:06.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.483+0000 7f8982ffd700 1 --2- 172.21.15.45:0/3918647140 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89840cca10 0x7f8984153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:06.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.483+0000 7f89837fe700 1 --2- 172.21.15.45:0/3918647140 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f898415b9a0 0x7f898415ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:06.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.483+0000 7f89827fc700 1 -- 172.21.15.45:0/3918647140 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89840cca10 msgr2=0x7f8984153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:06.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.483+0000 7f89827fc700 1 --2- 172.21.15.45:0/3918647140 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89840cca10 0x7f8984153210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:06.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.483+0000 7f89827fc700 1 -- 172.21.15.45:0/3918647140 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f898415b9a0 msgr2=0x7f898415ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:06.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.483+0000 7f89827fc700 1 --2- 172.21.15.45:0/3918647140 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f898415b9a0 0x7f898415ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:06.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.483+0000 7f89827fc700 1 -- 172.21.15.45:0/3918647140 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f897c009c40 con 0x7f89840ce2f0 2023-10-08T20:12:06.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.483+0000 7f89827fc700 1 --2- 172.21.15.45:0/3918647140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89840ce2f0 0x7f898415a710 secure :-1 s=READY pgs=3327 cs=0 l=1 rev1=1 crypto rx=0x7f896c00c500 tx=0x7f896c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:06.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.484+0000 7f897b7fe700 1 -- 172.21.15.45:0/3918647140 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c011790 con 0x7f89840ce2f0 2023-10-08T20:12:06.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.484+0000 7f897b7fe700 1 -- 172.21.15.45:0/3918647140 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f896c0118f0 con 0x7f89840ce2f0 2023-10-08T20:12:06.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.484+0000 7f897b7fe700 1 -- 172.21.15.45:0/3918647140 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c011ce0 con 0x7f89840ce2f0 2023-10-08T20:12:06.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.484+0000 7f8989777700 1 -- 172.21.15.45:0/3918647140 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f898415d0c0 con 0x7f89840ce2f0 2023-10-08T20:12:06.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.484+0000 7f8989777700 1 -- 172.21.15.45:0/3918647140 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f898415d680 con 0x7f89840ce2f0 2023-10-08T20:12:06.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.485+0000 7f8989777700 1 -- 172.21.15.45:0/3918647140 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f898404e4c0 con 0x7f89840ce2f0 2023-10-08T20:12:06.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.485+0000 7f897b7fe700 1 -- 172.21.15.45:0/3918647140 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f896c01c460 con 0x7f89840ce2f0 2023-10-08T20:12:06.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.486+0000 7f897b7fe700 1 --2- 172.21.15.45:0/3918647140 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f896406aed0 0x7f896406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:06.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.486+0000 7f897b7fe700 1 -- 172.21.15.45:0/3918647140 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f896c089230 con 0x7f89840ce2f0 2023-10-08T20:12:06.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.486+0000 7f8982ffd700 1 --2- 172.21.15.45:0/3918647140 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f896406aed0 0x7f896406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:06.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.487+0000 7f8982ffd700 1 --2- 172.21.15.45:0/3918647140 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f896406aed0 0x7f896406d390 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f8974005fd0 tx=0x7f897400b390 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:06.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.490+0000 7f897b7fe700 1 -- 172.21.15.45:0/3918647140 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f896c0545e0 con 0x7f89840ce2f0 2023-10-08T20:12:06.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.698+0000 7f8989777700 1 -- 172.21.15.45:0/3918647140 --> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f89840cf710 con 0x7f896406aed0 2023-10-08T20:12:06.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.701+0000 7f897b7fe700 1 -- 172.21.15.45:0/3918647140 <== mgr.4105 v2:172.21.15.78:6832/3438117854 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49224 (secure 0 0 0) 0x7f89840cf710 con 0x7f896406aed0 2023-10-08T20:12:06.702 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:12:06.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.703+0000 7f8989777700 1 -- 172.21.15.45:0/3918647140 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f896406aed0 msgr2=0x7f896406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:06.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.703+0000 7f8989777700 1 --2- 172.21.15.45:0/3918647140 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f896406aed0 0x7f896406d390 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f8974005fd0 tx=0x7f897400b390 comp rx=0 tx=0).stop 2023-10-08T20:12:06.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.703+0000 7f8989777700 1 -- 172.21.15.45:0/3918647140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89840ce2f0 msgr2=0x7f898415a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:06.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.703+0000 7f8989777700 1 --2- 172.21.15.45:0/3918647140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89840ce2f0 0x7f898415a710 secure :-1 s=READY pgs=3327 cs=0 l=1 rev1=1 crypto rx=0x7f896c00c500 tx=0x7f896c00c810 comp rx=0 tx=0).stop 2023-10-08T20:12:06.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.703+0000 7f8989777700 1 -- 172.21.15.45:0/3918647140 shutdown_connections 2023-10-08T20:12:06.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.703+0000 7f8989777700 1 --2- 172.21.15.45:0/3918647140 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f896406aed0 0x7f896406d390 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:06.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.703+0000 7f8989777700 1 --2- 172.21.15.45:0/3918647140 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f898415b9a0 0x7f898415ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:06.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.703+0000 7f8989777700 1 --2- 172.21.15.45:0/3918647140 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89840cca10 0x7f8984153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:06.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.703+0000 7f8989777700 1 --2- 172.21.15.45:0/3918647140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89840ce2f0 0x7f898415a710 unknown :-1 s=CLOSED pgs=3327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:06.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.703+0000 7f8989777700 1 -- 172.21.15.45:0/3918647140 >> 172.21.15.45:0/3918647140 conn(0x7f8984071940 msgr2=0x7f8984153d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:06.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.703+0000 7f8989777700 1 -- 172.21.15.45:0/3918647140 shutdown_connections 2023-10-08T20:12:06.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:06.703+0000 7f8989777700 1 -- 172.21.15.45:0/3918647140 wait complete. 2023-10-08T20:12:06.706 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-08T20:12:06.718 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":13426,"stamp":"2023-10-08T20:12:04.797581+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":10991624,"kb_used_data":4424,"kb_used_omap":40755,"kb_used_meta":10946380,"kb_avail":743983096,"statfs":{"total":773094113280,"available":761838690304,"internally_reserved":0,"allocated":4530176,"data_stored":2499280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41733465,"internal_metadata":11209093799},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":243,"apply_latency_ms":243,"commit_latency_ns":243000000,"apply_latency_ns":243000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.306834"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":400,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T20:11:52.939414+0000","last_change":"2023-10-08T12:45:21.094571+0000","last_active":"2023-10-08T20:11:52.939414+0000","last_peered":"2023-10-08T20:11:52.939414+0000","last_clean":"2023-10-08T20:11:52.939414+0000","last_became_active":"2023-10-08T12:45:21.093551+0000","last_became_peered":"2023-10-08T12:45:21.093551+0000","last_unstale":"2023-10-08T20:11:52.939414+0000","last_undegraded":"2023-10-08T20:11:52.939414+0000","last_fullsized":"2023-10-08T20:11:52.939414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:45:19.842786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:45:19.842786+0000","last_clean_scrub_stamp":"2023-10-08T12:45:19.842786+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:25.041743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580208,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":754020,"kb_used_data":988,"kb_used_omap":4391,"kb_used_meta":748632,"kb_avail":93617820,"statfs":{"total":96636764160,"available":95864647680,"internally_reserved":0,"allocated":1011712,"data_stored":755186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4496628,"internal_metadata":766599948},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":56,"apply_latency_ms":56,"commit_latency_ns":56000000,"apply_latency_ns":56000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.105,"15min":1.1879999999999999},"min":{"1min":0.23799999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":8.9909999999999997,"5min":8.9909999999999997,"15min":9.9529999999999994},"last":0.46200000000000002},{"interface":"front","average":{"1min":1.861,"5min":1.4219999999999999,"15min":1.3560000000000001},"min":{"1min":0.36799999999999999,"5min":0.27500000000000002,"15min":0.24199999999999999},"max":{"1min":8.9619999999999997,"5min":9.3420000000000005,"15min":13.359},"last":0.70099999999999996}]},{"osd":1,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":2.9409999999999998,"5min":1.986,"15min":1.7310000000000001},"min":{"1min":0.39600000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":8.8200000000000003,"5min":9.6809999999999992,"15min":9.6809999999999992},"last":0.48399999999999999},{"interface":"front","average":{"1min":2.476,"5min":1.843,"15min":1.591},"min":{"1min":0.377,"5min":0.28000000000000003,"15min":0.26400000000000001},"max":{"1min":8.8900000000000006,"5min":9.6579999999999995,"15min":9.6579999999999995},"last":0.56599999999999995}]},{"osd":2,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":2.9279999999999999,"5min":1.857,"15min":1.8580000000000001},"min":{"1min":0.28799999999999998,"5min":0.28000000000000003,"15min":0.27400000000000002},"max":{"1min":11.789,"5min":11.789,"15min":13.428000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":3.177,"5min":2.069,"15min":1.9710000000000001},"min":{"1min":0.35099999999999998,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":12.657,"5min":12.657,"15min":12.657},"last":0.54600000000000004}]},{"osd":3,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":2.0920000000000001,"5min":1.925,"15min":2.149},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.31900000000000001},"max":{"1min":8.3699999999999992,"5min":9.4109999999999996,"15min":13.272},"last":0.58199999999999996},{"interface":"front","average":{"1min":1.742,"5min":1.76,"15min":2.0369999999999999},"min":{"1min":0.35999999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":5.0679999999999996,"5min":6.6230000000000002,"15min":11.433999999999999},"last":0.66200000000000003}]},{"osd":4,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":0.94699999999999995,"15min":1.2110000000000001},"min":{"1min":0.29099999999999998,"5min":0.27300000000000002,"15min":0.26500000000000001},"max":{"1min":10.462,"5min":10.462,"15min":10.462},"last":0.627},{"interface":"front","average":{"1min":1.506,"5min":1.1180000000000001,"15min":1.3180000000000001},"min":{"1min":0.35599999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":5.7450000000000001,"5min":9.4420000000000002,"15min":13.114000000000001},"last":0.75700000000000001}]},{"osd":5,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.88500000000000001,"15min":1.2090000000000001},"min":{"1min":0.30299999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":6.1340000000000003,"5min":6.1340000000000003,"15min":9.0440000000000005},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.97599999999999998,"15min":1.3069999999999999},"min":{"1min":0.35599999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":3.653,"5min":6.125,"15min":9.6969999999999992},"last":0.72599999999999998}]},{"osd":6,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":1.028,"15min":1.4379999999999999},"min":{"1min":0.38900000000000001,"5min":0.35399999999999998,"15min":0.34999999999999998},"max":{"1min":4.149,"5min":7.1879999999999997,"15min":15.522},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.161,"15min":1.415},"min":{"1min":0.39900000000000002,"5min":0.375,"15min":0.375},"max":{"1min":5.806,"5min":9.3019999999999996,"15min":13.395},"last":0.80900000000000005}]}]},{"osd":6,"up_from":13,"seq":55834580210,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1769888,"kb_used_data":408,"kb_used_omap":3760,"kb_used_meta":1765711,"kb_avail":92601952,"statfs":{"total":96636764160,"available":94824398848,"internally_reserved":0,"allocated":417792,"data_stored":164818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3851216,"internal_metadata":1808088112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.90500000000000003,"15min":0.93400000000000005},"min":{"1min":0.253,"5min":0.24099999999999999,"15min":0.23799999999999999},"max":{"1min":4.2750000000000004,"5min":7.0650000000000004,"15min":9.6069999999999993},"last":0.41799999999999998},{"interface":"front","average":{"1min":2.1040000000000001,"5min":1.8360000000000001,"15min":1.5960000000000001},"min":{"1min":0.26600000000000001,"5min":0.246,"15min":0.246},"max":{"1min":7.4050000000000002,"5min":7.4050000000000002,"15min":11.526999999999999},"last":0.63800000000000001}]},{"osd":1,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":20.135999999999999,"5min":5.3949999999999996,"15min":3.0649999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.254},"max":{"1min":386.33300000000003,"5min":386.33300000000003,"15min":386.33300000000003},"last":0.55200000000000005},{"interface":"front","average":{"1min":20.344999999999999,"5min":5.2569999999999997,"15min":2.8279999999999998},"min":{"1min":0.28699999999999998,"5min":0.28000000000000003,"15min":0.26600000000000001},"max":{"1min":386.226,"5min":386.226,"15min":386.226},"last":0.622}]},{"osd":2,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":2.0609999999999999,"5min":1.804,"15min":1.931},"min":{"1min":0.35399999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":5.5759999999999996,"5min":6.173,"15min":8.4819999999999993},"last":0.51900000000000002},{"interface":"front","average":{"1min":2.2469999999999999,"5min":2.0030000000000001,"15min":2.0910000000000002},"min":{"1min":0.33300000000000002,"5min":0.32700000000000001,"15min":0.30599999999999999},"max":{"1min":7.0529999999999999,"5min":8.3740000000000006,"15min":8.3740000000000006},"last":0.39300000000000002}]},{"osd":3,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":2.0680000000000001,"5min":1.6830000000000001,"15min":1.875},"min":{"1min":0.371,"5min":0.316,"15min":0.316},"max":{"1min":7.4240000000000004,"5min":10.313000000000001,"15min":10.336},"last":0.66500000000000004},{"interface":"front","average":{"1min":2.6819999999999999,"5min":2.1539999999999999,"15min":2.133},"min":{"1min":0.36499999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":5.609,"5min":5.8639999999999999,"15min":9.8190000000000008},"last":0.71499999999999997}]},{"osd":4,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":0.90400000000000003,"15min":0.90700000000000003},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":5.0800000000000001,"5min":5.0800000000000001,"15min":9.4969999999999999},"last":0.5},{"interface":"front","average":{"1min":1.246,"5min":1.238,"15min":1.246},"min":{"1min":0.318,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":5.5250000000000004,"5min":5.5250000000000004,"15min":8.5969999999999995},"last":0.67400000000000004}]},{"osd":5,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":1.343,"15min":1.452},"min":{"1min":0.34100000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":5.9260000000000002,"5min":6.8479999999999999,"15min":9.7439999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":1.171,"5min":1.0449999999999999,"15min":1.224},"min":{"1min":0.36699999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":4.3520000000000003,"5min":6.524,"15min":9.5449999999999999},"last":0.56999999999999995}]},{"osd":7,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.2629999999999999,"15min":1.462},"min":{"1min":0.35399999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":5.665,"5min":5.665,"15min":10.858000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":1.821,"5min":1.387,"15min":1.532},"min":{"1min":0.39300000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":5.8769999999999998,"5min":8.1389999999999993,"15min":9.1669999999999998},"last":0.60199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834580177,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1721056,"kb_used_data":408,"kb_used_omap":5594,"kb_used_meta":1715045,"kb_avail":92650784,"statfs":{"total":96636764160,"available":94874402816,"internally_reserved":0,"allocated":417792,"data_stored":164818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5728863,"internal_metadata":1756206497},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":1.5940000000000001,"15min":1.55},"min":{"1min":0.247,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":3.181,"5min":14.423999999999999,"15min":14.423999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":2.3109999999999999,"5min":1.9419999999999999,"15min":1.8480000000000001},"min":{"1min":0.26100000000000001,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":9.4510000000000005,"5min":10.057,"15min":10.569000000000001},"last":4.3239999999999998}]},{"osd":2,"last update":"Sun Oct 8 20:11:21 2023","interfaces":[{"interface":"back","average":{"1min":3.1739999999999999,"5min":2.3620000000000001,"15min":2.1099999999999999},"min":{"1min":0.32700000000000001,"5min":0.28100000000000003,"15min":0.252},"max":{"1min":13.077,"5min":13.077,"15min":13.077},"last":16.175000000000001},{"interface":"front","average":{"1min":1.321,"5min":1.929,"15min":1.748},"min":{"1min":0.315,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":4.8940000000000001,"5min":14.48,"15min":14.48},"last":5.125}]},{"osd":3,"last update":"Sun Oct 8 20:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.992,"15min":1.76},"min":{"1min":0.33200000000000002,"5min":0.314,"15min":0.29399999999999998},"max":{"1min":8.4570000000000007,"5min":14.521000000000001,"15min":14.521000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":2.133,"5min":1.8200000000000001,"15min":1.8640000000000001},"min":{"1min":0.39000000000000001,"5min":0.29799999999999999,"15min":0.29599999999999999},"max":{"1min":11.058999999999999,"5min":11.663,"15min":11.663},"last":8.7629999999999999}]},{"osd":4,"last update":"Sun Oct 8 20:11:21 2023","interfaces":[{"interface":"back","average":{"1min":2.0939999999999999,"5min":1.621,"15min":1.702},"min":{"1min":0.42399999999999999,"5min":0.35699999999999998,"15min":0.34899999999999998},"max":{"1min":9.3119999999999994,"5min":9.3119999999999994,"15min":10.265000000000001},"last":15.460000000000001},{"interface":"front","average":{"1min":2.0030000000000001,"5min":1.8140000000000001,"15min":1.8500000000000001},"min":{"1min":0.44900000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":6.8209999999999997,"5min":12.164999999999999,"15min":14.638999999999999},"last":7.6280000000000001}]},{"osd":5,"last update":"Sun Oct 8 20:11:21 2023","interfaces":[{"interface":"back","average":{"1min":2.1139999999999999,"5min":2.024,"15min":1.913},"min":{"1min":0.50600000000000001,"5min":0.38800000000000001,"15min":0.36899999999999999},"max":{"1min":6.7320000000000002,"5min":12.220000000000001,"15min":12.220000000000001},"last":7.5209999999999999},{"interface":"front","average":{"1min":1.6220000000000001,"5min":1.5369999999999999,"15min":1.569},"min":{"1min":0.39400000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":13.117000000000001,"5min":13.117000000000001,"15min":14.130000000000001},"last":0.76300000000000001}]},{"osd":6,"last update":"Sun Oct 8 20:11:21 2023","interfaces":[{"interface":"back","average":{"1min":2.4849999999999999,"5min":1.9490000000000001,"15min":1.9710000000000001},"min":{"1min":0.48699999999999999,"5min":0.375,"15min":0.375},"max":{"1min":9.3699999999999992,"5min":9.3699999999999992,"15min":10.470000000000001},"last":8.6839999999999993},{"interface":"front","average":{"1min":1.9570000000000001,"5min":2.0230000000000001,"15min":2.0569999999999999},"min":{"1min":0.54200000000000004,"5min":0.41799999999999998,"15min":0.41199999999999998},"max":{"1min":6.9509999999999996,"5min":12.256,"15min":12.256},"last":7.585}]},{"osd":7,"last update":"Sun Oct 8 20:11:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":1.6339999999999999,"15min":1.8999999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":4.8369999999999997,"5min":7.8360000000000003,"15min":58.698999999999998},"last":0.83599999999999997},{"interface":"front","average":{"1min":2.093,"5min":1.9890000000000001,"15min":2.2850000000000001},"min":{"1min":0.54200000000000004,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":9.4120000000000008,"5min":11.714,"15min":58.920999999999999},"last":8.8089999999999993}]}]},{"osd":0,"up_from":13,"seq":55834580198,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1578468,"kb_used_data":988,"kb_used_omap":1928,"kb_used_meta":1575543,"kb_avail":92793372,"statfs":{"total":96636764160,"available":95020412928,"internally_reserved":0,"allocated":1011712,"data_stored":755186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1974368,"internal_metadata":1613356960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.5509999999999999,"15min":1.4239999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":6.0209999999999999,"5min":9.2059999999999995,"15min":11.839},"last":0.45600000000000002},{"interface":"front","average":{"1min":1.6719999999999999,"5min":1.6990000000000001,"15min":1.696},"min":{"1min":0.26200000000000001,"5min":0.248,"15min":0.248},"max":{"1min":6.4489999999999998,"5min":12.513999999999999,"15min":12.513999999999999},"last":0.48299999999999998}]},{"osd":2,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.508,"15min":1.5860000000000001},"min":{"1min":0.28999999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":8.1050000000000004,"5min":10.564,"15min":11.311999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":1.821,"5min":1.7869999999999999,"15min":1.9159999999999999},"min":{"1min":0.30399999999999999,"5min":0.28299999999999997,"15min":0.26600000000000001},"max":{"1min":6.327,"5min":8.6829999999999998,"15min":11.891},"last":0.54000000000000004}]},{"osd":3,"last update":"Sun Oct 8 20:11:58 2023","interfaces":[{"interface":"back","average":{"1min":2.0779999999999998,"5min":2.3149999999999999,"15min":2.4039999999999999},"min":{"1min":0.45500000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":6.8620000000000001,"5min":13.051,"15min":14.238},"last":0.50800000000000001},{"interface":"front","average":{"1min":1.129,"5min":1.335,"15min":1.5900000000000001},"min":{"1min":0.35699999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.323,"5min":7.0819999999999999,"15min":14.106},"last":0.56000000000000005}]},{"osd":4,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.544,"15min":1.6990000000000001},"min":{"1min":0.38800000000000001,"5min":0.313,"15min":0.313},"max":{"1min":6.1779999999999999,"5min":7.6349999999999998,"15min":32.792999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":2.3029999999999999,"5min":2.177,"15min":2.2799999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.34100000000000003},"max":{"1min":11.693,"5min":13.108000000000001,"15min":33.149000000000001},"last":0.66900000000000004}]},{"osd":5,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.292,"15min":1.335},"min":{"1min":0.43099999999999999,"5min":0.41199999999999998,"15min":0.35899999999999999},"max":{"1min":4.0599999999999996,"5min":6.484,"15min":8.8439999999999994},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.6830000000000001,"5min":1.7569999999999999,"15min":1.802},"min":{"1min":0.47699999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":6.2800000000000002,"5min":11.464,"15min":14.925000000000001},"last":0.68999999999999995}]},{"osd":6,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":2.3090000000000002,"5min":2.5830000000000002,"15min":2.3250000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.40400000000000003},"max":{"1min":12.279999999999999,"5min":13.146000000000001,"15min":13.146000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.5820000000000001,"15min":1.544},"min":{"1min":0.48399999999999999,"5min":0.44500000000000001,"15min":0.41299999999999998},"max":{"1min":6.8680000000000003,"5min":7.6219999999999999,"15min":8.8200000000000003},"last":0.71799999999999997}]},{"osd":7,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":1.681,"5min":2.008,"15min":2.016},"min":{"1min":0.56699999999999995,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":6.2320000000000002,"5min":11.125,"15min":11.125},"last":0.748},{"interface":"front","average":{"1min":2.3839999999999999,"5min":2.508,"15min":2.48},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.42299999999999999},"max":{"1min":12.909000000000001,"5min":13.183999999999999,"15min":13.183999999999999},"last":0.73399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834580189,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1735968,"kb_used_data":408,"kb_used_omap":1956,"kb_used_meta":1733595,"kb_avail":92635872,"statfs":{"total":96636764160,"available":94859132928,"internally_reserved":0,"allocated":417792,"data_stored":164818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2003896,"internal_metadata":1775201352},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:19 2023","interfaces":[{"interface":"back","average":{"1min":1.899,"5min":1.673,"15min":1.4079999999999999},"min":{"1min":0.27600000000000002,"5min":0.26100000000000001,"15min":0.24299999999999999},"max":{"1min":12.449,"5min":12.449,"15min":13.276},"last":0.40500000000000003},{"interface":"front","average":{"1min":3.048,"5min":2.3300000000000001,"15min":2.1019999999999999},"min":{"1min":0.41899999999999998,"5min":0.26700000000000002,"15min":0.26000000000000001},"max":{"1min":10.916,"5min":10.916,"15min":12.536},"last":0.54100000000000004}]},{"osd":1,"last update":"Sun Oct 8 20:11:19 2023","interfaces":[{"interface":"back","average":{"1min":1.6919999999999999,"5min":1.546,"15min":1.4299999999999999},"min":{"1min":0.32800000000000001,"5min":0.253,"15min":0.253},"max":{"1min":6.1360000000000001,"5min":7.2759999999999998,"15min":13.449999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":1.9770000000000001,"5min":2.419,"15min":2.2090000000000001},"min":{"1min":0.32000000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":10.000999999999999,"5min":14.356999999999999,"15min":14.356999999999999},"last":0.38400000000000001}]},{"osd":3,"last update":"Sun Oct 8 20:11:27 2023","interfaces":[{"interface":"back","average":{"1min":1.9630000000000001,"5min":2.2320000000000002,"15min":2.0139999999999998},"min":{"1min":0.32100000000000001,"5min":0.30599999999999999,"15min":0.29399999999999998},"max":{"1min":7.0910000000000002,"5min":13.281000000000001,"15min":13.281000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":1.863,"5min":1.806,"15min":1.677},"min":{"1min":0.41699999999999998,"5min":0.34100000000000003,"15min":0.33900000000000002},"max":{"1min":6.21,"5min":9.7210000000000001,"15min":13.381},"last":0.52200000000000002}]},{"osd":4,"last update":"Sun Oct 8 20:11:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.5589999999999999,"15min":1.7110000000000001},"min":{"1min":0.42199999999999999,"5min":0.371,"15min":0.34699999999999998},"max":{"1min":6.0430000000000001,"5min":8.8629999999999995,"15min":47.850999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.476,"5min":1.962,"15min":2.069},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.34499999999999997},"max":{"1min":9.9640000000000004,"5min":9.9640000000000004,"15min":47.712000000000003},"last":0.79600000000000004}]},{"osd":5,"last update":"Sun Oct 8 20:11:19 2023","interfaces":[{"interface":"back","average":{"1min":2.4500000000000002,"5min":2.2000000000000002,"15min":2.0670000000000002},"min":{"1min":0.40999999999999998,"5min":0.40000000000000002,"15min":0.36899999999999999},"max":{"1min":7.7000000000000002,"5min":13.15,"15min":13.15},"last":0.75},{"interface":"front","average":{"1min":1.788,"5min":1.746,"15min":1.635},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":6.1699999999999999,"5min":8.9269999999999996,"15min":13.416},"last":0.73399999999999999}]},{"osd":6,"last update":"Sun Oct 8 20:11:19 2023","interfaces":[{"interface":"back","average":{"1min":1.722,"5min":2.1419999999999999,"15min":2.089},"min":{"1min":0.439,"5min":0.42199999999999999,"15min":0.40100000000000002},"max":{"1min":9.9109999999999996,"5min":9.9109999999999996,"15min":10.101000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":3.1160000000000001,"5min":2.4940000000000002,"15min":2.2040000000000002},"min":{"1min":0.51200000000000001,"5min":0.45100000000000001,"15min":0.42499999999999999},"max":{"1min":7.2270000000000003,"5min":13.244999999999999,"15min":13.244999999999999},"last":0.69999999999999996}]},{"osd":7,"last update":"Sun Oct 8 20:11:19 2023","interfaces":[{"interface":"back","average":{"1min":2.1600000000000001,"5min":2.3570000000000002,"15min":2.2200000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.438},"max":{"1min":9.8680000000000003,"5min":9.8680000000000003,"15min":11.173},"last":0.70999999999999996},{"interface":"front","average":{"1min":3.1269999999999998,"5min":2.5739999999999998,"15min":2.2749999999999999},"min":{"1min":0.55800000000000005,"5min":0.45200000000000001,"15min":0.439},"max":{"1min":8.4429999999999996,"5min":13.207000000000001,"15min":13.207000000000001},"last":0.67200000000000004}]}]},{"osd":3,"up_from":13,"seq":55834580171,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1701344,"kb_used_data":408,"kb_used_omap":10612,"kb_used_meta":1690315,"kb_avail":92670496,"statfs":{"total":96636764160,"available":94894587904,"internally_reserved":0,"allocated":417792,"data_stored":164818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10867470,"internal_metadata":1730882802},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":3.1280000000000001,"5min":1.9450000000000001,"15min":1.6240000000000001},"min":{"1min":0.28000000000000003,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":17.279,"5min":17.279,"15min":17.279},"last":0.52500000000000002},{"interface":"front","average":{"1min":2.3849999999999998,"5min":1.8959999999999999,"15min":1.879},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.24399999999999999},"max":{"1min":8.8699999999999992,"5min":8.8699999999999992,"15min":9.6699999999999999},"last":0.32400000000000001}]},{"osd":1,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":8.452,"5min":3.3580000000000001,"15min":2.23},"min":{"1min":0.442,"5min":0.28599999999999998,"15min":0.24299999999999999},"max":{"1min":102.35299999999999,"5min":102.35299999999999,"15min":102.35299999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":9.2170000000000005,"5min":3.4580000000000002,"15min":2.2999999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.26100000000000001},"max":{"1min":102.66200000000001,"5min":102.66200000000001,"15min":102.66200000000001},"last":0.59499999999999997}]},{"osd":2,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":2.3180000000000001,"5min":2.2530000000000001,"15min":2.2080000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.28699999999999998},"max":{"1min":8.0169999999999995,"5min":11.678000000000001,"15min":14.084},"last":0.42999999999999999},{"interface":"front","average":{"1min":3.1520000000000001,"5min":2.1960000000000002,"15min":2.024},"min":{"1min":0.36899999999999999,"5min":0.34300000000000003,"15min":0.315},"max":{"1min":17.184999999999999,"5min":17.184999999999999,"15min":17.184999999999999},"last":0.64400000000000002}]},{"osd":4,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":2.153,"5min":1.865,"15min":1.8009999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":13.007,"5min":13.007,"15min":13.007},"last":0.503},{"interface":"front","average":{"1min":1.8140000000000001,"5min":1.9790000000000001,"15min":1.8129999999999999},"min":{"1min":0.443,"5min":0.372,"15min":0.33800000000000002},"max":{"1min":7.9409999999999998,"5min":11.074999999999999,"15min":11.074999999999999},"last":0.55100000000000005}]},{"osd":5,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":1.9339999999999999,"5min":2.117,"15min":1.9550000000000001},"min":{"1min":0.53200000000000003,"5min":0.41899999999999998,"15min":0.36599999999999999},"max":{"1min":7.8920000000000003,"5min":11.029,"15min":11.029},"last":0.47899999999999998},{"interface":"front","average":{"1min":2.9529999999999998,"5min":1.944,"15min":1.728},"min":{"1min":0.53100000000000003,"5min":0.36899999999999999,"15min":0.34100000000000003},"max":{"1min":17.315999999999999,"5min":17.315999999999999,"15min":17.315999999999999},"last":0.68000000000000005}]},{"osd":6,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":2.8969999999999998,"5min":2.2109999999999999,"15min":1.8109999999999999},"min":{"1min":0.57799999999999996,"5min":0.40600000000000003,"15min":0.38100000000000001},"max":{"1min":17.350000000000001,"5min":17.350000000000001,"15min":17.350000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":2.4060000000000001,"5min":2.2080000000000002,"15min":2.1320000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":12.890000000000001,"5min":12.890000000000001,"15min":12.890000000000001},"last":0.58099999999999996}]},{"osd":7,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":2.6800000000000002,"5min":2.1019999999999999,"15min":2.097},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.42899999999999999},"max":{"1min":12.94,"5min":12.94,"15min":12.94},"last":0.65900000000000003},{"interface":"front","average":{"1min":2.0619999999999998,"5min":2.1720000000000002,"15min":2.125},"min":{"1min":0.57099999999999995,"5min":0.437,"15min":0.437},"max":{"1min":8.0899999999999999,"5min":11.111000000000001,"15min":11.111000000000001},"last":0.61299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834580204,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":886112,"kb_used_data":408,"kb_used_omap":7607,"kb_used_meta":878088,"kb_avail":93485728,"statfs":{"total":96636764160,"available":95729385472,"internally_reserved":0,"allocated":417792,"data_stored":164818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7789817,"internal_metadata":899162887},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":1.111,"15min":1.0620000000000001},"min":{"1min":0.25700000000000001,"5min":0.23499999999999999,"15min":0.22900000000000001},"max":{"1min":11.608000000000001,"5min":11.608000000000001,"15min":11.686999999999999},"last":0.504},{"interface":"front","average":{"1min":2.2320000000000002,"5min":1.5760000000000001,"15min":1.7070000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.26100000000000001},"max":{"1min":8.5809999999999995,"5min":8.5809999999999995,"15min":48.774000000000001},"last":0.64800000000000002}]},{"osd":1,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":1.9470000000000001,"5min":1.806,"15min":1.879},"min":{"1min":0.40000000000000002,"5min":0.28599999999999998,"15min":0.27000000000000002},"max":{"1min":5.4870000000000001,"5min":10.792999999999999,"15min":10.792999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":1.472,"5min":1.3939999999999999,"15min":1.655},"min":{"1min":0.32500000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":5.4749999999999996,"5min":9.6029999999999998,"15min":10.807},"last":0.59799999999999998}]},{"osd":2,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.2470000000000001,"15min":1.972},"min":{"1min":0.32600000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":5.7380000000000004,"5min":8.7370000000000001,"15min":48.911000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":2.48,"5min":2.3420000000000001,"15min":2.1080000000000001},"min":{"1min":0.49299999999999999,"5min":0.36899999999999999,"15min":0.29799999999999999},"max":{"1min":6.21,"5min":8.0299999999999994,"15min":8.0299999999999994},"last":0.69399999999999995}]},{"osd":3,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":1.8069999999999999,"15min":1.9790000000000001},"min":{"1min":0.38,"5min":0.34200000000000003,"15min":0.33100000000000002},"max":{"1min":3.0630000000000002,"5min":9.6910000000000007,"15min":10.584},"last":0.53700000000000003},{"interface":"front","average":{"1min":2.0670000000000002,"5min":1.8879999999999999,"15min":2.198},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.33500000000000002},"max":{"1min":7.3570000000000002,"5min":15.992000000000001,"15min":48.990000000000002},"last":0.66400000000000003}]},{"osd":5,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94799999999999995,"15min":1.1899999999999999},"min":{"1min":0.27700000000000002,"5min":0.27200000000000002,"15min":0.26800000000000002},"max":{"1min":5.2249999999999996,"5min":5.4459999999999997,"15min":8.9649999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.86199999999999999,"15min":1.0840000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.944,"5min":11.625,"15min":11.625},"last":0.626}]},{"osd":6,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.81299999999999994,"15min":1.05},"min":{"1min":0.33700000000000002,"5min":0.32500000000000001,"15min":0.29699999999999999},"max":{"1min":2.1379999999999999,"5min":5.5670000000000002,"15min":11.917},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.137,"15min":1.381},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":5.2670000000000003,"5min":5.7759999999999998,"15min":13.375},"last":0.77600000000000002}]},{"osd":7,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.92500000000000004,"15min":1.1990000000000001},"min":{"1min":0.36099999999999999,"5min":0.33700000000000002,"15min":0.308},"max":{"1min":2.4020000000000001,"5min":5.4800000000000004,"15min":13.554},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.02,"15min":1.135},"min":{"1min":0.38800000000000001,"5min":0.36699999999999999,"15min":0.36099999999999999},"max":{"1min":6.1580000000000004,"5min":10.102,"15min":12.154},"last":0.749}]}]},{"osd":5,"up_from":13,"seq":55834580207,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":844768,"kb_used_data":408,"kb_used_omap":4903,"kb_used_meta":839448,"kb_avail":93527072,"statfs":{"total":96636764160,"available":95771721728,"internally_reserved":0,"allocated":417792,"data_stored":164818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5021207,"internal_metadata":859595241},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":1.0329999999999999,"15min":1.1020000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.22900000000000001},"max":{"1min":1.1879999999999999,"5min":5.4340000000000002,"15min":12.48},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.46899999999999997,"5min":1.363,"15min":1.365},"min":{"1min":0.33100000000000002,"5min":0.26300000000000001,"15min":0.251},"max":{"1min":1.2130000000000001,"5min":9.5899999999999999,"15min":9.5899999999999999},"last":0.56899999999999995}]},{"osd":1,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.4730000000000001,"15min":1.544},"min":{"1min":0.34100000000000003,"5min":0.25600000000000001,"15min":0.245},"max":{"1min":5.5659999999999998,"5min":6.7400000000000002,"15min":7.5590000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.744,"15min":1.8169999999999999},"min":{"1min":0.313,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":3.8599999999999999,"5min":9.8010000000000002,"15min":14.989000000000001},"last":0.59399999999999997}]},{"osd":2,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":1.9970000000000001,"15min":1.921},"min":{"1min":0.373,"5min":0.31,"15min":0.27100000000000002},"max":{"1min":3.1019999999999999,"5min":14.433999999999999,"15min":14.433999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.1439999999999999,"5min":2.0489999999999999,"15min":2.1280000000000001},"min":{"1min":0.375,"5min":0.33600000000000002,"15min":0.28399999999999997},"max":{"1min":3.7989999999999999,"5min":12.173,"15min":12.173},"last":0.54100000000000004}]},{"osd":3,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":2.048,"15min":2.246},"min":{"1min":0.36899999999999999,"5min":0.33500000000000002,"15min":0.33000000000000002},"max":{"1min":3.9929999999999999,"5min":6.1879999999999997,"15min":14.935},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.996,"15min":2.3359999999999999},"min":{"1min":0.45300000000000001,"5min":0.36299999999999999,"15min":0.32000000000000001},"max":{"1min":4.423,"5min":9.6530000000000005,"15min":10.862},"last":0.53000000000000003}]},{"osd":4,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.872,"15min":1.161},"min":{"1min":0.27600000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.95799999999999996,"5min":5.8659999999999997,"15min":10.701000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.84199999999999997,"15min":1.202},"min":{"1min":0.313,"5min":0.28899999999999998,"15min":0.28699999999999998},"max":{"1min":0.65200000000000002,"5min":6.2389999999999999,"15min":12.531000000000001},"last":0.433}]},{"osd":6,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":1.131,"15min":1.329},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.28299999999999997},"max":{"1min":3.7320000000000002,"5min":9.5410000000000004,"15min":12.426},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":1.141,"15min":1.355},"min":{"1min":0.36399999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.75,"5min":6.9409999999999998,"15min":9.3320000000000007},"last":0.49299999999999999}]},{"osd":7,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.83499999999999996,"15min":1.3300000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":3.3140000000000001,"5min":3.9020000000000001,"15min":15.071},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":1.0980000000000001,"15min":1.3839999999999999},"min":{"1min":0.376,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":3.4300000000000002,"5min":10.34,"15min":10.804},"last":0.47699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T20:12:06.722 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-08T12:45:19.842786+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=12, tm_min=45, tm_sec=19, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=20, tm_min=12, tm_sec=0, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T20:12:06.722 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-08T20:12:26.723 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T20:12:26.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.863+0000 7fb16f115700 1 -- 172.21.15.45:0/338792878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb168159960 msgr2=0x7fb1680b1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:26.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.863+0000 7fb16f115700 1 --2- 172.21.15.45:0/338792878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb168159960 0x7fb1680b1730 secure :-1 s=READY pgs=3329 cs=0 l=1 rev1=1 crypto rx=0x7fb1500098c0 tx=0x7fb150009bd0 comp rx=0 tx=0).stop 2023-10-08T20:12:26.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.863+0000 7fb16f115700 1 -- 172.21.15.45:0/338792878 shutdown_connections 2023-10-08T20:12:26.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.863+0000 7fb16f115700 1 --2- 172.21.15.45:0/338792878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb168159960 0x7fb1680b1730 unknown :-1 s=CLOSED pgs=3329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:26.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.863+0000 7fb16f115700 1 -- 172.21.15.45:0/338792878 >> 172.21.15.45:0/338792878 conn(0x7fb1680b0430 msgr2=0x7fb1680b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:26.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.863+0000 7fb16f115700 1 -- 172.21.15.45:0/338792878 shutdown_connections 2023-10-08T20:12:26.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.863+0000 7fb16f115700 1 -- 172.21.15.45:0/338792878 wait complete. 2023-10-08T20:12:26.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.864+0000 7fb16f115700 1 Processor -- start 2023-10-08T20:12:26.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.864+0000 7fb16f115700 1 -- start start 2023-10-08T20:12:26.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.865+0000 7fb16f115700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb16806a920 0x7fb1680ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:26.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.865+0000 7fb16f115700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb1680b3fb0 0x7fb168151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:26.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.865+0000 7fb16f115700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb168159960 0x7fb1680c6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:26.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.865+0000 7fb16f115700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1680aac80 con 0x7fb168159960 2023-10-08T20:12:26.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.865+0000 7fb16f115700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1680aaf60 con 0x7fb16806a920 2023-10-08T20:12:26.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.865+0000 7fb16f115700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1680ab240 con 0x7fb1680b3fb0 2023-10-08T20:12:26.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.865+0000 7fb16d6b2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb168159960 0x7fb1680c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:26.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.865+0000 7fb16d6b2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb168159960 0x7fb1680c6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51820/0 (socket says 172.21.15.45:51820) 2023-10-08T20:12:26.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.865+0000 7fb16d6b2700 1 -- 172.21.15.45:0/4258389772 learned_addr learned my addr 172.21.15.45:0/4258389772 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:12:26.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.865+0000 7fb167fff700 1 --2- 172.21.15.45:0/4258389772 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb1680b3fb0 0x7fb168151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:26.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.865+0000 7fb16ceb1700 1 --2- 172.21.15.45:0/4258389772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb16806a920 0x7fb1680ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:26.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.866+0000 7fb16d6b2700 1 -- 172.21.15.45:0/4258389772 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb1680b3fb0 msgr2=0x7fb168151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:26.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.866+0000 7fb16d6b2700 1 --2- 172.21.15.45:0/4258389772 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb1680b3fb0 0x7fb168151be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:26.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.866+0000 7fb16d6b2700 1 -- 172.21.15.45:0/4258389772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb16806a920 msgr2=0x7fb1680ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:26.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.866+0000 7fb16d6b2700 1 --2- 172.21.15.45:0/4258389772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb16806a920 0x7fb1680ac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:26.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.866+0000 7fb16d6b2700 1 -- 172.21.15.45:0/4258389772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb150009520 con 0x7fb168159960 2023-10-08T20:12:26.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.866+0000 7fb167fff700 1 --2- 172.21.15.45:0/4258389772 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb1680b3fb0 0x7fb168151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T20:12:26.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.866+0000 7fb16d6b2700 1 --2- 172.21.15.45:0/4258389772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb168159960 0x7fb1680c6980 secure :-1 s=READY pgs=3330 cs=0 l=1 rev1=1 crypto rx=0x7fb16000c500 tx=0x7fb16000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:26.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.866+0000 7fb1657fa700 1 -- 172.21.15.45:0/4258389772 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1600052d0 con 0x7fb168159960 2023-10-08T20:12:26.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.866+0000 7fb1657fa700 1 -- 172.21.15.45:0/4258389772 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb160005520 con 0x7fb168159960 2023-10-08T20:12:26.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.866+0000 7fb16f115700 1 -- 172.21.15.45:0/4258389772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1680ab520 con 0x7fb168159960 2023-10-08T20:12:26.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.866+0000 7fb1657fa700 1 -- 172.21.15.45:0/4258389772 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1600038e0 con 0x7fb168159960 2023-10-08T20:12:26.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.866+0000 7fb16f115700 1 -- 172.21.15.45:0/4258389772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1680acd80 con 0x7fb168159960 2023-10-08T20:12:26.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.867+0000 7fb16f115700 1 -- 172.21.15.45:0/4258389772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1680aba40 con 0x7fb168159960 2023-10-08T20:12:26.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.868+0000 7fb1657fa700 1 -- 172.21.15.45:0/4258389772 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb160003a40 con 0x7fb168159960 2023-10-08T20:12:26.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.868+0000 7fb1657fa700 1 --2- 172.21.15.45:0/4258389772 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb14806aed0 0x7fb14806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:26.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.868+0000 7fb1657fa700 1 -- 172.21.15.45:0/4258389772 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb160088a50 con 0x7fb168159960 2023-10-08T20:12:26.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.868+0000 7fb16ceb1700 1 --2- 172.21.15.45:0/4258389772 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb14806aed0 0x7fb14806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:26.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.869+0000 7fb16ceb1700 1 --2- 172.21.15.45:0/4258389772 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb14806aed0 0x7fb14806d390 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fb150000c00 tx=0x7fb150019040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:26.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:26.873+0000 7fb1657fa700 1 -- 172.21.15.45:0/4258389772 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb160053cf0 con 0x7fb168159960 2023-10-08T20:12:27.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.093+0000 7fb16f115700 1 -- 172.21.15.45:0/4258389772 --> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb1680c4bc0 con 0x7fb14806aed0 2023-10-08T20:12:27.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.096+0000 7fb1657fa700 1 -- 172.21.15.45:0/4258389772 <== mgr.4105 v2:172.21.15.78:6832/3438117854 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49039 (secure 0 0 0) 0x7fb1680c4bc0 con 0x7fb14806aed0 2023-10-08T20:12:27.097 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:12:27.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.098+0000 7fb16f115700 1 -- 172.21.15.45:0/4258389772 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb14806aed0 msgr2=0x7fb14806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:27.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.098+0000 7fb16f115700 1 --2- 172.21.15.45:0/4258389772 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb14806aed0 0x7fb14806d390 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fb150000c00 tx=0x7fb150019040 comp rx=0 tx=0).stop 2023-10-08T20:12:27.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.098+0000 7fb16f115700 1 -- 172.21.15.45:0/4258389772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb168159960 msgr2=0x7fb1680c6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:27.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.098+0000 7fb16f115700 1 --2- 172.21.15.45:0/4258389772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb168159960 0x7fb1680c6980 secure :-1 s=READY pgs=3330 cs=0 l=1 rev1=1 crypto rx=0x7fb16000c500 tx=0x7fb16000c810 comp rx=0 tx=0).stop 2023-10-08T20:12:27.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.098+0000 7fb16f115700 1 -- 172.21.15.45:0/4258389772 shutdown_connections 2023-10-08T20:12:27.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.098+0000 7fb16f115700 1 --2- 172.21.15.45:0/4258389772 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fb14806aed0 0x7fb14806d390 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:27.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.098+0000 7fb16f115700 1 --2- 172.21.15.45:0/4258389772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb168159960 0x7fb1680c6980 unknown :-1 s=CLOSED pgs=3330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:27.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.098+0000 7fb16f115700 1 --2- 172.21.15.45:0/4258389772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb16806a920 0x7fb1680ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:27.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.098+0000 7fb16f115700 1 --2- 172.21.15.45:0/4258389772 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb1680b3fb0 0x7fb168151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:27.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.098+0000 7fb16f115700 1 -- 172.21.15.45:0/4258389772 >> 172.21.15.45:0/4258389772 conn(0x7fb1680b0430 msgr2=0x7fb1680b09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:27.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.098+0000 7fb16f115700 1 -- 172.21.15.45:0/4258389772 shutdown_connections 2023-10-08T20:12:27.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.098+0000 7fb16f115700 1 -- 172.21.15.45:0/4258389772 wait complete. 2023-10-08T20:12:27.101 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-08T20:12:27.113 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":13437,"stamp":"2023-10-08T20:12:26.802188+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":10991624,"kb_used_data":4424,"kb_used_omap":40755,"kb_used_meta":10946380,"kb_avail":743983096,"statfs":{"total":773094113280,"available":761838690304,"internally_reserved":0,"allocated":4530176,"data_stored":2499280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41733465,"internal_metadata":11209093799},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002503"},"pg_stats":[{"pgid":"1.0","version":"36'119","reported_seq":411,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-08T20:12:07.023768+0000","last_change":"2023-10-08T20:12:07.023841+0000","last_active":"2023-10-08T20:12:07.023768+0000","last_peered":"2023-10-08T20:12:07.023768+0000","last_clean":"2023-10-08T20:12:07.023768+0000","last_became_active":"2023-10-08T12:45:21.093551+0000","last_became_peered":"2023-10-08T12:45:21.093551+0000","last_unstale":"2023-10-08T20:12:07.023768+0000","last_undegraded":"2023-10-08T20:12:07.023768+0000","last_fullsized":"2023-10-08T20:12:07.023768+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'119","last_scrub_stamp":"2023-10-08T20:12:07.023657+0000","last_deep_scrub":"36'119","last_deep_scrub_stamp":"2023-10-08T20:12:07.023657+0000","last_clean_scrub_stamp":"2023-10-08T20:12:07.023657+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:36:59.347193+0000","scrub_duration":0.084008258000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580213,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":754020,"kb_used_data":988,"kb_used_omap":4391,"kb_used_meta":748632,"kb_avail":93617820,"statfs":{"total":96636764160,"available":95864647680,"internally_reserved":0,"allocated":1011712,"data_stored":755186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4496628,"internal_metadata":766599948},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.105,"15min":1.1879999999999999},"min":{"1min":0.23799999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":8.9909999999999997,"5min":8.9909999999999997,"15min":9.9529999999999994},"last":0.46200000000000002},{"interface":"front","average":{"1min":1.861,"5min":1.4219999999999999,"15min":1.3560000000000001},"min":{"1min":0.36799999999999999,"5min":0.27500000000000002,"15min":0.24199999999999999},"max":{"1min":8.9619999999999997,"5min":9.3420000000000005,"15min":13.359},"last":0.69099999999999995}]},{"osd":1,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":2.9409999999999998,"5min":1.986,"15min":1.7310000000000001},"min":{"1min":0.39600000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":8.8200000000000003,"5min":9.6809999999999992,"15min":9.6809999999999992},"last":0.70599999999999996},{"interface":"front","average":{"1min":2.476,"5min":1.843,"15min":1.591},"min":{"1min":0.377,"5min":0.28000000000000003,"15min":0.26400000000000001},"max":{"1min":8.8900000000000006,"5min":9.6579999999999995,"15min":9.6579999999999995},"last":0.55300000000000005}]},{"osd":2,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":2.9279999999999999,"5min":1.857,"15min":1.8580000000000001},"min":{"1min":0.28799999999999998,"5min":0.28000000000000003,"15min":0.27400000000000002},"max":{"1min":11.789,"5min":11.789,"15min":13.428000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":3.177,"5min":2.069,"15min":1.9710000000000001},"min":{"1min":0.35099999999999998,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":12.657,"5min":12.657,"15min":12.657},"last":0.627}]},{"osd":3,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":2.0920000000000001,"5min":1.925,"15min":2.149},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.31900000000000001},"max":{"1min":8.3699999999999992,"5min":9.4109999999999996,"15min":13.272},"last":0.59099999999999997},{"interface":"front","average":{"1min":1.742,"5min":1.76,"15min":2.0369999999999999},"min":{"1min":0.35999999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":5.0679999999999996,"5min":6.6230000000000002,"15min":11.433999999999999},"last":0.66900000000000004}]},{"osd":4,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":0.94699999999999995,"15min":1.2110000000000001},"min":{"1min":0.29099999999999998,"5min":0.27300000000000002,"15min":0.26500000000000001},"max":{"1min":10.462,"5min":10.462,"15min":10.462},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.506,"5min":1.1180000000000001,"15min":1.3180000000000001},"min":{"1min":0.35599999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":5.7450000000000001,"5min":9.4420000000000002,"15min":13.114000000000001},"last":0.65200000000000002}]},{"osd":5,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.88500000000000001,"15min":1.2090000000000001},"min":{"1min":0.30299999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":6.1340000000000003,"5min":6.1340000000000003,"15min":9.0440000000000005},"last":0.748},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.97599999999999998,"15min":1.3069999999999999},"min":{"1min":0.35599999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":3.653,"5min":6.125,"15min":9.6969999999999992},"last":0.60899999999999999}]},{"osd":6,"last update":"Sun Oct 8 20:11:55 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":1.028,"15min":1.4379999999999999},"min":{"1min":0.38900000000000001,"5min":0.35399999999999998,"15min":0.34999999999999998},"max":{"1min":4.149,"5min":7.1879999999999997,"15min":15.522},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.161,"15min":1.415},"min":{"1min":0.39900000000000002,"5min":0.375,"15min":0.375},"max":{"1min":5.806,"5min":9.3019999999999996,"15min":13.395},"last":0.73299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834580215,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1769888,"kb_used_data":408,"kb_used_omap":3760,"kb_used_meta":1765711,"kb_avail":92601952,"statfs":{"total":96636764160,"available":94824398848,"internally_reserved":0,"allocated":417792,"data_stored":164818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3851216,"internal_metadata":1808088112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.90500000000000003,"15min":0.93400000000000005},"min":{"1min":0.253,"5min":0.24099999999999999,"15min":0.23799999999999999},"max":{"1min":4.2750000000000004,"5min":7.0650000000000004,"15min":9.6069999999999993},"last":0.58599999999999997},{"interface":"front","average":{"1min":2.1040000000000001,"5min":1.8360000000000001,"15min":1.5960000000000001},"min":{"1min":0.26600000000000001,"5min":0.246,"15min":0.246},"max":{"1min":7.4050000000000002,"5min":7.4050000000000002,"15min":11.526999999999999},"last":0.42699999999999999}]},{"osd":1,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":20.135999999999999,"5min":5.3949999999999996,"15min":3.0649999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.254},"max":{"1min":386.33300000000003,"5min":386.33300000000003,"15min":386.33300000000003},"last":0.60499999999999998},{"interface":"front","average":{"1min":20.344999999999999,"5min":5.2569999999999997,"15min":2.8279999999999998},"min":{"1min":0.28699999999999998,"5min":0.28000000000000003,"15min":0.26600000000000001},"max":{"1min":386.226,"5min":386.226,"15min":386.226},"last":0.63}]},{"osd":2,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":2.0609999999999999,"5min":1.804,"15min":1.931},"min":{"1min":0.35399999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":5.5759999999999996,"5min":6.173,"15min":8.4819999999999993},"last":0.51400000000000001},{"interface":"front","average":{"1min":2.2469999999999999,"5min":2.0030000000000001,"15min":2.0910000000000002},"min":{"1min":0.33300000000000002,"5min":0.32700000000000001,"15min":0.30599999999999999},"max":{"1min":7.0529999999999999,"5min":8.3740000000000006,"15min":8.3740000000000006},"last":0.46600000000000003}]},{"osd":3,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":2.0680000000000001,"5min":1.6830000000000001,"15min":1.875},"min":{"1min":0.371,"5min":0.316,"15min":0.316},"max":{"1min":7.4240000000000004,"5min":10.313000000000001,"15min":10.336},"last":0.53500000000000003},{"interface":"front","average":{"1min":2.6819999999999999,"5min":2.1539999999999999,"15min":2.133},"min":{"1min":0.36499999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":5.609,"5min":5.8639999999999999,"15min":9.8190000000000008},"last":0.57099999999999995}]},{"osd":4,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":0.90400000000000003,"15min":0.90700000000000003},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":5.0800000000000001,"5min":5.0800000000000001,"15min":9.4969999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":1.246,"5min":1.238,"15min":1.246},"min":{"1min":0.318,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":5.5250000000000004,"5min":5.5250000000000004,"15min":8.5969999999999995},"last":0.61599999999999999}]},{"osd":5,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":1.343,"15min":1.452},"min":{"1min":0.34100000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":5.9260000000000002,"5min":6.8479999999999999,"15min":9.7439999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":1.171,"5min":1.0449999999999999,"15min":1.224},"min":{"1min":0.36699999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":4.3520000000000003,"5min":6.524,"15min":9.5449999999999999},"last":0.66900000000000004}]},{"osd":7,"last update":"Sun Oct 8 20:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.2629999999999999,"15min":1.462},"min":{"1min":0.35399999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":5.665,"5min":5.665,"15min":10.858000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.821,"5min":1.387,"15min":1.532},"min":{"1min":0.39300000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":5.8769999999999998,"5min":8.1389999999999993,"15min":9.1669999999999998},"last":0.65300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834580182,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1721056,"kb_used_data":408,"kb_used_omap":5594,"kb_used_meta":1715045,"kb_avail":92650784,"statfs":{"total":96636764160,"available":94874402816,"internally_reserved":0,"allocated":417792,"data_stored":164818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5728863,"internal_metadata":1756206497},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:12:21 2023","interfaces":[{"interface":"back","average":{"1min":1.579,"5min":1.728,"15min":1.5449999999999999},"min":{"1min":0.29299999999999998,"5min":0.247,"15min":0.24099999999999999},"max":{"1min":8.609,"5min":14.423999999999999,"15min":14.423999999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.9610000000000001,"15min":1.819},"min":{"1min":0.26100000000000001,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":5.2050000000000001,"5min":10.057,"15min":10.569000000000001},"last":0.247}]},{"osd":2,"last update":"Sun Oct 8 20:12:21 2023","interfaces":[{"interface":"back","average":{"1min":3.0099999999999998,"5min":2.6859999999999999,"15min":2.1320000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.252},"max":{"1min":16.175000000000001,"5min":16.175000000000001,"15min":16.175000000000001},"last":0.28399999999999997},{"interface":"front","average":{"1min":2.0270000000000001,"5min":2.0910000000000002,"15min":1.7270000000000001},"min":{"1min":0.36499999999999999,"5min":0.308,"15min":0.27300000000000002},"max":{"1min":7.875,"5min":14.48,"15min":14.48},"last":0.38700000000000001}]},{"osd":3,"last update":"Sun Oct 8 20:12:21 2023","interfaces":[{"interface":"back","average":{"1min":1.665,"5min":2.0169999999999999,"15min":1.7410000000000001},"min":{"1min":0.39500000000000002,"5min":0.314,"15min":0.29399999999999998},"max":{"1min":7.9249999999999998,"5min":14.521000000000001,"15min":14.521000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":1.623,"5min":1.798,"15min":1.831},"min":{"1min":0.318,"5min":0.29799999999999999,"15min":0.29599999999999999},"max":{"1min":8.7629999999999999,"5min":11.058999999999999,"15min":11.663},"last":0.371}]},{"osd":4,"last update":"Sun Oct 8 20:12:21 2023","interfaces":[{"interface":"back","average":{"1min":2.0539999999999998,"5min":1.7450000000000001,"15min":1.7030000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.34899999999999998},"max":{"1min":15.460000000000001,"5min":15.460000000000001,"15min":15.460000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.9399999999999999,"5min":1.9039999999999999,"15min":1.821},"min":{"1min":0.49299999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":7.6280000000000001,"5min":7.6280000000000001,"15min":14.638999999999999},"last":0.747}]},{"osd":5,"last update":"Sun Oct 8 20:12:21 2023","interfaces":[{"interface":"back","average":{"1min":1.927,"5min":1.974,"15min":1.891},"min":{"1min":0.40600000000000003,"5min":0.38800000000000001,"15min":0.36899999999999999},"max":{"1min":7.5209999999999999,"5min":7.5209999999999999,"15min":12.220000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.603,"15min":1.506},"min":{"1min":0.46700000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":8.0109999999999992,"5min":13.117000000000001,"15min":14.130000000000001},"last":0.79500000000000004}]},{"osd":6,"last update":"Sun Oct 8 20:12:21 2023","interfaces":[{"interface":"back","average":{"1min":1.873,"5min":1.8899999999999999,"15min":1.9410000000000001},"min":{"1min":0.435,"5min":0.375,"15min":0.375},"max":{"1min":8.6839999999999993,"5min":9.3699999999999992,"15min":10.470000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.9419999999999999,"5min":2.0390000000000001,"15min":2.0350000000000001},"min":{"1min":0.44800000000000001,"5min":0.41799999999999998,"15min":0.41199999999999998},"max":{"1min":7.585,"5min":7.585,"15min":12.256},"last":0.88600000000000001}]},{"osd":7,"last update":"Sun Oct 8 20:12:21 2023","interfaces":[{"interface":"back","average":{"1min":1.5589999999999999,"5min":1.645,"15min":1.8169999999999999},"min":{"1min":0.56599999999999995,"5min":0.433,"15min":0.433},"max":{"1min":7.9720000000000004,"5min":7.9720000000000004,"15min":58.698999999999998},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.903,"5min":1.9339999999999999,"15min":2.2570000000000001},"min":{"1min":0.48099999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":8.8089999999999993,"5min":10.948,"15min":58.920999999999999},"last":0.72999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834580203,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1578468,"kb_used_data":988,"kb_used_omap":1928,"kb_used_meta":1575543,"kb_avail":92793372,"statfs":{"total":96636764160,"available":95020412928,"internally_reserved":0,"allocated":1011712,"data_stored":755186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1974368,"internal_metadata":1613356960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.5509999999999999,"15min":1.4239999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":6.0209999999999999,"5min":9.2059999999999995,"15min":11.839},"last":0.29199999999999998},{"interface":"front","average":{"1min":1.6719999999999999,"5min":1.6990000000000001,"15min":1.696},"min":{"1min":0.26200000000000001,"5min":0.248,"15min":0.248},"max":{"1min":6.4489999999999998,"5min":12.513999999999999,"15min":12.513999999999999},"last":0.38800000000000001}]},{"osd":2,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.508,"15min":1.5860000000000001},"min":{"1min":0.28999999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":8.1050000000000004,"5min":10.564,"15min":11.311999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":1.821,"5min":1.7869999999999999,"15min":1.9159999999999999},"min":{"1min":0.30399999999999999,"5min":0.28299999999999997,"15min":0.26600000000000001},"max":{"1min":6.327,"5min":8.6829999999999998,"15min":11.891},"last":0.34399999999999997}]},{"osd":3,"last update":"Sun Oct 8 20:11:58 2023","interfaces":[{"interface":"back","average":{"1min":2.0779999999999998,"5min":2.3149999999999999,"15min":2.4039999999999999},"min":{"1min":0.45500000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":6.8620000000000001,"5min":13.051,"15min":14.238},"last":0.313},{"interface":"front","average":{"1min":1.129,"5min":1.335,"15min":1.5900000000000001},"min":{"1min":0.35699999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.323,"5min":7.0819999999999999,"15min":14.106},"last":0.40400000000000003}]},{"osd":4,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.544,"15min":1.6990000000000001},"min":{"1min":0.38800000000000001,"5min":0.313,"15min":0.313},"max":{"1min":6.1779999999999999,"5min":7.6349999999999998,"15min":32.792999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":2.3029999999999999,"5min":2.177,"15min":2.2799999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.34100000000000003},"max":{"1min":11.693,"5min":13.108000000000001,"15min":33.149000000000001},"last":0.59599999999999997}]},{"osd":5,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.292,"15min":1.335},"min":{"1min":0.43099999999999999,"5min":0.41199999999999998,"15min":0.35899999999999999},"max":{"1min":4.0599999999999996,"5min":6.484,"15min":8.8439999999999994},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.6830000000000001,"5min":1.7569999999999999,"15min":1.802},"min":{"1min":0.47699999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":6.2800000000000002,"5min":11.464,"15min":14.925000000000001},"last":0.73599999999999999}]},{"osd":6,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":2.3090000000000002,"5min":2.5830000000000002,"15min":2.3250000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.40400000000000003},"max":{"1min":12.279999999999999,"5min":13.146000000000001,"15min":13.146000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.5820000000000001,"15min":1.544},"min":{"1min":0.48399999999999999,"5min":0.44500000000000001,"15min":0.41299999999999998},"max":{"1min":6.8680000000000003,"5min":7.6219999999999999,"15min":8.8200000000000003},"last":0.65700000000000003}]},{"osd":7,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":1.681,"5min":2.008,"15min":2.016},"min":{"1min":0.56699999999999995,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":6.2320000000000002,"5min":11.125,"15min":11.125},"last":0.77700000000000002},{"interface":"front","average":{"1min":2.3839999999999999,"5min":2.508,"15min":2.48},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.42299999999999999},"max":{"1min":12.909000000000001,"5min":13.183999999999999,"15min":13.183999999999999},"last":0.67900000000000005}]}]},{"osd":2,"up_from":13,"seq":55834580194,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1735968,"kb_used_data":408,"kb_used_omap":1956,"kb_used_meta":1733595,"kb_avail":92635872,"statfs":{"total":96636764160,"available":94859132928,"internally_reserved":0,"allocated":417792,"data_stored":164818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2003896,"internal_metadata":1775201352},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:12:24 2023","interfaces":[{"interface":"back","average":{"1min":2.032,"5min":1.677,"15min":1.4630000000000001},"min":{"1min":0.28299999999999997,"5min":0.26500000000000001,"15min":0.24299999999999999},"max":{"1min":8.5150000000000006,"5min":12.449,"15min":13.276},"last":0.40799999999999997},{"interface":"front","average":{"1min":1.1599999999999999,"5min":2.169,"15min":2.0579999999999998},"min":{"1min":0.30099999999999999,"5min":0.26700000000000002,"15min":0.26000000000000001},"max":{"1min":10.643000000000001,"5min":10.916,"15min":12.536},"last":0.33300000000000002}]},{"osd":1,"last update":"Sun Oct 8 20:12:24 2023","interfaces":[{"interface":"back","average":{"1min":1.9550000000000001,"5min":1.5640000000000001,"15min":1.4990000000000001},"min":{"1min":0.32500000000000001,"5min":0.253,"15min":0.253},"max":{"1min":8.5960000000000001,"5min":8.5960000000000001,"15min":13.449999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":1.2809999999999999,"5min":2.2360000000000002,"15min":2.1070000000000002},"min":{"1min":0.318,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":10.722,"5min":14.356999999999999,"15min":14.356999999999999},"last":0.379}]},{"osd":3,"last update":"Sun Oct 8 20:11:27 2023","interfaces":[{"interface":"back","average":{"1min":1.9630000000000001,"5min":2.2320000000000002,"15min":2.0139999999999998},"min":{"1min":0.32100000000000001,"5min":0.30599999999999999,"15min":0.29399999999999998},"max":{"1min":7.0910000000000002,"5min":13.281000000000001,"15min":13.281000000000001},"last":0.433},{"interface":"front","average":{"1min":1.863,"5min":1.806,"15min":1.677},"min":{"1min":0.41699999999999998,"5min":0.34100000000000003,"15min":0.33900000000000002},"max":{"1min":6.21,"5min":9.7210000000000001,"15min":13.381},"last":0.51300000000000001}]},{"osd":4,"last update":"Sun Oct 8 20:12:24 2023","interfaces":[{"interface":"back","average":{"1min":2.073,"5min":1.6870000000000001,"15min":1.792},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.34699999999999998},"max":{"1min":8.7400000000000002,"5min":8.8629999999999995,"15min":47.850999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.464,"5min":1.8939999999999999,"15min":2.0579999999999998},"min":{"1min":0.39500000000000002,"5min":0.35599999999999998,"15min":0.34499999999999997},"max":{"1min":10.577,"5min":10.577,"15min":47.712000000000003},"last":0.58999999999999997}]},{"osd":5,"last update":"Sun Oct 8 20:12:24 2023","interfaces":[{"interface":"back","average":{"1min":1.595,"5min":2.1339999999999999,"15min":2.0449999999999999},"min":{"1min":0.48599999999999999,"5min":0.40000000000000002,"15min":0.36899999999999999},"max":{"1min":11.303000000000001,"5min":13.15,"15min":13.15},"last":0.65100000000000002},{"interface":"front","average":{"1min":2.46,"5min":1.883,"15min":1.7290000000000001},"min":{"1min":0.45100000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":10.821999999999999,"5min":10.821999999999999,"15min":13.416},"last":0.78700000000000003}]},{"osd":6,"last update":"Sun Oct 8 20:12:24 2023","interfaces":[{"interface":"back","average":{"1min":1.7869999999999999,"5min":2.0960000000000001,"15min":2.0899999999999999},"min":{"1min":0.438,"5min":0.42199999999999999,"15min":0.40100000000000002},"max":{"1min":10.763999999999999,"5min":10.763999999999999,"15min":10.763999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":1.625,"5min":2.3839999999999999,"15min":2.157},"min":{"1min":0.52800000000000002,"5min":0.45100000000000001,"15min":0.42499999999999999},"max":{"1min":11.351000000000001,"5min":13.244999999999999,"15min":13.244999999999999},"last":0.76500000000000001}]},{"osd":7,"last update":"Sun Oct 8 20:12:24 2023","interfaces":[{"interface":"back","average":{"1min":1.6140000000000001,"5min":2.2629999999999999,"15min":2.21},"min":{"1min":0.51900000000000002,"5min":0.48499999999999999,"15min":0.438},"max":{"1min":10.683999999999999,"5min":10.683999999999999,"15min":11.173},"last":0.748},{"interface":"front","average":{"1min":1.5409999999999999,"5min":2.3919999999999999,"15min":2.2389999999999999},"min":{"1min":0.51500000000000001,"5min":0.45200000000000001,"15min":0.439},"max":{"1min":8.8559999999999999,"5min":13.207000000000001,"15min":13.207000000000001},"last":0.69499999999999995}]}]},{"osd":3,"up_from":13,"seq":55834580176,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1701344,"kb_used_data":408,"kb_used_omap":10612,"kb_used_meta":1690315,"kb_avail":92670496,"statfs":{"total":96636764160,"available":94894587904,"internally_reserved":0,"allocated":417792,"data_stored":164818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10867470,"internal_metadata":1730882802},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":3.1280000000000001,"5min":1.9450000000000001,"15min":1.6240000000000001},"min":{"1min":0.28000000000000003,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":17.279,"5min":17.279,"15min":17.279},"last":0.28000000000000003},{"interface":"front","average":{"1min":2.3849999999999998,"5min":1.8959999999999999,"15min":1.879},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.24399999999999999},"max":{"1min":8.8699999999999992,"5min":8.8699999999999992,"15min":9.6699999999999999},"last":0.33300000000000002}]},{"osd":1,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":8.452,"5min":3.3580000000000001,"15min":2.23},"min":{"1min":0.442,"5min":0.28599999999999998,"15min":0.24299999999999999},"max":{"1min":102.35299999999999,"5min":102.35299999999999,"15min":102.35299999999999},"last":0.313},{"interface":"front","average":{"1min":9.2170000000000005,"5min":3.4580000000000002,"15min":2.2999999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.26100000000000001},"max":{"1min":102.66200000000001,"5min":102.66200000000001,"15min":102.66200000000001},"last":0.46100000000000002}]},{"osd":2,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":2.3180000000000001,"5min":2.2530000000000001,"15min":2.2080000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.28699999999999998},"max":{"1min":8.0169999999999995,"5min":11.678000000000001,"15min":14.084},"last":0.374},{"interface":"front","average":{"1min":3.1520000000000001,"5min":2.1960000000000002,"15min":2.024},"min":{"1min":0.36899999999999999,"5min":0.34300000000000003,"15min":0.315},"max":{"1min":17.184999999999999,"5min":17.184999999999999,"15min":17.184999999999999},"last":0.41399999999999998}]},{"osd":4,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":2.153,"5min":1.865,"15min":1.8009999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":13.007,"5min":13.007,"15min":13.007},"last":0.58999999999999997},{"interface":"front","average":{"1min":1.8140000000000001,"5min":1.9790000000000001,"15min":1.8129999999999999},"min":{"1min":0.443,"5min":0.372,"15min":0.33800000000000002},"max":{"1min":7.9409999999999998,"5min":11.074999999999999,"15min":11.074999999999999},"last":0.60599999999999998}]},{"osd":5,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":1.9339999999999999,"5min":2.117,"15min":1.9550000000000001},"min":{"1min":0.53200000000000003,"5min":0.41899999999999998,"15min":0.36599999999999999},"max":{"1min":7.8920000000000003,"5min":11.029,"15min":11.029},"last":0.64400000000000002},{"interface":"front","average":{"1min":2.9529999999999998,"5min":1.944,"15min":1.728},"min":{"1min":0.53100000000000003,"5min":0.36899999999999999,"15min":0.34100000000000003},"max":{"1min":17.315999999999999,"5min":17.315999999999999,"15min":17.315999999999999},"last":0.57399999999999995}]},{"osd":6,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":2.8969999999999998,"5min":2.2109999999999999,"15min":1.8109999999999999},"min":{"1min":0.57799999999999996,"5min":0.40600000000000003,"15min":0.38100000000000001},"max":{"1min":17.350000000000001,"5min":17.350000000000001,"15min":17.350000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":2.4060000000000001,"5min":2.2080000000000002,"15min":2.1320000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":12.890000000000001,"5min":12.890000000000001,"15min":12.890000000000001},"last":0.65600000000000003}]},{"osd":7,"last update":"Sun Oct 8 20:11:54 2023","interfaces":[{"interface":"back","average":{"1min":2.6800000000000002,"5min":2.1019999999999999,"15min":2.097},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.42899999999999999},"max":{"1min":12.94,"5min":12.94,"15min":12.94},"last":0.623},{"interface":"front","average":{"1min":2.0619999999999998,"5min":2.1720000000000002,"15min":2.125},"min":{"1min":0.57099999999999995,"5min":0.437,"15min":0.437},"max":{"1min":8.0899999999999999,"5min":11.111000000000001,"15min":11.111000000000001},"last":0.68899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834580209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":886112,"kb_used_data":408,"kb_used_omap":7607,"kb_used_meta":878088,"kb_avail":93485728,"statfs":{"total":96636764160,"available":95729385472,"internally_reserved":0,"allocated":417792,"data_stored":164818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7789817,"internal_metadata":899162887},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":1.111,"15min":1.0620000000000001},"min":{"1min":0.25700000000000001,"5min":0.23499999999999999,"15min":0.22900000000000001},"max":{"1min":11.608000000000001,"5min":11.608000000000001,"15min":11.686999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":2.2320000000000002,"5min":1.5760000000000001,"15min":1.7070000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.26100000000000001},"max":{"1min":8.5809999999999995,"5min":8.5809999999999995,"15min":48.774000000000001},"last":0.64200000000000002}]},{"osd":1,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":1.9470000000000001,"5min":1.806,"15min":1.879},"min":{"1min":0.40000000000000002,"5min":0.28599999999999998,"15min":0.27000000000000002},"max":{"1min":5.4870000000000001,"5min":10.792999999999999,"15min":10.792999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":1.472,"5min":1.3939999999999999,"15min":1.655},"min":{"1min":0.32500000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":5.4749999999999996,"5min":9.6029999999999998,"15min":10.807},"last":0.47599999999999998}]},{"osd":2,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.2470000000000001,"15min":1.972},"min":{"1min":0.32600000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":5.7380000000000004,"5min":8.7370000000000001,"15min":48.911000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":2.48,"5min":2.3420000000000001,"15min":2.1080000000000001},"min":{"1min":0.49299999999999999,"5min":0.36899999999999999,"15min":0.29799999999999999},"max":{"1min":6.21,"5min":8.0299999999999994,"15min":8.0299999999999994},"last":0.56499999999999995}]},{"osd":3,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":1.8069999999999999,"15min":1.9790000000000001},"min":{"1min":0.38,"5min":0.34200000000000003,"15min":0.33100000000000002},"max":{"1min":3.0630000000000002,"5min":9.6910000000000007,"15min":10.584},"last":0.439},{"interface":"front","average":{"1min":2.0670000000000002,"5min":1.8879999999999999,"15min":2.198},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.33500000000000002},"max":{"1min":7.3570000000000002,"5min":15.992000000000001,"15min":48.990000000000002},"last":0.54400000000000004}]},{"osd":5,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94799999999999995,"15min":1.1899999999999999},"min":{"1min":0.27700000000000002,"5min":0.27200000000000002,"15min":0.26800000000000002},"max":{"1min":5.2249999999999996,"5min":5.4459999999999997,"15min":8.9649999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.86199999999999999,"15min":1.0840000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.944,"5min":11.625,"15min":11.625},"last":0.39500000000000002}]},{"osd":6,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.81299999999999994,"15min":1.05},"min":{"1min":0.33700000000000002,"5min":0.32500000000000001,"15min":0.29699999999999999},"max":{"1min":2.1379999999999999,"5min":5.5670000000000002,"15min":11.917},"last":0.59099999999999997},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.137,"15min":1.381},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":5.2670000000000003,"5min":5.7759999999999998,"15min":13.375},"last":0.67500000000000004}]},{"osd":7,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.92500000000000004,"15min":1.1990000000000001},"min":{"1min":0.36099999999999999,"5min":0.33700000000000002,"15min":0.308},"max":{"1min":2.4020000000000001,"5min":5.4800000000000004,"15min":13.554},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.02,"15min":1.135},"min":{"1min":0.38800000000000001,"5min":0.36699999999999999,"15min":0.36099999999999999},"max":{"1min":6.1580000000000004,"5min":10.102,"15min":12.154},"last":0.624}]}]},{"osd":5,"up_from":13,"seq":55834580212,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":844768,"kb_used_data":408,"kb_used_omap":4903,"kb_used_meta":839448,"kb_avail":93527072,"statfs":{"total":96636764160,"available":95771721728,"internally_reserved":0,"allocated":417792,"data_stored":164818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5021207,"internal_metadata":859595241},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":1.0329999999999999,"15min":1.1020000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.22900000000000001},"max":{"1min":1.1879999999999999,"5min":5.4340000000000002,"15min":12.48},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.46899999999999997,"5min":1.363,"15min":1.365},"min":{"1min":0.33100000000000002,"5min":0.26300000000000001,"15min":0.251},"max":{"1min":1.2130000000000001,"5min":9.5899999999999999,"15min":9.5899999999999999},"last":0.46899999999999997}]},{"osd":1,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.4730000000000001,"15min":1.544},"min":{"1min":0.34100000000000003,"5min":0.25600000000000001,"15min":0.245},"max":{"1min":5.5659999999999998,"5min":6.7400000000000002,"15min":7.5590000000000002},"last":0.56000000000000005},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.744,"15min":1.8169999999999999},"min":{"1min":0.313,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":3.8599999999999999,"5min":9.8010000000000002,"15min":14.989000000000001},"last":0.59899999999999998}]},{"osd":2,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":1.9970000000000001,"15min":1.921},"min":{"1min":0.373,"5min":0.31,"15min":0.27100000000000002},"max":{"1min":3.1019999999999999,"5min":14.433999999999999,"15min":14.433999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.1439999999999999,"5min":2.0489999999999999,"15min":2.1280000000000001},"min":{"1min":0.375,"5min":0.33600000000000002,"15min":0.28399999999999997},"max":{"1min":3.7989999999999999,"5min":12.173,"15min":12.173},"last":0.69599999999999995}]},{"osd":3,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":2.048,"15min":2.246},"min":{"1min":0.36899999999999999,"5min":0.33500000000000002,"15min":0.33000000000000002},"max":{"1min":3.9929999999999999,"5min":6.1879999999999997,"15min":14.935},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.996,"15min":2.3359999999999999},"min":{"1min":0.45300000000000001,"5min":0.36299999999999999,"15min":0.32000000000000001},"max":{"1min":4.423,"5min":9.6530000000000005,"15min":10.862},"last":0.746}]},{"osd":4,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.872,"15min":1.161},"min":{"1min":0.27600000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.95799999999999996,"5min":5.8659999999999997,"15min":10.701000000000001},"last":0.622},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.84199999999999997,"15min":1.202},"min":{"1min":0.313,"5min":0.28899999999999998,"15min":0.28699999999999998},"max":{"1min":0.65200000000000002,"5min":6.2389999999999999,"15min":12.531000000000001},"last":0.72299999999999998}]},{"osd":6,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":1.131,"15min":1.329},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.28299999999999997},"max":{"1min":3.7320000000000002,"5min":9.5410000000000004,"15min":12.426},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":1.141,"15min":1.355},"min":{"1min":0.36399999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.75,"5min":6.9409999999999998,"15min":9.3320000000000007},"last":0.77300000000000002}]},{"osd":7,"last update":"Sun Oct 8 20:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.83499999999999996,"15min":1.3300000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":3.3140000000000001,"5min":3.9020000000000001,"15min":15.071},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":1.0980000000000001,"15min":1.3839999999999999},"min":{"1min":0.376,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":3.4300000000000002,"5min":10.34,"15min":10.804},"last":0.84499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T20:12:27.116 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-08T20:12:27.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.253+0000 7f65f6979700 1 -- 172.21.15.45:0/1231338940 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f65f00ce020 msgr2=0x7f65f00cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:27.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.253+0000 7f65f6979700 1 --2- 172.21.15.45:0/1231338940 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f65f00ce020 0x7f65f00cb270 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f65e8009fd0 tx=0x7f65e800b380 comp rx=0 tx=0).stop 2023-10-08T20:12:27.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.253+0000 7f65f6979700 1 -- 172.21.15.45:0/1231338940 shutdown_connections 2023-10-08T20:12:27.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.253+0000 7f65f6979700 1 --2- 172.21.15.45:0/1231338940 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f65f00ce020 0x7f65f00cb270 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:27.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.253+0000 7f65f6979700 1 --2- 172.21.15.45:0/1231338940 >> v2:172.21.15.78:3300/0 conn(0x7f65f0159a30 0x7f65f0071cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:27.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.253+0000 7f65f6979700 1 -- 172.21.15.45:0/1231338940 >> 172.21.15.45:0/1231338940 conn(0x7f65f006b320 msgr2=0x7f65f006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:27.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.253+0000 7f65f6979700 1 -- 172.21.15.45:0/1231338940 shutdown_connections 2023-10-08T20:12:27.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.253+0000 7f65f6979700 1 -- 172.21.15.45:0/1231338940 wait complete. 2023-10-08T20:12:27.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.254+0000 7f65f6979700 1 Processor -- start 2023-10-08T20:12:27.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.255+0000 7f65f6979700 1 -- start start 2023-10-08T20:12:27.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.255+0000 7f65f6979700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65f0072230 0x7f65f00a7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:27.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.255+0000 7f65f6979700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f65f00ce020 0x7f65f0146770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:27.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.255+0000 7f65f6979700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65f0159a30 0x7f65f006b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:27.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.255+0000 7f65f6979700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f0146cb0 con 0x7f65f0072230 2023-10-08T20:12:27.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.255+0000 7f65f6979700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f01efad0 con 0x7f65f0159a30 2023-10-08T20:12:27.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.255+0000 7f65f6979700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f0146f10 con 0x7f65f00ce020 2023-10-08T20:12:27.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.255+0000 7f65effff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65f0072230 0x7f65f00a7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:27.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.256+0000 7f65effff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65f0072230 0x7f65f00a7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51830/0 (socket says 172.21.15.45:51830) 2023-10-08T20:12:27.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.256+0000 7f65effff700 1 -- 172.21.15.45:0/1577080572 learned_addr learned my addr 172.21.15.45:0/1577080572 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:12:27.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.256+0000 7f65ef7fe700 1 --2- 172.21.15.45:0/1577080572 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f65f00ce020 0x7f65f0146770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:27.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.256+0000 7f65f4f16700 1 --2- 172.21.15.45:0/1577080572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65f0159a30 0x7f65f006b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:27.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.256+0000 7f65effff700 1 -- 172.21.15.45:0/1577080572 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f65f00ce020 msgr2=0x7f65f0146770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:27.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.256+0000 7f65effff700 1 --2- 172.21.15.45:0/1577080572 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f65f00ce020 0x7f65f0146770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:27.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.256+0000 7f65effff700 1 -- 172.21.15.45:0/1577080572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65f0159a30 msgr2=0x7f65f006b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:27.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.256+0000 7f65effff700 1 --2- 172.21.15.45:0/1577080572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65f0159a30 0x7f65f006b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:27.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.256+0000 7f65effff700 1 -- 172.21.15.45:0/1577080572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e8009d00 con 0x7f65f0072230 2023-10-08T20:12:27.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.256+0000 7f65effff700 1 --2- 172.21.15.45:0/1577080572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65f0072230 0x7f65f00a7100 secure :-1 s=READY pgs=3331 cs=0 l=1 rev1=1 crypto rx=0x7f65e400e9f0 tx=0x7f65e400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:27.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.256+0000 7f65ecff9700 1 -- 172.21.15.45:0/1577080572 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e4009610 con 0x7f65f0072230 2023-10-08T20:12:27.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.256+0000 7f65ecff9700 1 -- 172.21.15.45:0/1577080572 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f65e400cab0 con 0x7f65f0072230 2023-10-08T20:12:27.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.256+0000 7f65f6979700 1 -- 172.21.15.45:0/1577080572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f01471f0 con 0x7f65f0072230 2023-10-08T20:12:27.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.256+0000 7f65ecff9700 1 -- 172.21.15.45:0/1577080572 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e400cea0 con 0x7f65f0072230 2023-10-08T20:12:27.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.256+0000 7f65f6979700 1 -- 172.21.15.45:0/1577080572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f01477b0 con 0x7f65f0072230 2023-10-08T20:12:27.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.257+0000 7f65f6979700 1 -- 172.21.15.45:0/1577080572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f006c2b0 con 0x7f65f0072230 2023-10-08T20:12:27.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.258+0000 7f65ecff9700 1 -- 172.21.15.45:0/1577080572 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f65e4010640 con 0x7f65f0072230 2023-10-08T20:12:27.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.258+0000 7f65ecff9700 1 --2- 172.21.15.45:0/1577080572 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f65dc06aed0 0x7f65dc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:27.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.258+0000 7f65ecff9700 1 -- 172.21.15.45:0/1577080572 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f65e4014070 con 0x7f65f0072230 2023-10-08T20:12:27.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.259+0000 7f65ef7fe700 1 --2- 172.21.15.45:0/1577080572 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f65dc06aed0 0x7f65dc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:27.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.259+0000 7f65ef7fe700 1 --2- 172.21.15.45:0/1577080572 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f65dc06aed0 0x7f65dc06d390 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f65e0007fd0 tx=0x7f65e0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:27.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.267+0000 7f65ecff9700 1 -- 172.21.15.45:0/1577080572 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f65e4051ca0 con 0x7f65f0072230 2023-10-08T20:12:27.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.474+0000 7f65f6979700 1 -- 172.21.15.45:0/1577080572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f65f015b3a0 con 0x7f65f0072230 2023-10-08T20:12:27.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.478+0000 7f65ecff9700 1 -- 172.21.15.45:0/1577080572 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v33)=0 v33) v1 ==== 123+0+0 (secure 0 0 0) 0x7f65e4055130 con 0x7f65f0072230 2023-10-08T20:12:27.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.479+0000 7f65ecff9700 1 -- 172.21.15.45:0/1577080572 <== mon.0 v2:172.21.15.45:3300/0 8 ==== config(6 keys) v1 ==== 172+0+0 (secure 0 0 0) 0x7f65e40594f0 con 0x7f65f0072230 2023-10-08T20:12:27.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.481+0000 7f65f6979700 1 -- 172.21.15.45:0/1577080572 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f65dc06aed0 msgr2=0x7f65dc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:27.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.481+0000 7f65f6979700 1 --2- 172.21.15.45:0/1577080572 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f65dc06aed0 0x7f65dc06d390 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f65e0007fd0 tx=0x7f65e0009040 comp rx=0 tx=0).stop 2023-10-08T20:12:27.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.481+0000 7f65f6979700 1 -- 172.21.15.45:0/1577080572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65f0072230 msgr2=0x7f65f00a7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:27.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.481+0000 7f65f6979700 1 --2- 172.21.15.45:0/1577080572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65f0072230 0x7f65f00a7100 secure :-1 s=READY pgs=3331 cs=0 l=1 rev1=1 crypto rx=0x7f65e400e9f0 tx=0x7f65e400ed00 comp rx=0 tx=0).stop 2023-10-08T20:12:27.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.481+0000 7f65f6979700 1 -- 172.21.15.45:0/1577080572 shutdown_connections 2023-10-08T20:12:27.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.481+0000 7f65f6979700 1 --2- 172.21.15.45:0/1577080572 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7f65dc06aed0 0x7f65dc06d390 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:27.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.481+0000 7f65f6979700 1 --2- 172.21.15.45:0/1577080572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65f0159a30 0x7f65f006b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:27.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.481+0000 7f65f6979700 1 --2- 172.21.15.45:0/1577080572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65f0072230 0x7f65f00a7100 unknown :-1 s=CLOSED pgs=3331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:27.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.481+0000 7f65f6979700 1 --2- 172.21.15.45:0/1577080572 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f65f00ce020 0x7f65f0146770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:27.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.481+0000 7f65f6979700 1 -- 172.21.15.45:0/1577080572 >> 172.21.15.45:0/1577080572 conn(0x7f65f006b320 msgr2=0x7f65f015b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:27.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.481+0000 7f65f6979700 1 -- 172.21.15.45:0/1577080572 shutdown_connections 2023-10-08T20:12:27.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.481+0000 7f65f6979700 1 -- 172.21.15.45:0/1577080572 wait complete. 2023-10-08T20:12:27.496 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T20:12:27.497 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T20:12:27.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.634+0000 7fa15fcb3700 1 -- 172.21.15.45:0/2183255157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1580ce1a0 msgr2=0x7fa1580caeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:27.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.634+0000 7fa15fcb3700 1 --2- 172.21.15.45:0/2183255157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1580ce1a0 0x7fa1580caeb0 secure :-1 s=READY pgs=3332 cs=0 l=1 rev1=1 crypto rx=0x7fa158072280 tx=0x7fa15000b380 comp rx=0 tx=0).stop 2023-10-08T20:12:27.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.634+0000 7fa15fcb3700 1 -- 172.21.15.45:0/2183255157 shutdown_connections 2023-10-08T20:12:27.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.634+0000 7fa15fcb3700 1 --2- 172.21.15.45:0/2183255157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1580ce1a0 0x7fa1580caeb0 unknown :-1 s=CLOSED pgs=3332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:27.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.634+0000 7fa15fcb3700 1 --2- 172.21.15.45:0/2183255157 >> v2:172.21.15.78:3300/0 conn(0x7fa15815baf0 0x7fa158160220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:27.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.634+0000 7fa15fcb3700 1 --2- 172.21.15.45:0/2183255157 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa15815bed0 0x7fa1580cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:27.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.634+0000 7fa15fcb3700 1 -- 172.21.15.45:0/2183255157 >> 172.21.15.45:0/2183255157 conn(0x7fa158097a20 msgr2=0x7fa1580ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:27.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.634+0000 7fa15fcb3700 1 -- 172.21.15.45:0/2183255157 shutdown_connections 2023-10-08T20:12:27.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.634+0000 7fa15fcb3700 1 -- 172.21.15.45:0/2183255157 wait complete. 2023-10-08T20:12:27.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.635+0000 7fa15fcb3700 1 Processor -- start 2023-10-08T20:12:27.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.635+0000 7fa15fcb3700 1 -- start start 2023-10-08T20:12:27.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.636+0000 7fa15fcb3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa1580ce1a0 0x7fa158158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:27.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.636+0000 7fa15fcb3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa15815baf0 0x7fa1580c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:27.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.636+0000 7fa15fcb3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1580c7a80 0x7fa1580c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:27.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.636+0000 7fa15fcb3700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1581f6170 con 0x7fa1580c7a80 2023-10-08T20:12:27.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.636+0000 7fa15fcb3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1580c7f10 con 0x7fa15815baf0 2023-10-08T20:12:27.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.636+0000 7fa15fcb3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1581f5840 con 0x7fa1580ce1a0 2023-10-08T20:12:27.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.636+0000 7fa15e250700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1580c7a80 0x7fa1580c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:27.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.636+0000 7fa15e250700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1580c7a80 0x7fa1580c42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51848/0 (socket says 172.21.15.45:51848) 2023-10-08T20:12:27.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.636+0000 7fa15e250700 1 -- 172.21.15.45:0/1777562871 learned_addr learned my addr 172.21.15.45:0/1777562871 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-08T20:12:27.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.636+0000 7fa15d24e700 1 --2- 172.21.15.45:0/1777562871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa15815baf0 0x7fa1580c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:27.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.636+0000 7fa15da4f700 1 --2- 172.21.15.45:0/1777562871 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa1580ce1a0 0x7fa158158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:27.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.637+0000 7fa15e250700 1 -- 172.21.15.45:0/1777562871 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa1580ce1a0 msgr2=0x7fa158158b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:27.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.637+0000 7fa15e250700 1 --2- 172.21.15.45:0/1777562871 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa1580ce1a0 0x7fa158158b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:27.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.637+0000 7fa15e250700 1 -- 172.21.15.45:0/1777562871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa15815baf0 msgr2=0x7fa1580c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:27.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.637+0000 7fa15e250700 1 --2- 172.21.15.45:0/1777562871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa15815baf0 0x7fa1580c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:27.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.637+0000 7fa15e250700 1 -- 172.21.15.45:0/1777562871 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa150009d00 con 0x7fa1580c7a80 2023-10-08T20:12:27.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.637+0000 7fa15d24e700 1 --2- 172.21.15.45:0/1777562871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa15815baf0 0x7fa1580c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T20:12:27.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.637+0000 7fa15e250700 1 --2- 172.21.15.45:0/1777562871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1580c7a80 0x7fa1580c42a0 secure :-1 s=READY pgs=3333 cs=0 l=1 rev1=1 crypto rx=0x7fa158070070 tx=0x7fa150007670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:27.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.637+0000 7fa14e7fc700 1 -- 172.21.15.45:0/1777562871 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15000e040 con 0x7fa1580c7a80 2023-10-08T20:12:27.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.637+0000 7fa14e7fc700 1 -- 172.21.15.45:0/1777562871 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(6 keys) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa150007d30 con 0x7fa1580c7a80 2023-10-08T20:12:27.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.637+0000 7fa14e7fc700 1 -- 172.21.15.45:0/1777562871 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15001d6e0 con 0x7fa1580c7a80 2023-10-08T20:12:27.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.637+0000 7fa15fcb3700 1 -- 172.21.15.45:0/1777562871 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa15815fc10 con 0x7fa1580c7a80 2023-10-08T20:12:27.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.637+0000 7fa15fcb3700 1 -- 172.21.15.45:0/1777562871 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1581f5ab0 con 0x7fa1580c7a80 2023-10-08T20:12:27.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.638+0000 7fa15fcb3700 1 -- 172.21.15.45:0/1777562871 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1581f62b0 con 0x7fa1580c7a80 2023-10-08T20:12:27.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.638+0000 7fa14e7fc700 1 -- 172.21.15.45:0/1777562871 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa15001b450 con 0x7fa1580c7a80 2023-10-08T20:12:27.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.639+0000 7fa14e7fc700 1 --2- 172.21.15.45:0/1777562871 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa13c06aed0 0x7fa13c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T20:12:27.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.639+0000 7fa14e7fc700 1 -- 172.21.15.45:0/1777562871 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa15008b540 con 0x7fa1580c7a80 2023-10-08T20:12:27.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.639+0000 7fa15da4f700 1 --2- 172.21.15.45:0/1777562871 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa13c06aed0 0x7fa13c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T20:12:27.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.640+0000 7fa15da4f700 1 --2- 172.21.15.45:0/1777562871 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa13c06aed0 0x7fa13c06d390 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fa154005e10 tx=0x7fa154005d20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T20:12:27.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.644+0000 7fa14e7fc700 1 -- 172.21.15.45:0/1777562871 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa1581f62b0 con 0x7fa1580c7a80 2023-10-08T20:12:27.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.902+0000 7fa15fcb3700 1 -- 172.21.15.45:0/1777562871 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1581f62b0 con 0x7fa1580c7a80 2023-10-08T20:12:27.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.902+0000 7fa14e7fc700 1 -- 172.21.15.45:0/1777562871 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3697 (secure 0 0 0) 0x7fa150021e90 con 0x7fa1580c7a80 2023-10-08T20:12:27.903 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-08T20:12:27.904 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4775,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/415745376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":415745376},{"type":"v1","addr":"172.21.15.78:6836","nonce":415745376}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/4017051943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":4017051943},{"type":"v1","addr":"172.21.15.78:6837","nonce":4017051943}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4784,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2071345881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2071345881},{"type":"v1","addr":"172.21.15.45:6835","nonce":2071345881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":13914,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3828583313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3828583313},{"type":"v1","addr":"172.21.15.45:6834","nonce":3828583313}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[]} 2023-10-08T20:12:27.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.905+0000 7fa15fcb3700 1 -- 172.21.15.45:0/1777562871 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa13c06aed0 msgr2=0x7fa13c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:27.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.905+0000 7fa15fcb3700 1 --2- 172.21.15.45:0/1777562871 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa13c06aed0 0x7fa13c06d390 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fa154005e10 tx=0x7fa154005d20 comp rx=0 tx=0).stop 2023-10-08T20:12:27.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.905+0000 7fa15fcb3700 1 -- 172.21.15.45:0/1777562871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1580c7a80 msgr2=0x7fa1580c42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T20:12:27.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.905+0000 7fa15fcb3700 1 --2- 172.21.15.45:0/1777562871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1580c7a80 0x7fa1580c42a0 secure :-1 s=READY pgs=3333 cs=0 l=1 rev1=1 crypto rx=0x7fa158070070 tx=0x7fa150007670 comp rx=0 tx=0).stop 2023-10-08T20:12:27.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.905+0000 7fa15fcb3700 1 -- 172.21.15.45:0/1777562871 shutdown_connections 2023-10-08T20:12:27.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.905+0000 7fa15fcb3700 1 --2- 172.21.15.45:0/1777562871 >> [v2:172.21.15.78:6832/3438117854,v1:172.21.15.78:6833/3438117854] conn(0x7fa13c06aed0 0x7fa13c06d390 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:27.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.905+0000 7fa15fcb3700 1 --2- 172.21.15.45:0/1777562871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1580c7a80 0x7fa1580c42a0 unknown :-1 s=CLOSED pgs=3333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:27.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.905+0000 7fa15fcb3700 1 --2- 172.21.15.45:0/1777562871 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa1580ce1a0 0x7fa158158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:27.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.905+0000 7fa15fcb3700 1 --2- 172.21.15.45:0/1777562871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa15815baf0 0x7fa1580c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T20:12:27.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.905+0000 7fa15fcb3700 1 -- 172.21.15.45:0/1777562871 >> 172.21.15.45:0/1777562871 conn(0x7fa158097a20 msgr2=0x7fa15806a440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T20:12:27.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.905+0000 7fa15fcb3700 1 -- 172.21.15.45:0/1777562871 shutdown_connections 2023-10-08T20:12:27.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-08T20:12:27.905+0000 7fa15fcb3700 1 -- 172.21.15.45:0/1777562871 wait complete. 2023-10-08T20:12:27.907 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 18 2023-10-08T20:12:27.920 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-08T20:12:27.920 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-08T20:12:27.920 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T20:12:27.920 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T20:12:27.930 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T20:12:27.931 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T20:12:27.931 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T20:12:27.984 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T20:12:27.984 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T20:12:27.984 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T20:12:27.996 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T20:12:27.996 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T20:12:27.996 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T20:12:28.048 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T20:12:28.048 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-08T20:12:28.048 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-08T20:12:28.048 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T20:12:32.957 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-10-08T20:12:34.150 INFO:tasks.ceph.osd.0:Stopped 2023-10-08T20:12:34.151 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-08T20:12:34.151 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T20:12:39.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-10-08T20:12:39.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-10-08T20:12:40.252 INFO:tasks.ceph.osd.1:Stopped 2023-10-08T20:12:40.253 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-08T20:12:40.253 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T20:12:45.075 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-10-08T20:12:45.075 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-10-08T20:12:46.355 INFO:tasks.ceph.osd.2:Stopped 2023-10-08T20:12:46.356 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-08T20:12:46.356 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T20:12:46.441 INFO:tasks.ceph.osd.3:Stopped 2023-10-08T20:12:46.441 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-08T20:12:46.441 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T20:12:46.523 INFO:tasks.ceph.osd.4:Stopped 2023-10-08T20:12:46.524 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-08T20:12:46.524 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T20:12:46.599 INFO:tasks.ceph.osd.5:Stopped 2023-10-08T20:12:46.600 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-08T20:12:46.600 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T20:12:46.691 INFO:tasks.ceph.osd.6:Stopped 2023-10-08T20:12:46.692 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-08T20:12:46.692 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T20:12:46.769 INFO:tasks.ceph.osd.7:Stopped 2023-10-08T20:12:46.770 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-08T20:12:46.770 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-08T20:12:46.770 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T20:12:50.478 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2023-10-08T20:12:50.479 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-10-08T20:12:52.872 INFO:tasks.ceph.mgr.y:Stopped 2023-10-08T20:12:52.873 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-08T20:12:52.873 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T20:12:52.902 INFO:tasks.ceph.mgr.x:Stopped 2023-10-08T20:12:52.902 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-08T20:12:52.903 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-08T20:12:52.903 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T20:12:52.937 INFO:tasks.ceph.mon.a:Stopped 2023-10-08T20:12:52.938 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-08T20:12:52.938 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T20:12:52.964 INFO:tasks.ceph.mon.b:Stopped 2023-10-08T20:12:52.965 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-08T20:12:52.965 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T20:12:53.025 INFO:tasks.ceph.mon.c:Stopped 2023-10-08T20:12:53.025 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-08T20:12:53.026 DEBUG:teuthology.orchestra.run.smithi045:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-08T20:12:53.155 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi045.front.sepia.ceph.com 2023-10-08T20:12:53.155 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-08T20:12:53.645 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi045.front.sepia.ceph.com 2023-10-08T20:12:53.645 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-08T20:12:53.854 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi045.front.sepia.ceph.com 2023-10-08T20:12:53.854 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-08T20:12:54.019 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi045.front.sepia.ceph.com 2023-10-08T20:12:54.019 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-08T20:12:54.188 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi078.front.sepia.ceph.com 2023-10-08T20:12:54.188 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-08T20:12:54.543 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi078.front.sepia.ceph.com 2023-10-08T20:12:54.544 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-08T20:12:54.674 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi078.front.sepia.ceph.com 2023-10-08T20:12:54.674 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-08T20:12:54.818 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi078.front.sepia.ceph.com 2023-10-08T20:12:54.819 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-08T20:12:54.972 INFO:tasks.ceph:Archiving mon data... 2023-10-08T20:12:54.974 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417949/data/mon.a.tgz 2023-10-08T20:12:54.974 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2023-10-08T20:12:54.994 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.Fq000cigR9 2023-10-08T20:12:54.994 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Fq000cigR9 2023-10-08T20:12:55.178 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0666 /tmp/tmp.Fq000cigR9 2023-10-08T20:12:55.315 DEBUG:teuthology.orchestra.remote:smithi045:/tmp/tmp.Fq000cigR9 is 602KB 2023-10-08T20:12:55.388 DEBUG:teuthology.orchestra.run.smithi045:> rm -fr /tmp/tmp.Fq000cigR9 2023-10-08T20:12:55.405 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417949/data/mon.b.tgz 2023-10-08T20:12:55.406 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2023-10-08T20:12:55.429 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.2IEsbj1ynf 2023-10-08T20:12:55.429 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.2IEsbj1ynf 2023-10-08T20:12:55.480 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2023-10-08T20:12:55.619 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.2IEsbj1ynf 2023-10-08T20:12:55.704 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.2IEsbj1ynf is 609KB 2023-10-08T20:12:55.775 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.2IEsbj1ynf 2023-10-08T20:12:55.801 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417949/data/mon.c.tgz 2023-10-08T20:12:55.801 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2023-10-08T20:12:55.857 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.pDJFgmf9dc 2023-10-08T20:12:55.857 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.pDJFgmf9dc 2023-10-08T20:12:56.009 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.pDJFgmf9dc 2023-10-08T20:12:56.094 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.pDJFgmf9dc is 609KB 2023-10-08T20:12:56.166 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.pDJFgmf9dc 2023-10-08T20:12:56.182 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-08T20:12:56.183 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-08T20:12:56.185 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-08T20:12:56.284 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-08T20:12:56.285 DEBUG:teuthology.orchestra.run.smithi045:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-08T20:12:56.287 DEBUG:teuthology.orchestra.run.smithi078:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-08T20:12:56.319 INFO:teuthology.orchestra.run.smithi078.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-08T20:12:56.335 INFO:teuthology.orchestra.run.smithi045.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-08T20:12:56.342 INFO:tasks.ceph:Archiving crash dumps... 2023-10-08T20:12:56.344 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417949/remote/smithi045/crash 2023-10-08T20:12:56.345 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-08T20:12:56.374 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417949/remote/smithi078/crash 2023-10-08T20:12:56.375 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-08T20:12:56.401 INFO:tasks.ceph:Shutting down logrotate 2023-10-08T20:13:29.491 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-08T20:13:29.531 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-08T20:13:29.571 INFO:tasks.ceph:Compressing logs... 2023-10-08T20:13:29.571 DEBUG:teuthology.orchestra.run.smithi045:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T20:13:29.574 DEBUG:teuthology.orchestra.run.smithi078:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T20:13:29.613 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344978.log 2023-10-08T20:13:29.616 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.809496.log 2023-10-08T20:13:29.616 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.344978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327759.log 2023-10-08T20:13:29.616 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344978.log.gz 2023-10-08T20:13:29.616 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.809496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198049.log 2023-10-08T20:13:29.616 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.809496.log.gz 2023-10-08T20:13:29.619 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.327759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.710766.log 2023-10-08T20:13:29.620 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327759.log.gz 2023-10-08T20:13:29.620 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.198049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.944144.log 2023-10-08T20:13:29.620 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198049.log.gz 2023-10-08T20:13:29.620 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.710766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655574.log 2023-10-08T20:13:29.620 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.710766.log.gz 2023-10-08T20:13:29.620 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.944144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620929.log 2023-10-08T20:13:29.620 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.944144.log.gz 2023-10-08T20:13:29.621 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.655574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401324.log 2023-10-08T20:13:29.621 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655574.log.gz 2023-10-08T20:13:29.621 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.620929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364546.log 2023-10-08T20:13:29.621 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620929.log.gz 2023-10-08T20:13:29.621 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.775728.log 2023-10-08T20:13:29.621 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263464.log 2023-10-08T20:13:29.621 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357819.log 2023-10-08T20:13:29.621 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335156.log 2023-10-08T20:13:29.622 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.829231.log 2023-10-08T20:13:29.622 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287444.log 2023-10-08T20:13:29.622 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360417.log 2023-10-08T20:13:29.622 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.701208.log 2023-10-08T20:13:29.622 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.832039.log 2023-10-08T20:13:29.622 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388610.log 2023-10-08T20:13:29.656 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.943671.log 2023-10-08T20:13:29.656 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377542.log 2023-10-08T20:13:29.656 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327339.log 2023-10-08T20:13:29.656 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116368.log 2023-10-08T20:13:29.656 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402782.log 2023-10-08T20:13:29.656 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.818808.log 2023-10-08T20:13:29.656 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405126.log 2023-10-08T20:13:29.657 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.647461.log 2023-10-08T20:13:29.657 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.831148.log 2023-10-08T20:13:29.657 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.364546.log: /var/log/ceph/ceph-client.admin.775728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.816983.log 2023-10-08T20:13:29.657 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.401324.log: /var/log/ceph/ceph-client.admin.829231.log: /var/log/ceph/ceph-client.admin.116368.log: /var/log/ceph/ceph-client.admin.360417.log: /var/log/ceph/ceph-client.admin.357819.log: /var/log/ceph/ceph-client.admin.831148.log: /var/log/ceph/ceph-client.admin.701208.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.360417.log.gz 2023-10-08T20:13:29.657 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410644.log 2023-10-08T20:13:29.657 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357819.log.gz 2023-10-08T20:13:29.657 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.832039.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.831148.log.gz 2023-10-08T20:13:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.943671.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.701208.log.gz 2023-10-08T20:13:29.658 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.832039.log.gz 2023-10-08T20:13:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.818808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.943671.log.gz 2023-10-08T20:13:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.647461.log: /var/log/ceph/ceph-client.admin.816983.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.818808.log.gz 2023-10-08T20:13:29.658 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.364546.log.gz 2023-10-08T20:13:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.377542.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.647461.log.gz 2023-10-08T20:13:29.658 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.816983.log.gz 2023-10-08T20:13:29.658 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.377542.log.gz 2023-10-08T20:13:29.659 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.263464.log: /var/log/ceph/ceph-client.admin.335156.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.775728.log.gz 2023-10-08T20:13:29.659 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.388610.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263464.log.gz 2023-10-08T20:13:29.659 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335156.log.gz 2023-10-08T20:13:29.659 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.829231.log.gz 2023-10-08T20:13:29.659 INFO:teuthology.orchestra.run.smithi045.stderr:gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.388610.log.gz-- 2023-10-08T20:13:29.659 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.691276.log 2023-10-08T20:13:29.659 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.401324.log.gz 2023-10-08T20:13:29.659 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.402782.log: /var/log/ceph/ceph-client.admin.405126.log: /var/log/ceph/ceph-client.admin.287444.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.402782.log.gz 2023-10-08T20:13:29.660 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.405126.log.gz 2023-10-08T20:13:29.660 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.327339.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287444.log.gz 2023-10-08T20:13:29.660 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.410644.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327339.log.gz 2023-10-08T20:13:29.660 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410644.log.gz 2023-10-08T20:13:29.660 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344753.log 2023-10-08T20:13:29.660 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.691276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.691276.log.gz 2023-10-08T20:13:29.661 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111812.log 2023-10-08T20:13:29.661 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.344753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369651.log 2023-10-08T20:13:29.661 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344753.log.gz 2023-10-08T20:13:29.661 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276537.log 2023-10-08T20:13:29.661 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.369651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697379.log 2023-10-08T20:13:29.661 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.369651.log.gz 2023-10-08T20:13:29.661 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.276537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111079.log 2023-10-08T20:13:29.661 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276537.log.gz 2023-10-08T20:13:29.662 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.697379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113608.log 2023-10-08T20:13:29.662 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697379.log.gz 2023-10-08T20:13:29.662 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193690.log 2023-10-08T20:13:29.662 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.113608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685082.log 2023-10-08T20:13:29.662 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.193690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386634.log 2023-10-08T20:13:29.662 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193690.log.gz 2023-10-08T20:13:29.662 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.685082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223553.log 2023-10-08T20:13:29.663 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685082.log.gz 2023-10-08T20:13:29.663 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.386634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440890.log 2023-10-08T20:13:29.663 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.386634.log.gz 2023-10-08T20:13:29.663 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.223553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299702.log 2023-10-08T20:13:29.663 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223553.log.gz 2023-10-08T20:13:29.663 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.440890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.936175.log 2023-10-08T20:13:29.664 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.440890.log.gz 2023-10-08T20:13:29.664 INFO:teuthology.orchestra.run.smithi045.stderr:gzip /var/log/ceph/ceph-client.admin.299702.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.683147.log 2023-10-08T20:13:29.664 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299702.log.gz 2023-10-08T20:13:29.664 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.936175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171562.log 2023-10-08T20:13:29.664 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.936175.log.gz 2023-10-08T20:13:29.664 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.683147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212493.log 2023-10-08T20:13:29.665 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.683147.log.gz 2023-10-08T20:13:29.665 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.171562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376337.log 2023-10-08T20:13:29.665 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.171562.log.gz 2023-10-08T20:13:29.665 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.212493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110801.log 2023-10-08T20:13:29.665 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212493.log.gz 2023-10-08T20:13:29.666 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.376337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380922.log 2023-10-08T20:13:29.666 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.376337.log.gz 2023-10-08T20:13:29.666 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635430.log 2023-10-08T20:13:29.666 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.380922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344767.log 2023-10-08T20:13:29.667 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.380922.log.gz 2023-10-08T20:13:29.667 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.635430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414650.log 2023-10-08T20:13:29.667 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635430.log.gz 2023-10-08T20:13:29.667 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.344767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476189.log 2023-10-08T20:13:29.667 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344767.log.gz 2023-10-08T20:13:29.667 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.414650.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.116368.log.gz 2023-10-08T20:13:29.668 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.414650.log.gz 2023-10-08T20:13:29.668 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417364.log 2023-10-08T20:13:29.668 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.476189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.704474.log 2023-10-08T20:13:29.668 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.476189.log.gz 2023-10-08T20:13:29.668 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.417364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.671263.log 2023-10-08T20:13:29.669 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.417364.log.gz 2023-10-08T20:13:29.669 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.704474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374867.log 2023-10-08T20:13:29.669 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.704474.log.gz 2023-10-08T20:13:29.669 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.671263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281348.log 2023-10-08T20:13:29.669 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.671263.log.gz 2023-10-08T20:13:29.670 INFO:teuthology.orchestra.run.smithi045.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.111812.log.gz 2023-10-08T20:13:29.670 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.374867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321782.log 2023-10-08T20:13:29.670 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.374867.log.gz 2023-10-08T20:13:29.670 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.281348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367276.log 2023-10-08T20:13:29.671 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281348.log.gz 2023-10-08T20:13:29.671 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.321782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262496.log 2023-10-08T20:13:29.671 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321782.log.gz 2023-10-08T20:13:29.671 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.367276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199465.log 2023-10-08T20:13:29.671 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.367276.log.gz 2023-10-08T20:13:29.672 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.262496.log: 87.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.110801.log.gz--verbose 2023-10-08T20:13:29.672 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.116322.log 2023-10-08T20:13:29.672 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262496.log.gz 2023-10-08T20:13:29.672 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.199465.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.111079.log.gz 2023-10-08T20:13:29.672 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.769903.log 2023-10-08T20:13:29.673 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199465.log.gz 2023-10-08T20:13:29.673 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116322.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.113608.log.gz 2023-10-08T20:13:29.673 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.773099.log 2023-10-08T20:13:29.673 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.769903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327325.log 2023-10-08T20:13:29.673 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.116322.log.gz 2023-10-08T20:13:29.674 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.769903.log.gz 2023-10-08T20:13:29.674 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.773099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.773099.log.gz 2023-10-08T20:13:29.674 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438615.log 2023-10-08T20:13:29.674 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.327325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198246.log 2023-10-08T20:13:29.674 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327325.log.gz 2023-10-08T20:13:29.675 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.438615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195828.log 2023-10-08T20:13:29.675 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.438615.log.gz 2023-10-08T20:13:29.675 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.198246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.709212.log 2023-10-08T20:13:29.675 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198246.log.gz 2023-10-08T20:13:29.676 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.195828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620552.log 2023-10-08T20:13:29.676 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195828.log.gz 2023-10-08T20:13:29.676 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.709212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359099.log 2023-10-08T20:13:29.676 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.709212.log.gz 2023-10-08T20:13:29.676 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.620552.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620552.log.gz 2023-10-08T20:13:29.677 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332304.log 2023-10-08T20:13:29.677 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.359099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222487.log 2023-10-08T20:13:29.677 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.359099.log.gz 2023-10-08T20:13:29.677 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.332304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280830.log 2023-10-08T20:13:29.677 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332304.log.gz 2023-10-08T20:13:29.677 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.222487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364756.log 2023-10-08T20:13:29.678 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222487.log.gz 2023-10-08T20:13:29.678 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.280830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191582.log 2023-10-08T20:13:29.678 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280830.log.gz 2023-10-08T20:13:29.678 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.364756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175574.log 2023-10-08T20:13:29.678 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.364756.log.gz 2023-10-08T20:13:29.678 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.191582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361244.log 2023-10-08T20:13:29.678 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191582.log.gz 2023-10-08T20:13:29.678 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.175574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695006.log 2023-10-08T20:13:29.679 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175574.log.gz 2023-10-08T20:13:29.679 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.361244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.826112.log 2023-10-08T20:13:29.679 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.361244.log.gz 2023-10-08T20:13:29.679 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.695006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.823361.log 2023-10-08T20:13:29.679 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695006.log.gz 2023-10-08T20:13:29.679 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.826112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.814240.log 2023-10-08T20:13:29.679 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.826112.log.gz 2023-10-08T20:13:29.679 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.823361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472864.log 2023-10-08T20:13:29.680 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.823361.log.gz 2023-10-08T20:13:29.680 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.814240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315905.log 2023-10-08T20:13:29.680 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.814240.log.gz 2023-10-08T20:13:29.680 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.472864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.783774.log 2023-10-08T20:13:29.680 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.472864.log.gz 2023-10-08T20:13:29.680 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.315905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.639236.log 2023-10-08T20:13:29.680 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315905.log.gz 2023-10-08T20:13:29.681 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.783774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371278.log 2023-10-08T20:13:29.681 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.783774.log.gz 2023-10-08T20:13:29.681 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.639236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287244.log 2023-10-08T20:13:29.681 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.639236.log.gz 2023-10-08T20:13:29.681 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.371278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330824.log 2023-10-08T20:13:29.681 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.371278.log.gz 2023-10-08T20:13:29.681 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.287244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.937111.log 2023-10-08T20:13:29.681 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287244.log.gz 2023-10-08T20:13:29.682 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.330824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275023.log 2023-10-08T20:13:29.682 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330824.log.gz 2023-10-08T20:13:29.682 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.937111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252066.log 2023-10-08T20:13:29.682 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.937111.log.gz 2023-10-08T20:13:29.682 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.275023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265412.log 2023-10-08T20:13:29.682 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275023.log.gz 2023-10-08T20:13:29.682 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.252066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154145.log 2023-10-08T20:13:29.682 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252066.log.gz 2023-10-08T20:13:29.683 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.265412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.691736.log 2023-10-08T20:13:29.683 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265412.log.gz 2023-10-08T20:13:29.683 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.154145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.684836.log 2023-10-08T20:13:29.683 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154145.log.gz 2023-10-08T20:13:29.683 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.691736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.802353.log 2023-10-08T20:13:29.683 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.691736.log.gz 2023-10-08T20:13:29.683 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.684836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119101.log 2023-10-08T20:13:29.683 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.684836.log.gz 2023-10-08T20:13:29.684 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.802353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.817809.log 2023-10-08T20:13:29.684 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.802353.log.gz 2023-10-08T20:13:29.684 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.119101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692296.log 2023-10-08T20:13:29.684 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.817809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.646177.log 2023-10-08T20:13:29.684 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.817809.log.gz 2023-10-08T20:13:29.684 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.692296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415768.log 2023-10-08T20:13:29.684 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.692296.log.gz 2023-10-08T20:13:29.684 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.646177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311163.log 2023-10-08T20:13:29.685 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.646177.log.gz 2023-10-08T20:13:29.685 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.415768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373843.log 2023-10-08T20:13:29.685 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.415768.log.gz 2023-10-08T20:13:29.685 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.311163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636339.log 2023-10-08T20:13:29.685 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311163.log.gz 2023-10-08T20:13:29.685 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.373843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.937599.log 2023-10-08T20:13:29.686 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.373843.log.gz 2023-10-08T20:13:29.686 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.636339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388852.log 2023-10-08T20:13:29.686 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636339.log.gz 2023-10-08T20:13:29.686 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.937599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.662370.log 2023-10-08T20:13:29.686 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.937599.log.gz 2023-10-08T20:13:29.686 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.388852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.829245.log 2023-10-08T20:13:29.686 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.388852.log.gz 2023-10-08T20:13:29.686 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.662370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330071.log 2023-10-08T20:13:29.687 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.662370.log.gz 2023-10-08T20:13:29.687 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.829245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692219.log 2023-10-08T20:13:29.687 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.829245.log.gz 2023-10-08T20:13:29.687 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.330071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636113.log 2023-10-08T20:13:29.687 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330071.log.gz 2023-10-08T20:13:29.687 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.692219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262161.log 2023-10-08T20:13:29.687 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.692219.log.gz 2023-10-08T20:13:29.688 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.636113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.773387.log 2023-10-08T20:13:29.688 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636113.log.gz 2023-10-08T20:13:29.688 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.262161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111568.log 2023-10-08T20:13:29.688 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262161.log.gz 2023-10-08T20:13:29.688 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.773387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.825655.log 2023-10-08T20:13:29.688 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.773387.log.gz 2023-10-08T20:13:29.689 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477922.log 2023-10-08T20:13:29.689 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.825655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156870.log 2023-10-08T20:13:29.689 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.825655.log.gz 2023-10-08T20:13:29.689 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.477922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397065.log 2023-10-08T20:13:29.689 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.477922.log.gz 2023-10-08T20:13:29.689 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.156870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.816782.log 2023-10-08T20:13:29.689 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156870.log.gz 2023-10-08T20:13:29.690 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.397065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.829614.log 2023-10-08T20:13:29.690 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.397065.log.gz 2023-10-08T20:13:29.690 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.816782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116548.log 2023-10-08T20:13:29.690 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.816782.log.gz 2023-10-08T20:13:29.690 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.829614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385005.log 2023-10-08T20:13:29.690 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.829614.log.gz 2023-10-08T20:13:29.690 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111522.log 2023-10-08T20:13:29.693 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.385005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.807037.log 2023-10-08T20:13:29.693 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385005.log.gz 2023-10-08T20:13:29.693 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195424.log 2023-10-08T20:13:29.693 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.807037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.679373.log 2023-10-08T20:13:29.693 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.807037.log.gz 2023-10-08T20:13:29.704 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.111505.log 2023-10-08T20:13:29.704 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-08T20:13:29.704 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-08T20:13:29.704 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.3.111505.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.111505.log.gz 2023-10-08T20:13:29.704 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104163.log 2023-10-08T20:13:29.704 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104302.log 2023-10-08T20:13:29.704 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.104163.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-08T20:13:29.705 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.104302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104018.log 2023-10-08T20:13:29.705 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-08T20:13:29.705 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.104018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104071.log 2023-10-08T20:13:29.705 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-08T20:13:29.705 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.104071.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-08T20:13:29.705 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.110898.log 2023-10-08T20:13:29.705 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104116.log 2023-10-08T20:13:29.705 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.1.110898.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-08T20:13:29.705 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.110898.log.gz 2023-10-08T20:13:29.706 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.104116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104350.log 2023-10-08T20:13:29.706 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-08T20:13:29.706 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.104350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104207.log 2023-10-08T20:13:29.706 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-08T20:13:29.706 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.104207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.110890.log 2023-10-08T20:13:29.706 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.111509.log 2023-10-08T20:13:29.707 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.1.110890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.110890.log.gz 2023-10-08T20:13:29.707 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-08T20:13:29.707 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-08T20:13:29.707 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.3.111509.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.111509.log.gz 2023-10-08T20:13:29.707 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104254.log 2023-10-08T20:13:29.710 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-client.admin.104254.log: 86.6% 86.8% 86.6% -- replaced with /var/log/ceph/ceph-client.admin.104163.log.gz -- replaced with /var/log/ceph/ceph-client.admin.104018.log.gz -- replaced with /var/log/ceph/ceph-client.admin.104116.log.gz 2023-10-08T20:13:29.710 INFO:teuthology.orchestra.run.smithi078.stderr: 2023-10-08T20:13:29.710 INFO:teuthology.orchestra.run.smithi078.stderr: 2023-10-08T20:13:29.711 INFO:teuthology.orchestra.run.smithi078.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.104254.log.gz 2023-10-08T20:13:29.711 INFO:teuthology.orchestra.run.smithi078.stderr: 86.5% 86.9% -- replaced with /var/log/ceph/ceph-client.admin.104207.log.gz 2023-10-08T20:13:29.711 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.104071.log.gz 2023-10-08T20:13:29.711 INFO:teuthology.orchestra.run.smithi078.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.104302.log.gz 2023-10-08T20:13:29.711 INFO:teuthology.orchestra.run.smithi078.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.104350.log.gz 2023-10-08T20:13:29.786 INFO:teuthology.orchestra.run.smithi078.stderr: 93.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-08T20:13:30.086 INFO:teuthology.orchestra.run.smithi078.stderr: 94.8% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-08T20:13:30.219 INFO:teuthology.orchestra.run.smithi078.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-08T20:13:30.297 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.195424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245292.log 2023-10-08T20:13:30.297 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195424.log.gz 2023-10-08T20:13:30.297 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.679373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.686165.log 2023-10-08T20:13:30.297 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.679373.log.gz 2023-10-08T20:13:30.297 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.245292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.690722.log 2023-10-08T20:13:30.298 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245292.log.gz 2023-10-08T20:13:30.298 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.686165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.782971.log 2023-10-08T20:13:30.298 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.686165.log.gz 2023-10-08T20:13:30.298 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.690722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331199.log 2023-10-08T20:13:30.298 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.690722.log.gz 2023-10-08T20:13:30.298 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.782971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.658490.log 2023-10-08T20:13:30.298 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.119101.log.gz 2023-10-08T20:13:30.298 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.782971.log.gz 2023-10-08T20:13:30.299 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.331199.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.111568.log.gz 2023-10-08T20:13:30.299 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.939965.log 2023-10-08T20:13:30.299 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331199.log.gz 2023-10-08T20:13:30.299 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.111522.log.gz 2023-10-08T20:13:30.299 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.658490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328564.log 2023-10-08T20:13:30.299 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.658490.log.gz 2023-10-08T20:13:30.299 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.939965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404749.log 2023-10-08T20:13:30.299 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.939965.log.gz 2023-10-08T20:13:30.300 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.328564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110528.log 2023-10-08T20:13:30.300 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328564.log.gz 2023-10-08T20:13:30.300 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.404749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242346.log 2023-10-08T20:13:30.300 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.404749.log.gz 2023-10-08T20:13:30.300 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387136.log 2023-10-08T20:13:30.300 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.242346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387432.log 2023-10-08T20:13:30.300 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242346.log.gz 2023-10-08T20:13:30.301 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110528.log.gz 2023-10-08T20:13:30.301 INFO:teuthology.orchestra.run.smithi045.stderr:gzip /var/log/ceph/ceph-client.admin.387136.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.360403.log 2023-10-08T20:13:30.301 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.387136.log.gz 2023-10-08T20:13:30.301 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.387432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116881.log 2023-10-08T20:13:30.301 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.387432.log.gz 2023-10-08T20:13:30.301 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.360403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158977.log 2023-10-08T20:13:30.301 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.360403.log.gz 2023-10-08T20:13:30.301 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346702.log 2023-10-08T20:13:30.301 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.158977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224206.log 2023-10-08T20:13:30.302 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158977.log.gz 2023-10-08T20:13:30.302 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.346702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402313.log 2023-10-08T20:13:30.302 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346702.log.gz 2023-10-08T20:13:30.302 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.224206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.707222.log 2023-10-08T20:13:30.302 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224206.log.gz 2023-10-08T20:13:30.302 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.402313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.772128.log 2023-10-08T20:13:30.302 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.402313.log.gz 2023-10-08T20:13:30.302 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.707222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205716.log 2023-10-08T20:13:30.303 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.707222.log.gz 2023-10-08T20:13:30.303 INFO:teuthology.orchestra.run.smithi045.stderr:gzip /var/log/ceph/ceph-client.admin.772128.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.709986.log 2023-10-08T20:13:30.303 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.772128.log.gz 2023-10-08T20:13:30.303 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.205716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379128.log 2023-10-08T20:13:30.303 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205716.log.gz 2023-10-08T20:13:30.303 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.709986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118527.log 2023-10-08T20:13:30.303 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.709986.log.gz 2023-10-08T20:13:30.303 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.379128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.943275.log 2023-10-08T20:13:30.304 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.379128.log.gz 2023-10-08T20:13:30.304 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.118527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302025.log 2023-10-08T20:13:30.304 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.943275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.659951.log 2023-10-08T20:13:30.304 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.943275.log.gz 2023-10-08T20:13:30.304 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.771734.log 2023-10-08T20:13:30.304 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302025.log.gz 2023-10-08T20:13:30.304 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.659951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281549.log 2023-10-08T20:13:30.304 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.659951.log.gz 2023-10-08T20:13:30.305 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.771734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368695.log 2023-10-08T20:13:30.305 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.771734.log.gz 2023-10-08T20:13:30.305 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.281549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.776204.log 2023-10-08T20:13:30.305 INFO:teuthology.orchestra.run.smithi045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.116548.log.gz 2023-10-08T20:13:30.305 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281549.log.gz 2023-10-08T20:13:30.305 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.368695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267745.log 2023-10-08T20:13:30.305 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.368695.log.gz 2023-10-08T20:13:30.305 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.776204.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.116881.log.gz 2023-10-08T20:13:30.306 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.622914.log 2023-10-08T20:13:30.306 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.776204.log.gz 2023-10-08T20:13:30.306 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.809008.log 2023-10-08T20:13:30.306 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.267745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267745.log.gz 2023-10-08T20:13:30.306 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.622914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294141.log 2023-10-08T20:13:30.306 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.622914.log.gz 2023-10-08T20:13:30.306 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.809008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384092.log 2023-10-08T20:13:30.306 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.809008.log.gz 2023-10-08T20:13:30.307 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.294141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115806.log 2023-10-08T20:13:30.307 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294141.log.gz 2023-10-08T20:13:30.307 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.384092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620249.log 2023-10-08T20:13:30.307 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384092.log.gz 2023-10-08T20:13:30.307 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347687.log 2023-10-08T20:13:30.307 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.620249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213232.log 2023-10-08T20:13:30.307 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620249.log.gz 2023-10-08T20:13:30.307 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.347687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277765.log 2023-10-08T20:13:30.308 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347687.log.gz 2023-10-08T20:13:30.308 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275958.log 2023-10-08T20:13:30.308 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.213232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213232.log.gz 2023-10-08T20:13:30.308 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.277765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.687910.log 2023-10-08T20:13:30.308 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277765.log.gz 2023-10-08T20:13:30.308 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.275958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215196.log 2023-10-08T20:13:30.308 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275958.log.gz 2023-10-08T20:13:30.308 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.687910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369380.log 2023-10-08T20:13:30.309 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.687910.log.gz 2023-10-08T20:13:30.309 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.215196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.679897.log 2023-10-08T20:13:30.309 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.215196.log.gz 2023-10-08T20:13:30.309 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.369380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297338.log 2023-10-08T20:13:30.309 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.369380.log.gz 2023-10-08T20:13:30.309 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.115806.log.gz 2023-10-08T20:13:30.309 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.679897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397333.log 2023-10-08T20:13:30.309 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.679897.log.gz 2023-10-08T20:13:30.310 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.297338.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.297338.log.gz--verbose 2023-10-08T20:13:30.310 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.703514.log 2023-10-08T20:13:30.310 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.397333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249103.log 2023-10-08T20:13:30.310 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.397333.log.gz 2023-10-08T20:13:30.310 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.703514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117107.log 2023-10-08T20:13:30.310 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703514.log.gz 2023-10-08T20:13:30.310 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.249103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.787106.log 2023-10-08T20:13:30.310 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249103.log.gz 2023-10-08T20:13:30.311 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290052.log 2023-10-08T20:13:30.311 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.787106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.806033.log 2023-10-08T20:13:30.311 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.787106.log.gz 2023-10-08T20:13:30.311 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.117107.log.gz 2023-10-08T20:13:30.311 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.290052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326321.log 2023-10-08T20:13:30.311 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290052.log.gz 2023-10-08T20:13:30.311 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.806033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263387.log 2023-10-08T20:13:30.311 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.806033.log.gz 2023-10-08T20:13:30.312 INFO:teuthology.orchestra.run.smithi045.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.118527.log.gz 2023-10-08T20:13:30.312 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.326321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.805107.log 2023-10-08T20:13:30.312 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326321.log.gz 2023-10-08T20:13:30.312 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.263387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441212.log 2023-10-08T20:13:30.312 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263387.log.gz 2023-10-08T20:13:30.312 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.805107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164324.log 2023-10-08T20:13:30.312 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.805107.log.gz 2023-10-08T20:13:30.313 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.441212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.807749.log 2023-10-08T20:13:30.313 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.441212.log.gz 2023-10-08T20:13:30.313 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.164324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304274.log 2023-10-08T20:13:30.313 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164324.log.gz 2023-10-08T20:13:30.313 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.807749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110575.log 2023-10-08T20:13:30.313 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.807749.log.gz 2023-10-08T20:13:30.313 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.304274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630244.log 2023-10-08T20:13:30.313 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304274.log.gz 2023-10-08T20:13:30.314 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409103.log 2023-10-08T20:13:30.314 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.630244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324799.log 2023-10-08T20:13:30.314 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630244.log.gz 2023-10-08T20:13:30.314 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110575.log.gz 2023-10-08T20:13:30.314 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.409103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.705714.log 2023-10-08T20:13:30.314 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409103.log.gz 2023-10-08T20:13:30.314 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.324799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173903.log 2023-10-08T20:13:30.314 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.324799.log.gz 2023-10-08T20:13:30.315 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.705714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.824341.log 2023-10-08T20:13:30.315 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.705714.log.gz 2023-10-08T20:13:30.315 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.173903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302326.log 2023-10-08T20:13:30.315 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173903.log.gz 2023-10-08T20:13:30.315 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.824341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.641166.log 2023-10-08T20:13:30.315 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.824341.log.gz 2023-10-08T20:13:30.315 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165679.log 2023-10-08T20:13:30.315 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302326.log.gz 2023-10-08T20:13:30.316 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.641166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361321.log 2023-10-08T20:13:30.316 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.641166.log.gz 2023-10-08T20:13:30.316 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.165679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.776709.log 2023-10-08T20:13:30.316 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165679.log.gz 2023-10-08T20:13:30.316 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.361321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.618274.log 2023-10-08T20:13:30.316 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.361321.log.gz 2023-10-08T20:13:30.316 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.776709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117567.log 2023-10-08T20:13:30.316 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.776709.log.gz 2023-10-08T20:13:30.316 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.618274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196874.log 2023-10-08T20:13:30.317 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618274.log.gz 2023-10-08T20:13:30.317 INFO:teuthology.orchestra.run.smithi045.stderr:gzip /var/log/ceph/ceph-client.admin.117567.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.191118.log 2023-10-08T20:13:30.317 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.196874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334635.log 2023-10-08T20:13:30.317 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196874.log.gz 2023-10-08T20:13:30.317 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.117567.log.gz 2023-10-08T20:13:30.317 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.191118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177863.log 2023-10-08T20:13:30.317 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191118.log.gz 2023-10-08T20:13:30.317 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.334635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410155.log 2023-10-08T20:13:30.318 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334635.log.gz 2023-10-08T20:13:30.318 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.177863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103907.log 2023-10-08T20:13:30.318 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177863.log.gz 2023-10-08T20:13:30.318 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.410155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163791.log 2023-10-08T20:13:30.318 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410155.log.gz 2023-10-08T20:13:30.318 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.103907.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-08T20:13:30.318 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.163791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257646.log 2023-10-08T20:13:30.318 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163791.log.gz 2023-10-08T20:13:30.319 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633007.log 2023-10-08T20:13:30.319 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.257646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362552.log 2023-10-08T20:13:30.319 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257646.log.gz 2023-10-08T20:13:30.319 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.633007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341627.log 2023-10-08T20:13:30.319 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633007.log.gz 2023-10-08T20:13:30.319 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.362552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250360.log 2023-10-08T20:13:30.319 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.362552.log.gz 2023-10-08T20:13:30.319 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.341627.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.341627.log.gz--verbose 2023-10-08T20:13:30.320 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.289536.log 2023-10-08T20:13:30.320 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.250360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.824819.log 2023-10-08T20:13:30.320 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250360.log.gz 2023-10-08T20:13:30.320 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.289536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201557.log 2023-10-08T20:13:30.320 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289536.log.gz 2023-10-08T20:13:30.320 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.824819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.824819.log.gz 2023-10-08T20:13:30.320 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363449.log 2023-10-08T20:13:30.320 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.201557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268800.log 2023-10-08T20:13:30.321 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201557.log.gz 2023-10-08T20:13:30.321 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.363449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623937.log 2023-10-08T20:13:30.321 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.363449.log.gz 2023-10-08T20:13:30.321 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.268800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115069.log 2023-10-08T20:13:30.321 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268800.log.gz 2023-10-08T20:13:30.321 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.623937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623185.log 2023-10-08T20:13:30.321 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623937.log.gz 2023-10-08T20:13:30.321 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261405.log 2023-10-08T20:13:30.322 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.623185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319875.log 2023-10-08T20:13:30.322 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623185.log.gz 2023-10-08T20:13:30.322 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.261405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287535.log 2023-10-08T20:13:30.322 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261405.log.gz 2023-10-08T20:13:30.322 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.319875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409581.log 2023-10-08T20:13:30.322 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319875.log.gz 2023-10-08T20:13:30.322 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.287535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693769.log 2023-10-08T20:13:30.322 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287535.log.gz 2023-10-08T20:13:30.323 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.409581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.686533.log 2023-10-08T20:13:30.323 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409581.log.gz 2023-10-08T20:13:30.323 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.693769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.709972.log 2023-10-08T20:13:30.323 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.693769.log.gz 2023-10-08T20:13:30.323 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.686533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415754.log 2023-10-08T20:13:30.323 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.686533.log.gz 2023-10-08T20:13:30.323 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.709972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303120.log 2023-10-08T20:13:30.323 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.709972.log.gz 2023-10-08T20:13:30.324 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.415754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194956.log 2023-10-08T20:13:30.324 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.415754.log.gz 2023-10-08T20:13:30.324 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.303120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383198.log 2023-10-08T20:13:30.324 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303120.log.gz 2023-10-08T20:13:30.324 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.194956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693755.log 2023-10-08T20:13:30.324 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194956.log.gz 2023-10-08T20:13:30.324 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.383198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346410.log 2023-10-08T20:13:30.324 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.383198.log.gz 2023-10-08T20:13:30.325 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.693755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626890.log 2023-10-08T20:13:30.325 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.693755.log.gz 2023-10-08T20:13:30.325 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.346410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672769.log 2023-10-08T20:13:30.325 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346410.log.gz 2023-10-08T20:13:30.325 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.626890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.707713.log 2023-10-08T20:13:30.325 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626890.log.gz 2023-10-08T20:13:30.325 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.672769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300109.log 2023-10-08T20:13:30.325 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.672769.log.gz 2023-10-08T20:13:30.326 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.707713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288022.log 2023-10-08T20:13:30.326 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.707713.log.gz 2023-10-08T20:13:30.326 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.300109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.809510.log 2023-10-08T20:13:30.326 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300109.log.gz 2023-10-08T20:13:30.326 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.288022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267354.log 2023-10-08T20:13:30.326 INFO:teuthology.orchestra.run.smithi045.stderr: 75.8% -- replaced with /var/log/ceph/ceph-client.admin.103907.log.gz 2023-10-08T20:13:30.326 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288022.log.gz 2023-10-08T20:13:30.326 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.809510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368494.log 2023-10-08T20:13:30.327 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.809510.log.gz 2023-10-08T20:13:30.327 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.115069.log.gz 2023-10-08T20:13:30.327 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.267354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254955.log 2023-10-08T20:13:30.327 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267354.log.gz 2023-10-08T20:13:30.327 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.368494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281045.log 2023-10-08T20:13:30.327 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.368494.log.gz 2023-10-08T20:13:30.327 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.254955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635627.log 2023-10-08T20:13:30.327 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254955.log.gz 2023-10-08T20:13:30.328 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.281045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.638845.log 2023-10-08T20:13:30.328 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281045.log.gz 2023-10-08T20:13:30.328 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.635627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382730.log 2023-10-08T20:13:30.328 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635627.log.gz 2023-10-08T20:13:30.328 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.638845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386926.log 2023-10-08T20:13:30.328 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.638845.log.gz 2023-10-08T20:13:30.328 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.382730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316129.log 2023-10-08T20:13:30.328 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382730.log.gz 2023-10-08T20:13:30.329 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111813.log 2023-10-08T20:13:30.329 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.386926.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.386926.log.gz 2023-10-08T20:13:30.329 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.316129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160483.log 2023-10-08T20:13:30.329 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316129.log.gz 2023-10-08T20:13:30.329 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437950.log 2023-10-08T20:13:30.329 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.160483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321768.log 2023-10-08T20:13:30.329 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160483.log.gz 2023-10-08T20:13:30.329 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.437950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111317.log 2023-10-08T20:13:30.330 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.437950.log.gz 2023-10-08T20:13:30.330 INFO:teuthology.orchestra.run.smithi045.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.111813.log.gz 2023-10-08T20:13:30.330 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.321768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255534.log 2023-10-08T20:13:30.330 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321768.log.gz 2023-10-08T20:13:30.330 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317850.log 2023-10-08T20:13:30.330 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.255534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.949275.log 2023-10-08T20:13:30.330 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255534.log.gz 2023-10-08T20:13:30.330 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.111317.log.gz 2023-10-08T20:13:30.331 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.317850.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.317850.log.gz 2023-10-08T20:13:30.331 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.833755.log 2023-10-08T20:13:30.331 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.949275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196586.log 2023-10-08T20:13:30.331 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.833755.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.949275.log.gz 2023-10-08T20:13:30.331 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.789382.log -- replaced with /var/log/ceph/ceph-client.admin.833755.log.gz 2023-10-08T20:13:30.331 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-10-08T20:13:30.331 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.196586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.810514.log 2023-10-08T20:13:30.332 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196586.log.gz 2023-10-08T20:13:30.332 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.789382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416758.log 2023-10-08T20:13:30.332 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.789382.log.gz 2023-10-08T20:13:30.332 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.810514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.790346.log 2023-10-08T20:13:30.332 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.810514.log.gz 2023-10-08T20:13:30.332 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.416758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.783178.log 2023-10-08T20:13:30.332 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.416758.log.gz 2023-10-08T20:13:30.332 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.790346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244045.log 2023-10-08T20:13:30.333 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.790346.log.gz 2023-10-08T20:13:30.333 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.783178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.947746.log 2023-10-08T20:13:30.333 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.783178.log.gz 2023-10-08T20:13:30.333 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.244045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408085.log 2023-10-08T20:13:30.333 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244045.log.gz 2023-10-08T20:13:30.333 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.947746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.788464.log 2023-10-08T20:13:30.333 INFO:teuthology.orchestra.run.smithi045.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.947746.log.gz 2023-10-08T20:13:30.333 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.408085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.939477.log 2023-10-08T20:13:30.333 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408085.log.gz 2023-10-08T20:13:30.334 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.788464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293079.log 2023-10-08T20:13:30.334 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.788464.log.gz 2023-10-08T20:13:30.334 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.939477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520851.log 2023-10-08T20:13:30.334 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.939477.log.gz 2023-10-08T20:13:30.334 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.293079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394078.log 2023-10-08T20:13:30.334 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293079.log.gz 2023-10-08T20:13:30.334 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.520851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474691.log 2023-10-08T20:13:30.334 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.520851.log.gz 2023-10-08T20:13:30.335 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.394078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619387.log 2023-10-08T20:13:30.335 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394078.log.gz 2023-10-08T20:13:30.335 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.474691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.949229.log 2023-10-08T20:13:30.335 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.474691.log.gz 2023-10-08T20:13:30.335 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.619387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312014.log 2023-10-08T20:13:30.335 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.619387.log.gz 2023-10-08T20:13:30.335 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.949229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389910.log 2023-10-08T20:13:30.335 INFO:teuthology.orchestra.run.smithi045.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.949229.log.gz 2023-10-08T20:13:30.336 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.312014.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.312014.log.gz 2023-10-08T20:13:30.336 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.335142.log 2023-10-08T20:13:30.336 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.389910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.702030.log 2023-10-08T20:13:30.336 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.389910.log.gz 2023-10-08T20:13:30.336 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.335142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644024.log 2023-10-08T20:13:30.336 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335142.log.gz 2023-10-08T20:13:30.336 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.702030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363234.log 2023-10-08T20:13:30.336 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702030.log.gz 2023-10-08T20:13:30.337 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.644024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.806047.log 2023-10-08T20:13:30.337 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.644024.log.gz 2023-10-08T20:13:30.337 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.363234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.947884.log 2023-10-08T20:13:30.337 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.363234.log.gz 2023-10-08T20:13:30.337 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.806047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173415.log 2023-10-08T20:13:30.337 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.806047.log.gz 2023-10-08T20:13:30.337 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.947884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291860.log 2023-10-08T20:13:30.338 INFO:teuthology.orchestra.run.smithi045.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.947884.log.gz 2023-10-08T20:13:30.338 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.173415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655874.log 2023-10-08T20:13:30.338 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173415.log.gz 2023-10-08T20:13:30.338 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.291860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.656083.log 2023-10-08T20:13:30.338 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291860.log.gz 2023-10-08T20:13:30.338 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.655874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.813528.log 2023-10-08T20:13:30.338 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655874.log.gz 2023-10-08T20:13:30.338 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.656083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685629.log 2023-10-08T20:13:30.339 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.656083.log.gz 2023-10-08T20:13:30.339 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.813528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323233.log 2023-10-08T20:13:30.339 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.813528.log.gz 2023-10-08T20:13:30.339 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.685629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.657038.log 2023-10-08T20:13:30.339 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685629.log.gz 2023-10-08T20:13:30.339 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.323233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210620.log 2023-10-08T20:13:30.339 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323233.log.gz 2023-10-08T20:13:30.339 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.657038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378840.log 2023-10-08T20:13:30.340 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.657038.log.gz 2023-10-08T20:13:30.340 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.210620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370726.log 2023-10-08T20:13:30.340 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210620.log.gz 2023-10-08T20:13:30.340 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.378840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190654.log 2023-10-08T20:13:30.340 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.378840.log.gz 2023-10-08T20:13:30.340 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.370726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398199.log 2023-10-08T20:13:30.340 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.370726.log.gz 2023-10-08T20:13:30.340 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.190654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391657.log 2023-10-08T20:13:30.341 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190654.log.gz 2023-10-08T20:13:30.341 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.398199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243272.log 2023-10-08T20:13:30.341 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.398199.log.gz 2023-10-08T20:13:30.341 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.391657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257660.log 2023-10-08T20:13:30.341 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.391657.log.gz 2023-10-08T20:13:30.341 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.243272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306023.log 2023-10-08T20:13:30.341 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243272.log.gz 2023-10-08T20:13:30.341 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.257660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349437.log 2023-10-08T20:13:30.342 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257660.log.gz 2023-10-08T20:13:30.342 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.306023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.948677.log 2023-10-08T20:13:30.342 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306023.log.gz 2023-10-08T20:13:30.342 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.349437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287745.log 2023-10-08T20:13:30.342 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349437.log.gz 2023-10-08T20:13:30.342 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.948677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365555.log 2023-10-08T20:13:30.342 INFO:teuthology.orchestra.run.smithi045.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.948677.log.gz 2023-10-08T20:13:30.342 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.287745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398701.log 2023-10-08T20:13:30.343 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287745.log.gz 2023-10-08T20:13:30.343 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.365555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331706.log 2023-10-08T20:13:30.343 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.365555.log.gz 2023-10-08T20:13:30.343 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.398701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440981.log 2023-10-08T20:13:30.343 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.398701.log.gz 2023-10-08T20:13:30.343 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.331706.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331706.log.gz 2023-10-08T20:13:30.343 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.940911.log 2023-10-08T20:13:30.343 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.440981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249585.log 2023-10-08T20:13:30.344 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.440981.log.gz 2023-10-08T20:13:30.344 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.940911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380435.log 2023-10-08T20:13:30.344 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.940911.log.gz 2023-10-08T20:13:30.344 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.249585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399352.log 2023-10-08T20:13:30.344 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249585.log.gz 2023-10-08T20:13:30.344 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.380435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.708874.log 2023-10-08T20:13:30.344 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.380435.log.gz 2023-10-08T20:13:30.344 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.399352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194460.log 2023-10-08T20:13:30.345 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.399352.log.gz 2023-10-08T20:13:30.345 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.708874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.776413.log 2023-10-08T20:13:30.345 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.708874.log.gz 2023-10-08T20:13:30.345 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.194460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438524.log 2023-10-08T20:13:30.345 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194460.log.gz 2023-10-08T20:13:30.345 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.776413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295647.log 2023-10-08T20:13:30.345 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.776413.log.gz 2023-10-08T20:13:30.346 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.438524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254878.log 2023-10-08T20:13:30.346 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.438524.log.gz 2023-10-08T20:13:30.346 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.295647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160114.log 2023-10-08T20:13:30.346 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.295647.log.gz 2023-10-08T20:13:30.346 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.254878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372889.log 2023-10-08T20:13:30.346 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254878.log.gz 2023-10-08T20:13:30.346 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.160114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.691645.log 2023-10-08T20:13:30.346 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160114.log.gz 2023-10-08T20:13:30.347 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.372889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.645388.log 2023-10-08T20:13:30.347 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.372889.log.gz 2023-10-08T20:13:30.347 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.691645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.774750.log 2023-10-08T20:13:30.347 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.691645.log.gz 2023-10-08T20:13:30.347 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.645388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291162.log 2023-10-08T20:13:30.347 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.645388.log.gz 2023-10-08T20:13:30.347 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.774750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.687083.log 2023-10-08T20:13:30.347 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.774750.log.gz 2023-10-08T20:13:30.348 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.291162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380143.log 2023-10-08T20:13:30.348 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291162.log.gz 2023-10-08T20:13:30.348 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.687083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621988.log 2023-10-08T20:13:30.348 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.687083.log.gz 2023-10-08T20:13:30.348 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.380143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329354.log 2023-10-08T20:13:30.348 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.380143.log.gz 2023-10-08T20:13:30.348 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.621988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358878.log 2023-10-08T20:13:30.348 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621988.log.gz 2023-10-08T20:13:30.349 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.329354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409567.log 2023-10-08T20:13:30.349 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329354.log.gz 2023-10-08T20:13:30.349 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.358878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.832507.log 2023-10-08T20:13:30.349 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358878.log.gz 2023-10-08T20:13:30.349 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.409567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.810724.log 2023-10-08T20:13:30.349 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409567.log.gz 2023-10-08T20:13:30.349 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.832507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221077.log 2023-10-08T20:13:30.349 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.832507.log.gz 2023-10-08T20:13:30.350 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.810724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392576.log 2023-10-08T20:13:30.350 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.810724.log.gz 2023-10-08T20:13:30.350 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.221077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.948999.log 2023-10-08T20:13:30.350 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221077.log.gz 2023-10-08T20:13:30.350 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.392576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.643097.log 2023-10-08T20:13:30.350 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.392576.log.gz 2023-10-08T20:13:30.350 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.948999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299217.log 2023-10-08T20:13:30.350 INFO:teuthology.orchestra.run.smithi045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.948999.log.gz 2023-10-08T20:13:30.351 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.643097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364029.log 2023-10-08T20:13:30.351 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.643097.log.gz 2023-10-08T20:13:30.351 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.299217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.574471.log 2023-10-08T20:13:30.351 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299217.log.gz 2023-10-08T20:13:30.351 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.364029.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.364029.log.gz--verbose 2023-10-08T20:13:30.351 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.347673.log 2023-10-08T20:13:30.351 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.574471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336840.log 2023-10-08T20:13:30.351 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.574471.log.gz 2023-10-08T20:13:30.352 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.347673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339728.log 2023-10-08T20:13:30.352 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347673.log.gz 2023-10-08T20:13:30.352 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.336840.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-08T20:13:30.352 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336840.log.gz 2023-10-08T20:13:30.352 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.339728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.775220.log 2023-10-08T20:13:30.352 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339728.log.gz 2023-10-08T20:13:30.352 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382653.log 2023-10-08T20:13:30.352 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.775220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210156.log 2023-10-08T20:13:30.353 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.775220.log.gz 2023-10-08T20:13:30.353 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.382653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317759.log 2023-10-08T20:13:30.353 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382653.log.gz 2023-10-08T20:13:30.353 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.210156.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210156.log.gz 2023-10-08T20:13:30.353 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242802.log 2023-10-08T20:13:30.353 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.317759.log: -- /var/log/ceph/ceph-client.admin.813026.log 2023-10-08T20:13:30.353 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317759.log.gz 2023-10-08T20:13:30.353 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.242802.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242802.log.gz 2023-10-08T20:13:30.354 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477936.log 2023-10-08T20:13:30.354 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.813026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309248.log 2023-10-08T20:13:30.354 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.813026.log.gz 2023-10-08T20:13:30.354 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.477936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.477936.log.gz 2023-10-08T20:13:30.354 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.828147.log 2023-10-08T20:13:30.354 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.309248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342722.log 2023-10-08T20:13:30.355 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309248.log.gz 2023-10-08T20:13:30.355 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.828147.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.828147.log.gz 2023-10-08T20:13:30.355 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414636.log 2023-10-08T20:13:30.355 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.342722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116789.log 2023-10-08T20:13:30.355 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342722.log.gz 2023-10-08T20:13:30.355 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.414636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409849.log 2023-10-08T20:13:30.355 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.414636.log.gz 2023-10-08T20:13:30.355 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.808917.log 2023-10-08T20:13:30.356 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.409849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.647886.log 2023-10-08T20:13:30.356 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409849.log.gz 2023-10-08T20:13:30.356 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.808917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252157.log 2023-10-08T20:13:30.356 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.116789.log.gz 2023-10-08T20:13:30.356 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.808917.log.gz 2023-10-08T20:13:30.356 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.647886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372190.log 2023-10-08T20:13:30.356 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.647886.log.gz 2023-10-08T20:13:30.356 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.252157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372875.log 2023-10-08T20:13:30.357 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252157.log.gz 2023-10-08T20:13:30.357 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.372190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221091.log 2023-10-08T20:13:30.357 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.372190.log.gz 2023-10-08T20:13:30.357 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.372875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282555.log 2023-10-08T20:13:30.357 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.372875.log.gz 2023-10-08T20:13:30.357 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.221091.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221091.log.gz 2023-10-08T20:13:30.357 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164247.log 2023-10-08T20:13:30.357 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.282555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376770.log 2023-10-08T20:13:30.358 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282555.log.gz 2023-10-08T20:13:30.358 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.164247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289961.log 2023-10-08T20:13:30.358 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164247.log.gz 2023-10-08T20:13:30.358 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.376770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342206.log 2023-10-08T20:13:30.358 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.376770.log.gz 2023-10-08T20:13:30.358 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.289961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289961.log.gz 2023-10-08T20:13:30.358 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336333.log 2023-10-08T20:13:30.358 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.342206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.772421.log 2023-10-08T20:13:30.359 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342206.log.gz 2023-10-08T20:13:30.359 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.336333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252552.log 2023-10-08T20:13:30.359 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336333.log.gz 2023-10-08T20:13:30.359 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.772421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296530.log 2023-10-08T20:13:30.359 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.772421.log.gz 2023-10-08T20:13:30.359 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.252552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437457.log 2023-10-08T20:13:30.359 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252552.log.gz 2023-10-08T20:13:30.359 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.296530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.296530.log.gz 2023-10-08T20:13:30.360 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172489.log 2023-10-08T20:13:30.360 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.437457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274521.log 2023-10-08T20:13:30.360 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.437457.log.gz 2023-10-08T20:13:30.360 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.172489.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.172489.log.gz--verbose 2023-10-08T20:13:30.360 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.267263.log 2023-10-08T20:13:30.360 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.274521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474211.log 2023-10-08T20:13:30.360 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274521.log.gz 2023-10-08T20:13:30.360 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.267263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120380.log 2023-10-08T20:13:30.361 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267263.log.gz 2023-10-08T20:13:30.361 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.474211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.947171.log 2023-10-08T20:13:30.361 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.474211.log.gz 2023-10-08T20:13:30.361 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.120380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378340.log 2023-10-08T20:13:30.361 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.947171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285048.log 2023-10-08T20:13:30.361 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.947171.log.gz 2023-10-08T20:13:30.361 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.378340.log: gzip 87.5%-5 --verbose -- /var/log/ceph/ceph-client.admin.250144.log 2023-10-08T20:13:30.361 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.120380.log.gz 2023-10-08T20:13:30.362 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.378340.log.gz 2023-10-08T20:13:30.362 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209271.log 2023-10-08T20:13:30.362 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.285048.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285048.log.gz 2023-10-08T20:13:30.362 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.250144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.833471.log 2023-10-08T20:13:30.362 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250144.log.gz 2023-10-08T20:13:30.362 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.209271.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.209271.log.gz 2023-10-08T20:13:30.362 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288524.log 2023-10-08T20:13:30.362 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.833471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104555.log 2023-10-08T20:13:30.363 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.833471.log.gz 2023-10-08T20:13:30.363 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.288524.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288524.log.gz 2023-10-08T20:13:30.363 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275543.log 2023-10-08T20:13:30.363 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386849.log 2023-10-08T20:13:30.363 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.275543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215105.log 2023-10-08T20:13:30.363 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275543.log.gz 2023-10-08T20:13:30.363 INFO:teuthology.orchestra.run.smithi045.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.104555.log.gz 2023-10-08T20:13:30.363 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.386849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.772815.log 2023-10-08T20:13:30.364 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.386849.log.gz 2023-10-08T20:13:30.364 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437380.log 2023-10-08T20:13:30.364 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.215105.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.215105.log.gz 2023-10-08T20:13:30.364 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.772815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280340.log 2023-10-08T20:13:30.364 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.772815.log.gz 2023-10-08T20:13:30.364 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.437380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.814742.log 2023-10-08T20:13:30.364 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.437380.log.gz 2023-10-08T20:13:30.364 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.280340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364455.log 2023-10-08T20:13:30.365 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280340.log.gz 2023-10-08T20:13:30.365 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.814742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104605.log 2023-10-08T20:13:30.365 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.814742.log.gz 2023-10-08T20:13:30.365 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.364455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.622991.log 2023-10-08T20:13:30.365 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.364455.log.gz 2023-10-08T20:13:30.365 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309795.log 2023-10-08T20:13:30.365 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.622991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.694637.log 2023-10-08T20:13:30.366 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.622991.log.gz 2023-10-08T20:13:30.366 INFO:teuthology.orchestra.run.smithi045.stderr: 86.2%gzip -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.104605.log.gz-- 2023-10-08T20:13:30.366 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.278753.log 2023-10-08T20:13:30.366 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.309795.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309795.log.gz 2023-10-08T20:13:30.366 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.694637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345256.log 2023-10-08T20:13:30.366 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.694637.log.gz 2023-10-08T20:13:30.366 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.278753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164338.log 2023-10-08T20:13:30.366 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278753.log.gz 2023-10-08T20:13:30.367 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.345256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.808994.log 2023-10-08T20:13:30.367 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345256.log.gz 2023-10-08T20:13:30.367 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.164338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.673047.log 2023-10-08T20:13:30.367 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164338.log.gz 2023-10-08T20:13:30.367 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.808994.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.808994.log.gz 2023-10-08T20:13:30.367 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359432.log 2023-10-08T20:13:30.367 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.673047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399634.log 2023-10-08T20:13:30.367 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.673047.log.gz 2023-10-08T20:13:30.368 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.359432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.772330.log 2023-10-08T20:13:30.368 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.359432.log.gz 2023-10-08T20:13:30.368 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.399634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339135.log 2023-10-08T20:13:30.368 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.399634.log.gz 2023-10-08T20:13:30.368 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.772330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.772330.log.gz 2023-10-08T20:13:30.368 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.936651.log 2023-10-08T20:13:30.368 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.339135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.671249.log 2023-10-08T20:13:30.368 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339135.log.gz 2023-10-08T20:13:30.369 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.936651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115852.log 0.0% 2023-10-08T20:13:30.369 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.936651.log.gz 2023-10-08T20:13:30.369 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.671249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247135.log 2023-10-08T20:13:30.369 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.671249.log.gz 2023-10-08T20:13:30.369 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.941790.log 2023-10-08T20:13:30.369 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.247135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.770554.log 2023-10-08T20:13:30.369 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247135.log.gz 2023-10-08T20:13:30.369 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.115852.log.gz 2023-10-08T20:13:30.370 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.941790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311605.log 2023-10-08T20:13:30.370 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.941790.log.gz 2023-10-08T20:13:30.370 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.770554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355356.log 2023-10-08T20:13:30.370 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.770554.log.gz 2023-10-08T20:13:30.370 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.311605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364962.log 2023-10-08T20:13:30.370 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311605.log.gz 2023-10-08T20:13:30.370 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.355356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.783985.log 2023-10-08T20:13:30.370 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355356.log.gz 2023-10-08T20:13:30.371 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.364962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.683133.log 2023-10-08T20:13:30.371 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.364962.log.gz 2023-10-08T20:13:30.371 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.783985.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.783985.log.gz--verbose 2023-10-08T20:13:30.371 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.278792.log 2023-10-08T20:13:30.371 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.683133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268227.log 2023-10-08T20:13:30.371 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.683133.log.gz 2023-10-08T20:13:30.371 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.278792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162479.log 2023-10-08T20:13:30.371 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278792.log.gz 2023-10-08T20:13:30.372 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.268227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.689375.log 2023-10-08T20:13:30.372 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268227.log.gz 2023-10-08T20:13:30.372 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.162479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344676.log 2023-10-08T20:13:30.372 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162479.log.gz 2023-10-08T20:13:30.372 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.689375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377875.log 2023-10-08T20:13:30.372 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.689375.log.gz 2023-10-08T20:13:30.372 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.344676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378628.log 2023-10-08T20:13:30.373 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344676.log.gz 2023-10-08T20:13:30.373 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.377875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312598.log 2023-10-08T20:13:30.373 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.377875.log.gz 2023-10-08T20:13:30.373 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.378628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341426.log 2023-10-08T20:13:30.373 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.378628.log.gz 2023-10-08T20:13:30.373 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.312598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700049.log 2023-10-08T20:13:30.373 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312598.log.gz 2023-10-08T20:13:30.373 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.341426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.941408.log 2023-10-08T20:13:30.373 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341426.log.gz 2023-10-08T20:13:30.374 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.700049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.782985.log 2023-10-08T20:13:30.374 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700049.log.gz 2023-10-08T20:13:30.374 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.941408.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.941408.log.gz-- 2023-10-08T20:13:30.374 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.821158.log 2023-10-08T20:13:30.374 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.782985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200795.log 2023-10-08T20:13:30.374 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.782985.log.gz 2023-10-08T20:13:30.374 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.821158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.643947.log 2023-10-08T20:13:30.375 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.821158.log.gz 2023-10-08T20:13:30.375 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.200795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.681758.log 2023-10-08T20:13:30.375 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200795.log.gz 2023-10-08T20:13:30.375 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.643947.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.642104.log -- replaced with /var/log/ceph/ceph-client.admin.643947.log.gz 2023-10-08T20:13:30.375 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-10-08T20:13:30.375 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.681758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.114090.log 2023-10-08T20:13:30.375 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.681758.log.gz 2023-10-08T20:13:30.375 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.642104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337347.log 2023-10-08T20:13:30.376 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.642104.log.gz 2023-10-08T20:13:30.376 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.114090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359961.log 2023-10-08T20:13:30.376 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.114090.log.gz 2023-10-08T20:13:30.376 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.337347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292864.log 2023-10-08T20:13:30.376 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337347.log.gz 2023-10-08T20:13:30.376 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.359961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644976.log 2023-10-08T20:13:30.376 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.359961.log.gz 2023-10-08T20:13:30.376 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.292864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.783164.log 2023-10-08T20:13:30.377 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292864.log.gz 2023-10-08T20:13:30.377 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.644976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475250.log 2023-10-08T20:13:30.377 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.644976.log.gz 2023-10-08T20:13:30.377 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.783164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.658413.log 2023-10-08T20:13:30.377 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.783164.log.gz 2023-10-08T20:13:30.377 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.475250.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.475250.log.gz 2023-10-08T20:13:30.377 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325559.log 2023-10-08T20:13:30.377 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.658413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118205.log 2023-10-08T20:13:30.378 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.658413.log.gz 2023-10-08T20:13:30.378 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.325559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.694345.log 2023-10-08T20:13:30.378 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325559.log.gz 2023-10-08T20:13:30.378 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.118205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358522.log 2023-10-08T20:13:30.378 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.694345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396580.log 2023-10-08T20:13:30.378 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.694345.log.gz 2023-10-08T20:13:30.378 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118205.log.gz 2023-10-08T20:13:30.378 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.358522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672559.log 2023-10-08T20:13:30.379 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358522.log.gz 2023-10-08T20:13:30.379 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404735.log /var/log/ceph/ceph-client.admin.396580.log: 2023-10-08T20:13:30.379 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.396580.log.gz 2023-10-08T20:13:30.379 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.672559.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.672559.log.gz--verbose 2023-10-08T20:13:30.379 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.115392.log 2023-10-08T20:13:30.379 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.404735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.710461.log 2023-10-08T20:13:30.379 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.404735.log.gz 2023-10-08T20:13:30.379 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413698.log 2023-10-08T20:13:30.380 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.710461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375332.log 2023-10-08T20:13:30.380 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.710461.log.gz 2023-10-08T20:13:30.380 INFO:teuthology.orchestra.run.smithi045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.115392.log.gz 2023-10-08T20:13:30.380 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.413698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.683357.log 2023-10-08T20:13:30.380 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.413698.log.gz 2023-10-08T20:13:30.380 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-08T20:13:30.380 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.375332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294365.log 2023-10-08T20:13:30.380 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.375332.log.gz 2023-10-08T20:13:30.381 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.683357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117199.log 2023-10-08T20:13:30.381 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.683357.log.gz 2023-10-08T20:13:30.381 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.294365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415224.log 2023-10-08T20:13:30.381 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294365.log.gz 2023-10-08T20:13:30.381 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.789575.log 2023-10-08T20:13:30.381 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.415224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.660658.log 2023-10-08T20:13:30.381 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.415224.log.gz 2023-10-08T20:13:30.381 INFO:teuthology.orchestra.run.smithi045.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.117199.log.gz 2023-10-08T20:13:30.382 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.789575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117153.log 2023-10-08T20:13:30.382 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.789575.log.gz 2023-10-08T20:13:30.382 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.660658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621465.log 2023-10-08T20:13:30.382 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.660658.log.gz 2023-10-08T20:13:30.382 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655991.log 2023-10-08T20:13:30.382 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.621465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302828.log 2023-10-08T20:13:30.382 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621465.log.gz 2023-10-08T20:13:30.382 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.117153.log.gz 2023-10-08T20:13:30.383 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.655991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112558.log 2023-10-08T20:13:30.383 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655991.log.gz 2023-10-08T20:13:30.383 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.807964.log 2023-10-08T20:13:30.383 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302828.log.gz 2023-10-08T20:13:30.383 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629332.log 2023-10-08T20:13:30.383 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.807964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350667.log 2023-10-08T20:13:30.383 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.807964.log.gz 2023-10-08T20:13:30.383 INFO:teuthology.orchestra.run.smithi045.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.112558.log.gz 2023-10-08T20:13:30.384 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.629332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420345.log 2023-10-08T20:13:30.384 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629332.log.gz 2023-10-08T20:13:30.384 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.350667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334176.log 2023-10-08T20:13:30.384 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350667.log.gz 2023-10-08T20:13:30.384 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.420345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112465.log 2023-10-08T20:13:30.384 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.420345.log.gz 2023-10-08T20:13:30.384 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.334176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378931.log 2023-10-08T20:13:30.384 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334176.log.gz 2023-10-08T20:13:30.385 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.631643.log 2023-10-08T20:13:30.385 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.378931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.938058.log 2023-10-08T20:13:30.385 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.378931.log.gz 2023-10-08T20:13:30.385 INFO:teuthology.orchestra.run.smithi045.stderr: 87.1%/var/log/ceph/ceph-client.admin.631643.log: -- replaced with /var/log/ceph/ceph-client.admin.112465.log.gz 2023-10-08T20:13:30.385 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.631643.log.gz 2023-10-08T20:13:30.385 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262905.log 2023-10-08T20:13:30.385 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.938058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.787015.log 2023-10-08T20:13:30.385 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.938058.log.gz 2023-10-08T20:13:30.386 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.262905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440508.log 2023-10-08T20:13:30.386 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262905.log.gz 2023-10-08T20:13:30.386 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.787015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262510.log 2023-10-08T20:13:30.386 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.787015.log.gz 2023-10-08T20:13:30.386 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174189.log 2023-10-08T20:13:30.386 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.440508.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.440508.log.gz 2023-10-08T20:13:30.386 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.262510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298046.log 2023-10-08T20:13:30.386 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262510.log.gz 2023-10-08T20:13:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.174189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306467.log 2023-10-08T20:13:30.387 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174189.log.gz 2023-10-08T20:13:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.298046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175123.log 2023-10-08T20:13:30.387 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.298046.log.gz 2023-10-08T20:13:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.306467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346109.log 2023-10-08T20:13:30.387 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306467.log.gz 2023-10-08T20:13:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.175123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418193.log 2023-10-08T20:13:30.387 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175123.log.gz 2023-10-08T20:13:30.388 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.346109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.645890.log 2023-10-08T20:13:30.388 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346109.log.gz 2023-10-08T20:13:30.388 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.418193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.683056.log 2023-10-08T20:13:30.388 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.418193.log.gz 2023-10-08T20:13:30.388 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.645890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371187.log 2023-10-08T20:13:30.388 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.645890.log.gz 2023-10-08T20:13:30.388 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.683056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377363.log 2023-10-08T20:13:30.388 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.683056.log.gz 2023-10-08T20:13:30.389 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.371187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.624133.log 2023-10-08T20:13:30.389 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.371187.log.gz 2023-10-08T20:13:30.389 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.377363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.640758.log 2023-10-08T20:13:30.389 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.377363.log.gz 2023-10-08T20:13:30.389 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.624133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414172.log 2023-10-08T20:13:30.389 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.624133.log.gz 2023-10-08T20:13:30.389 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.640758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159492.log 0.0% 2023-10-08T20:13:30.389 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.640758.log.gz 2023-10-08T20:13:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.414172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276049.log 2023-10-08T20:13:30.390 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.414172.log.gz 2023-10-08T20:13:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.159492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.656152.log 2023-10-08T20:13:30.390 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159492.log.gz 2023-10-08T20:13:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.276049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475778.log 2023-10-08T20:13:30.390 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276049.log.gz 2023-10-08T20:13:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.656152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111217.log 2023-10-08T20:13:30.391 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.656152.log.gz 2023-10-08T20:13:30.391 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.475778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655945.log 2023-10-08T20:13:30.391 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.475778.log.gz 2023-10-08T20:13:30.391 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.658919.log 2023-10-08T20:13:30.391 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.655945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115576.log 2023-10-08T20:13:30.391 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655945.log.gz 2023-10-08T20:13:30.391 INFO:teuthology.orchestra.run.smithi045.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.111217.log.gz 2023-10-08T20:13:30.391 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.658919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.810222.log 2023-10-08T20:13:30.392 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.658919.log.gz 2023-10-08T20:13:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195347.log 2023-10-08T20:13:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.810222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333669.log 2023-10-08T20:13:30.392 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.810222.log.gz 2023-10-08T20:13:30.392 INFO:teuthology.orchestra.run.smithi045.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.115576.log.gz 2023-10-08T20:13:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.195347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629706.log 2023-10-08T20:13:30.392 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195347.log.gz 2023-10-08T20:13:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.333669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438323.log 2023-10-08T20:13:30.393 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333669.log.gz 2023-10-08T20:13:30.393 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.629706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477443.log 2023-10-08T20:13:30.393 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629706.log.gz 2023-10-08T20:13:30.393 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.438323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.816248.log 2023-10-08T20:13:30.393 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.438323.log.gz 2023-10-08T20:13:30.393 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.477443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473841.log 2023-10-08T20:13:30.393 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.477443.log.gz 2023-10-08T20:13:30.393 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.816248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.657024.log 2023-10-08T20:13:30.393 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.816248.log.gz 2023-10-08T20:13:30.394 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.473841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161394.log 2023-10-08T20:13:30.394 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.473841.log.gz 2023-10-08T20:13:30.394 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.657024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.673527.log 2023-10-08T20:13:30.394 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.657024.log.gz 2023-10-08T20:13:30.394 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.161394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279101.log 2023-10-08T20:13:30.394 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161394.log.gz 2023-10-08T20:13:30.394 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.673527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357742.log 2023-10-08T20:13:30.394 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.673527.log.gz 2023-10-08T20:13:30.395 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.279101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196113.log 2023-10-08T20:13:30.395 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279101.log.gz 2023-10-08T20:13:30.395 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.357742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315402.log 2023-10-08T20:13:30.395 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357742.log.gz 2023-10-08T20:13:30.395 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.196113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258928.log 2023-10-08T20:13:30.395 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196113.log.gz 2023-10-08T20:13:30.395 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.315402.log: gzip -5 --verbose -- /var/log/ceph/xfstests-dev-results/results/check.log 2023-10-08T20:13:30.395 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315402.log.gz 2023-10-08T20:13:30.396 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.258928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.789864.log 2023-10-08T20:13:30.396 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258928.log.gz 2023-10-08T20:13:30.396 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/xfstests-dev-results/results/check.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.783595.log 2023-10-08T20:13:30.396 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.789864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.944642.log 2023-10-08T20:13:30.396 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.789864.log.gz 2023-10-08T20:13:30.396 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.783595.log: gzip -5 89.8%--verbose -- replaced with /var/log/ceph/xfstests-dev-results/results/check.log.gz-- 2023-10-08T20:13:30.396 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.288748.log 2023-10-08T20:13:30.396 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.783595.log.gz 2023-10-08T20:13:30.397 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.944642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276460.log 2023-10-08T20:13:30.397 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.944642.log.gz 2023-10-08T20:13:30.397 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.288748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.945719.log 2023-10-08T20:13:30.397 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288748.log.gz 2023-10-08T20:13:30.397 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.276460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333592.log 2023-10-08T20:13:30.397 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276460.log.gz 2023-10-08T20:13:30.397 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.945719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.682139.log 2023-10-08T20:13:30.397 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.945719.log.gz 2023-10-08T20:13:30.398 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.333592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406876.log 2023-10-08T20:13:30.398 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333592.log.gz 2023-10-08T20:13:30.398 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.682139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343762.log 2023-10-08T20:13:30.398 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.682139.log.gz 2023-10-08T20:13:30.398 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.406876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.817823.log 2023-10-08T20:13:30.398 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406876.log.gz 2023-10-08T20:13:30.398 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.343762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.660440.log 2023-10-08T20:13:30.398 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343762.log.gz 2023-10-08T20:13:30.399 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.817823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.589403.log 2023-10-08T20:13:30.399 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.817823.log.gz 2023-10-08T20:13:30.399 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.660440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341202.log 2023-10-08T20:13:30.399 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.660440.log.gz 2023-10-08T20:13:30.399 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.589403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406350.log 2023-10-08T20:13:30.399 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.589403.log.gz 2023-10-08T20:13:30.399 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.341202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327033.log 2023-10-08T20:13:30.399 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341202.log.gz 2023-10-08T20:13:30.400 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.406350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685859.log 2023-10-08T20:13:30.400 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406350.log.gz 2023-10-08T20:13:30.400 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.327033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192064.log 2023-10-08T20:13:30.400 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327033.log.gz 2023-10-08T20:13:30.400 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.685859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364532.log 2023-10-08T20:13:30.400 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685859.log.gz 2023-10-08T20:13:30.400 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.192064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.670050.log 2023-10-08T20:13:30.400 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192064.log.gz 2023-10-08T20:13:30.401 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.364532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273140.log 2023-10-08T20:13:30.401 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.364532.log.gz 2023-10-08T20:13:30.401 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.670050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450706.log 2023-10-08T20:13:30.401 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.670050.log.gz 2023-10-08T20:13:30.401 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.273140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623474.log 2023-10-08T20:13:30.401 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273140.log.gz 2023-10-08T20:13:30.401 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.450706.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.799422.log 2023-10-08T20:13:30.401 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.450706.log.gz 2023-10-08T20:13:30.402 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.623474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.785152.log 2023-10-08T20:13:30.402 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623474.log.gz 2023-10-08T20:13:30.402 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.799422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117383.log 2023-10-08T20:13:30.402 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.799422.log.gz 2023-10-08T20:13:30.402 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.785152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.785152.log.gzgzip 2023-10-08T20:13:30.402 INFO:teuthology.orchestra.run.smithi045.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.814518.log 2023-10-08T20:13:30.402 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197474.log 2023-10-08T20:13:30.402 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.814518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473066.log 2023-10-08T20:13:30.403 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.814518.log.gz 2023-10-08T20:13:30.403 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.197474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.694623.log 2023-10-08T20:13:30.403 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.117383.log.gz 2023-10-08T20:13:30.403 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197474.log.gz 2023-10-08T20:13:30.403 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.473066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635916.log 2023-10-08T20:13:30.403 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.473066.log.gz 2023-10-08T20:13:30.403 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.694623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359647.log 2023-10-08T20:13:30.403 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.694623.log.gz 2023-10-08T20:13:30.404 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.635916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250067.log 2023-10-08T20:13:30.404 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635916.log.gz 2023-10-08T20:13:30.404 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.359647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348083.log 2023-10-08T20:13:30.404 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.359647.log.gz 2023-10-08T20:13:30.404 INFO:teuthology.orchestra.run.smithi045.stderr:gzip /var/log/ceph/ceph-client.admin.250067.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.402691.log 2023-10-08T20:13:30.404 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250067.log.gz 2023-10-08T20:13:30.404 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.348083.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.348083.log.gz-5 2023-10-08T20:13:30.404 INFO:teuthology.orchestra.run.smithi045.stderr:--verbose -- /var/log/ceph/ceph-client.admin.787288.log 2023-10-08T20:13:30.405 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.402691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332290.log 2023-10-08T20:13:30.405 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.402691.log.gz 2023-10-08T20:13:30.405 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.787288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346186.log 2023-10-08T20:13:30.405 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.787288.log.gz 2023-10-08T20:13:30.405 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.332290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372113.log 2023-10-08T20:13:30.405 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332290.log.gz 2023-10-08T20:13:30.405 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.346186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.641257.log 2023-10-08T20:13:30.405 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346186.log.gz 2023-10-08T20:13:30.406 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.372113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399060.log 2023-10-08T20:13:30.406 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.372113.log.gz 2023-10-08T20:13:30.406 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.641257.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.641257.log.gz-5 2023-10-08T20:13:30.406 INFO:teuthology.orchestra.run.smithi045.stderr:--verbose -- /var/log/ceph/ceph-client.admin.647685.log 2023-10-08T20:13:30.406 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.399060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.785166.log 2023-10-08T20:13:30.406 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.399060.log.gz 2023-10-08T20:13:30.406 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.647685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648349.log 2023-10-08T20:13:30.406 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.647685.log.gz 2023-10-08T20:13:30.407 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.785166.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.785166.log.gz 2023-10-08T20:13:30.407 INFO:teuthology.orchestra.run.smithi045.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.769442.log 2023-10-08T20:13:30.407 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.648349.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-08T20:13:30.407 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648349.log.gz 2023-10-08T20:13:30.407 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.769442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621388.log 2023-10-08T20:13:30.407 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.769442.log.gz 2023-10-08T20:13:30.407 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623489.log 2023-10-08T20:13:30.407 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.621388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112179.log 2023-10-08T20:13:30.408 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621388.log.gz 2023-10-08T20:13:30.408 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.623489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323733.log 2023-10-08T20:13:30.408 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623489.log.gz 2023-10-08T20:13:30.408 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620538.log 2023-10-08T20:13:30.408 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.323733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335663.log 2023-10-08T20:13:30.408 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323733.log.gz 2023-10-08T20:13:30.408 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.620538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309339.log 2023-10-08T20:13:30.408 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620538.log.gz 2023-10-08T20:13:30.409 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.335663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289451.log 2023-10-08T20:13:30.409 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335663.log.gz 2023-10-08T20:13:30.409 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163868.log 2023-10-08T20:13:30.409 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.309339.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309339.log.gz 2023-10-08T20:13:30.409 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.289451.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.477718.log 2023-10-08T20:13:30.409 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.289451.log.gz 2023-10-08T20:13:30.409 INFO:teuthology.orchestra.run.smithi045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.112179.log.gz 2023-10-08T20:13:30.409 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.163868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345740.log 2023-10-08T20:13:30.410 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163868.log.gz 2023-10-08T20:13:30.410 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.477718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368480.log 2023-10-08T20:13:30.410 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.477718.log.gz 2023-10-08T20:13:30.410 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.345740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248637.log 2023-10-08T20:13:30.410 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345740.log.gz 2023-10-08T20:13:30.410 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.368480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.709613.log 2023-10-08T20:13:30.410 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.368480.log.gz 2023-10-08T20:13:30.410 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.248637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.656037.log 2023-10-08T20:13:30.411 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248637.log.gz 2023-10-08T20:13:30.411 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.709613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161485.log 2023-10-08T20:13:30.411 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.709613.log.gz 2023-10-08T20:13:30.411 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.656037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366272.log 2023-10-08T20:13:30.411 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.656037.log.gz 2023-10-08T20:13:30.411 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.161485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111821.log 2023-10-08T20:13:30.411 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161485.log.gz 2023-10-08T20:13:30.411 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.366272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418867.log 2023-10-08T20:13:30.411 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.366272.log.gz 2023-10-08T20:13:30.412 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314865.log 2023-10-08T20:13:30.412 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.418867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278043.log 2023-10-08T20:13:30.412 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.418867.log.gz 2023-10-08T20:13:30.412 INFO:teuthology.orchestra.run.smithi045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.111821.log.gz 2023-10-08T20:13:30.412 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.314865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.811728.log 2023-10-08T20:13:30.412 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.314865.log.gz 2023-10-08T20:13:30.412 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.278043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441198.log 2023-10-08T20:13:30.413 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278043.log.gz 2023-10-08T20:13:30.413 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.811728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365464.log 2023-10-08T20:13:30.413 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.811728.log.gz 2023-10-08T20:13:30.413 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.441198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215657.log 2023-10-08T20:13:30.413 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.441198.log.gz 2023-10-08T20:13:30.413 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.365464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273536.log 2023-10-08T20:13:30.413 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.365464.log.gz 2023-10-08T20:13:30.413 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.215657.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.171548.log -- replaced with /var/log/ceph/ceph-client.admin.215657.log.gz 2023-10-08T20:13:30.414 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-10-08T20:13:30.414 INFO:teuthology.orchestra.run.smithi045.stderr:gzip /var/log/ceph/ceph-client.admin.273536.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.631103.log 2023-10-08T20:13:30.414 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273536.log.gz 2023-10-08T20:13:30.414 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.171548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266781.log 2023-10-08T20:13:30.414 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.171548.log.gz 2023-10-08T20:13:30.414 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.631103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262982.log 2023-10-08T20:13:30.414 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.631103.log.gz 2023-10-08T20:13:30.414 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.266781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.772114.log 2023-10-08T20:13:30.415 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266781.log.gz 2023-10-08T20:13:30.415 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.262982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401415.log 2023-10-08T20:13:30.415 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262982.log.gz 2023-10-08T20:13:30.415 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.772114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.790854.log 2023-10-08T20:13:30.415 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.772114.log.gz 2023-10-08T20:13:30.415 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.401415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342708.log 2023-10-08T20:13:30.415 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.401415.log.gz 2023-10-08T20:13:30.415 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.790854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335649.log 2023-10-08T20:13:30.416 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.790854.log.gz 2023-10-08T20:13:30.416 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.342708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.935597.log 2023-10-08T20:13:30.416 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342708.log.gz 2023-10-08T20:13:30.416 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.335649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379114.log 2023-10-08T20:13:30.416 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335649.log.gz 2023-10-08T20:13:30.416 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.935597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225462.log 2023-10-08T20:13:30.416 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.935597.log.gz 2023-10-08T20:13:30.416 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.379114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165469.log 2023-10-08T20:13:30.417 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.379114.log.gz 2023-10-08T20:13:30.417 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.225462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.825189.log 2023-10-08T20:13:30.417 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225462.log.gz 2023-10-08T20:13:30.417 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.165469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692310.log 2023-10-08T20:13:30.417 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165469.log.gz 2023-10-08T20:13:30.417 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.825189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293863.log 2023-10-08T20:13:30.417 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.825189.log.gz 2023-10-08T20:13:30.417 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.692310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.679820.log 2023-10-08T20:13:30.418 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.692310.log.gz 2023-10-08T20:13:30.418 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.293863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.675634.log 2023-10-08T20:13:30.418 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293863.log.gz 2023-10-08T20:13:30.418 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.679820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320822.log 2023-10-08T20:13:30.418 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.679820.log.gz 2023-10-08T20:13:30.418 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.675634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390380.log 2023-10-08T20:13:30.418 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.675634.log.gz 2023-10-08T20:13:30.418 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.320822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118863.log 2023-10-08T20:13:30.419 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320822.log.gz 2023-10-08T20:13:30.419 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.390380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633554.log 2023-10-08T20:13:30.419 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.390380.log.gz 2023-10-08T20:13:30.419 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.118863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163181.log 2023-10-08T20:13:30.419 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.633554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329071.log 2023-10-08T20:13:30.419 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633554.log.gz 2023-10-08T20:13:30.419 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.163181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344475.log 2023-10-08T20:13:30.419 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163181.log.gz 2023-10-08T20:13:30.419 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.329071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.784562.log 2023-10-08T20:13:30.420 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329071.log.gz 2023-10-08T20:13:30.420 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.344475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386424.log 2023-10-08T20:13:30.420 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344475.log.gz 2023-10-08T20:13:30.420 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.784562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634016.log 2023-10-08T20:13:30.420 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.784562.log.gz 2023-10-08T20:13:30.420 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.386424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405217.log 2023-10-08T20:13:30.420 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.386424.log.gz 2023-10-08T20:13:30.420 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.634016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281122.log 2023-10-08T20:13:30.421 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634016.log.gz 2023-10-08T20:13:30.421 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.405217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274067.log 2023-10-08T20:13:30.421 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.405217.log.gz 2023-10-08T20:13:30.421 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.281122.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.118863.log.gz 2023-10-08T20:13:30.421 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.832584.log 2023-10-08T20:13:30.421 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281122.log.gz 2023-10-08T20:13:30.421 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.274067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390836.log 2023-10-08T20:13:30.421 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274067.log.gz 2023-10-08T20:13:30.422 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.832584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336123.log 2023-10-08T20:13:30.422 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.832584.log.gz 2023-10-08T20:13:30.422 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.390836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.390836.log.gz 2023-10-08T20:13:30.422 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301609.log 2023-10-08T20:13:30.422 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449466.log 2023-10-08T20:13:30.422 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.336123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336123.log.gz 2023-10-08T20:13:30.422 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.301609.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301609.log.gz 2023-10-08T20:13:30.422 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.815732.log 2023-10-08T20:13:30.423 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.449466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195136.log 2023-10-08T20:13:30.423 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.449466.log.gz 2023-10-08T20:13:30.423 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.815732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.815732.log.gz 2023-10-08T20:13:30.423 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327047.log 2023-10-08T20:13:30.423 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.195136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293156.log 2023-10-08T20:13:30.423 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195136.log.gz 2023-10-08T20:13:30.423 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.327047.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.948041.log -- replaced with /var/log/ceph/ceph-client.admin.327047.log.gz 2023-10-08T20:13:30.423 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-10-08T20:13:30.424 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.681772.log 2023-10-08T20:13:30.424 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.293156.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293156.log.gz 2023-10-08T20:13:30.424 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.948041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294657.log 2023-10-08T20:13:30.424 INFO:teuthology.orchestra.run.smithi045.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.948041.log.gz 2023-10-08T20:13:30.424 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.681772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371725.log 2023-10-08T20:13:30.424 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.681772.log.gz 2023-10-08T20:13:30.424 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294657.log: /var/log/ceph/ceph-client.admin.265894.log 2023-10-08T20:13:30.424 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294657.log.gz 2023-10-08T20:13:30.425 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.371725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278771.log 2023-10-08T20:13:30.425 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.371725.log.gz 2023-10-08T20:13:30.425 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.265894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265894.log.gz 2023-10-08T20:13:30.425 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256075.log 2023-10-08T20:13:30.425 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.278771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.698815.log 2023-10-08T20:13:30.425 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278771.log.gz 2023-10-08T20:13:30.425 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.256075.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256075.log.gz 2023-10-08T20:13:30.425 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262200.log 2023-10-08T20:13:30.426 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.698815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.943289.log 2023-10-08T20:13:30.426 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.698815.log.gz 2023-10-08T20:13:30.426 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.262200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262200.log.gz 2023-10-08T20:13:30.426 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.642641.log 2023-10-08T20:13:30.426 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.943289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411705.log 2023-10-08T20:13:30.426 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.943289.log.gz 2023-10-08T20:13:30.426 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.642641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.684118.log 0.0% 2023-10-08T20:13:30.426 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.642641.log.gz 2023-10-08T20:13:30.426 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.411705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113224.log 2023-10-08T20:13:30.427 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411705.log.gz 2023-10-08T20:13:30.427 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.684118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.949045.log 2023-10-08T20:13:30.427 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.684118.log.gz 2023-10-08T20:13:30.427 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.113224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339436.log 2023-10-08T20:13:30.427 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.949045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.828446.log 2023-10-08T20:13:30.427 INFO:teuthology.orchestra.run.smithi045.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.949045.log.gz 2023-10-08T20:13:30.427 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.339436.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339436.log.gz 2023-10-08T20:13:30.427 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251680.log 2023-10-08T20:13:30.428 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.828446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.828446.log.gz 2023-10-08T20:13:30.428 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316860.log 2023-10-08T20:13:30.428 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.251680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.639327.log 2023-10-08T20:13:30.428 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251680.log.gz 2023-10-08T20:13:30.428 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.316860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282354.log 2023-10-08T20:13:30.428 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316860.log.gz 2023-10-08T20:13:30.428 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.639327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636930.log 2023-10-08T20:13:30.428 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.639327.log.gz 2023-10-08T20:13:30.429 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.282354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648426.log 2023-10-08T20:13:30.429 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282354.log.gz 2023-10-08T20:13:30.429 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.636930.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.636930.log.gz 2023-10-08T20:13:30.429 INFO:teuthology.orchestra.run.smithi045.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.946651.log 2023-10-08T20:13:30.429 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.648426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194865.log 2023-10-08T20:13:30.429 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648426.log.gz 2023-10-08T20:13:30.429 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.946651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.631657.log 2023-10-08T20:13:30.429 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.946651.log.gz 2023-10-08T20:13:30.430 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.194865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308883.log 2023-10-08T20:13:30.430 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194865.log.gz 2023-10-08T20:13:30.430 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.631657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395661.log 2023-10-08T20:13:30.430 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.631657.log.gz 2023-10-08T20:13:30.430 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.308883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695097.log 2023-10-08T20:13:30.430 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308883.log.gz 2023-10-08T20:13:30.430 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.395661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338132.log 2023-10-08T20:13:30.430 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.395661.log.gz 2023-10-08T20:13:30.431 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.695097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.679594.log 2023-10-08T20:13:30.431 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695097.log.gz 2023-10-08T20:13:30.431 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.338132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199927.log 2023-10-08T20:13:30.431 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338132.log.gz 2023-10-08T20:13:30.431 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.679594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.656106.log 2023-10-08T20:13:30.431 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.679594.log.gz 2023-10-08T20:13:30.431 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.199927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215182.log 2023-10-08T20:13:30.431 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199927.log.gz 2023-10-08T20:13:30.432 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.656106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.658704.log 2023-10-08T20:13:30.432 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.656106.log.gz 2023-10-08T20:13:30.432 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.215182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.822090.log 2023-10-08T20:13:30.432 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.215182.log.gz 2023-10-08T20:13:30.432 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.658704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210247.log 2023-10-08T20:13:30.432 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.658704.log.gz 2023-10-08T20:13:30.432 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.822090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.816540.log 2023-10-08T20:13:30.432 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.822090.log.gz 2023-10-08T20:13:30.433 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.210247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.815244.log 2023-10-08T20:13:30.433 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210247.log.gz 2023-10-08T20:13:30.433 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.816540.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.816540.log.gz 2023-10-08T20:13:30.433 INFO:teuthology.orchestra.run.smithi045.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.260688.log 2023-10-08T20:13:30.433 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.815244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170765.log 2023-10-08T20:13:30.433 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.815244.log.gz 2023-10-08T20:13:30.433 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.260688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104504.log 2023-10-08T20:13:30.433 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260688.log.gz 2023-10-08T20:13:30.433 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.170765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166212.log 2023-10-08T20:13:30.434 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170765.log.gz 2023-10-08T20:13:30.434 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305932.log 2023-10-08T20:13:30.434 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.166212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277263.log 2023-10-08T20:13:30.434 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166212.log.gz 2023-10-08T20:13:30.434 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.305932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417812.log 2023-10-08T20:13:30.434 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305932.log.gz 2023-10-08T20:13:30.434 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.277263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275247.log 2023-10-08T20:13:30.435 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277263.log.gz 2023-10-08T20:13:30.435 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.417812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118251.log 2023-10-08T20:13:30.435 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.417812.log.gz 2023-10-08T20:13:30.435 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.275247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.690813.log 2023-10-08T20:13:30.435 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275247.log.gz 2023-10-08T20:13:30.435 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.118251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375241.log 2023-10-08T20:13:30.435 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.690813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.810925.log 2023-10-08T20:13:30.435 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.690813.log.gz 2023-10-08T20:13:30.436 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.375241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.119471.log 2023-10-08T20:13:30.436 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.375241.log.gz 2023-10-08T20:13:30.436 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.810925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439446.log 2023-10-08T20:13:30.436 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.810925.log.gz 2023-10-08T20:13:30.436 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.119471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115944.log 2023-10-08T20:13:30.436 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.119471.log.gz 2023-10-08T20:13:30.436 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.439446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.439446.log.gzgzip 2023-10-08T20:13:30.436 INFO:teuthology.orchestra.run.smithi045.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.682597.log 2023-10-08T20:13:30.437 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695477.log 2023-10-08T20:13:30.437 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.682597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692603.log 2023-10-08T20:13:30.437 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.682597.log.gz 2023-10-08T20:13:30.437 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.695477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358321.log 2023-10-08T20:13:30.437 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695477.log.gz 2023-10-08T20:13:30.437 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.692603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.942725.log 2023-10-08T20:13:30.437 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.692603.log.gz 2023-10-08T20:13:30.437 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.358321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112463.log 2023-10-08T20:13:30.438 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358321.log.gz 2023-10-08T20:13:30.438 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.942725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.656729.log 2023-10-08T20:13:30.438 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.942725.log.gz 2023-10-08T20:13:30.438 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105218.log 2023-10-08T20:13:30.438 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.656729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253659.log 2023-10-08T20:13:30.438 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.656729.log.gz 2023-10-08T20:13:30.438 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.105218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165483.log 2023-10-08T20:13:30.438 INFO:teuthology.orchestra.run.smithi045.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.104504.log.gz 2023-10-08T20:13:30.439 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.253659.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113224.log.gz 2023-10-08T20:13:30.439 INFO:teuthology.orchestra.run.smithi045.stderr:gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.253659.log.gz--verbose 2023-10-08T20:13:30.439 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-mds.a.log 2023-10-08T20:13:30.439 INFO:teuthology.orchestra.run.smithi045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.118251.log.gz 2023-10-08T20:13:30.439 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.165483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326837.log 2023-10-08T20:13:30.439 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165483.log.gz 2023-10-08T20:13:30.439 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378917.log 2023-10-08T20:13:30.439 INFO:teuthology.orchestra.run.smithi045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.115944.log.gz 2023-10-08T20:13:30.440 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.326837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.771346.log 2023-10-08T20:13:30.440 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326837.log.gz 2023-10-08T20:13:30.440 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.378917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.816024.log 2023-10-08T20:13:30.440 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.378917.log.gz 2023-10-08T20:13:30.440 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193704.log 2023-10-08T20:13:30.440 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.771346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.771346.log.gz 2023-10-08T20:13:30.440 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.816024.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.816024.log.gz 2023-10-08T20:13:30.440 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412119.log 2023-10-08T20:13:30.441 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117979.log 2023-10-08T20:13:30.441 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.193704.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193704.log.gz 2023-10-08T20:13:30.441 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.412119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245278.log 2023-10-08T20:13:30.441 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412119.log.gz 2023-10-08T20:13:30.441 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.687069.log 2023-10-08T20:13:30.441 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113316.log 2023-10-08T20:13:30.441 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.245278.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245278.log.gz 2023-10-08T20:13:30.441 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.687069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348385.log 2023-10-08T20:13:30.442 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.687069.log.gz 2023-10-08T20:13:30.442 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.113316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198232.log 2023-10-08T20:13:30.442 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299624.log 2023-10-08T20:13:30.442 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.348385.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348385.log.gz 2023-10-08T20:13:30.442 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.198232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411614.log 0.0% 2023-10-08T20:13:30.442 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.198232.log.gz 2023-10-08T20:13:30.442 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.299624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.816526.log 2023-10-08T20:13:30.442 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299624.log.gz 2023-10-08T20:13:30.443 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.411614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166135.log 2023-10-08T20:13:30.443 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411614.log.gz 2023-10-08T20:13:30.443 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.816526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.811504.log 2023-10-08T20:13:30.443 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.816526.log.gz 2023-10-08T20:13:30.443 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.166135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373934.log 2023-10-08T20:13:30.443 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166135.log.gz 2023-10-08T20:13:30.443 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.811504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264910.log 2023-10-08T20:13:30.443 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.811504.log.gz 2023-10-08T20:13:30.444 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.373934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.833079.log 2023-10-08T20:13:30.444 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.373934.log.gz 2023-10-08T20:13:30.444 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.264910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329875.log 2023-10-08T20:13:30.444 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264910.log.gz 2023-10-08T20:13:30.444 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.833079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644494.log 2023-10-08T20:13:30.444 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.833079.log.gz 2023-10-08T20:13:30.444 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.329875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379417.log 2023-10-08T20:13:30.444 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329875.log.gz 2023-10-08T20:13:30.444 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.644494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396974.log 2023-10-08T20:13:30.445 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.644494.log.gz 2023-10-08T20:13:30.445 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.379417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697866.log 2023-10-08T20:13:30.445 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.379417.log.gz 2023-10-08T20:13:30.445 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.396974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372397.log 2023-10-08T20:13:30.445 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.396974.log.gz 2023-10-08T20:13:30.445 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.697866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269750.log 2023-10-08T20:13:30.445 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697866.log.gz 2023-10-08T20:13:30.445 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.372397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175959.log 2023-10-08T20:13:30.446 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.372397.log.gz 2023-10-08T20:13:30.446 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.269750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105085.log 2023-10-08T20:13:30.446 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269750.log.gz 2023-10-08T20:13:30.446 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.175959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321297.log 2023-10-08T20:13:30.446 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175959.log.gz 2023-10-08T20:13:30.446 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105085.log: /var/log/ceph/ceph-client.admin.944719.log 2023-10-08T20:13:30.446 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.321297.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.622497.log 2023-10-08T20:13:30.447 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.321297.log.gz 2023-10-08T20:13:30.447 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.944719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267822.log 2023-10-08T20:13:30.447 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.944719.log.gz 2023-10-08T20:13:30.447 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.622497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111476.log 2023-10-08T20:13:30.447 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.622497.log.gz 2023-10-08T20:13:30.447 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.703244.log 2023-10-08T20:13:30.447 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.267822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267822.log.gz 2023-10-08T20:13:30.447 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332213.log 2023-10-08T20:13:30.448 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.703244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115990.log 2023-10-08T20:13:30.448 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703244.log.gz 2023-10-08T20:13:30.448 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.332213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251603.log 2023-10-08T20:13:30.448 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332213.log.gz 2023-10-08T20:13:30.448 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.809921.log 2023-10-08T20:13:30.448 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.251603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331783.log 2023-10-08T20:13:30.448 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251603.log.gz 2023-10-08T20:13:30.448 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.809921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.683643.log 2023-10-08T20:13:30.449 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.809921.log.gz 2023-10-08T20:13:30.449 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.331783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634876.log 2023-10-08T20:13:30.449 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331783.log.gz 2023-10-08T20:13:30.449 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.683643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207295.log 2023-10-08T20:13:30.449 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.683643.log.gz 2023-10-08T20:13:30.449 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.634876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355447.log 2023-10-08T20:13:30.449 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634876.log.gz 2023-10-08T20:13:30.449 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118963.log 2023-10-08T20:13:30.450 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.207295.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207295.log.gz 2023-10-08T20:13:30.450 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.355447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.782491.log 2023-10-08T20:13:30.450 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355447.log.gz 2023-10-08T20:13:30.450 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.118963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191027.log 2023-10-08T20:13:30.450 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.782491.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.782491.log.gz--verbose 2023-10-08T20:13:30.450 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.177955.log 2023-10-08T20:13:30.450 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 /var/log/ceph/ceph-client.admin.191027.log: --verbose -- /var/log/ceph/ceph-client.admin.399648.log 2023-10-08T20:13:30.450 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191027.log.gz 2023-10-08T20:13:30.451 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.177955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.788840.log 2023-10-08T20:13:30.451 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177955.log.gz 2023-10-08T20:13:30.451 INFO:teuthology.orchestra.run.smithi045.stderr:gzip /var/log/ceph/ceph-client.admin.399648.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.277464.log 2023-10-08T20:13:30.451 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.399648.log.gz 2023-10-08T20:13:30.451 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.788840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.794078.log 2023-10-08T20:13:30.451 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.788840.log.gz 2023-10-08T20:13:30.451 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115346.log 2023-10-08T20:13:30.451 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.277464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277464.log.gz 2023-10-08T20:13:30.452 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.794078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195905.log 2023-10-08T20:13:30.452 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.794078.log.gz 2023-10-08T20:13:30.452 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449220.log 2023-10-08T20:13:30.452 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221469.log 2023-10-08T20:13:30.452 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.195905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195905.log.gz 2023-10-08T20:13:30.452 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.449220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.676196.log 2023-10-08T20:13:30.452 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.449220.log.gz 2023-10-08T20:13:30.452 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.221469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.683657.log 2023-10-08T20:13:30.453 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221469.log.gz 2023-10-08T20:13:30.453 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116686.log 2023-10-08T20:13:30.453 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.676196.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.676196.log.gz 2023-10-08T20:13:30.453 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.683657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.942329.log 2023-10-08T20:13:30.453 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.683657.log.gz 2023-10-08T20:13:30.453 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303987.log 2023-10-08T20:13:30.453 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296072.log 2023-10-08T20:13:30.453 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.942329.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.942329.log.gz 2023-10-08T20:13:30.454 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.303987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111815.log 2023-10-08T20:13:30.454 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303987.log.gz 2023-10-08T20:13:30.454 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.296072.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.296072.log.gz 2023-10-08T20:13:30.454 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118389.log 2023-10-08T20:13:30.454 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363526.log 2023-10-08T20:13:30.454 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111815.log: /var/log/ceph/ceph-client.admin.118389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280128.log 2023-10-08T20:13:30.454 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.657954.log 2023-10-08T20:13:30.454 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.363526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.363526.log.gz 2023-10-08T20:13:30.455 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.280128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.622398.log 2023-10-08T20:13:30.455 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280128.log.gz 2023-10-08T20:13:30.455 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302116.log 2023-10-08T20:13:30.455 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.657954.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.657954.log.gz 2023-10-08T20:13:30.455 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.622398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305469.log 2023-10-08T20:13:30.455 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.622398.log.gz 2023-10-08T20:13:30.455 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648809.log 2023-10-08T20:13:30.455 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302116.log.gz 2023-10-08T20:13:30.456 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.305469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332762.log 2023-10-08T20:13:30.456 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305469.log.gz 2023-10-08T20:13:30.456 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113086.log 2023-10-08T20:13:30.456 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.648809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648809.log.gz 2023-10-08T20:13:30.456 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.112463.log.gz 2023-10-08T20:13:30.456 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.332762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204384.log 2023-10-08T20:13:30.456 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332762.log.gz 2023-10-08T20:13:30.456 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.113086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.806458.log 2023-10-08T20:13:30.457 INFO:teuthology.orchestra.run.smithi045.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.105218.log.gz 2023-10-08T20:13:30.457 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.117979.log.gz 2023-10-08T20:13:30.457 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.204384.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204384.log.gz 2023-10-08T20:13:30.457 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.113316.log.gz 2023-10-08T20:13:30.457 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.806458.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.105085.log.gz 2023-10-08T20:13:30.457 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.806458.log.gz 2023-10-08T20:13:30.457 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.772892.log 2023-10-08T20:13:30.457 INFO:teuthology.orchestra.run.smithi045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.115990.log.gz 2023-10-08T20:13:30.458 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311528.log 2023-10-08T20:13:30.458 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.111476.log.gz 2023-10-08T20:13:30.458 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.772892.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.118963.log.gz 2023-10-08T20:13:30.458 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.772892.log.gz 2023-10-08T20:13:30.458 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.115346.log.gz 2023-10-08T20:13:30.458 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.311528.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311528.log.gz 2023-10-08T20:13:30.458 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116686.log.gz 2023-10-08T20:13:30.458 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272083.log 2023-10-08T20:13:30.459 INFO:teuthology.orchestra.run.smithi045.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.111815.log.gz 2023-10-08T20:13:30.459 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.118389.log.gz-5 2023-10-08T20:13:30.459 INFO:teuthology.orchestra.run.smithi045.stderr:--verbose -- /var/log/ceph/ceph-client.admin.655351.log 2023-10-08T20:13:30.459 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.272083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306481.log 2023-10-08T20:13:30.459 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272083.log.gz 2023-10-08T20:13:30.459 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.655351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.945135.log 2023-10-08T20:13:30.459 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655351.log.gz 2023-10-08T20:13:30.459 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.306481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305044.log 2023-10-08T20:13:30.460 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306481.log.gz 2023-10-08T20:13:30.460 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.945135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478907.log 2023-10-08T20:13:30.460 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.945135.log.gz 2023-10-08T20:13:30.460 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408815.log 2023-10-08T20:13:30.460 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.305044.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305044.log.gz 2023-10-08T20:13:30.460 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.478907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377071.log 2023-10-08T20:13:30.460 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.478907.log.gz 2023-10-08T20:13:30.460 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.408815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411218.log 2023-10-08T20:13:30.461 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408815.log.gz 2023-10-08T20:13:30.461 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303622.log 2023-10-08T20:13:30.461 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.377071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.377071.log.gz 2023-10-08T20:13:30.461 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.411218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380129.log 2023-10-08T20:13:30.461 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411218.log.gz 2023-10-08T20:13:30.461 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.303622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302102.log 2023-10-08T20:13:30.461 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303622.log.gz 2023-10-08T20:13:30.461 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394454.log 2023-10-08T20:13:30.462 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.380129.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.380129.log.gz 2023-10-08T20:13:30.462 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347113.log 2023-10-08T20:13:30.462 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302102.log.gz 2023-10-08T20:13:30.462 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.394454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.807247.log 2023-10-08T20:13:30.462 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394454.log.gz 2023-10-08T20:13:30.462 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248138.log 2023-10-08T20:13:30.462 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.347113.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347113.log.gz 2023-10-08T20:13:30.462 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.807247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.812523.log 2023-10-08T20:13:30.463 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.807247.log.gz 2023-10-08T20:13:30.463 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.248138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655057.log 2023-10-08T20:13:30.463 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248138.log.gz 2023-10-08T20:13:30.463 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.645465.log 2023-10-08T20:13:30.463 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.812523.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.812523.log.gz 2023-10-08T20:13:30.463 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.655057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115253.log 2023-10-08T20:13:30.463 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655057.log.gz 2023-10-08T20:13:30.463 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.645465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160574.log 2023-10-08T20:13:30.464 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.645465.log.gz 2023-10-08T20:13:30.464 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403759.log 2023-10-08T20:13:30.464 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115253.log: /var/log/ceph/ceph-client.admin.160574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380344.log 2023-10-08T20:13:30.464 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160574.log.gz 2023-10-08T20:13:30.464 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.403759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.675037.log 2023-10-08T20:13:30.464 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.403759.log.gz 2023-10-08T20:13:30.464 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295570.log 2023-10-08T20:13:30.464 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.380344.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.380344.log.gz 2023-10-08T20:13:30.465 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.675037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201571.log 2023-10-08T20:13:30.465 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.675037.log.gz 2023-10-08T20:13:30.465 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.295570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.770276.log 2023-10-08T20:13:30.465 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.295570.log.gz 2023-10-08T20:13:30.465 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322731.log 2023-10-08T20:13:30.465 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.201571.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201571.log.gz 2023-10-08T20:13:30.465 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.770276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.788917.log 2023-10-08T20:13:30.466 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.770276.log.gz 2023-10-08T20:13:30.466 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.322731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.674745.log 2023-10-08T20:13:30.466 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322731.log.gz 2023-10-08T20:13:30.466 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330747.log 2023-10-08T20:13:30.466 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.788917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.788917.log.gz 2023-10-08T20:13:30.466 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.674745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193222.log 2023-10-08T20:13:30.466 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.674745.log.gz 2023-10-08T20:13:30.466 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.330747.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.330747.log.gz 2023-10-08T20:13:30.467 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.363952.log 2023-10-08T20:13:30.467 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326531.log 2023-10-08T20:13:30.467 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.193222.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193222.log.gz 2023-10-08T20:13:30.467 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.363952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.658690.log 2023-10-08T20:13:30.467 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.363952.log.gz 2023-10-08T20:13:30.467 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.326531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695568.log 2023-10-08T20:13:30.467 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326531.log.gz 2023-10-08T20:13:30.467 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370817.log 2023-10-08T20:13:30.467 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.658690.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.658690.log.gz 2023-10-08T20:13:30.468 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.695568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288538.log 2023-10-08T20:13:30.468 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695568.log.gz 2023-10-08T20:13:30.468 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.370817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.776618.log 0.0% 2023-10-08T20:13:30.468 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.370817.log.gz 2023-10-08T20:13:30.468 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358563.log 2023-10-08T20:13:30.468 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.288538.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288538.log.gz 2023-10-08T20:13:30.468 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.776618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308367.log 2023-10-08T20:13:30.468 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.776618.log.gz 2023-10-08T20:13:30.469 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.358563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116973.log 2023-10-08T20:13:30.469 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358563.log.gz 2023-10-08T20:13:30.469 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.819256.log 2023-10-08T20:13:30.469 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.308367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308367.log.gz 2023-10-08T20:13:30.469 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390822.log 2023-10-08T20:13:30.469 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.819256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408829.log 2023-10-08T20:13:30.469 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.819256.log.gz 2023-10-08T20:13:30.470 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.390822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302312.log 2023-10-08T20:13:30.470 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.390822.log.gz 2023-10-08T20:13:30.470 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118343.log 2023-10-08T20:13:30.470 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.408829.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408829.log.gz 2023-10-08T20:13:30.470 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346200.log 2023-10-08T20:13:30.470 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302312.log.gz 2023-10-08T20:13:30.470 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.118343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409863.log 2023-10-08T20:13:30.470 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.702241.log 2023-10-08T20:13:30.471 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.346200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346200.log.gz 2023-10-08T20:13:30.471 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.409863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.661058.log 2023-10-08T20:13:30.471 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409863.log.gz 2023-10-08T20:13:30.471 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.702241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118623.log 2023-10-08T20:13:30.471 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702241.log.gz 2023-10-08T20:13:30.471 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.661058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325335.log 2023-10-08T20:13:30.471 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.661058.log.gz 2023-10-08T20:13:30.471 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.118623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291372.log 2023-10-08T20:13:30.472 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.325335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395012.log 2023-10-08T20:13:30.472 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325335.log.gz 2023-10-08T20:13:30.472 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.291372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.710675.log 2023-10-08T20:13:30.472 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291372.log.gz 2023-10-08T20:13:30.472 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386438.log 2023-10-08T20:13:30.472 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.395012.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.395012.log.gz 2023-10-08T20:13:30.472 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.710675.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.710675.log.gz 2023-10-08T20:13:30.472 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201271.log 2023-10-08T20:13:30.473 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.386438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115760.log 2023-10-08T20:13:30.473 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.386438.log.gz 2023-10-08T20:13:30.473 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.201271.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201271.log.gz 2023-10-08T20:13:30.473 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190640.log 2023-10-08T20:13:30.473 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329057.log 2023-10-08T20:13:30.473 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115760.log: /var/log/ceph/ceph-client.admin.190640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.705489.log 2023-10-08T20:13:30.473 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190640.log.gz 2023-10-08T20:13:30.473 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.329057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397625.log 2023-10-08T20:13:30.474 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329057.log.gz 2023-10-08T20:13:30.474 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.674731.log 2023-10-08T20:13:30.474 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.705489.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.705489.log.gz 2023-10-08T20:13:30.474 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.397625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165198.log 2023-10-08T20:13:30.474 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.397625.log.gz 2023-10-08T20:13:30.474 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.674731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359947.log 2023-10-08T20:13:30.474 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.674731.log.gz 2023-10-08T20:13:30.475 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296612.log 2023-10-08T20:13:30.475 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.165198.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165198.log.gz 2023-10-08T20:13:30.475 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.113086.log.gz 2023-10-08T20:13:30.475 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.359947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395893.log 2023-10-08T20:13:30.475 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.115253.log.gz 2023-10-08T20:13:30.475 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.359947.log.gz 2023-10-08T20:13:30.475 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.296612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274535.log 2023-10-08T20:13:30.475 INFO:teuthology.orchestra.run.smithi045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.118343.log.gz 2023-10-08T20:13:30.476 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.296612.log.gz 2023-10-08T20:13:30.476 INFO:teuthology.orchestra.run.smithi045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.118623.log.gz 2023-10-08T20:13:30.476 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.395893.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.395893.log.gz 2023-10-08T20:13:30.476 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358864.log 2023-10-08T20:13:30.476 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.115760.log.gz 2023-10-08T20:13:30.476 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116973.log.gz 2023-10-08T20:13:30.476 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.274535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325760.log 2023-10-08T20:13:30.476 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274535.log.gz 2023-10-08T20:13:30.477 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.358864.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358864.log.gz 2023-10-08T20:13:30.477 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409117.log 2023-10-08T20:13:30.477 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.325760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196312.log 2023-10-08T20:13:30.477 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325760.log.gz 2023-10-08T20:13:30.477 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.409117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.631182.log 2023-10-08T20:13:30.477 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409117.log.gz 2023-10-08T20:13:30.477 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.196312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.682688.log 2023-10-08T20:13:30.477 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196312.log.gz 2023-10-08T20:13:30.477 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191776.log 2023-10-08T20:13:30.478 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.631182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.631182.log.gz 2023-10-08T20:13:30.478 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.682688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326823.log 2023-10-08T20:13:30.478 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.682688.log.gz 2023-10-08T20:13:30.478 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.191776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220535.log 2023-10-08T20:13:30.478 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191776.log.gz 2023-10-08T20:13:30.478 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157587.log 2023-10-08T20:13:30.478 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.326823.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326823.log.gz 2023-10-08T20:13:30.478 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.220535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.942802.log 2023-10-08T20:13:30.479 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220535.log.gz 2023-10-08T20:13:30.479 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.157587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.811016.log 2023-10-08T20:13:30.479 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157587.log.gz 2023-10-08T20:13:30.479 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.945628.log 2023-10-08T20:13:30.479 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.942802.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.942802.log.gz 2023-10-08T20:13:30.479 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.811016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699093.log 2023-10-08T20:13:30.479 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.811016.log.gz 2023-10-08T20:13:30.479 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.945628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475974.log 2023-10-08T20:13:30.480 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.945628.log.gz 2023-10-08T20:13:30.480 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.699093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278545.log 2023-10-08T20:13:30.480 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699093.log.gz 2023-10-08T20:13:30.480 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.475974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162493.log 2023-10-08T20:13:30.480 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.475974.log.gz 2023-10-08T20:13:30.480 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.278545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295661.log 2023-10-08T20:13:30.480 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278545.log.gz 2023-10-08T20:13:30.480 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.709198.log 2023-10-08T20:13:30.481 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.162493.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162493.log.gz 2023-10-08T20:13:30.481 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.295661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381381.log 2023-10-08T20:13:30.481 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.295661.log.gz 2023-10-08T20:13:30.481 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.709198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342220.log 2023-10-08T20:13:30.481 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.709198.log.gz 2023-10-08T20:13:30.481 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312105.log 2023-10-08T20:13:30.481 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.381381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381381.log.gz 2023-10-08T20:13:30.481 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.342220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393314.log 2023-10-08T20:13:30.482 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342220.log.gz 2023-10-08T20:13:30.482 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.312105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.640208.log 2023-10-08T20:13:30.482 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312105.log.gz 2023-10-08T20:13:30.482 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.945212.log /var/log/ceph/ceph-client.admin.393314.log: 2023-10-08T20:13:30.482 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393314.log.gz 2023-10-08T20:13:30.482 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.640208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.813738.log 2023-10-08T20:13:30.482 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.640208.log.gz 2023-10-08T20:13:30.482 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.945212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222110.log 2023-10-08T20:13:30.483 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.945212.log.gz 2023-10-08T20:13:30.483 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.702774.log 2023-10-08T20:13:30.483 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.813738.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.813738.log.gz 2023-10-08T20:13:30.483 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.222110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366062.log 2023-10-08T20:13:30.483 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222110.log.gz 2023-10-08T20:13:30.483 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.702774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290506.log 2023-10-08T20:13:30.483 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702774.log.gz 2023-10-08T20:13:30.483 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.832791.log 2023-10-08T20:13:30.484 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.366062.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.366062.log.gz 2023-10-08T20:13:30.484 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.290506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478219.log 2023-10-08T20:13:30.484 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290506.log.gz 2023-10-08T20:13:30.484 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.832791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286518.log 2023-10-08T20:13:30.484 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.832791.log.gz 2023-10-08T20:13:30.484 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300685.log 2023-10-08T20:13:30.484 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.478219.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.478219.log.gz 2023-10-08T20:13:30.484 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.286518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247121.log 2023-10-08T20:13:30.485 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286518.log.gz 2023-10-08T20:13:30.485 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.300685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285758.log 2023-10-08T20:13:30.485 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300685.log.gz 2023-10-08T20:13:30.485 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365971.log 2023-10-08T20:13:30.485 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.247121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247121.log.gz 2023-10-08T20:13:30.485 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.285758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477159.log 2023-10-08T20:13:30.485 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285758.log.gz 2023-10-08T20:13:30.485 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.365971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370175.log 2023-10-08T20:13:30.486 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.365971.log.gz 2023-10-08T20:13:30.486 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.949366.log 2023-10-08T20:13:30.486 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.477159.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.477159.log.gz 2023-10-08T20:13:30.486 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.370175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367262.log 2023-10-08T20:13:30.486 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.370175.log.gz 2023-10-08T20:13:30.486 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.949366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294867.log 2023-10-08T20:13:30.486 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.949366.log.gz 2023-10-08T20:13:30.486 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.367262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.937508.log 2023-10-08T20:13:30.487 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.367262.log.gz 2023-10-08T20:13:30.487 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.294867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156961.log 2023-10-08T20:13:30.487 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294867.log.gz 2023-10-08T20:13:30.487 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.937508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.829154.log 2023-10-08T20:13:30.487 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.937508.log.gz 2023-10-08T20:13:30.487 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-08T20:13:30.487 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.156961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156961.log.gz 2023-10-08T20:13:30.487 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.829154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390289.log 2023-10-08T20:13:30.488 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.829154.log.gz 2023-10-08T20:13:30.488 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170293.log 2023-10-08T20:13:30.488 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359633.log 2023-10-08T20:13:30.488 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.390289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.390289.log.gz 2023-10-08T20:13:30.488 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.170293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289236.log 2023-10-08T20:13:30.488 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170293.log.gz 2023-10-08T20:13:30.488 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.359633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160023.log 2023-10-08T20:13:30.488 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.359633.log.gz 2023-10-08T20:13:30.489 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342947.log 2023-10-08T20:13:30.489 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.289236.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289236.log.gz 2023-10-08T20:13:30.489 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.160023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.772618.log 2023-10-08T20:13:30.489 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160023.log.gz 2023-10-08T20:13:30.489 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.342947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331500.log 2023-10-08T20:13:30.489 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342947.log.gz 2023-10-08T20:13:30.489 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.772618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283120.log 2023-10-08T20:13:30.489 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.772618.log.gz 2023-10-08T20:13:30.490 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.331500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359870.log 2023-10-08T20:13:30.490 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331500.log.gz 2023-10-08T20:13:30.490 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.283120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.641437.log 2023-10-08T20:13:30.490 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283120.log.gz 2023-10-08T20:13:30.490 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273126.log 2023-10-08T20:13:30.490 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.359870.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.359870.log.gz 2023-10-08T20:13:30.490 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.641437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.789850.log 2023-10-08T20:13:30.490 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.641437.log.gz 2023-10-08T20:13:30.491 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.273126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247044.log 2023-10-08T20:13:30.491 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273126.log.gz 2023-10-08T20:13:30.491 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203919.log 2023-10-08T20:13:30.491 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.789850.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.789850.log.gz 2023-10-08T20:13:30.491 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.247044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154067.log 2023-10-08T20:13:30.491 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247044.log.gz 2023-10-08T20:13:30.491 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.203919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.114755.log 2023-10-08T20:13:30.491 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.203919.log.gz 2023-10-08T20:13:30.491 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635839.log 2023-10-08T20:13:30.492 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.154067.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154067.log.gz 2023-10-08T20:13:30.492 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.2.114755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308869.log 2023-10-08T20:13:30.492 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.114755.log.gz 2023-10-08T20:13:30.492 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.635839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.645689.log 2023-10-08T20:13:30.492 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635839.log.gz 2023-10-08T20:13:30.492 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315828.log 2023-10-08T20:13:30.492 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.308869.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308869.log.gz 2023-10-08T20:13:30.492 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.645689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321283.log 2023-10-08T20:13:30.493 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.645689.log.gz 2023-10-08T20:13:30.493 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.315828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.678888.log 2023-10-08T20:13:30.493 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315828.log.gz 2023-10-08T20:13:30.493 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.773296.log 2023-10-08T20:13:30.493 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.321283.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321283.log.gz 2023-10-08T20:13:30.493 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.678888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.772407.log 2023-10-08T20:13:30.493 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.678888.log.gz 2023-10-08T20:13:30.493 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.773296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399366.log 2023-10-08T20:13:30.494 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.773296.log.gz 2023-10-08T20:13:30.494 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.787795.log 2023-10-08T20:13:30.494 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.772407.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.772407.log.gz 2023-10-08T20:13:30.494 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.399366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477641.log 2023-10-08T20:13:30.494 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.399366.log.gz 2023-10-08T20:13:30.494 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.787795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395481.log 2023-10-08T20:13:30.494 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.787795.log.gz 2023-10-08T20:13:30.494 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.948861.log 2023-10-08T20:13:30.495 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.477641.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.477641.log.gz 2023-10-08T20:13:30.495 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.395481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.947462.log 2023-10-08T20:13:30.495 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.395481.log.gz 2023-10-08T20:13:30.495 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.948861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294064.log 2023-10-08T20:13:30.495 INFO:teuthology.orchestra.run.smithi045.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.948861.log.gz 2023-10-08T20:13:30.495 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.947462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398500.log 2023-10-08T20:13:30.495 INFO:teuthology.orchestra.run.smithi045.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.947462.log.gz 2023-10-08T20:13:30.495 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.294064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212584.log 2023-10-08T20:13:30.496 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294064.log.gz 2023-10-08T20:13:30.496 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.398500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356276.log 2023-10-08T20:13:30.496 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.398500.log.gz 2023-10-08T20:13:30.496 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342631.log 2023-10-08T20:13:30.496 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.212584.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212584.log.gz 2023-10-08T20:13:30.496 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.356276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246616.log 2023-10-08T20:13:30.496 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356276.log.gz 2023-10-08T20:13:30.496 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.342631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.814030.log 2023-10-08T20:13:30.497 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342631.log.gz 2023-10-08T20:13:30.497 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.688826.log 2023-10-08T20:13:30.497 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.246616.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246616.log.gz 2023-10-08T20:13:30.497 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.814030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378614.log 2023-10-08T20:13:30.497 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.814030.log.gz 2023-10-08T20:13:30.497 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.688826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347596.log 2023-10-08T20:13:30.497 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.688826.log.gz 2023-10-08T20:13:30.497 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.782400.log 2023-10-08T20:13:30.497 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.378614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.378614.log.gz 2023-10-08T20:13:30.498 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.347596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212118.log 2023-10-08T20:13:30.498 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347596.log.gz 2023-10-08T20:13:30.498 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.782400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.698442.log 2023-10-08T20:13:30.498 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.782400.log.gz 2023-10-08T20:13:30.498 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311149.log 2023-10-08T20:13:30.498 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.212118.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212118.log.gz 2023-10-08T20:13:30.498 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.698442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263960.log 2023-10-08T20:13:30.499 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.698442.log.gz 2023-10-08T20:13:30.499 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.311149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347190.log 2023-10-08T20:13:30.499 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311149.log.gz 2023-10-08T20:13:30.499 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322745.log 2023-10-08T20:13:30.499 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.263960.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263960.log.gz 2023-10-08T20:13:30.499 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.347190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.791324.log 2023-10-08T20:13:30.499 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347190.log.gz 2023-10-08T20:13:30.499 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.322745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.681220.log 2023-10-08T20:13:30.499 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322745.log.gz 2023-10-08T20:13:30.500 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693471.log 2023-10-08T20:13:30.500 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.791324.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.791324.log.gz 2023-10-08T20:13:30.500 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.681220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276245.log 2023-10-08T20:13:30.500 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.681220.log.gz 2023-10-08T20:13:30.500 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.693471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478621.log 2023-10-08T20:13:30.500 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.693471.log.gz 2023-10-08T20:13:30.500 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.276245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113270.log 2023-10-08T20:13:30.500 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276245.log.gz 2023-10-08T20:13:30.501 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.478621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274745.log 2023-10-08T20:13:30.501 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.478621.log.gz 2023-10-08T20:13:30.501 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.113270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360862.log 2023-10-08T20:13:30.501 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272566.log 2023-10-08T20:13:30.501 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.274745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274745.log.gz 2023-10-08T20:13:30.501 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.360862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.937034.log 2023-10-08T20:13:30.501 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.360862.log.gz 2023-10-08T20:13:30.501 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.272566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330291.log 2023-10-08T20:13:30.502 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272566.log.gz 2023-10-08T20:13:30.502 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.937034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655968.log 2023-10-08T20:13:30.502 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.937034.log.gz 2023-10-08T20:13:30.502 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.330291.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330291.log.gz 2023-10-08T20:13:30.502 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381367.log 2023-10-08T20:13:30.502 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672253.log 2023-10-08T20:13:30.502 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.655968.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655968.log.gz 2023-10-08T20:13:30.502 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.381367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280844.log 2023-10-08T20:13:30.503 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381367.log.gz 2023-10-08T20:13:30.503 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.672253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283134.log 2023-10-08T20:13:30.503 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.672253.log.gz 2023-10-08T20:13:30.503 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.661505.log 2023-10-08T20:13:30.503 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.280844.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280844.log.gz 2023-10-08T20:13:30.503 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.283134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296149.log 2023-10-08T20:13:30.503 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283134.log.gz 2023-10-08T20:13:30.503 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337644.log 2023-10-08T20:13:30.504 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.661505.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.661505.log.gz 2023-10-08T20:13:30.504 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.296149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.656129.log 2023-10-08T20:13:30.504 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.296149.log.gz 2023-10-08T20:13:30.506 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.337644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330368.log 2023-10-08T20:13:30.506 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337644.log.gz 2023-10-08T20:13:30.506 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.656129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320745.log 2023-10-08T20:13:30.506 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.656129.log.gz 2023-10-08T20:13:30.506 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.330368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315919.log 2023-10-08T20:13:30.507 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330368.log.gz 2023-10-08T20:13:30.507 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.320745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362475.log 2023-10-08T20:13:30.507 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320745.log.gz 2023-10-08T20:13:30.507 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289026.log 2023-10-08T20:13:30.507 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.315919.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315919.log.gz 2023-10-08T20:13:30.507 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.362475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.641243.log 2023-10-08T20:13:30.507 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.362475.log.gz 2023-10-08T20:13:30.507 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.289026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176974.log 2023-10-08T20:13:30.508 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289026.log.gz 2023-10-08T20:13:30.508 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.641243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263478.log 2023-10-08T20:13:30.508 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.641243.log.gz 2023-10-08T20:13:30.508 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.176974.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176974.log.gz 2023-10-08T20:13:30.508 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115299.log 2023-10-08T20:13:30.508 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281851.log 2023-10-08T20:13:30.508 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.263478.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263478.log.gz 2023-10-08T20:13:30.508 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.657489.log 2023-10-08T20:13:30.509 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.281851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.662447.log 2023-10-08T20:13:30.509 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281851.log.gz 2023-10-08T20:13:30.509 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.657489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399849.log 2023-10-08T20:13:30.509 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.657489.log.gz 2023-10-08T20:13:30.509 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.662447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418471.log 2023-10-08T20:13:30.509 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.662447.log.gz 2023-10-08T20:13:30.509 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.399849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.674370.log 2023-10-08T20:13:30.509 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.399849.log.gz 2023-10-08T20:13:30.510 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.418471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113362.log 2023-10-08T20:13:30.510 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.418471.log.gz 2023-10-08T20:13:30.510 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.674370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315612.log 2023-10-08T20:13:30.510 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.674370.log.gz 2023-10-08T20:13:30.510 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326335.log 2023-10-08T20:13:30.510 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.113362.log: /var/log/ceph/ceph-client.admin.315612.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315612.log.gz 2023-10-08T20:13:30.510 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.938072.log 2023-10-08T20:13:30.510 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.769889.log 2023-10-08T20:13:30.511 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.326335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326335.log.gz 2023-10-08T20:13:30.511 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.938072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685160.log 2023-10-08T20:13:30.511 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.938072.log.gz 2023-10-08T20:13:30.511 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.769889.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.340910.log 2023-10-08T20:13:30.511 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.769889.log.gz 2023-10-08T20:13:30.511 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.685160.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685160.log.gzgzip 2023-10-08T20:13:30.511 INFO:teuthology.orchestra.run.smithi045.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.348174.log 2023-10-08T20:13:30.511 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326031.log 2023-10-08T20:13:30.511 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.340910.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340910.log.gz 2023-10-08T20:13:30.512 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.348174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437693.log 2023-10-08T20:13:30.512 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348174.log.gz 2023-10-08T20:13:30.512 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.326031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385459.log 2023-10-08T20:13:30.512 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326031.log.gz 2023-10-08T20:13:30.512 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388929.log 2023-10-08T20:13:30.512 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.437693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.437693.log.gz 2023-10-08T20:13:30.512 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.385459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630258.log 2023-10-08T20:13:30.512 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385459.log.gz 2023-10-08T20:13:30.513 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.388929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386146.log 2023-10-08T20:13:30.513 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.388929.log.gz 2023-10-08T20:13:30.513 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.671053.log 2023-10-08T20:13:30.513 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.630258.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630258.log.gz 2023-10-08T20:13:30.513 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.386146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.788160.log 2023-10-08T20:13:30.513 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.386146.log.gz 2023-10-08T20:13:30.513 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.671053.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.643020.log -- replaced with /var/log/ceph/ceph-client.admin.671053.log.gz 2023-10-08T20:13:30.513 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-10-08T20:13:30.514 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.820721.log 2023-10-08T20:13:30.514 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.788160.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.788160.log.gz 2023-10-08T20:13:30.514 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.643020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289746.log 2023-10-08T20:13:30.514 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.643020.log.gz 2023-10-08T20:13:30.514 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.820721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375797.log 2023-10-08T20:13:30.514 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.820721.log.gz 2023-10-08T20:13:30.514 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.817074.log 2023-10-08T20:13:30.514 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.289746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289746.log.gz 2023-10-08T20:13:30.515 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.375797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403433.log 2023-10-08T20:13:30.515 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.375797.log.gz 2023-10-08T20:13:30.515 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.817074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365263.log 2023-10-08T20:13:30.515 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.817074.log.gz 2023-10-08T20:13:30.515 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.805741.log 2023-10-08T20:13:30.515 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.403433.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.403433.log.gz 2023-10-08T20:13:30.515 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.365263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178142.log 2023-10-08T20:13:30.515 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.365263.log.gz 2023-10-08T20:13:30.515 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.805741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.826671.log 2023-10-08T20:13:30.516 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.805741.log.gz 2023-10-08T20:13:30.516 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.833562.log 2023-10-08T20:13:30.516 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.178142.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178142.log.gz 2023-10-08T20:13:30.516 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.826671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387948.log 2023-10-08T20:13:30.516 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.826671.log.gz 2023-10-08T20:13:30.516 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.833562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.769428.log 2023-10-08T20:13:30.516 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.833562.log.gz 2023-10-08T20:13:30.516 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217020.log 2023-10-08T20:13:30.517 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.387948.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.387948.log.gz 2023-10-08T20:13:30.517 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.769428.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.769428.log.gz 2023-10-08T20:13:30.517 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476937.log 2023-10-08T20:13:30.517 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.217020.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.686992.log 2023-10-08T20:13:30.517 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.217020.log.gz 2023-10-08T20:13:30.517 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.476937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114977.log 2023-10-08T20:13:30.517 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.476937.log.gz 2023-10-08T20:13:30.518 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279297.log 2023-10-08T20:13:30.518 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.686992.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.686992.log.gz 2023-10-08T20:13:30.518 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.114977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259606.log 2023-10-08T20:13:30.518 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.279297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.657877.log 2023-10-08T20:13:30.518 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279297.log.gz 2023-10-08T20:13:30.518 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.259606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291148.log 2023-10-08T20:13:30.518 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259606.log.gz 2023-10-08T20:13:30.518 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 /var/log/ceph/ceph-client.admin.657877.log: --verbose -- /var/log/ceph/ceph-client.admin.791338.log 2023-10-08T20:13:30.519 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.657877.log.gz 2023-10-08T20:13:30.519 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.291148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.642564.log 2023-10-08T20:13:30.519 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291148.log.gz 2023-10-08T20:13:30.519 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.791338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.791338.log.gzgzip 2023-10-08T20:13:30.519 INFO:teuthology.orchestra.run.smithi045.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.299231.log 2023-10-08T20:13:30.519 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248714.log 2023-10-08T20:13:30.519 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.642564.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.642564.log.gz 2023-10-08T20:13:30.519 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.299231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389451.log 2023-10-08T20:13:30.520 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299231.log.gz 2023-10-08T20:13:30.520 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.248714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.645479.log 2023-10-08T20:13:30.520 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248714.log.gz 2023-10-08T20:13:30.520 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.826941.log 2023-10-08T20:13:30.520 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.389451.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.389451.log.gz 2023-10-08T20:13:30.520 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.645479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398213.log 2023-10-08T20:13:30.520 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.645479.log.gz 2023-10-08T20:13:30.520 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.826941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211151.log 2023-10-08T20:13:30.521 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.826941.log.gz 2023-10-08T20:13:30.521 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111817.log 2023-10-08T20:13:30.521 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.398213.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.398213.log.gz 2023-10-08T20:13:30.521 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.211151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.688903.log 2023-10-08T20:13:30.521 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211151.log.gz 2023-10-08T20:13:30.521 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.694331.log 2023-10-08T20:13:30.521 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.701759.log 2023-10-08T20:13:30.521 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.688903.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.688903.log.gz 2023-10-08T20:13:30.522 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.694331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329578.log 2023-10-08T20:13:30.522 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.694331.log.gz 2023-10-08T20:13:30.522 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.701759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695554.log 2023-10-08T20:13:30.522 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.701759.log.gz 2023-10-08T20:13:30.522 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385936.log 2023-10-08T20:13:30.522 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.329578.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329578.log.gz 2023-10-08T20:13:30.522 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.695554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198986.log 2023-10-08T20:13:30.522 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695554.log.gz 2023-10-08T20:13:30.523 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.385936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385936.log.gz 2023-10-08T20:13:30.523 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476729.log 2023-10-08T20:13:30.523 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.198986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400592.log 2023-10-08T20:13:30.523 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198986.log.gz 2023-10-08T20:13:30.523 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.476729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364043.log 2023-10-08T20:13:30.523 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.476729.log.gz 2023-10-08T20:13:30.523 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.400592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348888.log 2023-10-08T20:13:30.523 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.400592.log.gz 2023-10-08T20:13:30.523 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284007.log 2023-10-08T20:13:30.524 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.364043.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.364043.log.gz 2023-10-08T20:13:30.524 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.348888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.771269.log 2023-10-08T20:13:30.524 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348888.log.gz 2023-10-08T20:13:30.524 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.284007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284007.log.gz 2023-10-08T20:13:30.524 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.808702.log 2023-10-08T20:13:30.524 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.771269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203933.log 2023-10-08T20:13:30.524 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.771269.log.gz 2023-10-08T20:13:30.524 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.808702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.681297.log 2023-10-08T20:13:30.525 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.808702.log.gz 2023-10-08T20:13:30.525 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.203933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260306.log 2023-10-08T20:13:30.525 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.203933.log.gz 2023-10-08T20:13:30.525 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363248.log 2023-10-08T20:13:30.525 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.681297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.681297.log.gz 2023-10-08T20:13:30.525 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.260306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336032.log 2023-10-08T20:13:30.525 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260306.log.gz 2023-10-08T20:13:30.525 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.363248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306858.log 2023-10-08T20:13:30.526 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.363248.log.gz 2023-10-08T20:13:30.526 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.662656.log 2023-10-08T20:13:30.526 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.336032.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336032.log.gz 2023-10-08T20:13:30.526 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.306858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.659477.log 2023-10-08T20:13:30.526 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306858.log.gz 2023-10-08T20:13:30.526 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.662656.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.662656.log.gz 2023-10-08T20:13:30.526 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637113.log 2023-10-08T20:13:30.526 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.659477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333226.log 2023-10-08T20:13:30.527 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.659477.log.gz 2023-10-08T20:13:30.527 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.637113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449234.log 2023-10-08T20:13:30.527 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637113.log.gz 2023-10-08T20:13:30.527 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.333226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274081.log 2023-10-08T20:13:30.527 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333226.log.gz 2023-10-08T20:13:30.527 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400377.log 2023-10-08T20:13:30.527 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.449234.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.449234.log.gz 2023-10-08T20:13:30.527 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.274081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280114.log 2023-10-08T20:13:30.527 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274081.log.gz 2023-10-08T20:13:30.528 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.400377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160100.log 2023-10-08T20:13:30.528 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.400377.log.gz 2023-10-08T20:13:30.528 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.815947.log 2023-10-08T20:13:30.528 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.280114.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280114.log.gz 2023-10-08T20:13:30.528 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.160100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392210.log 2023-10-08T20:13:30.528 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160100.log.gz 2023-10-08T20:13:30.528 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.815947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316115.log 2023-10-08T20:13:30.528 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.815947.log.gz 2023-10-08T20:13:30.529 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348905.log 2023-10-08T20:13:30.529 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.392210.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.392210.log.gz 2023-10-08T20:13:30.529 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.316115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317348.log 2023-10-08T20:13:30.529 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316115.log.gz 2023-10-08T20:13:30.529 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.348905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287731.log 0.0% 2023-10-08T20:13:30.529 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.348905.log.gz 2023-10-08T20:13:30.529 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368029.log 2023-10-08T20:13:30.529 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.317348.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317348.log.gz 2023-10-08T20:13:30.530 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.287731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292376.log 2023-10-08T20:13:30.530 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287731.log.gz 2023-10-08T20:13:30.530 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.368029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385382.log 2023-10-08T20:13:30.530 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.368029.log.gz 2023-10-08T20:13:30.530 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253849.log 2023-10-08T20:13:30.530 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.292376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292376.log.gz 2023-10-08T20:13:30.530 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.385382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288734.log 2023-10-08T20:13:30.530 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385382.log.gz 2023-10-08T20:13:30.531 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.253849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.949137.log 2023-10-08T20:13:30.531 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253849.log.gz 2023-10-08T20:13:30.531 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672468.log 2023-10-08T20:13:30.531 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.288734.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288734.log.gz 2023-10-08T20:13:30.531 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.949137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116036.log 2023-10-08T20:13:30.531 INFO:teuthology.orchestra.run.smithi045.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.949137.log.gz 2023-10-08T20:13:30.531 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.672468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337046.log 2023-10-08T20:13:30.531 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.672468.log.gz 2023-10-08T20:13:30.532 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626681.log 2023-10-08T20:13:30.532 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.337046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.947654.log 2023-10-08T20:13:30.532 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337046.log.gz 2023-10-08T20:13:30.532 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.626681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692818.log 2023-10-08T20:13:30.532 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626681.log.gz 2023-10-08T20:13:30.532 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348874.log 2023-10-08T20:13:30.532 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.947654.log: /var/log/ceph/ceph-client.admin.692818.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.947654.log.gz 2023-10-08T20:13:30.532 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411141.log 2023-10-08T20:13:30.533 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.692818.log.gz 2023-10-08T20:13:30.533 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.348874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.784273.log 2023-10-08T20:13:30.533 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348874.log.gz 2023-10-08T20:13:30.533 INFO:teuthology.orchestra.run.smithi045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.111817.log.gz 2023-10-08T20:13:30.533 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.411141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262419.log 2023-10-08T20:13:30.533 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411141.log.gz 2023-10-08T20:13:30.533 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306949.log 2023-10-08T20:13:30.533 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.784273.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.784273.log.gz 2023-10-08T20:13:30.533 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.262419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289760.log 2023-10-08T20:13:30.534 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262419.log.gz 2023-10-08T20:13:30.534 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.306949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299140.log 2023-10-08T20:13:30.534 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306949.log.gz 2023-10-08T20:13:30.534 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.289760.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.321492.log -- replaced with /var/log/ceph/ceph-client.admin.289760.log.gz 2023-10-08T20:13:30.534 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-10-08T20:13:30.534 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.113270.log.gz 2023-10-08T20:13:30.534 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.299140.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113362.log.gz 2023-10-08T20:13:30.534 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299140.log.gz 2023-10-08T20:13:30.535 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.321492.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.114977.log.gz 2023-10-08T20:13:30.535 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321492.log.gz 2023-10-08T20:13:30.535 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173338.log 2023-10-08T20:13:30.535 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.115299.log.gz 2023-10-08T20:13:30.535 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317836.log 2023-10-08T20:13:30.535 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.173338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632639.log 2023-10-08T20:13:30.535 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173338.log.gz 2023-10-08T20:13:30.535 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.116036.log.gz 2023-10-08T20:13:30.536 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.317836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375318.log 2023-10-08T20:13:30.536 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317836.log.gz 2023-10-08T20:13:30.536 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.632639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.676416.log 2023-10-08T20:13:30.536 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632639.log.gz 2023-10-08T20:13:30.536 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.375318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349236.log 2023-10-08T20:13:30.536 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.375318.log.gz 2023-10-08T20:13:30.536 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.676416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111125.log 2023-10-08T20:13:30.536 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.676416.log.gz 2023-10-08T20:13:30.537 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.349236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206309.log 2023-10-08T20:13:30.537 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349236.log.gz 2023-10-08T20:13:30.537 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.944733.log 2023-10-08T20:13:30.537 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.206309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327851.log 2023-10-08T20:13:30.537 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206309.log.gz 2023-10-08T20:13:30.537 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.944733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325349.log 2023-10-08T20:13:30.537 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.944733.log.gz 2023-10-08T20:13:30.537 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.327851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.940424.log 2023-10-08T20:13:30.537 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327851.log.gz 2023-10-08T20:13:30.538 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.325349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.775430.log 2023-10-08T20:13:30.538 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325349.log.gz 2023-10-08T20:13:30.538 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.940424.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.940424.log.gz 2023-10-08T20:13:30.538 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475764.log 2023-10-08T20:13:30.538 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340422.log 2023-10-08T20:13:30.538 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.775430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.775430.log.gz 2023-10-08T20:13:30.538 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.475764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.475764.log.gz 2023-10-08T20:13:30.538 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118435.log 2023-10-08T20:13:30.539 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.340422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491835.log 2023-10-08T20:13:30.539 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340422.log.gz 2023-10-08T20:13:30.539 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.118435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.703806.log 2023-10-08T20:13:30.539 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.491835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326545.log 2023-10-08T20:13:30.539 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.491835.log.gz 2023-10-08T20:13:30.539 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.703806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270155.log 2023-10-08T20:13:30.539 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703806.log.gz 2023-10-08T20:13:30.540 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.709690.log 2023-10-08T20:13:30.540 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.326545.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326545.log.gz 2023-10-08T20:13:30.540 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.270155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112902.log 2023-10-08T20:13:30.540 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270155.log.gz 2023-10-08T20:13:30.540 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.709690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.694546.log 2023-10-08T20:13:30.540 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.709690.log.gz 2023-10-08T20:13:30.540 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.660967.log 2023-10-08T20:13:30.540 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112902.log: /var/log/ceph/ceph-client.admin.694546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322243.log 2023-10-08T20:13:30.541 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.694546.log.gz 2023-10-08T20:13:30.541 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.660967.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.660967.log.gz--verbose 2023-10-08T20:13:30.541 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.703153.log 2023-10-08T20:13:30.541 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.676119.log 2023-10-08T20:13:30.541 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.322243.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322243.log.gz 2023-10-08T20:13:30.541 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.703153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379627.log 2023-10-08T20:13:30.541 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703153.log.gz 2023-10-08T20:13:30.541 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.676119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.784259.log 2023-10-08T20:13:30.542 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.676119.log.gz 2023-10-08T20:13:30.542 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.809204.log 2023-10-08T20:13:30.542 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.379627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.379627.log.gz 2023-10-08T20:13:30.542 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.784259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.684536.log 2023-10-08T20:13:30.542 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.784259.log.gz 2023-10-08T20:13:30.542 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.809204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322654.log 2023-10-08T20:13:30.542 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.809204.log.gz 2023-10-08T20:13:30.542 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.684536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272160.log 2023-10-08T20:13:30.543 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.684536.log.gz 2023-10-08T20:13:30.543 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.322654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440494.log 2023-10-08T20:13:30.543 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322654.log.gz 2023-10-08T20:13:30.543 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.272160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282129.log 2023-10-08T20:13:30.543 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272160.log.gz 2023-10-08T20:13:30.543 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374776.log 2023-10-08T20:13:30.543 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.440494.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.440494.log.gz 2023-10-08T20:13:30.543 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.282129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161993.log 2023-10-08T20:13:30.543 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282129.log.gz 2023-10-08T20:13:30.544 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.374776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266299.log 2023-10-08T20:13:30.544 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.374776.log.gz 2023-10-08T20:13:30.544 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.816768.log 2023-10-08T20:13:30.544 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.161993.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161993.log.gz 2023-10-08T20:13:30.544 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.266299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310707.log 2023-10-08T20:13:30.544 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266299.log.gz 2023-10-08T20:13:30.544 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.816768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.645173.log 2023-10-08T20:13:30.544 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.816768.log.gz 2023-10-08T20:13:30.545 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307605.log 2023-10-08T20:13:30.545 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.310707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310707.log.gz 2023-10-08T20:13:30.545 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.645173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117337.log 2023-10-08T20:13:30.545 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.645173.log.gz 2023-10-08T20:13:30.545 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.307605.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.307605.log.gz-5 2023-10-08T20:13:30.545 INFO:teuthology.orchestra.run.smithi045.stderr:--verbose -- /var/log/ceph/ceph-client.admin.814016.log 2023-10-08T20:13:30.545 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.706285.log 2023-10-08T20:13:30.545 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117337.log: /var/log/ceph/ceph-client.admin.814016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634409.log 2023-10-08T20:13:30.546 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.814016.log.gz 2023-10-08T20:13:30.546 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.706285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400916.log 2023-10-08T20:13:30.546 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.706285.log.gz 2023-10-08T20:13:30.546 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275037.log 2023-10-08T20:13:30.546 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.634409.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634409.log.gz 2023-10-08T20:13:30.546 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.400916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635930.log 2023-10-08T20:13:30.546 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.400916.log.gz 2023-10-08T20:13:30.546 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.275037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276962.log 2023-10-08T20:13:30.547 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275037.log.gz 2023-10-08T20:13:30.547 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.635930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356754.log 2023-10-08T20:13:30.547 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635930.log.gz 2023-10-08T20:13:30.547 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.276962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408162.log 2023-10-08T20:13:30.547 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276962.log.gz 2023-10-08T20:13:30.547 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.356754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418944.log 2023-10-08T20:13:30.547 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356754.log.gz 2023-10-08T20:13:30.547 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.828428.log 2023-10-08T20:13:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.408162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408162.log.gz 2023-10-08T20:13:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.418944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.818793.log 2023-10-08T20:13:30.548 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.418944.log.gz 2023-10-08T20:13:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.828428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.710949.log 2023-10-08T20:13:30.548 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.828428.log.gz 2023-10-08T20:13:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.818793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.661428.log 2023-10-08T20:13:30.548 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.818793.log.gz 2023-10-08T20:13:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.710949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241962.log 2023-10-08T20:13:30.549 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.710949.log.gz 2023-10-08T20:13:30.549 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.661428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115714.log 2023-10-08T20:13:30.549 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.661428.log.gz 2023-10-08T20:13:30.549 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403447.log 2023-10-08T20:13:30.549 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.241962.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241962.log.gz 2023-10-08T20:13:30.549 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.770367.log 2023-10-08T20:13:30.549 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.403447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389465.log 2023-10-08T20:13:30.549 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.403447.log.gz 2023-10-08T20:13:30.550 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.770367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417287.log 2023-10-08T20:13:30.550 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.770367.log.gz 2023-10-08T20:13:30.550 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.389465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.817593.log 2023-10-08T20:13:30.550 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.389465.log.gz 2023-10-08T20:13:30.550 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.417287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193014.log 2023-10-08T20:13:30.550 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.417287.log.gz 2023-10-08T20:13:30.550 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.817593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169716.log 2023-10-08T20:13:30.551 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.817593.log.gz 2023-10-08T20:13:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619023.log 2023-10-08T20:13:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.193014.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193014.log.gz 2023-10-08T20:13:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.169716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241884.log 2023-10-08T20:13:30.551 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169716.log.gz 2023-10-08T20:13:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.619023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341718.log 2023-10-08T20:13:30.551 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.619023.log.gz 2023-10-08T20:13:30.552 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326244.log 2023-10-08T20:13:30.552 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.241884.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241884.log.gz 2023-10-08T20:13:30.552 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.341718.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341718.log.gz 2023-10-08T20:13:30.552 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409026.log 2023-10-08T20:13:30.552 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192455.log 2023-10-08T20:13:30.552 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.326244.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326244.log.gz 2023-10-08T20:13:30.552 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.409026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192546.log 2023-10-08T20:13:30.552 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409026.log.gz 2023-10-08T20:13:30.553 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.192455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.806549.log 2023-10-08T20:13:30.553 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192455.log.gz 2023-10-08T20:13:30.553 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192546.log: /var/log/ceph/ceph-client.admin.827156.log 2023-10-08T20:13:30.553 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192546.log.gz 2023-10-08T20:13:30.553 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.806549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298123.log 2023-10-08T20:13:30.553 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.806549.log.gz 2023-10-08T20:13:30.553 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.827156.log: gzip -5 0.0%--verbose -- /var/log/ceph/ceph-client.admin.382198.log -- replaced with /var/log/ceph/ceph-client.admin.827156.log.gz 2023-10-08T20:13:30.553 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-10-08T20:13:30.553 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384923.log 2023-10-08T20:13:30.554 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.298123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.298123.log.gz 2023-10-08T20:13:30.554 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.382198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.813724.log 2023-10-08T20:13:30.554 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382198.log.gz 2023-10-08T20:13:30.554 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.384923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.823858.log 2023-10-08T20:13:30.554 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384923.log.gz 2023-10-08T20:13:30.554 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.813724.log: /var/log/ceph/ceph-client.admin.336630.log 2023-10-08T20:13:30.554 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.813724.log.gz 2023-10-08T20:13:30.554 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.823858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244362.log 2023-10-08T20:13:30.555 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.823858.log.gz 2023-10-08T20:13:30.555 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.336630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291650.log 2023-10-08T20:13:30.555 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336630.log.gz 2023-10-08T20:13:30.555 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.774212.log 2023-10-08T20:13:30.555 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.244362.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244362.log.gz 2023-10-08T20:13:30.555 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.291650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393529.log 2023-10-08T20:13:30.555 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291650.log.gz 2023-10-08T20:13:30.555 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.774212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216034.log 2023-10-08T20:13:30.556 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.774212.log.gz 2023-10-08T20:13:30.556 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399074.log 2023-10-08T20:13:30.556 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.393529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393529.log.gz 2023-10-08T20:13:30.556 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.216034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.947930.log 2023-10-08T20:13:30.556 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216034.log.gz 2023-10-08T20:13:30.556 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.399074.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.399074.log.gz 2023-10-08T20:13:30.556 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202957.log 2023-10-08T20:13:30.556 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-08T20:13:30.556 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.947930.log: /var/log/ceph/ceph-client.admin.202957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406670.log 2023-10-08T20:13:30.557 INFO:teuthology.orchestra.run.smithi045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.947930.log.gz 2023-10-08T20:13:30.557 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202957.log.gz 2023-10-08T20:13:30.557 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629318.log 2023-10-08T20:13:30.557 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308290.log 2023-10-08T20:13:30.557 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.406670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406670.log.gz 2023-10-08T20:13:30.557 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.629318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.797963.log 2023-10-08T20:13:30.557 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629318.log.gz 2023-10-08T20:13:30.557 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.308290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.704266.log 2023-10-08T20:13:30.558 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308290.log.gz 2023-10-08T20:13:30.558 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.670551.log 2023-10-08T20:13:30.558 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.797963.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.797963.log.gz 2023-10-08T20:13:30.558 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.704266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328262.log 2023-10-08T20:13:30.558 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.704266.log.gz 2023-10-08T20:13:30.558 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.670551.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.670551.log.gz 2023-10-08T20:13:30.558 INFO:teuthology.orchestra.run.smithi045.stderr:--verbose -- /var/log/ceph/ceph-client.admin.383184.log 2023-10-08T20:13:30.558 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173825.log 2023-10-08T20:13:30.559 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.328262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328262.log.gz 2023-10-08T20:13:30.559 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.383184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.770353.log 2023-10-08T20:13:30.559 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.383184.log.gz 2023-10-08T20:13:30.559 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.173825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116927.log 2023-10-08T20:13:30.559 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173825.log.gz 2023-10-08T20:13:30.559 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 /var/log/ceph/ceph-client.admin.770353.log: --verbose -- /var/log/ceph/ceph-client.admin.941867.log 2023-10-08T20:13:30.559 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.770353.log.gz 2023-10-08T20:13:30.559 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104001.log 2023-10-08T20:13:30.560 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.941867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170688.log 2023-10-08T20:13:30.560 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.941867.log.gz 2023-10-08T20:13:30.560 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.675918.log 2023-10-08T20:13:30.560 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104001.log: /var/log/ceph/ceph-client.admin.170688.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170688.log.gz 2023-10-08T20:13:30.560 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.937585.log 2023-10-08T20:13:30.560 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.675918.log: -- /var/log/ceph/ceph-client.admin.774303.log 2023-10-08T20:13:30.560 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.675918.log.gz 2023-10-08T20:13:30.560 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.937585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340408.log 2023-10-08T20:13:30.560 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.937585.log.gz 2023-10-08T20:13:30.561 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118435.log.gz 2023-10-08T20:13:30.561 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.774303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.643563.log 2023-10-08T20:13:30.561 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.774303.log.gz 2023-10-08T20:13:30.561 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283525.log 2023-10-08T20:13:30.561 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.340408.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.112902.log.gz 2023-10-08T20:13:30.561 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340408.log.gz 2023-10-08T20:13:30.561 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.117337.log.gz 2023-10-08T20:13:30.561 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.643563.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116927.log.gz 2023-10-08T20:13:30.561 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.643563.log.gz 2023-10-08T20:13:30.562 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.821609.log 2023-10-08T20:13:30.562 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.283525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283525.log.gz 2023-10-08T20:13:30.562 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.643111.log 2023-10-08T20:13:30.562 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.821609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.773845.log 2023-10-08T20:13:30.562 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.821609.log.gz 2023-10-08T20:13:30.562 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.643111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329277.log 2023-10-08T20:13:30.562 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.643111.log.gz 2023-10-08T20:13:30.563 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 /var/log/ceph/ceph-client.admin.773845.log: --verbose -- /var/log/ceph/ceph-client.admin.204860.log 2023-10-08T20:13:30.563 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.773845.log.gz 2023-10-08T20:13:30.563 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.329277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450227.log 2023-10-08T20:13:30.563 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329277.log.gz 2023-10-08T20:13:30.563 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.204860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330382.log 2023-10-08T20:13:30.563 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204860.log.gz 2023-10-08T20:13:30.563 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.811427.log 2023-10-08T20:13:30.563 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.450227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.450227.log.gz 2023-10-08T20:13:30.564 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.330382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.604260.log 2023-10-08T20:13:30.564 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330382.log.gz 2023-10-08T20:13:30.564 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.811427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.946201.log 2023-10-08T20:13:30.564 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.811427.log.gz 2023-10-08T20:13:30.564 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331276.log 2023-10-08T20:13:30.564 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.604260.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.604260.log.gz 2023-10-08T20:13:30.564 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.946201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289040.log 2023-10-08T20:13:30.564 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.946201.log.gz 2023-10-08T20:13:30.565 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.331276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331276.log.gz 2023-10-08T20:13:30.565 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304078.log 2023-10-08T20:13:30.565 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.687448.log /var/log/ceph/ceph-client.admin.289040.log: 2023-10-08T20:13:30.565 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289040.log.gz 2023-10-08T20:13:30.565 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.304078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.641648.log 2023-10-08T20:13:30.565 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304078.log.gz 2023-10-08T20:13:30.565 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.687448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359085.log 2023-10-08T20:13:30.565 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.687448.log.gz 2023-10-08T20:13:30.565 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.641648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401615.log 2023-10-08T20:13:30.566 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.641648.log.gz 2023-10-08T20:13:30.566 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.359085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190563.log 2023-10-08T20:13:30.566 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.359085.log.gz 2023-10-08T20:13:30.566 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.401615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175588.log 2023-10-08T20:13:30.566 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.401615.log.gz 2023-10-08T20:13:30.566 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.702318.log 2023-10-08T20:13:30.566 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.190563.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190563.log.gz 2023-10-08T20:13:30.567 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.175588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276747.log 2023-10-08T20:13:30.567 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175588.log.gz 2023-10-08T20:13:30.567 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.702318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355895.log 2023-10-08T20:13:30.567 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702318.log.gz 2023-10-08T20:13:30.567 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450720.log 2023-10-08T20:13:30.567 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.276747.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276747.log.gz 2023-10-08T20:13:30.567 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.355895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170202.log 2023-10-08T20:13:30.567 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355895.log.gz 2023-10-08T20:13:30.568 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.450720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414559.log 2023-10-08T20:13:30.568 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.450720.log.gz 2023-10-08T20:13:30.568 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 /var/log/ceph/ceph-client.admin.170202.log: --verbose -- /var/log/ceph/ceph-client.admin.320339.log 2023-10-08T20:13:30.568 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170202.log.gz 2023-10-08T20:13:30.568 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.414559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.772906.log 2023-10-08T20:13:30.568 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.414559.log.gz 2023-10-08T20:13:30.568 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.320339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175497.log 2023-10-08T20:13:30.568 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320339.log.gz 2023-10-08T20:13:30.568 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.772906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.809998.log 2023-10-08T20:13:30.569 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.772906.log.gz 2023-10-08T20:13:30.569 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.175497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.114751.log 2023-10-08T20:13:30.569 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175497.log.gz 2023-10-08T20:13:30.569 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.809998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.817283.log 2023-10-08T20:13:30.569 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.809998.log.gz 2023-10-08T20:13:30.569 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.2.114751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338146.log 2023-10-08T20:13:30.569 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.114751.log.gz 2023-10-08T20:13:30.569 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.817283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260702.log 2023-10-08T20:13:30.570 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.817283.log.gz 2023-10-08T20:13:30.570 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338146.log: /var/log/ceph/ceph-client.admin.284971.log 2023-10-08T20:13:30.570 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338146.log.gz 2023-10-08T20:13:30.570 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.260702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412196.log 2023-10-08T20:13:30.570 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260702.log.gz 2023-10-08T20:13:30.570 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.284971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197747.log 2023-10-08T20:13:30.570 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284971.log.gz 2023-10-08T20:13:30.570 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.412196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292654.log 2023-10-08T20:13:30.571 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412196.log.gz 2023-10-08T20:13:30.571 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.197747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195919.log 2023-10-08T20:13:30.571 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197747.log.gz 2023-10-08T20:13:30.571 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.292654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692909.log 2023-10-08T20:13:30.571 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292654.log.gz 2023-10-08T20:13:30.571 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257569.log 2023-10-08T20:13:30.571 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.195919.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195919.log.gz 2023-10-08T20:13:30.572 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.692909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275452.log 2023-10-08T20:13:30.572 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.692909.log.gz 2023-10-08T20:13:30.572 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.257569.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.784076.log -- replaced with /var/log/ceph/ceph-client.admin.257569.log.gz 2023-10-08T20:13:30.572 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-10-08T20:13:30.572 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.275452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635613.log 2023-10-08T20:13:30.572 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275452.log.gz 2023-10-08T20:13:30.572 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.784076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.707430.log 2023-10-08T20:13:30.572 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.784076.log.gz 2023-10-08T20:13:30.573 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.635613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253038.log 2023-10-08T20:13:30.573 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635613.log.gz 2023-10-08T20:13:30.573 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.707430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328047.log 2023-10-08T20:13:30.573 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.707430.log.gz 2023-10-08T20:13:30.573 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.253038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279603.log 2023-10-08T20:13:30.573 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253038.log.gz 2023-10-08T20:13:30.573 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.328047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300671.log 2023-10-08T20:13:30.573 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328047.log.gz 2023-10-08T20:13:30.574 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.279603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.818024.log 2023-10-08T20:13:30.574 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279603.log.gz 2023-10-08T20:13:30.574 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.300671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.770806.log 2023-10-08T20:13:30.574 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300671.log.gz 2023-10-08T20:13:30.574 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.818024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174798.log 2023-10-08T20:13:30.574 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.818024.log.gz 2023-10-08T20:13:30.574 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.770806.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.770806.log.gz 2023-10-08T20:13:30.574 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251694.log 2023-10-08T20:13:30.575 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.174798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648440.log 2023-10-08T20:13:30.575 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174798.log.gz 2023-10-08T20:13:30.575 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.251694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271692.log 2023-10-08T20:13:30.575 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251694.log.gz 2023-10-08T20:13:30.575 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.648440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376561.log 2023-10-08T20:13:30.575 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648440.log.gz 2023-10-08T20:13:30.575 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.271692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.790840.log 2023-10-08T20:13:30.575 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271692.log.gz 2023-10-08T20:13:30.576 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.376561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672043.log 2023-10-08T20:13:30.576 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.376561.log.gz 2023-10-08T20:13:30.576 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 /var/log/ceph/ceph-client.admin.790840.log: --verbose -- /var/log/ceph/ceph-client.admin.366258.log 2023-10-08T20:13:30.576 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.790840.log.gz 2023-10-08T20:13:30.576 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.672043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333135.log 2023-10-08T20:13:30.576 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.672043.log.gz 2023-10-08T20:13:30.576 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.366258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292878.log 2023-10-08T20:13:30.576 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.366258.log.gz 2023-10-08T20:13:30.577 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336616.log 2023-10-08T20:13:30.577 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.333135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333135.log.gz 2023-10-08T20:13:30.577 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.292878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.947608.log 2023-10-08T20:13:30.577 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292878.log.gz 2023-10-08T20:13:30.577 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.336616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620055.log 2023-10-08T20:13:30.577 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336616.log.gz 2023-10-08T20:13:30.577 INFO:teuthology.orchestra.run.smithi045.stderr:gzip /var/log/ceph/ceph-client.admin.947608.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.257079.log 2023-10-08T20:13:30.577 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.620055.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.947608.log.gz 2023-10-08T20:13:30.577 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620055.log.gz 2023-10-08T20:13:30.578 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.257079.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257079.log.gz 2023-10-08T20:13:30.578 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350257.log 2023-10-08T20:13:30.578 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276551.log 2023-10-08T20:13:30.578 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.350257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112994.log 2023-10-08T20:13:30.578 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350257.log.gz 2023-10-08T20:13:30.578 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.276551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177468.log 2023-10-08T20:13:30.578 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276551.log.gz 2023-10-08T20:13:30.579 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628864.log 2023-10-08T20:13:30.579 INFO:teuthology.orchestra.run.smithi045.stderr:gzip /var/log/ceph/ceph-client.admin.177468.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.284084.log 2023-10-08T20:13:30.579 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177468.log.gz 2023-10-08T20:13:30.579 INFO:teuthology.orchestra.run.smithi045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.112994.log.gz 2023-10-08T20:13:30.579 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.628864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325258.log 2023-10-08T20:13:30.579 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628864.log.gz 2023-10-08T20:13:30.579 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.284084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391201.log 2023-10-08T20:13:30.579 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284084.log.gz 2023-10-08T20:13:30.579 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.325258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407159.log 2023-10-08T20:13:30.580 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325258.log.gz 2023-10-08T20:13:30.580 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.391201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304967.log 2023-10-08T20:13:30.580 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.391201.log.gz 2023-10-08T20:13:30.580 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.407159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.813939.log 2023-10-08T20:13:30.580 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407159.log.gz 2023-10-08T20:13:30.580 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.304967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261978.log 2023-10-08T20:13:30.580 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304967.log.gz 2023-10-08T20:13:30.580 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.813939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634500.log 2023-10-08T20:13:30.581 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.813939.log.gz 2023-10-08T20:13:30.581 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.261978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.939004.log 2023-10-08T20:13:30.581 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261978.log.gz 2023-10-08T20:13:30.581 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.634500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159054.log 2023-10-08T20:13:30.581 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634500.log.gz 2023-10-08T20:13:30.581 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292166.log 2023-10-08T20:13:30.581 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.939004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.939004.log.gz 2023-10-08T20:13:30.582 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.159054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347204.log 2023-10-08T20:13:30.582 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159054.log.gz 2023-10-08T20:13:30.582 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.292166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.701850.log 0.0% 2023-10-08T20:13:30.582 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.292166.log.gz 2023-10-08T20:13:30.582 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337630.log 2023-10-08T20:13:30.582 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.347204.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347204.log.gz 2023-10-08T20:13:30.582 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.701850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113178.log 2023-10-08T20:13:30.582 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.701850.log.gz 2023-10-08T20:13:30.583 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.337630.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.337630.log.gz-- 2023-10-08T20:13:30.583 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.349482.log 2023-10-08T20:13:30.583 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.657412.log 2023-10-08T20:13:30.583 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.113178.log: /var/log/ceph/ceph-client.admin.349482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333683.log 2023-10-08T20:13:30.583 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349482.log.gz 2023-10-08T20:13:30.583 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.657412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379641.log 2023-10-08T20:13:30.583 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.657412.log.gz 2023-10-08T20:13:30.583 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382289.log 2023-10-08T20:13:30.584 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.333683.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333683.log.gz 2023-10-08T20:13:30.584 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.379641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404658.log 2023-10-08T20:13:30.584 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.379641.log.gz 2023-10-08T20:13:30.584 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.382289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245667.log 2023-10-08T20:13:30.584 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382289.log.gz 2023-10-08T20:13:30.584 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.674946.log 2023-10-08T20:13:30.584 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.404658.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.404658.log.gz 2023-10-08T20:13:30.584 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.245667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411232.log 2023-10-08T20:13:30.585 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245667.log.gz 2023-10-08T20:13:30.585 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.674946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.631197.log 2023-10-08T20:13:30.585 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.674946.log.gz 2023-10-08T20:13:30.585 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380831.log 2023-10-08T20:13:30.585 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.411232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411232.log.gz 2023-10-08T20:13:30.585 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.631197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.670761.log 2023-10-08T20:13:30.585 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.631197.log.gz 2023-10-08T20:13:30.585 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.380831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476280.log 2023-10-08T20:13:30.586 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.380831.log.gz 2023-10-08T20:13:30.586 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172973.log 2023-10-08T20:13:30.586 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.670761.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.670761.log.gz 2023-10-08T20:13:30.586 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.476280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388624.log 2023-10-08T20:13:30.586 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.476280.log.gz 2023-10-08T20:13:30.586 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.172973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404161.log 2023-10-08T20:13:30.586 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172973.log.gz 2023-10-08T20:13:30.587 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205340.log 2023-10-08T20:13:30.587 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.388624.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.388624.log.gz 2023-10-08T20:13:30.587 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.404161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.816038.log 2023-10-08T20:13:30.587 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.404161.log.gz 2023-10-08T20:13:30.587 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.205340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.831071.log 2023-10-08T20:13:30.587 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205340.log.gz 2023-10-08T20:13:30.587 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333879.log 2023-10-08T20:13:30.587 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.816038.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.816038.log.gz 2023-10-08T20:13:30.587 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.831071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.948907.log 2023-10-08T20:13:30.588 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.831071.log.gz 2023-10-08T20:13:30.588 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.333879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.821172.log 2023-10-08T20:13:30.588 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333879.log.gz 2023-10-08T20:13:30.588 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270637.log 2023-10-08T20:13:30.588 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.948907.log: /var/log/ceph/ceph-client.admin.821172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314879.log 2023-10-08T20:13:30.588 INFO:teuthology.orchestra.run.smithi045.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.948907.log.gz 2023-10-08T20:13:30.588 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.821172.log.gz 2023-10-08T20:13:30.588 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.270637.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270637.log.gz 2023-10-08T20:13:30.589 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302618.log 2023-10-08T20:13:30.589 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375874.log 2023-10-08T20:13:30.589 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.314879.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.314879.log.gz 2023-10-08T20:13:30.589 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621974.log 2023-10-08T20:13:30.589 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302618.log.gz 2023-10-08T20:13:30.589 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.375874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300594.log 2023-10-08T20:13:30.589 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.375874.log.gz 2023-10-08T20:13:30.589 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297114.log 2023-10-08T20:13:30.590 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.621974.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621974.log.gz 2023-10-08T20:13:30.590 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.300594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316330.log 2023-10-08T20:13:30.590 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300594.log.gz 2023-10-08T20:13:30.590 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.297114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197110.log 2023-10-08T20:13:30.590 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.297114.log.gz 2023-10-08T20:13:30.590 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119217.log 2023-10-08T20:13:30.590 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.316330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316330.log.gz 2023-10-08T20:13:30.590 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.197110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175109.log 2023-10-08T20:13:30.591 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197110.log.gz 2023-10-08T20:13:30.591 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.119217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110288.log 2023-10-08T20:13:30.591 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393027.log 2023-10-08T20:13:30.591 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.175109.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175109.log.gz 2023-10-08T20:13:30.591 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269764.log 2023-10-08T20:13:30.591 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.393027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396489.log 2023-10-08T20:13:30.591 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393027.log.gz 2023-10-08T20:13:30.591 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.269764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296626.log 2023-10-08T20:13:30.591 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269764.log.gz 2023-10-08T20:13:30.592 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.396489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.790332.log 2023-10-08T20:13:30.592 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.396489.log.gz 2023-10-08T20:13:30.592 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.296626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.678408.log 2023-10-08T20:13:30.592 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.296626.log.gz 2023-10-08T20:13:30.592 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.790332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256998.log 2023-10-08T20:13:30.592 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.790332.log.gz 2023-10-08T20:13:30.592 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.678408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672970.log 2023-10-08T20:13:30.592 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.678408.log.gz 2023-10-08T20:13:30.593 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.256998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.939874.log 2023-10-08T20:13:30.593 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256998.log.gz 2023-10-08T20:13:30.593 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.672970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345726.log 2023-10-08T20:13:30.593 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.672970.log.gz 2023-10-08T20:13:30.593 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.939874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104440.log 2023-10-08T20:13:30.593 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.939874.log.gz 2023-10-08T20:13:30.593 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.345726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655135.log 2023-10-08T20:13:30.593 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345726.log.gz 2023-10-08T20:13:30.594 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.676210.log 2023-10-08T20:13:30.594 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.655135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220082.log 2023-10-08T20:13:30.594 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655135.log.gz 2023-10-08T20:13:30.594 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.676210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397051.log 2023-10-08T20:13:30.594 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.676210.log.gz 2023-10-08T20:13:30.594 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.220082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.948133.log 2023-10-08T20:13:30.594 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220082.log.gz 2023-10-08T20:13:30.594 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.397051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.771360.log 2023-10-08T20:13:30.595 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.397051.log.gz 2023-10-08T20:13:30.595 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.948133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.831650.log 2023-10-08T20:13:30.595 INFO:teuthology.orchestra.run.smithi045.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.948133.log.gz 2023-10-08T20:13:30.595 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.771360.log: -- /var/log/ceph/ceph-client.admin.816234.log 2023-10-08T20:13:30.595 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.771360.log.gz 2023-10-08T20:13:30.595 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.831650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.706194.log 2023-10-08T20:13:30.595 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.831650.log.gz 2023-10-08T20:13:30.595 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.816234.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.816234.log.gz 2023-10-08T20:13:30.596 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284580.log 2023-10-08T20:13:30.596 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.706194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.696228.log 2023-10-08T20:13:30.596 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.706194.log.gz 2023-10-08T20:13:30.596 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.284580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332748.log 2023-10-08T20:13:30.596 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284580.log.gz 2023-10-08T20:13:30.596 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.696228.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.696228.log.gz 2023-10-08T20:13:30.596 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620069.log 2023-10-08T20:13:30.596 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.332748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400578.log 2023-10-08T20:13:30.597 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332748.log.gz 2023-10-08T20:13:30.597 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.620069.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.620069.log.gz--verbose 2023-10-08T20:13:30.597 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.705806.log 2023-10-08T20:13:30.597 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.400578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112160.log 2023-10-08T20:13:30.597 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.400578.log.gz 2023-10-08T20:13:30.597 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.705806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219990.log 2023-10-08T20:13:30.597 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.705806.log.gz 2023-10-08T20:13:30.597 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412675.log 2023-10-08T20:13:30.597 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.219990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169807.log 2023-10-08T20:13:30.598 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219990.log.gz 2023-10-08T20:13:30.598 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.412675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.824250.log 2023-10-08T20:13:30.598 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412675.log.gz 2023-10-08T20:13:30.598 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.169807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346611.log 2023-10-08T20:13:30.598 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169807.log.gz 2023-10-08T20:13:30.598 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.824250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700608.log 2023-10-08T20:13:30.598 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.824250.log.gz 2023-10-08T20:13:30.598 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.346611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693970.log 2023-10-08T20:13:30.599 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346611.log.gz 2023-10-08T20:13:30.599 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.700608.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700608.log.gz 2023-10-08T20:13:30.599 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362566.log 2023-10-08T20:13:30.599 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300187.log 2023-10-08T20:13:30.599 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.693970.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.693970.log.gz 2023-10-08T20:13:30.599 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451156.log 2023-10-08T20:13:30.599 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.362566.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.362566.log.gz 2023-10-08T20:13:30.599 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.300187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406684.log 2023-10-08T20:13:30.600 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300187.log.gz 2023-10-08T20:13:30.600 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.451156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210697.log 2023-10-08T20:13:30.600 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.451156.log.gz 2023-10-08T20:13:30.600 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.406684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410064.log 2023-10-08T20:13:30.600 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406684.log.gz 2023-10-08T20:13:30.600 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.210697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349451.log 2023-10-08T20:13:30.600 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210697.log.gz 2023-10-08T20:13:30.600 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.410064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.706671.log 2023-10-08T20:13:30.601 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410064.log.gz 2023-10-08T20:13:30.601 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.349451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358307.log 2023-10-08T20:13:30.601 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349451.log.gz 2023-10-08T20:13:30.601 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.706671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337137.log 2023-10-08T20:13:30.601 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.706671.log.gz 2023-10-08T20:13:30.601 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.358307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303106.log 2023-10-08T20:13:30.601 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358307.log.gz 2023-10-08T20:13:30.601 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.337137.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337137.log.gz 2023-10-08T20:13:30.602 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415677.log 2023-10-08T20:13:30.602 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.303106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177941.log 2023-10-08T20:13:30.602 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303106.log.gz 2023-10-08T20:13:30.602 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.415677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.812231.log 2023-10-08T20:13:30.602 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.415677.log.gz 2023-10-08T20:13:30.602 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.177941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194942.log 2023-10-08T20:13:30.602 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177941.log.gz 2023-10-08T20:13:30.602 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.812231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.674447.log 2023-10-08T20:13:30.603 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.812231.log.gz 2023-10-08T20:13:30.603 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.194942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287020.log 2023-10-08T20:13:30.603 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194942.log.gz 2023-10-08T20:13:30.603 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.674447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.674447.log.gz 2023-10-08T20:13:30.603 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189727.log 2023-10-08T20:13:30.603 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.287020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365541.log 2023-10-08T20:13:30.603 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287020.log.gz 2023-10-08T20:13:30.603 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.189727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414918.log 2023-10-08T20:13:30.604 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189727.log.gz 2023-10-08T20:13:30.604 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.365541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174722.log 2023-10-08T20:13:30.604 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.365541.log.gz 2023-10-08T20:13:30.604 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.414918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.640299.log 2023-10-08T20:13:30.604 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.414918.log.gz 2023-10-08T20:13:30.604 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.174722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204398.log 2023-10-08T20:13:30.604 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174722.log.gz 2023-10-08T20:13:30.604 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.640299.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.640299.log.gzgzip 2023-10-08T20:13:30.605 INFO:teuthology.orchestra.run.smithi045.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.314377.log 2023-10-08T20:13:30.605 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.204398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388332.log 2023-10-08T20:13:30.605 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204398.log.gz 2023-10-08T20:13:30.605 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.314377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281136.log 2023-10-08T20:13:30.605 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.314377.log.gz 2023-10-08T20:13:30.605 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.388332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.658504.log 2023-10-08T20:13:30.605 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.388332.log.gz 2023-10-08T20:13:30.605 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.281136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174118.log 2023-10-08T20:13:30.605 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281136.log.gz 2023-10-08T20:13:30.606 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.658504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.710187.log 2023-10-08T20:13:30.606 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.658504.log.gz 2023-10-08T20:13:30.606 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.174118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280618.log 2023-10-08T20:13:30.606 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174118.log.gz 2023-10-08T20:13:30.606 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.710187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.618197.log 2023-10-08T20:13:30.606 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.710187.log.gz 2023-10-08T20:13:30.606 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.280618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118158.log 2023-10-08T20:13:30.607 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280618.log.gz 2023-10-08T20:13:30.607 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.618197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.638768.log 2023-10-08T20:13:30.607 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618197.log.gz 2023-10-08T20:13:30.607 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.118158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269673.log 2023-10-08T20:13:30.607 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.638768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.786126.log 2023-10-08T20:13:30.607 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.638768.log.gz 2023-10-08T20:13:30.607 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.269673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393328.log 2023-10-08T20:13:30.607 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269673.log.gz 2023-10-08T20:13:30.608 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.786126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.661519.log 2023-10-08T20:13:30.608 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.786126.log.gz 2023-10-08T20:13:30.608 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.393328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.769812.log 2023-10-08T20:13:30.608 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393328.log.gz 2023-10-08T20:13:30.608 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.661519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117751.log 2023-10-08T20:13:30.608 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.661519.log.gz 2023-10-08T20:13:30.608 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.769812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336109.log 2023-10-08T20:13:30.608 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.769812.log.gz 2023-10-08T20:13:30.609 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388943.log 2023-10-08T20:13:30.609 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.336109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361335.log 2023-10-08T20:13:30.609 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336109.log.gz 2023-10-08T20:13:30.609 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.388943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270232.log 2023-10-08T20:13:30.609 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.388943.log.gz 2023-10-08T20:13:30.609 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.361335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251198.log 2023-10-08T20:13:30.609 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.361335.log.gz 2023-10-08T20:13:30.609 INFO:teuthology.orchestra.run.smithi045.stderr:gzip /var/log/ceph/ceph-client.admin.270232.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.394545.log 2023-10-08T20:13:30.610 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270232.log.gz 2023-10-08T20:13:30.610 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.113178.log.gz 2023-10-08T20:13:30.610 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.251198.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.112160.log.gz 2023-10-08T20:13:30.610 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251198.log.gz 2023-10-08T20:13:30.610 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.118158.log.gz 2023-10-08T20:13:30.610 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.394545.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.117751.log.gz 2023-10-08T20:13:30.610 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394545.log.gz 2023-10-08T20:13:30.611 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.119217.log.gz 2023-10-08T20:13:30.611 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364240.log 2023-10-08T20:13:30.611 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302604.log 2023-10-08T20:13:30.611 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.364240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385845.log 2023-10-08T20:13:30.611 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.364240.log.gz 2023-10-08T20:13:30.611 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672545.log 2023-10-08T20:13:30.611 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302604.log.gz 2023-10-08T20:13:30.611 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.385845.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.385845.log.gz--verbose 2023-10-08T20:13:30.612 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.410658.log 2023-10-08T20:13:30.612 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.672545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.652497.log 2023-10-08T20:13:30.612 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.672545.log.gz 2023-10-08T20:13:30.612 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.410658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.784576.log 2023-10-08T20:13:30.612 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410658.log.gz 2023-10-08T20:13:30.612 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.652497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399275.log 2023-10-08T20:13:30.612 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.652497.log.gz 2023-10-08T20:13:30.612 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.784576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260611.log 2023-10-08T20:13:30.613 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.784576.log.gz 2023-10-08T20:13:30.613 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.399275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224756.log 2023-10-08T20:13:30.613 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.399275.log.gz 2023-10-08T20:13:30.613 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.260611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279836.log 2023-10-08T20:13:30.613 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260611.log.gz 2023-10-08T20:13:30.613 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.224756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.935675.log 2023-10-08T20:13:30.613 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224756.log.gz 2023-10-08T20:13:30.613 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.279836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369471.log 2023-10-08T20:13:30.614 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279836.log.gz 2023-10-08T20:13:30.614 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.935675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.696539.log 2023-10-08T20:13:30.614 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.935675.log.gz 2023-10-08T20:13:30.614 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.369471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.675321.log 2023-10-08T20:13:30.614 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.369471.log.gz 2023-10-08T20:13:30.614 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.696539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.820198.log 2023-10-08T20:13:30.614 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.696539.log.gz 2023-10-08T20:13:30.615 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.675321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410926.log 2023-10-08T20:13:30.615 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.675321.log.gz 2023-10-08T20:13:30.615 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.820198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389924.log 2023-10-08T20:13:30.615 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.820198.log.gz 2023-10-08T20:13:30.615 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.410926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290038.log 2023-10-08T20:13:30.615 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410926.log.gz 2023-10-08T20:13:30.615 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.389924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113408.log 2023-10-08T20:13:30.615 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.389924.log.gz 2023-10-08T20:13:30.616 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.290038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372204.log 2023-10-08T20:13:30.616 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290038.log.gz 2023-10-08T20:13:30.616 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.113408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259139.log 2023-10-08T20:13:30.616 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.372204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.790255.log 2023-10-08T20:13:30.616 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.372204.log.gz 2023-10-08T20:13:30.616 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.259139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315416.log 2023-10-08T20:13:30.616 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259139.log.gz 2023-10-08T20:13:30.616 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.790255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266872.log 2023-10-08T20:13:30.617 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.790255.log.gz 2023-10-08T20:13:30.617 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.315416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221546.log 2023-10-08T20:13:30.617 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315416.log.gz 2023-10-08T20:13:30.617 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.266872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623199.log 2023-10-08T20:13:30.617 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266872.log.gz 2023-10-08T20:13:30.617 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.221546.log: gzip -5 0.0%--verbose -- replaced with /var/log/ceph/ceph-client.admin.221546.log.gz-- 2023-10-08T20:13:30.617 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.775143.log 2023-10-08T20:13:30.617 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.623199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.675522.log 2023-10-08T20:13:30.617 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623199.log.gz 2023-10-08T20:13:30.618 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.775143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.673513.log 2023-10-08T20:13:30.618 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.775143.log.gz 2023-10-08T20:13:30.618 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.675522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.675522.log.gz 2023-10-08T20:13:30.618 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.775742.log 2023-10-08T20:13:30.618 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.673513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375888.log 2023-10-08T20:13:30.618 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.673513.log.gz 2023-10-08T20:13:30.618 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.775742.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.775742.log.gz-- 2023-10-08T20:13:30.619 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.648900.log 2023-10-08T20:13:30.619 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.375888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.826580.log 2023-10-08T20:13:30.619 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.375888.log.gz 2023-10-08T20:13:30.619 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.648900.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648900.log.gz 2023-10-08T20:13:30.619 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249194.log 2023-10-08T20:13:30.619 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.826580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197092.log 2023-10-08T20:13:30.619 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.826580.log.gz 2023-10-08T20:13:30.619 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.249194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412598.log 2023-10-08T20:13:30.620 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249194.log.gz 2023-10-08T20:13:30.620 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297539.log 2023-10-08T20:13:30.620 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.197092.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197092.log.gz 2023-10-08T20:13:30.620 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.412598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.656743.log 2023-10-08T20:13:30.620 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412598.log.gz 2023-10-08T20:13:30.620 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.297539.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.297539.log.gz--verbose 2023-10-08T20:13:30.620 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.645981.log 2023-10-08T20:13:30.620 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.656743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418485.log 2023-10-08T20:13:30.621 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.656743.log.gz 2023-10-08T20:13:30.621 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.645981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.657968.log 2023-10-08T20:13:30.621 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.645981.log.gz 2023-10-08T20:13:30.621 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.418485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310616.log 2023-10-08T20:13:30.621 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.418485.log.gz 2023-10-08T20:13:30.621 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.657968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393606.log 2023-10-08T20:13:30.621 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.657968.log.gz 2023-10-08T20:13:30.622 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.310616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278267.log 2023-10-08T20:13:30.622 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310616.log.gz 2023-10-08T20:13:30.622 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.393606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112163.log 2023-10-08T20:13:30.622 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393606.log.gz 2023-10-08T20:13:30.622 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.278267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.832988.log 2023-10-08T20:13:30.622 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278267.log.gz 2023-10-08T20:13:30.622 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379919.log 2023-10-08T20:13:30.623 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.832988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304566.log 2023-10-08T20:13:30.623 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.832988.log.gz 2023-10-08T20:13:30.623 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.379919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.675904.log 2023-10-08T20:13:30.623 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.379919.log.gz 2023-10-08T20:13:30.623 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.304566.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304566.log.gz 2023-10-08T20:13:30.623 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216624.log 2023-10-08T20:13:30.623 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.675904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637918.log 2023-10-08T20:13:30.623 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.675904.log.gz 2023-10-08T20:13:30.623 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.216624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278468.log 2023-10-08T20:13:30.624 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216624.log.gz 2023-10-08T20:13:30.624 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.637918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416849.log 2023-10-08T20:13:30.624 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637918.log.gz 2023-10-08T20:13:30.624 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.278468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.817502.log 2023-10-08T20:13:30.624 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278468.log.gz 2023-10-08T20:13:30.624 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.416849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321206.log 2023-10-08T20:13:30.624 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.416849.log.gz 2023-10-08T20:13:30.624 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.817502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626908.log 2023-10-08T20:13:30.625 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.817502.log.gz 2023-10-08T20:13:30.625 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655149.log 2023-10-08T20:13:30.625 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.321206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321206.log.gz 2023-10-08T20:13:30.625 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.626908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359355.log 2023-10-08T20:13:30.625 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626908.log.gz 2023-10-08T20:13:30.625 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.655149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348160.log 2023-10-08T20:13:30.625 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655149.log.gz 2023-10-08T20:13:30.625 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.359355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279311.log 2023-10-08T20:13:30.626 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.359355.log.gz 2023-10-08T20:13:30.626 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.348160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174524.log 2023-10-08T20:13:30.626 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348160.log.gz 2023-10-08T20:13:30.626 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.279311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119147.log 2023-10-08T20:13:30.626 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279311.log.gz 2023-10-08T20:13:30.626 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.174524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270246.log 2023-10-08T20:13:30.626 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174524.log.gz 2023-10-08T20:13:30.627 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.119147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341704.log 2023-10-08T20:13:30.627 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.270246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.671541.log 2023-10-08T20:13:30.627 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270246.log.gz 2023-10-08T20:13:30.627 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.341704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250158.log 2023-10-08T20:13:30.627 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341704.log.gz 2023-10-08T20:13:30.627 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363023.log 2023-10-08T20:13:30.627 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.671541.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.671541.log.gz 2023-10-08T20:13:30.627 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.250158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.661044.log 2023-10-08T20:13:30.627 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250158.log.gz 2023-10-08T20:13:30.628 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.363023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.786601.log 2023-10-08T20:13:30.628 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.363023.log.gz 2023-10-08T20:13:30.628 INFO:teuthology.orchestra.run.smithi045.stderr:gzip /var/log/ceph/ceph-client.admin.661044.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.708219.log 2023-10-08T20:13:30.628 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.661044.log.gz 2023-10-08T20:13:30.628 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.786601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.675620.log 2023-10-08T20:13:30.628 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.786601.log.gz 2023-10-08T20:13:30.628 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.708219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199451.log 2023-10-08T20:13:30.628 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.708219.log.gz 2023-10-08T20:13:30.629 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112764.log 2023-10-08T20:13:30.629 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.675620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.675620.log.gz 2023-10-08T20:13:30.629 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.199451.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.369903.log 2023-10-08T20:13:30.629 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.199451.log.gz 2023-10-08T20:13:30.629 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-08T20:13:30.629 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112764.log: /var/log/ceph/ceph-client.admin.369903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378417.log 2023-10-08T20:13:30.629 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.369903.log.gz 2023-10-08T20:13:30.629 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.789368.log 2023-10-08T20:13:30.630 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307897.log 2023-10-08T20:13:30.630 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.378417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.378417.log.gz 2023-10-08T20:13:30.630 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.789368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323156.log 2023-10-08T20:13:30.630 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.789368.log.gz 2023-10-08T20:13:30.630 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.307897.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307897.log.gz 2023-10-08T20:13:30.630 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281626.log 2023-10-08T20:13:30.630 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160943.log 2023-10-08T20:13:30.630 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.323156.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323156.log.gz 2023-10-08T20:13:30.631 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.281626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.831573.log 2023-10-08T20:13:30.631 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281626.log.gz 2023-10-08T20:13:30.631 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.160943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204769.log 2023-10-08T20:13:30.631 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160943.log.gz 2023-10-08T20:13:30.631 INFO:teuthology.orchestra.run.smithi045.stderr:gzip /var/log/ceph/ceph-client.admin.831573.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.646392.log 2023-10-08T20:13:30.631 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.831573.log.gz 2023-10-08T20:13:30.631 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.204769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.783788.log 2023-10-08T20:13:30.631 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204769.log.gz 2023-10-08T20:13:30.632 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.646392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367568.log 2023-10-08T20:13:30.632 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.646392.log.gz 2023-10-08T20:13:30.632 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.783788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111614.log 2023-10-08T20:13:30.632 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.783788.log.gz 2023-10-08T20:13:30.632 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630167.log 2023-10-08T20:13:30.632 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.367568.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.367568.log.gz 2023-10-08T20:13:30.632 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412210.log 2023-10-08T20:13:30.632 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.630167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397548.log 2023-10-08T20:13:30.632 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630167.log.gz 2023-10-08T20:13:30.633 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.412210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.660750.log 2023-10-08T20:13:30.633 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412210.log.gz 2023-10-08T20:13:30.633 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192740.log 2023-10-08T20:13:30.633 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.397548.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.397548.log.gz 2023-10-08T20:13:30.633 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.660750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.682674.log 2023-10-08T20:13:30.633 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.660750.log.gz 2023-10-08T20:13:30.633 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.192740.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.192740.log.gz--verbose 2023-10-08T20:13:30.633 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.706465.log 2023-10-08T20:13:30.634 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.815522.log 2023-10-08T20:13:30.634 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.682674.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.682674.log.gz 2023-10-08T20:13:30.634 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.706465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395467.log 2023-10-08T20:13:30.634 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.706465.log.gz 2023-10-08T20:13:30.634 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.815522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162007.log 2023-10-08T20:13:30.634 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.815522.log.gz 2023-10-08T20:13:30.634 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224770.log 2023-10-08T20:13:30.634 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.395467.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.395467.log.gz 2023-10-08T20:13:30.635 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.162007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.656947.log 2023-10-08T20:13:30.635 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162007.log.gz 2023-10-08T20:13:30.635 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.224770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.638859.log 2023-10-08T20:13:30.635 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224770.log.gz 2023-10-08T20:13:30.635 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.656947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162402.log 2023-10-08T20:13:30.635 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.656947.log.gz 2023-10-08T20:13:30.635 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.638859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.662173.log 2023-10-08T20:13:30.635 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.638859.log.gz 2023-10-08T20:13:30.636 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.162402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373324.log 2023-10-08T20:13:30.636 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162402.log.gz 2023-10-08T20:13:30.636 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.662173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.709121.log 2023-10-08T20:13:30.636 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.662173.log.gz 2023-10-08T20:13:30.636 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.373324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273613.log 2023-10-08T20:13:30.636 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.373324.log.gz 2023-10-08T20:13:30.636 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.709121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309781.log 2023-10-08T20:13:30.636 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.709121.log.gz 2023-10-08T20:13:30.637 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473387.log 2023-10-08T20:13:30.637 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.273613.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273613.log.gz 2023-10-08T20:13:30.637 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.309781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.547787.log 2023-10-08T20:13:30.637 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309781.log.gz 2023-10-08T20:13:30.637 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.473387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289250.log 2023-10-08T20:13:30.637 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.473387.log.gz 2023-10-08T20:13:30.637 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.785834.log 2023-10-08T20:13:30.637 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.547787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.547787.log.gz 2023-10-08T20:13:30.637 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.289250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414932.log 2023-10-08T20:13:30.638 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289250.log.gz 2023-10-08T20:13:30.638 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.785834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.684850.log 2023-10-08T20:13:30.638 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.785834.log.gz 2023-10-08T20:13:30.638 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.414932.log: -- /var/log/ceph/ceph-client.admin.630719.log 2023-10-08T20:13:30.638 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.414932.log.gz 2023-10-08T20:13:30.638 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.684850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113132.log 2023-10-08T20:13:30.638 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.684850.log.gz 2023-10-08T20:13:30.639 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.630719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630719.log.gz 2023-10-08T20:13:30.639 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339422.log 2023-10-08T20:13:30.639 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401113.log 2023-10-08T20:13:30.639 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.113132.log: /var/log/ceph/ceph-client.admin.339422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.774764.log 2023-10-08T20:13:30.639 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339422.log.gz 2023-10-08T20:13:30.639 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.401113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.787881.log 2023-10-08T20:13:30.639 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.401113.log.gz 2023-10-08T20:13:30.639 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.774764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308591.log 2023-10-08T20:13:30.639 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.774764.log.gz 2023-10-08T20:13:30.640 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.787881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476652.log 2023-10-08T20:13:30.640 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.787881.log.gz 2023-10-08T20:13:30.640 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.308591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173917.log 2023-10-08T20:13:30.640 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308591.log.gz 2023-10-08T20:13:30.640 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.476652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.947700.log 2023-10-08T20:13:30.640 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.476652.log.gz 2023-10-08T20:13:30.640 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.173917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173917.log.gz 2023-10-08T20:13:30.640 INFO:teuthology.orchestra.run.smithi045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.113408.log.gz 2023-10-08T20:13:30.641 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.947700.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.947700.log.gz 2023-10-08T20:13:30.641 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.811714.log 2023-10-08T20:13:30.641 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288447.log 2023-10-08T20:13:30.641 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.811714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262996.log 2023-10-08T20:13:30.641 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.811714.log.gz 2023-10-08T20:13:30.641 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.288447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.708903.log 2023-10-08T20:13:30.641 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288447.log.gz 2023-10-08T20:13:30.641 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262996.log: /var/log/ceph/ceph-client.admin.815536.log 2023-10-08T20:13:30.642 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262996.log.gz 2023-10-08T20:13:30.642 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.708903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206741.log 2023-10-08T20:13:30.642 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.708903.log.gz 2023-10-08T20:13:30.642 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.815536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223644.log 2023-10-08T20:13:30.642 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.815536.log.gz 2023-10-08T20:13:30.642 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.206741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206741.log.gz 2023-10-08T20:13:30.642 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.704189.log 2023-10-08T20:13:30.642 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.223644.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.223644.log.gz--verbose 2023-10-08T20:13:30.643 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.349788.log 2023-10-08T20:13:30.643 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.696032.log 2023-10-08T20:13:30.643 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.704189.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.704189.log.gz 2023-10-08T20:13:30.643 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.349788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.826657.log 2023-10-08T20:13:30.643 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349788.log.gz 2023-10-08T20:13:30.643 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.696032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374401.log 2023-10-08T20:13:30.643 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.696032.log.gz 2023-10-08T20:13:30.643 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.826657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293639.log 2023-10-08T20:13:30.644 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.826657.log.gz 2023-10-08T20:13:30.644 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.374401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158050.log 2023-10-08T20:13:30.644 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.374401.log.gz 2023-10-08T20:13:30.644 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210233.log 2023-10-08T20:13:30.644 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.293639.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293639.log.gz 2023-10-08T20:13:30.644 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.158050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348586.log 2023-10-08T20:13:30.644 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158050.log.gz 2023-10-08T20:13:30.644 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.210233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363737.log 2023-10-08T20:13:30.644 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210233.log.gz 2023-10-08T20:13:30.645 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301062.log 2023-10-08T20:13:30.645 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.348586.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348586.log.gz 2023-10-08T20:13:30.645 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.363737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474782.log 2023-10-08T20:13:30.645 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.363737.log.gz 2023-10-08T20:13:30.645 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.301062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165770.log 2023-10-08T20:13:30.645 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301062.log.gz 2023-10-08T20:13:30.645 INFO:teuthology.orchestra.run.smithi045.stderr:gzip /var/log/ceph/ceph-client.admin.474782.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.785556.log 2023-10-08T20:13:30.645 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.474782.log.gz 2023-10-08T20:13:30.646 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.165770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362111.log 2023-10-08T20:13:30.646 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165770.log.gz 2023-10-08T20:13:30.646 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.785556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.682216.log 2023-10-08T20:13:30.646 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.785556.log.gz 2023-10-08T20:13:30.646 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.362111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112396.log 2023-10-08T20:13:30.646 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.362111.log.gz 2023-10-08T20:13:30.646 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.682216.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.682216.log.gz 2023-10-08T20:13:30.646 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378431.log 2023-10-08T20:13:30.647 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393104.log 2023-10-08T20:13:30.647 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.378431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.378431.log.gz 2023-10-08T20:13:30.647 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.393104.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393104.log.gz 2023-10-08T20:13:30.647 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.771825.log 2023-10-08T20:13:30.647 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.641725.log 2023-10-08T20:13:30.647 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.771825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295068.log 2023-10-08T20:13:30.647 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.771825.log.gz 2023-10-08T20:13:30.647 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.641725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.702788.log 2023-10-08T20:13:30.648 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.641725.log.gz 2023-10-08T20:13:30.648 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279087.log 2023-10-08T20:13:30.648 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.295068.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.295068.log.gz 2023-10-08T20:13:30.648 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.702788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365053.log 2023-10-08T20:13:30.648 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702788.log.gz 2023-10-08T20:13:30.648 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.279087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322439.log 2023-10-08T20:13:30.648 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279087.log.gz 2023-10-08T20:13:30.648 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278057.log 2023-10-08T20:13:30.649 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.365053.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.365053.log.gz 2023-10-08T20:13:30.649 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.322439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.694061.log 2023-10-08T20:13:30.649 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322439.log.gz 2023-10-08T20:13:30.649 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.278057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221000.log 2023-10-08T20:13:30.649 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278057.log.gz 2023-10-08T20:13:30.649 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.694061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367052.log 2023-10-08T20:13:30.649 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.694061.log.gz 2023-10-08T20:13:30.649 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.221000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343169.log 2023-10-08T20:13:30.650 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221000.log.gz 2023-10-08T20:13:30.650 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.367052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117659.log 2023-10-08T20:13:30.650 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.367052.log.gz 2023-10-08T20:13:30.650 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.343169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366048.log 2023-10-08T20:13:30.650 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343169.log.gz 2023-10-08T20:13:30.650 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266376.log 2023-10-08T20:13:30.650 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.366048.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.366048.log.gz 2023-10-08T20:13:30.650 INFO:teuthology.orchestra.run.smithi045.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.661889.log 2023-10-08T20:13:30.651 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.825746.log 2023-10-08T20:13:30.651 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.266376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266376.log.gz 2023-10-08T20:13:30.651 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.661889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.119475.log 2023-10-08T20:13:30.651 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.661889.log.gz 2023-10-08T20:13:30.651 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.825746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473373.log 2023-10-08T20:13:30.651 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.825746.log.gz 2023-10-08T20:13:30.651 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.119475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112464.log 2023-10-08T20:13:30.651 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.119475.log.gz 2023-10-08T20:13:30.652 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.473373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630642.log 2023-10-08T20:13:30.652 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.473373.log.gz 2023-10-08T20:13:30.652 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635416.log 2023-10-08T20:13:30.652 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324152.log 2023-10-08T20:13:30.652 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.630642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630642.log.gz 2023-10-08T20:13:30.652 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.635416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.684027.log 2023-10-08T20:13:30.652 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635416.log.gz 2023-10-08T20:13:30.652 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.324152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111171.log 2023-10-08T20:13:30.653 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.324152.log.gz 2023-10-08T20:13:30.653 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.684027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303330.log 2023-10-08T20:13:30.653 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.684027.log.gz 2023-10-08T20:13:30.653 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265426.log 2023-10-08T20:13:30.653 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285744.log 2023-10-08T20:13:30.653 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.303330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303330.log.gz 2023-10-08T20:13:30.653 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.265426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.688459.log 2023-10-08T20:13:30.653 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265426.log.gz 2023-10-08T20:13:30.653 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.285744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292075.log 2023-10-08T20:13:30.654 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285744.log.gz 2023-10-08T20:13:30.654 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.688459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255984.log 2023-10-08T20:13:30.654 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.688459.log.gz 2023-10-08T20:13:30.654 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.292075.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.292075.log.gz-- 2023-10-08T20:13:30.654 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.208689.log 2023-10-08T20:13:30.654 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324229.log 2023-10-08T20:13:30.654 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.255984.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255984.log.gz 2023-10-08T20:13:30.655 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.208689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385019.log 2023-10-08T20:13:30.655 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208689.log.gz 2023-10-08T20:13:30.655 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.324229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115023.log 2023-10-08T20:13:30.655 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.324229.log.gz 2023-10-08T20:13:30.655 INFO:teuthology.orchestra.run.smithi045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.112163.log.gz 2023-10-08T20:13:30.655 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.385019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164733.log 2023-10-08T20:13:30.655 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385019.log.gz 2023-10-08T20:13:30.655 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115023.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.119147.log.gz 2023-10-08T20:13:30.656 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.164733.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164733.log.gz 2023-10-08T20:13:30.656 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.822878.log 2023-10-08T20:13:30.656 INFO:teuthology.orchestra.run.smithi045.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.112764.log.gz 2023-10-08T20:13:30.656 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.946665.log 2023-10-08T20:13:30.656 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.678422.log 2023-10-08T20:13:30.656 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.822878.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.822878.log.gz 2023-10-08T20:13:30.656 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.946665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.659860.log 2023-10-08T20:13:30.656 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.113132.log.gz 2023-10-08T20:13:30.656 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.946665.log.gz 2023-10-08T20:13:30.657 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.678422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476743.log 2023-10-08T20:13:30.657 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.678422.log.gz 2023-10-08T20:13:30.657 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.659860.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.659860.log.gz 2023-10-08T20:13:30.657 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117475.log 2023-10-08T20:13:30.657 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.639537.log 2023-10-08T20:13:30.657 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.476743.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.476743.log.gz 2023-10-08T20:13:30.657 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359129.log 2023-10-08T20:13:30.657 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.639537.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.639537.log.gz 2023-10-08T20:13:30.658 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212104.log 2023-10-08T20:13:30.658 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389374.log 2023-10-08T20:13:30.658 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.359129.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.359129.log.gz 2023-10-08T20:13:30.658 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.212104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.618288.log 2023-10-08T20:13:30.658 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212104.log.gz 2023-10-08T20:13:30.658 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.939018.log 2023-10-08T20:13:30.658 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.389374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.389374.log.gz 2023-10-08T20:13:30.658 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.618288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245201.log 2023-10-08T20:13:30.659 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618288.log.gz 2023-10-08T20:13:30.659 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.939018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.652418.log 2023-10-08T20:13:30.659 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.939018.log.gz 2023-10-08T20:13:30.659 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.245201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.811518.log 2023-10-08T20:13:30.659 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245201.log.gz 2023-10-08T20:13:30.659 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.652418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371648.log 2023-10-08T20:13:30.659 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.652418.log.gz 2023-10-08T20:13:30.659 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.811518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176423.log 2023-10-08T20:13:30.660 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.811518.log.gz 2023-10-08T20:13:30.660 INFO:teuthology.orchestra.run.smithi045.stderr:gzip /var/log/ceph/ceph-client.admin.371648.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.636627.log 2023-10-08T20:13:30.660 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.371648.log.gz 2023-10-08T20:13:30.660 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.176423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158516.log 2023-10-08T20:13:30.660 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176423.log.gz 2023-10-08T20:13:30.660 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.636627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283616.log 2023-10-08T20:13:30.660 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636627.log.gz 2023-10-08T20:13:30.660 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.158516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265908.log 2023-10-08T20:13:30.660 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158516.log.gz 2023-10-08T20:13:30.661 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.283616.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.283616.log.gz-5 2023-10-08T20:13:30.661 INFO:teuthology.orchestra.run.smithi045.stderr:--verbose -- /var/log/ceph/ceph-client.admin.216610.log 2023-10-08T20:13:30.661 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.828742.log 2023-10-08T20:13:30.661 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.265908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265908.log.gz 2023-10-08T20:13:30.661 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.216610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253129.log 2023-10-08T20:13:30.661 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216610.log.gz 2023-10-08T20:13:30.661 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.828742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117613.log 2023-10-08T20:13:30.661 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.828742.log.gz 2023-10-08T20:13:30.662 INFO:teuthology.orchestra.run.smithi045.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.104440.log.gz 2023-10-08T20:13:30.662 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.253129.log: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.104001.log.gz 2023-10-08T20:13:30.662 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253129.log.gz 2023-10-08T20:13:30.662 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325545.log 2023-10-08T20:13:30.662 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112856.log 2023-10-08T20:13:30.662 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110288.log.gz 2023-10-08T20:13:30.662 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.325545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.949183.log 2023-10-08T20:13:30.662 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325545.log.gz 2023-10-08T20:13:30.663 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.775444.log 2023-10-08T20:13:30.663 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.111125.log.gz 2023-10-08T20:13:30.663 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.949183.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.117659.log.gz 2023-10-08T20:13:30.663 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% 87.3% -- replaced with /var/log/ceph/ceph-client.admin.112396.log.gz 2023-10-08T20:13:30.663 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.949183.log.gz 2023-10-08T20:13:30.663 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.775444.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.775444.log.gz 2023-10-08T20:13:30.663 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.676394.log 2023-10-08T20:13:30.663 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.112464.log.gz 2023-10-08T20:13:30.664 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.115023.log.gz 2023-10-08T20:13:30.664 INFO:teuthology.orchestra.run.smithi045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.117475.log.gz 2023-10-08T20:13:30.664 INFO:teuthology.orchestra.run.smithi045.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.111171.log.gz 2023-10-08T20:13:30.664 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.117613.log.gz 2023-10-08T20:13:30.664 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.111614.log.gz 2023-10-08T20:13:30.664 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.676394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.676394.log.gz 2023-10-08T20:13:30.664 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178156.log 2023-10-08T20:13:30.664 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.646483.log 2023-10-08T20:13:30.665 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.112856.log.gz 2023-10-08T20:13:30.665 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.178156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626474.log 2023-10-08T20:13:30.665 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178156.log.gz 2023-10-08T20:13:30.665 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.646483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357351.log 2023-10-08T20:13:30.665 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.646483.log.gz 2023-10-08T20:13:30.665 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.941317.log 2023-10-08T20:13:30.665 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.626474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626474.log.gz 2023-10-08T20:13:30.665 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.357351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380908.log 2023-10-08T20:13:30.666 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357351.log.gz 2023-10-08T20:13:30.666 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.941317.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.941317.log.gz--verbose 2023-10-08T20:13:30.666 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.357365.log 2023-10-08T20:13:30.666 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.380908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699107.log 2023-10-08T20:13:30.666 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.115714.log.gz 2023-10-08T20:13:30.666 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.380908.log.gz 2023-10-08T20:13:30.666 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.357365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387355.log 2023-10-08T20:13:30.666 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357365.log.gz 2023-10-08T20:13:30.667 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.699107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384015.log 2023-10-08T20:13:30.667 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699107.log.gz 2023-10-08T20:13:30.667 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.387355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104840.log 2023-10-08T20:13:30.667 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.387355.log.gz 2023-10-08T20:13:30.667 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.384015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.819270.log 2023-10-08T20:13:30.667 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384015.log.gz 2023-10-08T20:13:30.667 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290429.log 2023-10-08T20:13:30.667 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.819270.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.784062.log -- replaced with /var/log/ceph/ceph-client.admin.819270.log.gz 2023-10-08T20:13:30.667 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-10-08T20:13:30.668 INFO:teuthology.orchestra.run.smithi045.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.104840.log.gz 2023-10-08T20:13:30.668 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.290429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309704.log 2023-10-08T20:13:30.668 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290429.log.gz 2023-10-08T20:13:30.668 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113454.log 2023-10-08T20:13:30.668 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.784062.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.784062.log.gz 2023-10-08T20:13:30.668 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.309704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472773.log 2023-10-08T20:13:30.668 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309704.log.gz 2023-10-08T20:13:30.668 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.113454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700594.log 2023-10-08T20:13:30.669 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.472773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115207.log 2023-10-08T20:13:30.669 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.472773.log.gz 2023-10-08T20:13:30.669 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.700594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348663.log 2023-10-08T20:13:30.669 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700594.log.gz 2023-10-08T20:13:30.669 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637417.log 2023-10-08T20:13:30.669 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.348663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193510.log 2023-10-08T20:13:30.669 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348663.log.gz 2023-10-08T20:13:30.669 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.637417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621020.log 2023-10-08T20:13:30.670 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637417.log.gz 2023-10-08T20:13:30.670 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.193510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174158.log 2023-10-08T20:13:30.670 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193510.log.gz 2023-10-08T20:13:30.670 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.621020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243814.log 2023-10-08T20:13:30.670 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621020.log.gz 2023-10-08T20:13:30.670 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.174158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268318.log 2023-10-08T20:13:30.670 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174158.log.gz 2023-10-08T20:13:30.670 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.243814.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.115207.log.gz 2023-10-08T20:13:30.671 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365751.log 2023-10-08T20:13:30.671 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243814.log.gz 2023-10-08T20:13:30.671 INFO:teuthology.orchestra.run.smithi045.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.113454.log.gz 2023-10-08T20:13:30.671 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.268318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.671039.log 2023-10-08T20:13:30.671 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268318.log.gz 2023-10-08T20:13:30.671 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.365751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.639834.log 2023-10-08T20:13:30.671 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.365751.log.gz 2023-10-08T20:13:30.671 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.671039.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.399926.log 2023-10-08T20:13:30.672 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.671039.log.gz 2023-10-08T20:13:30.672 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.639834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260112.log 2023-10-08T20:13:30.672 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.639834.log.gz 2023-10-08T20:13:30.672 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.399926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205326.log 2023-10-08T20:13:30.672 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.399926.log.gz 2023-10-08T20:13:30.672 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.260112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407884.log 2023-10-08T20:13:30.672 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260112.log.gz 2023-10-08T20:13:30.672 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.205326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197551.log 2023-10-08T20:13:30.673 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205326.log.gz 2023-10-08T20:13:30.673 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.407884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110622.log 2023-10-08T20:13:30.673 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407884.log.gz 2023-10-08T20:13:30.673 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.197551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393620.log 2023-10-08T20:13:30.673 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197551.log.gz 2023-10-08T20:13:30.673 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315325.log 2023-10-08T20:13:30.673 INFO:teuthology.orchestra.run.smithi045.stderr:gzip /var/log/ceph/ceph-client.admin.393620.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.284566.log 2023-10-08T20:13:30.673 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393620.log.gz 2023-10-08T20:13:30.674 INFO:teuthology.orchestra.run.smithi045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.110622.log.gz 2023-10-08T20:13:30.674 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.315325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261887.log 2023-10-08T20:13:30.674 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315325.log.gz 2023-10-08T20:13:30.674 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360876.log 2023-10-08T20:13:30.674 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.284566.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284566.log.gz 2023-10-08T20:13:30.674 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.261887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.647963.log 2023-10-08T20:13:30.674 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261887.log.gz 2023-10-08T20:13:30.674 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.360876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637628.log 2023-10-08T20:13:30.675 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.360876.log.gz 2023-10-08T20:13:30.675 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.647963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242894.log 2023-10-08T20:13:30.675 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.647963.log.gz 2023-10-08T20:13:30.675 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.637628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.687987.log 2023-10-08T20:13:30.675 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637628.log.gz 2023-10-08T20:13:30.675 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.242894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.833548.log 2023-10-08T20:13:30.675 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242894.log.gz 2023-10-08T20:13:30.675 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.687987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304064.log 2023-10-08T20:13:30.676 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.687987.log.gz 2023-10-08T20:13:30.676 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.833548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.947416.log 2023-10-08T20:13:30.676 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.833548.log.gz 2023-10-08T20:13:30.676 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.304064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314391.log 2023-10-08T20:13:30.676 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304064.log.gz 2023-10-08T20:13:30.676 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.947416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194654.log 2023-10-08T20:13:30.676 INFO:teuthology.orchestra.run.smithi045.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.947416.log.gz 2023-10-08T20:13:30.676 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.314391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.800856.log 2023-10-08T20:13:30.677 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.314391.log.gz 2023-10-08T20:13:30.677 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.194654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273627.log 2023-10-08T20:13:30.677 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194654.log.gz 2023-10-08T20:13:30.677 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.800856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.706271.log 2023-10-08T20:13:30.677 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.800856.log.gz 2023-10-08T20:13:30.677 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.273627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.703528.log 2023-10-08T20:13:30.677 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273627.log.gz 2023-10-08T20:13:30.677 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.706271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257854.log 2023-10-08T20:13:30.678 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.706271.log.gz 2023-10-08T20:13:30.678 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.703528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401401.log 2023-10-08T20:13:30.678 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703528.log.gz 2023-10-08T20:13:30.678 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.257854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.832598.log 2023-10-08T20:13:30.678 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257854.log.gz 2023-10-08T20:13:30.678 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.401401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103847.log 2023-10-08T20:13:30.678 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.401401.log.gz 2023-10-08T20:13:30.678 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.832598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.825280.log 2023-10-08T20:13:30.679 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.832598.log.gz 2023-10-08T20:13:30.679 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.103847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370189.log 2023-10-08T20:13:30.679 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.825280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.688445.log 2023-10-08T20:13:30.679 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.825280.log.gz 2023-10-08T20:13:30.679 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.370189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313100.log 2023-10-08T20:13:30.679 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.370189.log.gz 2023-10-08T20:13:30.679 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.688445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372383.log 2023-10-08T20:13:30.679 INFO:teuthology.orchestra.run.smithi045.stderr: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.103847.log.gz 2023-10-08T20:13:30.680 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.688445.log.gz 2023-10-08T20:13:30.680 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.313100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369011.log 2023-10-08T20:13:30.680 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313100.log.gz 2023-10-08T20:13:30.680 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.372383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644962.log 2023-10-08T20:13:30.680 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.372383.log.gz 2023-10-08T20:13:30.680 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.369011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417378.log 2023-10-08T20:13:30.680 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.369011.log.gz 2023-10-08T20:13:30.680 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-08T20:13:30.681 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.644962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.670036.log 2023-10-08T20:13:30.681 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.644962.log.gz 2023-10-08T20:13:30.681 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.417378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.815230.log 2023-10-08T20:13:30.681 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.417378.log.gz 2023-10-08T20:13:30.681 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.670036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.696448.log 2023-10-08T20:13:30.681 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.670036.log.gz 2023-10-08T20:13:30.681 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.815230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310693.log 2023-10-08T20:13:30.681 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.815230.log.gz 2023-10-08T20:13:30.682 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.696448.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.670962.log 2023-10-08T20:13:30.682 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.696448.log.gz 2023-10-08T20:13:30.682 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.310693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118297.log 2023-10-08T20:13:30.682 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310693.log.gz 2023-10-08T20:13:30.682 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.670962.log: gzip -5 0.0%--verbose -- replaced with /var/log/ceph/ceph-client.admin.670962.log.gz-- 2023-10-08T20:13:30.682 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.191762.log 2023-10-08T20:13:30.682 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.118297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370803.log 2023-10-08T20:13:30.683 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.191762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104154.log 2023-10-08T20:13:30.683 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191762.log.gz 2023-10-08T20:13:30.683 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.370803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365765.log 2023-10-08T20:13:30.683 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.370803.log.gz 2023-10-08T20:13:30.683 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343246.log 2023-10-08T20:13:30.683 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.365765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258942.log 2023-10-08T20:13:30.683 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.365765.log.gz 2023-10-08T20:13:30.683 INFO:teuthology.orchestra.run.smithi045.stderr:gzip /var/log/ceph/ceph-client.admin.343246.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.377057.log 2023-10-08T20:13:30.684 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343246.log.gz 2023-10-08T20:13:30.684 INFO:teuthology.orchestra.run.smithi045.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.118297.log.gz 2023-10-08T20:13:30.684 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.258942.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.258942.log.gz-- 2023-10-08T20:13:30.684 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.388409.log 2023-10-08T20:13:30.684 INFO:teuthology.orchestra.run.smithi045.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.104154.log.gz 2023-10-08T20:13:30.684 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.377057.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.377057.log.gz-- 2023-10-08T20:13:30.684 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.225385.log 2023-10-08T20:13:30.684 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323642.log 2023-10-08T20:13:30.685 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.388409.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.388409.log.gz 2023-10-08T20:13:30.685 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.225385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250730.log 2023-10-08T20:13:30.685 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225385.log.gz 2023-10-08T20:13:30.685 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.323642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338055.log 2023-10-08T20:13:30.685 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323642.log.gz 2023-10-08T20:13:30.685 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.250730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.822801.log 2023-10-08T20:13:30.685 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250730.log.gz 2023-10-08T20:13:30.685 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.338055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270714.log 2023-10-08T20:13:30.686 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338055.log.gz 2023-10-08T20:13:30.686 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250346.log 2023-10-08T20:13:30.686 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.822801.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.822801.log.gz 2023-10-08T20:13:30.686 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208212.log 2023-10-08T20:13:30.686 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.270714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270714.log.gz 2023-10-08T20:13:30.686 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.250346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281334.log 2023-10-08T20:13:30.686 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250346.log.gz 2023-10-08T20:13:30.686 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.208212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.944221.log 2023-10-08T20:13:30.687 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208212.log.gz 2023-10-08T20:13:30.687 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.281334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217111.log 2023-10-08T20:13:30.687 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281334.log.gz 2023-10-08T20:13:30.687 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.944221.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.944221.log.gz 2023-10-08T20:13:30.687 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.670537.log 2023-10-08T20:13:30.687 INFO:teuthology.orchestra.run.smithi045.stderr:gzip /var/log/ceph/ceph-client.admin.217111.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.534835.log 2023-10-08T20:13:30.687 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217111.log.gz 2023-10-08T20:13:30.687 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.670537.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.670537.log.gz-5 2023-10-08T20:13:30.688 INFO:teuthology.orchestra.run.smithi045.stderr:--verbose -- /var/log/ceph/ceph-client.admin.639523.log 2023-10-08T20:13:30.688 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406336.log 2023-10-08T20:13:30.688 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.534835.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.534835.log.gz 2023-10-08T20:13:30.688 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.639523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.937981.log 2023-10-08T20:13:30.688 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.639523.log.gz 2023-10-08T20:13:30.688 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440015.log 2023-10-08T20:13:30.688 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.406336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406336.log.gz 2023-10-08T20:13:30.688 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.937981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117705.log 2023-10-08T20:13:30.689 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.937981.log.gz 2023-10-08T20:13:30.689 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.440015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693485.log 2023-10-08T20:13:30.689 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.440015.log.gz 2023-10-08T20:13:30.689 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693179.log 2023-10-08T20:13:30.689 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.693485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478712.log 2023-10-08T20:13:30.689 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.693485.log.gz 2023-10-08T20:13:30.689 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.693179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.680395.log 2023-10-08T20:13:30.689 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.693179.log.gz 2023-10-08T20:13:30.690 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.478712.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.478712.log.gz/var/log/ceph/ceph-client.admin.679295.log 2023-10-08T20:13:30.690 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-10-08T20:13:30.690 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.680395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.647165.log 2023-10-08T20:13:30.690 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.680395.log.gz 2023-10-08T20:13:30.690 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.679295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291664.log 2023-10-08T20:13:30.690 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.679295.log.gz 2023-10-08T20:13:30.690 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.647165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.811002.log 2023-10-08T20:13:30.690 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.647165.log.gz 2023-10-08T20:13:30.691 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.291664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416835.log 2023-10-08T20:13:30.691 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291664.log.gz 2023-10-08T20:13:30.691 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.811002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259528.log 2023-10-08T20:13:30.691 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.811002.log.gz 2023-10-08T20:13:30.691 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.416835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.830168.log 2023-10-08T20:13:30.691 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.416835.log.gz 2023-10-08T20:13:30.691 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.259528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165756.log 2023-10-08T20:13:30.691 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259528.log.gz 2023-10-08T20:13:30.692 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.830168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194474.log 2023-10-08T20:13:30.692 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.830168.log.gz 2023-10-08T20:13:30.692 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.165756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397347.log 2023-10-08T20:13:30.692 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165756.log.gz 2023-10-08T20:13:30.692 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.194474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.708596.log 2023-10-08T20:13:30.692 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194474.log.gz 2023-10-08T20:13:30.692 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.397347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.810710.log 2023-10-08T20:13:30.692 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.397347.log.gz 2023-10-08T20:13:30.692 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.708596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296836.log 2023-10-08T20:13:30.693 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.708596.log.gz 2023-10-08T20:13:30.693 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.810710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.938545.log 2023-10-08T20:13:30.693 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.810710.log.gz 2023-10-08T20:13:30.693 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.296836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.659010.log 2023-10-08T20:13:30.693 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.296836.log.gz 2023-10-08T20:13:30.693 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.938545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200872.log 2023-10-08T20:13:30.693 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.938545.log.gz 2023-10-08T20:13:30.693 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.659010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205793.log 0.0% 2023-10-08T20:13:30.694 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.659010.log.gz 2023-10-08T20:13:30.694 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.200872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.948401.log 2023-10-08T20:13:30.694 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200872.log.gz 2023-10-08T20:13:30.694 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.205793.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205793.log.gz 2023-10-08T20:13:30.694 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.708673.log 2023-10-08T20:13:30.694 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.948401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.691185.log 2023-10-08T20:13:30.694 INFO:teuthology.orchestra.run.smithi045.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.948401.log.gz 2023-10-08T20:13:30.694 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.708673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.656014.log 2023-10-08T20:13:30.695 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.708673.log.gz 2023-10-08T20:13:30.695 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.691185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296163.log 2023-10-08T20:13:30.695 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.691185.log.gz 2023-10-08T20:13:30.695 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.656014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216111.log 2023-10-08T20:13:30.695 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.656014.log.gz 2023-10-08T20:13:30.695 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.296163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327248.log 2023-10-08T20:13:30.695 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.296163.log.gz 2023-10-08T20:13:30.695 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.216111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699833.log 2023-10-08T20:13:30.696 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216111.log.gz 2023-10-08T20:13:30.696 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.327248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633540.log 2023-10-08T20:13:30.696 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327248.log.gz 2023-10-08T20:13:30.696 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.699833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297616.log 2023-10-08T20:13:30.696 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699833.log.gz 2023-10-08T20:13:30.696 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.633540.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633540.log.gz 2023-10-08T20:13:30.696 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449667.log 2023-10-08T20:13:30.696 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.776190.log 2023-10-08T20:13:30.697 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.297616.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.297616.log.gz 2023-10-08T20:13:30.697 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.449667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279010.log 2023-10-08T20:13:30.697 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.449667.log.gz 2023-10-08T20:13:30.697 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.776190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.786140.log 2023-10-08T20:13:30.697 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.776190.log.gz 2023-10-08T20:13:30.697 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.279010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382275.log 2023-10-08T20:13:30.697 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279010.log.gz 2023-10-08T20:13:30.697 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.786140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373401.log 2023-10-08T20:13:30.698 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.786140.log.gz 2023-10-08T20:13:30.698 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.382275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200319.log 2023-10-08T20:13:30.698 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382275.log.gz 2023-10-08T20:13:30.698 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.373401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324876.log 2023-10-08T20:13:30.698 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.373401.log.gz 2023-10-08T20:13:30.698 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.200319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.704280.log 2023-10-08T20:13:30.698 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200319.log.gz 2023-10-08T20:13:30.698 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.324876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.942816.log 2023-10-08T20:13:30.699 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.324876.log.gz 2023-10-08T20:13:30.699 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.704280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655899.log 2023-10-08T20:13:30.699 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.704280.log.gz 2023-10-08T20:13:30.699 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.942816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297037.log 2023-10-08T20:13:30.699 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.942816.log.gz 2023-10-08T20:13:30.699 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.655899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342416.log 2023-10-08T20:13:30.699 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655899.log.gz 2023-10-08T20:13:30.699 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.297037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257840.log 2023-10-08T20:13:30.700 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.297037.log.gz 2023-10-08T20:13:30.700 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.342416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629783.log 2023-10-08T20:13:30.700 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342416.log.gz 2023-10-08T20:13:30.700 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.257840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.646191.log 2023-10-08T20:13:30.700 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257840.log.gz 2023-10-08T20:13:30.700 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.629783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451233.log 2023-10-08T20:13:30.700 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629783.log.gz 2023-10-08T20:13:30.700 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.646191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115115.log 2023-10-08T20:13:30.701 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.646191.log.gz 2023-10-08T20:13:30.701 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.451233.log: 92.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-08T20:13:30.701 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192244.log 2023-10-08T20:13:30.701 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.451233.log.gz 2023-10-08T20:13:30.701 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396227.log 2023-10-08T20:13:30.701 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.192244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439062.log 2023-10-08T20:13:30.701 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192244.log.gz 2023-10-08T20:13:30.701 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.396227.log: -- /var/log/ceph/ceph-client.admin.407675.log 2023-10-08T20:13:30.702 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.396227.log.gz 2023-10-08T20:13:30.702 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.439062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.809419.log 2023-10-08T20:13:30.702 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.439062.log.gz 2023-10-08T20:13:30.702 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.407675.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407675.log.gz 2023-10-08T20:13:30.702 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264924.log 2023-10-08T20:13:30.702 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.809419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371264.log 2023-10-08T20:13:30.702 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.809419.log.gz 2023-10-08T20:13:30.702 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.264924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.945705.log 2023-10-08T20:13:30.703 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264924.log.gz 2023-10-08T20:13:30.703 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.371264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368015.log 2023-10-08T20:13:30.703 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.371264.log.gz 2023-10-08T20:13:30.703 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.945705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.688001.log 2023-10-08T20:13:30.703 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.945705.log.gz 2023-10-08T20:13:30.703 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.368015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339226.log 2023-10-08T20:13:30.703 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.368015.log.gz 2023-10-08T20:13:30.703 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.688001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.824805.log 2023-10-08T20:13:30.704 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.688001.log.gz 2023-10-08T20:13:30.704 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.339226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.775234.log 2023-10-08T20:13:30.704 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339226.log.gz 2023-10-08T20:13:30.704 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.824805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315626.log 2023-10-08T20:13:30.704 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.824805.log.gz 2023-10-08T20:13:30.704 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.775234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.787092.log 2023-10-08T20:13:30.704 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.775234.log.gz 2023-10-08T20:13:30.704 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.315626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340212.log 2023-10-08T20:13:30.705 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315626.log.gz 2023-10-08T20:13:30.705 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.787092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636127.log 2023-10-08T20:13:30.705 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.787092.log.gz 2023-10-08T20:13:30.705 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223165.log 2023-10-08T20:13:30.705 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.340212.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340212.log.gz 2023-10-08T20:13:30.705 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.636127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334649.log 2023-10-08T20:13:30.705 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636127.log.gz 2023-10-08T20:13:30.705 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.223165.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.223165.log.gz-- 2023-10-08T20:13:30.706 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.367938.log 2023-10-08T20:13:30.706 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.117705.log.gz 2023-10-08T20:13:30.706 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.334649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392119.log 2023-10-08T20:13:30.706 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334649.log.gz 2023-10-08T20:13:30.706 INFO:teuthology.orchestra.run.smithi045.stderr:gzip /var/log/ceph/ceph-client.admin.367938.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.796714.log 2023-10-08T20:13:30.706 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.367938.log.gz 2023-10-08T20:13:30.706 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.392119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450150.log 2023-10-08T20:13:30.706 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.392119.log.gz 2023-10-08T20:13:30.706 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.796714.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314299.log 2023-10-08T20:13:30.707 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.796714.log.gz 2023-10-08T20:13:30.707 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.450150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.819735.log 2023-10-08T20:13:30.707 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.450150.log.gz 2023-10-08T20:13:30.707 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.314299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.810012.log 2023-10-08T20:13:30.709 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.314299.log.gz 2023-10-08T20:13:30.709 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.819735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193028.log 2023-10-08T20:13:30.709 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.819735.log.gz 2023-10-08T20:13:30.709 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.810012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.773373.log 2023-10-08T20:13:30.709 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.810012.log.gz 2023-10-08T20:13:30.709 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.193028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700140.log 2023-10-08T20:13:30.709 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193028.log.gz 2023-10-08T20:13:30.710 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.773373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407584.log 2023-10-08T20:13:30.710 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.773373.log.gz 2023-10-08T20:13:30.710 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.700140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223881.log 2023-10-08T20:13:30.710 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700140.log.gz 2023-10-08T20:13:30.710 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.407584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.947508.log 2023-10-08T20:13:30.710 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407584.log.gz 2023-10-08T20:13:30.710 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.223881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190176.log 2023-10-08T20:13:30.710 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223881.log.gz 2023-10-08T20:13:30.711 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.947508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298735.log 2023-10-08T20:13:30.711 INFO:teuthology.orchestra.run.smithi045.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.947508.log.gz 2023-10-08T20:13:30.711 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.190176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.830634.log 2023-10-08T20:13:30.711 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190176.log.gz 2023-10-08T20:13:30.711 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.298735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.661980.log 2023-10-08T20:13:30.711 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.298735.log.gz 2023-10-08T20:13:30.711 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.830634.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.830634.log.gz 2023-10-08T20:13:30.711 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116414.log 2023-10-08T20:13:30.712 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.661980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.688917.log 2023-10-08T20:13:30.712 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.661980.log.gz 2023-10-08T20:13:30.712 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111820.log 2023-10-08T20:13:30.712 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.688917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272174.log 2023-10-08T20:13:30.712 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.688917.log.gz 2023-10-08T20:13:30.712 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.776898.log 2023-10-08T20:13:30.712 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.272174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637340.log 2023-10-08T20:13:30.712 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272174.log.gz 2023-10-08T20:13:30.713 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.776898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308381.log 2023-10-08T20:13:30.713 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.776898.log.gz 2023-10-08T20:13:30.713 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.637340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391748.log 2023-10-08T20:13:30.713 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637340.log.gz 2023-10-08T20:13:30.713 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.308381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.708687.log 2023-10-08T20:13:30.713 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308381.log.gz 2023-10-08T20:13:30.713 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.391748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.806745.log 2023-10-08T20:13:30.713 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.391748.log.gz 2023-10-08T20:13:30.714 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.708687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.827247.log 2023-10-08T20:13:30.714 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.708687.log.gz 2023-10-08T20:13:30.714 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.806745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621006.log 2023-10-08T20:13:30.714 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.806745.log.gz 2023-10-08T20:13:30.714 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.827247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405685.log 2023-10-08T20:13:30.714 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.827247.log.gz 2023-10-08T20:13:30.714 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.621006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.831162.log 2023-10-08T20:13:30.714 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621006.log.gz 2023-10-08T20:13:30.715 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.405685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449431.log 2023-10-08T20:13:30.715 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.405685.log.gz 2023-10-08T20:13:30.715 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.831162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695083.log 2023-10-08T20:13:30.715 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.831162.log.gz 2023-10-08T20:13:30.715 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.449431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.680303.log 2023-10-08T20:13:30.715 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.449431.log.gz 2023-10-08T20:13:30.715 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.695083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281640.log 2023-10-08T20:13:30.715 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695083.log.gz 2023-10-08T20:13:30.715 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.680303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117061.log 2023-10-08T20:13:30.716 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.680303.log.gz 2023-10-08T20:13:30.716 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.281640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.703729.log 2023-10-08T20:13:30.716 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281640.log.gz 2023-10-08T20:13:30.716 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.659937.log 2023-10-08T20:13:30.716 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.703729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.710752.log 2023-10-08T20:13:30.716 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703729.log.gz 2023-10-08T20:13:30.716 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.659937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.659937.log.gz 2023-10-08T20:13:30.716 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329564.log 2023-10-08T20:13:30.717 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.710752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356831.log 2023-10-08T20:13:30.717 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.710752.log.gz 2023-10-08T20:13:30.717 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.329564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474288.log 2023-10-08T20:13:30.717 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329564.log.gz 2023-10-08T20:13:30.717 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.356831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366564.log 2023-10-08T20:13:30.717 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356831.log.gz 2023-10-08T20:13:30.717 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.474288.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.474288.log.gz-- 2023-10-08T20:13:30.717 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.343456.log 2023-10-08T20:13:30.718 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.366564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.690341.log 2023-10-08T20:13:30.718 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.366564.log.gz 2023-10-08T20:13:30.718 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.343456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.638397.log 2023-10-08T20:13:30.718 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343456.log.gz 2023-10-08T20:13:30.718 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.690341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.690341.log.gz 2023-10-08T20:13:30.718 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389833.log 2023-10-08T20:13:30.718 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.638397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392653.log 2023-10-08T20:13:30.718 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.638397.log.gz 2023-10-08T20:13:30.719 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.389833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.820630.log 2023-10-08T20:13:30.719 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.389833.log.gz 2023-10-08T20:13:30.719 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.392653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.832130.log 2023-10-08T20:13:30.719 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.392653.log.gz 2023-10-08T20:13:30.719 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.820630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242423.log 2023-10-08T20:13:30.719 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.820630.log.gz 2023-10-08T20:13:30.719 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.832130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251212.log 2023-10-08T20:13:30.719 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.832130.log.gz 2023-10-08T20:13:30.719 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.242423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.639820.log 2023-10-08T20:13:30.720 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242423.log.gz 2023-10-08T20:13:30.720 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.251212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.781852.log 2023-10-08T20:13:30.720 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251212.log.gz 2023-10-08T20:13:30.720 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.639820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285062.log 2023-10-08T20:13:30.720 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.639820.log.gz 2023-10-08T20:13:30.720 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.781852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294853.log 2023-10-08T20:13:30.720 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.781852.log.gz 2023-10-08T20:13:30.720 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.285062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293562.log 2023-10-08T20:13:30.721 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285062.log.gz 2023-10-08T20:13:30.721 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.294853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437679.log 2023-10-08T20:13:30.721 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294853.log.gz 2023-10-08T20:13:30.721 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.293562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.947125.log 2023-10-08T20:13:30.721 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293562.log.gz 2023-10-08T20:13:30.721 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.437679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.627229.log 2023-10-08T20:13:30.721 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.437679.log.gz 2023-10-08T20:13:30.721 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.947125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.789291.log 2023-10-08T20:13:30.722 INFO:teuthology.orchestra.run.smithi045.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.947125.log.gz 2023-10-08T20:13:30.722 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.627229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253863.log 2023-10-08T20:13:30.722 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.627229.log.gz 2023-10-08T20:13:30.722 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.789291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334859.log 2023-10-08T20:13:30.722 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.789291.log.gz 2023-10-08T20:13:30.722 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.253863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.812734.log 2023-10-08T20:13:30.722 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253863.log.gz 2023-10-08T20:13:30.722 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440967.log 2023-10-08T20:13:30.723 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.334859.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334859.log.gz 2023-10-08T20:13:30.723 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.812734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.656244.log 2023-10-08T20:13:30.723 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.812734.log.gz 2023-10-08T20:13:30.723 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.440967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.702697.log 2023-10-08T20:13:30.723 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.440967.log.gz 2023-10-08T20:13:30.723 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.656244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112161.log 2023-10-08T20:13:30.723 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.656244.log.gz 2023-10-08T20:13:30.723 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.702697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.820707.log 2023-10-08T20:13:30.724 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702697.log.gz 2023-10-08T20:13:30.724 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377798.log 2023-10-08T20:13:30.724 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.820707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451247.log 2023-10-08T20:13:30.724 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.820707.log.gz 2023-10-08T20:13:30.724 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.377798.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.377798.log.gzgzip 2023-10-08T20:13:30.724 INFO:teuthology.orchestra.run.smithi045.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.166226.log 2023-10-08T20:13:30.724 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.451247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394064.log 2023-10-08T20:13:30.725 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.451247.log.gz 2023-10-08T20:13:30.725 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.166226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386648.log 2023-10-08T20:13:30.725 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166226.log.gz 2023-10-08T20:13:30.725 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.394064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341928.log 2023-10-08T20:13:30.725 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394064.log.gz 2023-10-08T20:13:30.725 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.386648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215643.log 2023-10-08T20:13:30.725 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.386648.log.gz 2023-10-08T20:13:30.725 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.341928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117843.log 2023-10-08T20:13:30.726 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341928.log.gz 2023-10-08T20:13:30.726 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.215643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.647179.log 2023-10-08T20:13:30.726 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.215643.log.gz 2023-10-08T20:13:30.726 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286728.log 2023-10-08T20:13:30.726 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.647179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.945226.log 2023-10-08T20:13:30.726 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.647179.log.gz 2023-10-08T20:13:30.726 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.286728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.944235.log 2023-10-08T20:13:30.726 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286728.log.gz 2023-10-08T20:13:30.727 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.945226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285548.log 2023-10-08T20:13:30.727 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.945226.log.gz 2023-10-08T20:13:30.727 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.944235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363751.log 2023-10-08T20:13:30.727 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.944235.log.gz 2023-10-08T20:13:30.727 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.285548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632111.log 2023-10-08T20:13:30.727 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285548.log.gz 2023-10-08T20:13:30.727 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.363751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253568.log 2023-10-08T20:13:30.727 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.363751.log.gz 2023-10-08T20:13:30.728 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.632111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312612.log 2023-10-08T20:13:30.728 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632111.log.gz 2023-10-08T20:13:30.728 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.253568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316422.log 2023-10-08T20:13:30.728 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253568.log.gz 2023-10-08T20:13:30.728 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 /var/log/ceph/ceph-client.admin.312612.log: --verbose -- /var/log/ceph/ceph-client.admin.395675.log 2023-10-08T20:13:30.728 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312612.log.gz 2023-10-08T20:13:30.728 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.316422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.781929.log 2023-10-08T20:13:30.728 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316422.log.gz 2023-10-08T20:13:30.729 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.115115.log.gz 2023-10-08T20:13:30.729 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.395675.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.395675.log.gz--verbose 2023-10-08T20:13:30.729 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.400300.log 2023-10-08T20:13:30.729 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.781929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.671765.log 2023-10-08T20:13:30.729 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.781929.log.gz 2023-10-08T20:13:30.729 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.400300.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.400300.log.gz 2023-10-08T20:13:30.729 INFO:teuthology.orchestra.run.smithi045.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.706002.log 2023-10-08T20:13:30.729 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.671765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340121.log 2023-10-08T20:13:30.730 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.671765.log.gz 2023-10-08T20:13:30.730 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.706002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339922.log 2023-10-08T20:13:30.730 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.706002.log.gz 2023-10-08T20:13:30.730 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.340121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.662461.log 2023-10-08T20:13:30.730 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340121.log.gz 2023-10-08T20:13:30.730 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.339922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373068.log 2023-10-08T20:13:30.730 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339922.log.gz 2023-10-08T20:13:30.730 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.662461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346688.log 2023-10-08T20:13:30.731 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.662461.log.gz 2023-10-08T20:13:30.731 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.373068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363540.log 2023-10-08T20:13:30.731 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.373068.log.gz 2023-10-08T20:13:30.731 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.346688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.822013.log 2023-10-08T20:13:30.731 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346688.log.gz 2023-10-08T20:13:30.731 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.363540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402768.log 2023-10-08T20:13:30.731 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.363540.log.gz 2023-10-08T20:13:30.731 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.822013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.701836.log 2023-10-08T20:13:30.732 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.822013.log.gz 2023-10-08T20:13:30.732 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.402768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.698227.log 2023-10-08T20:13:30.732 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.402768.log.gz 2023-10-08T20:13:30.732 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.701836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224679.log 2023-10-08T20:13:30.732 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.701836.log.gz 2023-10-08T20:13:30.732 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.698227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189636.log 2023-10-08T20:13:30.732 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.698227.log.gz 2023-10-08T20:13:30.732 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.224679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473082.log 2023-10-08T20:13:30.732 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224679.log.gz 2023-10-08T20:13:30.733 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.189636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257322.log 2023-10-08T20:13:30.733 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189636.log.gz 2023-10-08T20:13:30.733 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.473082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208226.log 2023-10-08T20:13:30.733 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.473082.log.gz 2023-10-08T20:13:30.733 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.257322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337333.log 2023-10-08T20:13:30.733 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257322.log.gz 2023-10-08T20:13:30.733 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.208226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685841.log 2023-10-08T20:13:30.733 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208226.log.gz 2023-10-08T20:13:30.734 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.337333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.948769.log 2023-10-08T20:13:30.734 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337333.log.gz 2023-10-08T20:13:30.734 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.685841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163167.log 2023-10-08T20:13:30.734 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685841.log.gz 2023-10-08T20:13:30.734 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.948769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340623.log 2023-10-08T20:13:30.734 INFO:teuthology.orchestra.run.smithi045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.948769.log.gz 2023-10-08T20:13:30.734 INFO:teuthology.orchestra.run.smithi045.stderr:gzip /var/log/ceph/ceph-client.admin.163167.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.156947.log 2023-10-08T20:13:30.734 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163167.log.gz 2023-10-08T20:13:30.735 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.340623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478128.log 2023-10-08T20:13:30.735 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340623.log.gz 2023-10-08T20:13:30.735 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.156947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340700.log 2023-10-08T20:13:30.735 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156947.log.gz 2023-10-08T20:13:30.735 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.478128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359446.log 2023-10-08T20:13:30.735 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.478128.log.gz 2023-10-08T20:13:30.735 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387446.log 2023-10-08T20:13:30.735 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.340700.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340700.log.gz 2023-10-08T20:13:30.736 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.359446.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.359446.log.gz--verbose 2023-10-08T20:13:30.736 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.818115.log 2023-10-08T20:13:30.736 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282340.log 2023-10-08T20:13:30.736 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.387446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.387446.log.gz 2023-10-08T20:13:30.736 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.818115.log: -- /var/log/ceph/ceph-client.admin.815034.log 2023-10-08T20:13:30.736 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.818115.log.gz 2023-10-08T20:13:30.736 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.282340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112810.log 2023-10-08T20:13:30.737 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282340.log.gz 2023-10-08T20:13:30.737 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.815034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.815034.log.gz 2023-10-08T20:13:30.737 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.823375.log 2023-10-08T20:13:30.737 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157510.log 2023-10-08T20:13:30.737 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.823375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282052.log 2023-10-08T20:13:30.737 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.823375.log.gz 2023-10-08T20:13:30.737 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.157510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376547.log 2023-10-08T20:13:30.737 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157510.log.gz 2023-10-08T20:13:30.738 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.282052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322941.log 2023-10-08T20:13:30.738 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282052.log.gz 2023-10-08T20:13:30.738 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.376547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.770883.log 2023-10-08T20:13:30.738 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.376547.log.gz 2023-10-08T20:13:30.738 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.322941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.819721.log 2023-10-08T20:13:30.738 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322941.log.gz 2023-10-08T20:13:30.738 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.770883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695941.log 2023-10-08T20:13:30.738 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.770883.log.gz 2023-10-08T20:13:30.739 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.819721.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.819721.log.gz--verbose 2023-10-08T20:13:30.739 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.770897.log 2023-10-08T20:13:30.739 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.695941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.684613.log 2023-10-08T20:13:30.739 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695941.log.gz 2023-10-08T20:13:30.739 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.770897.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.770897.log.gz-5 2023-10-08T20:13:30.739 INFO:teuthology.orchestra.run.smithi045.stderr:--verbose -- /var/log/ceph/ceph-client.admin.833065.log 2023-10-08T20:13:30.739 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.684613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.946110.log 2023-10-08T20:13:30.739 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.684613.log.gz 2023-10-08T20:13:30.740 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.833065.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.833065.log.gz 2023-10-08T20:13:30.740 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115530.log 2023-10-08T20:13:30.740 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.946110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439924.log 2023-10-08T20:13:30.740 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.946110.log.gz 2023-10-08T20:13:30.740 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.686074.log 2023-10-08T20:13:30.740 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.439924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.943198.log 2023-10-08T20:13:30.740 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.439924.log.gz 2023-10-08T20:13:30.740 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.686074.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.686074.log.gz--verbose 2023-10-08T20:13:30.741 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.207204.log 2023-10-08T20:13:30.741 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.943198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362020.log 2023-10-08T20:13:30.741 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.943198.log.gz 2023-10-08T20:13:30.741 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.207204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116230.log 2023-10-08T20:13:30.741 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207204.log.gz 2023-10-08T20:13:30.741 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242880.log 2023-10-08T20:13:30.741 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.362020.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.362020.log.gz 2023-10-08T20:13:30.741 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439537.log 2023-10-08T20:13:30.741 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.242880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295871.log 2023-10-08T20:13:30.742 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242880.log.gz 2023-10-08T20:13:30.742 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.439537.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.439537.log.gz 2023-10-08T20:13:30.742 INFO:teuthology.orchestra.run.smithi045.stderr:--verbose -- /var/log/ceph/ceph-client.admin.376861.log 2023-10-08T20:13:30.742 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.295871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291573.log 2023-10-08T20:13:30.742 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.295871.log.gz 2023-10-08T20:13:30.742 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.376861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115161.log 2023-10-08T20:13:30.742 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.376861.log.gz 2023-10-08T20:13:30.742 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.291573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.939491.log 2023-10-08T20:13:30.743 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291573.log.gz 2023-10-08T20:13:30.743 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475988.log 2023-10-08T20:13:30.743 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.939491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355818.log 2023-10-08T20:13:30.743 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.939491.log.gz 2023-10-08T20:13:30.743 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.475988.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.475988.log.gz-5 2023-10-08T20:13:30.743 INFO:teuthology.orchestra.run.smithi045.stderr:--verbose -- /var/log/ceph/ceph-client.admin.305268.log 2023-10-08T20:13:30.743 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.355818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693193.log 2023-10-08T20:13:30.743 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355818.log.gz 2023-10-08T20:13:30.744 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.305268.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305268.log.gzgzip 2023-10-08T20:13:30.744 INFO:teuthology.orchestra.run.smithi045.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.638306.log 2023-10-08T20:13:30.744 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.693193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278739.log 2023-10-08T20:13:30.744 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.693193.log.gz 2023-10-08T20:13:30.744 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.638306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.638306.log.gz 2023-10-08T20:13:30.744 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263946.log 2023-10-08T20:13:30.744 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.278739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194186.log 2023-10-08T20:13:30.744 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278739.log.gz 2023-10-08T20:13:30.745 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.263946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263946.log.gz 2023-10-08T20:13:30.745 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247526.log 2023-10-08T20:13:30.745 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477732.log 2023-10-08T20:13:30.745 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.194186.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194186.log.gz 2023-10-08T20:13:30.745 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.247526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247526.log.gz 2023-10-08T20:13:30.745 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390366.log 2023-10-08T20:13:30.745 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222564.log 2023-10-08T20:13:30.746 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.477732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.477732.log.gz 2023-10-08T20:13:30.746 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.390366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633098.log 2023-10-08T20:13:30.746 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.390366.log.gz 2023-10-08T20:13:30.746 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.222564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339637.log 2023-10-08T20:13:30.746 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222564.log.gz 2023-10-08T20:13:30.746 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.633098.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633098.log.gz 2023-10-08T20:13:30.746 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449758.log 2023-10-08T20:13:30.746 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.339637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117889.log 2023-10-08T20:13:30.747 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339637.log.gz 2023-10-08T20:13:30.747 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.449758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.640772.log 2023-10-08T20:13:30.747 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.449758.log.gz 2023-10-08T20:13:30.747 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203468.log 2023-10-08T20:13:30.747 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.640772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344173.log 2023-10-08T20:13:30.747 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.640772.log.gz 2023-10-08T20:13:30.747 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.203468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408635.log 2023-10-08T20:13:30.748 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.203468.log.gz 2023-10-08T20:13:30.748 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.344173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.646969.log 2023-10-08T20:13:30.748 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344173.log.gz 2023-10-08T20:13:30.748 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.408635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.786803.log 2023-10-08T20:13:30.748 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408635.log.gz 2023-10-08T20:13:30.748 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.646969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.646969.log.gz 2023-10-08T20:13:30.748 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243363.log 2023-10-08T20:13:30.748 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.786803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297324.log 2023-10-08T20:13:30.748 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.786803.log.gz 2023-10-08T20:13:30.749 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.243363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374853.log 2023-10-08T20:13:30.749 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243363.log.gz 2023-10-08T20:13:30.749 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.297324.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.297324.log.gz--verbose 2023-10-08T20:13:30.749 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.699847.log 2023-10-08T20:13:30.749 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.374853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196389.log 2023-10-08T20:13:30.749 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.374853.log.gz 2023-10-08T20:13:30.749 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.699847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346396.log 2023-10-08T20:13:30.749 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699847.log.gz 2023-10-08T20:13:30.750 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.196389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396566.log 2023-10-08T20:13:30.750 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196389.log.gz 2023-10-08T20:13:30.750 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.346396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346396.log.gz 2023-10-08T20:13:30.750 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295355.log 2023-10-08T20:13:30.750 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.396566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.790541.log 2023-10-08T20:13:30.750 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.396566.log.gz 2023-10-08T20:13:30.750 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.295355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110849.log 2023-10-08T20:13:30.751 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.295355.log.gz 2023-10-08T20:13:30.751 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.790541.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.790541.log.gz-5 2023-10-08T20:13:30.751 INFO:teuthology.orchestra.run.smithi045.stderr:--verbose -- /var/log/ceph/ceph-client.admin.112554.log 2023-10-08T20:13:30.751 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243737.log 2023-10-08T20:13:30.751 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.639743.log 2023-10-08T20:13:30.751 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.243737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438041.log 2023-10-08T20:13:30.751 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243737.log.gz 2023-10-08T20:13:30.751 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.639743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396178.log 2023-10-08T20:13:30.751 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.639743.log.gz 2023-10-08T20:13:30.752 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.438041.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.438041.log.gzgzip 2023-10-08T20:13:30.752 INFO:teuthology.orchestra.run.smithi045.stderr:-5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-08T20:13:30.752 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.396178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405203.log 2023-10-08T20:13:30.752 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.396178.log.gz 2023-10-08T20:13:30.752 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245758.log 2023-10-08T20:13:30.752 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.405203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334845.log 2023-10-08T20:13:30.752 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.405203.log.gz 2023-10-08T20:13:30.753 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.245758.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.245758.log.gz--verbose 2023-10-08T20:13:30.753 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.303608.log 2023-10-08T20:13:30.753 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.334845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367477.log 2023-10-08T20:13:30.753 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334845.log.gz 2023-10-08T20:13:30.753 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.303608.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.303608.log.gz--verbose 2023-10-08T20:13:30.753 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.205807.log 2023-10-08T20:13:30.753 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.367477.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.116414.log.gz 2023-10-08T20:13:30.754 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.367477.log.gz 2023-10-08T20:13:30.754 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.826189.log 2023-10-08T20:13:30.754 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.205807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397639.log 2023-10-08T20:13:30.754 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205807.log.gz 2023-10-08T20:13:30.754 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.826189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208780.log 2023-10-08T20:13:30.754 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.826189.log.gz 2023-10-08T20:13:30.754 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.397639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.787976.log 2023-10-08T20:13:30.755 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.397639.log.gz 2023-10-08T20:13:30.755 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.208780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307820.log 2023-10-08T20:13:30.755 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208780.log.gz 2023-10-08T20:13:30.755 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.787976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.662159.log 2023-10-08T20:13:30.755 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.787976.log.gz 2023-10-08T20:13:30.755 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.307820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223179.log 2023-10-08T20:13:30.755 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307820.log.gz 2023-10-08T20:13:30.756 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.662159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244031.log 2023-10-08T20:13:30.756 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.662159.log.gz 2023-10-08T20:13:30.756 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.223179.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.223179.log.gz-5 2023-10-08T20:13:30.756 INFO:teuthology.orchestra.run.smithi045.stderr:--verbose -- /var/log/ceph/ceph-client.admin.832777.log 2023-10-08T20:13:30.756 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.244031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.673061.log 2023-10-08T20:13:30.756 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244031.log.gz 2023-10-08T20:13:30.756 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.832777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.832777.log.gz 2023-10-08T20:13:30.757 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338667.log 2023-10-08T20:13:30.757 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.673061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400391.log 2023-10-08T20:13:30.757 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.673061.log.gz 2023-10-08T20:13:30.757 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.338667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338667.log.gz 2023-10-08T20:13:30.757 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264428.log 2023-10-08T20:13:30.757 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.400391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117521.log 2023-10-08T20:13:30.757 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.400391.log.gz 2023-10-08T20:13:30.757 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.264428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629797.log 2023-10-08T20:13:30.758 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264428.log.gz 2023-10-08T20:13:30.758 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331486.log 2023-10-08T20:13:30.758 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.629797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206818.log 2023-10-08T20:13:30.758 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629797.log.gz 2023-10-08T20:13:30.758 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.331486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.827472.log 2023-10-08T20:13:30.758 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331486.log.gz 2023-10-08T20:13:30.758 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.206818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.782477.log 2023-10-08T20:13:30.758 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206818.log.gz 2023-10-08T20:13:30.759 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.827472.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.827472.log.gz 2023-10-08T20:13:30.759 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413070.log 2023-10-08T20:13:30.759 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.782477.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.782477.log.gz--verbose 2023-10-08T20:13:30.759 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.288246.log 2023-10-08T20:13:30.759 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.413070.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.413070.log.gz-5 2023-10-08T20:13:30.759 INFO:teuthology.orchestra.run.smithi045.stderr:--verbose -- /var/log/ceph/ceph-client.admin.368920.log 2023-10-08T20:13:30.759 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.288246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294351.log 2023-10-08T20:13:30.759 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288246.log.gz 2023-10-08T20:13:30.760 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.368920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297630.log 2023-10-08T20:13:30.760 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.368920.log.gz 2023-10-08T20:13:30.760 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.294351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.705988.log 2023-10-08T20:13:30.760 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294351.log.gz 2023-10-08T20:13:30.760 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.297630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.781943.log 2023-10-08T20:13:30.760 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.297630.log.gz 2023-10-08T20:13:30.760 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.705988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328061.log 2023-10-08T20:13:30.760 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.705988.log.gz 2023-10-08T20:13:30.761 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.781943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.656175.log 2023-10-08T20:13:30.761 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.781943.log.gz 2023-10-08T20:13:30.761 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.328061.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.328061.log.gz-5 2023-10-08T20:13:30.761 INFO:teuthology.orchestra.run.smithi045.stderr:--verbose -- /var/log/ceph/ceph-client.admin.388423.log 2023-10-08T20:13:30.761 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.656175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334099.log 2023-10-08T20:13:30.761 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.656175.log.gz 2023-10-08T20:13:30.761 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.388423.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.388423.log.gzgzip 2023-10-08T20:13:30.762 INFO:teuthology.orchestra.run.smithi045.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.192258.log 2023-10-08T20:13:30.762 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.334099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.938454.log 2023-10-08T20:13:30.762 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334099.log.gz 2023-10-08T20:13:30.762 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.192258.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192258.log.gz 2023-10-08T20:13:30.762 INFO:teuthology.orchestra.run.smithi045.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.111820.log.gz 2023-10-08T20:13:30.762 INFO:teuthology.orchestra.run.smithi045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.117061.log.gz 2023-10-08T20:13:30.762 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.938454.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.112161.log.gz 2023-10-08T20:13:30.762 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.938454.log.gz 2023-10-08T20:13:30.763 INFO:teuthology.orchestra.run.smithi045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.112810.log.gz 2023-10-08T20:13:30.763 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.117843.log.gz 2023-10-08T20:13:30.763 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157973.log 2023-10-08T20:13:30.763 INFO:teuthology.orchestra.run.smithi045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.115530.log.gz 2023-10-08T20:13:30.763 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116230.log.gz 2023-10-08T20:13:30.763 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.805755.log 2023-10-08T20:13:30.763 INFO:teuthology.orchestra.run.smithi045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.115161.log.gz 2023-10-08T20:13:30.763 INFO:teuthology.orchestra.run.smithi045.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.117889.log.gz 2023-10-08T20:13:30.764 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.157973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.647977.log 2023-10-08T20:13:30.764 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157973.log.gz 2023-10-08T20:13:30.764 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.112554.log.gz 2023-10-08T20:13:30.764 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.805755.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.110849.log.gz 2023-10-08T20:13:30.764 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.805755.log.gz 2023-10-08T20:13:30.764 INFO:teuthology.orchestra.run.smithi045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.117521.log.gz 2023-10-08T20:13:30.764 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.647977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216125.log 2023-10-08T20:13:30.764 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.647977.log.gz 2023-10-08T20:13:30.765 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191104.log 2023-10-08T20:13:30.765 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.216125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381290.log 2023-10-08T20:13:30.765 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216125.log.gz 2023-10-08T20:13:30.765 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.191104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.684627.log 2023-10-08T20:13:30.765 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191104.log.gz 2023-10-08T20:13:30.765 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.381290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348371.log 2023-10-08T20:13:30.765 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381290.log.gz 2023-10-08T20:13:30.765 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.684627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.811226.log 2023-10-08T20:13:30.766 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.684627.log.gz 2023-10-08T20:13:30.766 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.348371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120426.log 2023-10-08T20:13:30.766 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348371.log.gz 2023-10-08T20:13:30.766 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.811226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364254.log 2023-10-08T20:13:30.766 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.811226.log.gz 2023-10-08T20:13:30.766 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.120426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355909.log 2023-10-08T20:13:30.766 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211074.log 2023-10-08T20:13:30.766 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.364254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.364254.log.gz 2023-10-08T20:13:30.767 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.355909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636613.log 2023-10-08T20:13:30.767 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355909.log.gz 2023-10-08T20:13:30.767 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.211074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.822104.log 2023-10-08T20:13:30.767 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211074.log.gz 2023-10-08T20:13:30.767 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.636613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177377.log 2023-10-08T20:13:30.767 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636613.log.gz 2023-10-08T20:13:30.767 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.822104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399940.log 2023-10-08T20:13:30.767 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.822104.log.gz 2023-10-08T20:13:30.768 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.819179.log 2023-10-08T20:13:30.768 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.177377.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177377.log.gz 2023-10-08T20:13:30.768 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.399940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320836.log 2023-10-08T20:13:30.768 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.399940.log.gz 2023-10-08T20:13:30.768 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.819179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161471.log 2023-10-08T20:13:30.768 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.819179.log.gz 2023-10-08T20:13:30.768 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301153.log 2023-10-08T20:13:30.768 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.320836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320836.log.gz 2023-10-08T20:13:30.769 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.161471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350758.log 2023-10-08T20:13:30.769 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161471.log.gz 2023-10-08T20:13:30.769 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.301153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634967.log 2023-10-08T20:13:30.769 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301153.log.gz 2023-10-08T20:13:30.769 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.622171.log 2023-10-08T20:13:30.769 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.350758.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350758.log.gz 2023-10-08T20:13:30.769 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.634967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328353.log 2023-10-08T20:13:30.769 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634967.log.gz 2023-10-08T20:13:30.770 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.622171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341125.log 2023-10-08T20:13:30.770 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.622171.log.gz 2023-10-08T20:13:30.770 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.328353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343972.log 2023-10-08T20:13:30.770 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328353.log.gz 2023-10-08T20:13:30.770 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476923.log 2023-10-08T20:13:30.770 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.341125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341125.log.gz 2023-10-08T20:13:30.770 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.343972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.812007.log 2023-10-08T20:13:30.770 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343972.log.gz 2023-10-08T20:13:30.771 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.476923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.689819.log 2023-10-08T20:13:30.771 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.476923.log.gz 2023-10-08T20:13:30.771 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365039.log 2023-10-08T20:13:30.771 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.812007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.812007.log.gz 2023-10-08T20:13:30.771 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.689819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295369.log 2023-10-08T20:13:30.771 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.689819.log.gz 2023-10-08T20:13:30.771 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.365039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621897.log 2023-10-08T20:13:30.771 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.365039.log.gz 2023-10-08T20:13:30.772 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244813.log 2023-10-08T20:13:30.772 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.295369.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.295369.log.gz 2023-10-08T20:13:30.772 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.621897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.689833.log 2023-10-08T20:13:30.772 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621897.log.gz 2023-10-08T20:13:30.772 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.244813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174216.log 2023-10-08T20:13:30.772 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244813.log.gz 2023-10-08T20:13:30.772 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174133.log 2023-10-08T20:13:30.772 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.689833.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.689833.log.gz 2023-10-08T20:13:30.773 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.174216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244736.log 2023-10-08T20:13:30.773 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174216.log.gz 2023-10-08T20:13:30.773 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.174133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316408.log 2023-10-08T20:13:30.773 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174133.log.gz 2023-10-08T20:13:30.773 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327837.log 2023-10-08T20:13:30.773 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.244736.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244736.log.gz 2023-10-08T20:13:30.773 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.316408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.638383.log 2023-10-08T20:13:30.773 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316408.log.gz 2023-10-08T20:13:30.774 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.327837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172025.log 2023-10-08T20:13:30.774 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327837.log.gz 2023-10-08T20:13:30.774 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.815445.log 2023-10-08T20:13:30.774 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.638383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.638383.log.gz 2023-10-08T20:13:30.774 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.172025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387150.log 2023-10-08T20:13:30.774 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172025.log.gz 2023-10-08T20:13:30.774 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.815445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288036.log 2023-10-08T20:13:30.774 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.815445.log.gz 2023-10-08T20:13:30.775 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336319.log 2023-10-08T20:13:30.775 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.387150.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.387150.log.gz 2023-10-08T20:13:30.775 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.288036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118723.log 2023-10-08T20:13:30.775 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288036.log.gz 2023-10-08T20:13:30.775 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.336319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.675023.log 2023-10-08T20:13:30.775 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336319.log.gz 2023-10-08T20:13:30.775 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.118723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.645187.log 2023-10-08T20:13:30.776 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.675023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418394.log 2023-10-08T20:13:30.776 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.675023.log.gz 2023-10-08T20:13:30.776 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.645187.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.645187.log.gz 2023-10-08T20:13:30.776 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.776113.log 2023-10-08T20:13:30.776 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272643.log 2023-10-08T20:13:30.776 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.418394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.418394.log.gz 2023-10-08T20:13:30.776 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.776113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.819644.log 2023-10-08T20:13:30.776 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.776113.log.gz 2023-10-08T20:13:30.777 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.272643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330838.log 2023-10-08T20:13:30.777 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272643.log.gz 2023-10-08T20:13:30.777 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269282.log 2023-10-08T20:13:30.777 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.819644.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.819644.log.gz 2023-10-08T20:13:30.777 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.330838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329861.log 2023-10-08T20:13:30.777 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330838.log.gz 2023-10-08T20:13:30.777 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.269282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104315.log 2023-10-08T20:13:30.777 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269282.log.gz 2023-10-08T20:13:30.778 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344250.log 2023-10-08T20:13:30.778 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.329861.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329861.log.gz 2023-10-08T20:13:30.778 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.947838.log 2023-10-08T20:13:30.778 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.344250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398792.log 2023-10-08T20:13:30.778 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344250.log.gz 2023-10-08T20:13:30.778 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.947838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.947792.log 2023-10-08T20:13:30.778 INFO:teuthology.orchestra.run.smithi045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.947838.log.gz 2023-10-08T20:13:30.779 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.398792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317271.log 2023-10-08T20:13:30.779 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.398792.log.gz 2023-10-08T20:13:30.779 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.947792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.627243.log 2023-10-08T20:13:30.779 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.947792.log.gz 2023-10-08T20:13:30.779 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.317271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.788387.log 2023-10-08T20:13:30.779 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317271.log.gz 2023-10-08T20:13:30.779 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.627243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.683343.log 2023-10-08T20:13:30.779 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.627243.log.gz 2023-10-08T20:13:30.780 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.788387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355433.log 2023-10-08T20:13:30.780 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.788387.log.gz 2023-10-08T20:13:30.780 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.683343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265335.log 2023-10-08T20:13:30.780 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.683343.log.gz 2023-10-08T20:13:30.780 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.814728.log 2023-10-08T20:13:30.780 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.355433.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355433.log.gz 2023-10-08T20:13:30.780 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.265335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287521.log 2023-10-08T20:13:30.780 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265335.log.gz 2023-10-08T20:13:30.781 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.814728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104414.log 2023-10-08T20:13:30.781 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.814728.log.gz 2023-10-08T20:13:30.781 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.813222.log 2023-10-08T20:13:30.781 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.287521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287521.log.gz 2023-10-08T20:13:30.781 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412689.log 2023-10-08T20:13:30.781 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.813222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700517.log 2023-10-08T20:13:30.781 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.813222.log.gz 2023-10-08T20:13:30.781 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.412689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338744.log 2023-10-08T20:13:30.782 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412689.log.gz 2023-10-08T20:13:30.782 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159583.log 2023-10-08T20:13:30.782 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.700517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700517.log.gz 2023-10-08T20:13:30.782 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.338744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224220.log 2023-10-08T20:13:30.782 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338744.log.gz 2023-10-08T20:13:30.782 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.159583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176960.log 2023-10-08T20:13:30.782 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159583.log.gz 2023-10-08T20:13:30.782 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193978.log 2023-10-08T20:13:30.783 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.224220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224220.log.gz 2023-10-08T20:13:30.783 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.176960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158530.log 2023-10-08T20:13:30.783 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176960.log.gz 2023-10-08T20:13:30.783 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.193978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.810208.log 2023-10-08T20:13:30.783 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193978.log.gz 2023-10-08T20:13:30.783 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111814.log 2023-10-08T20:13:30.783 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.158530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158530.log.gz 2023-10-08T20:13:30.783 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.810208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.707236.log 2023-10-08T20:13:30.784 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.810208.log.gz 2023-10-08T20:13:30.784 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.783504.log 2023-10-08T20:13:30.784 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636839.log 2023-10-08T20:13:30.784 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.707236.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.707236.log.gz 2023-10-08T20:13:30.784 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.783504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340198.log 2023-10-08T20:13:30.784 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.783504.log.gz 2023-10-08T20:13:30.784 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.120426.log.gz 2023-10-08T20:13:30.784 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.636839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350271.log 2023-10-08T20:13:30.785 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636839.log.gz 2023-10-08T20:13:30.785 INFO:teuthology.orchestra.run.smithi045.stderr:gzip /var/log/ceph/ceph-client.admin.340198.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.670460.log 2023-10-08T20:13:30.785 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340198.log.gz 2023-10-08T20:13:30.785 INFO:teuthology.orchestra.run.smithi045.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.104315.log.gz 2023-10-08T20:13:30.785 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.350271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404238.log 2023-10-08T20:13:30.785 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350271.log.gz 2023-10-08T20:13:30.785 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118723.log.gz 2023-10-08T20:13:30.785 INFO:teuthology.orchestra.run.smithi045.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.104414.log.gz 2023-10-08T20:13:30.786 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.670460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403745.log 2023-10-08T20:13:30.786 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.670460.log.gz 2023-10-08T20:13:30.786 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.111814.log.gz 2023-10-08T20:13:30.786 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.404238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.659189.log 2023-10-08T20:13:30.786 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.404238.log.gz 2023-10-08T20:13:30.786 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.403745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404252.log 2023-10-08T20:13:30.786 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.403745.log.gz 2023-10-08T20:13:30.786 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.659189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116276.log 2023-10-08T20:13:30.787 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.659189.log.gz 2023-10-08T20:13:30.787 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.816449.log 2023-10-08T20:13:30.787 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.404252.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.404252.log.gz 2023-10-08T20:13:30.787 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335366.log 2023-10-08T20:13:30.787 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.816449.log: gzip -5 87.2%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.116276.log.gz/var/log/ceph/ceph-client.admin.224464.log 2023-10-08T20:13:30.787 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-10-08T20:13:30.787 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.816449.log.gz 2023-10-08T20:13:30.787 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.335366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266858.log 2023-10-08T20:13:30.787 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335366.log.gz 2023-10-08T20:13:30.788 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.662930.log 2023-10-08T20:13:30.788 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.224464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224464.log.gz 2023-10-08T20:13:30.788 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.266858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321691.log 2023-10-08T20:13:30.788 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266858.log.gz 2023-10-08T20:13:30.788 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.662930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115438.log 2023-10-08T20:13:30.788 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.662930.log.gz 2023-10-08T20:13:30.788 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415133.log 2023-10-08T20:13:30.788 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.321691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321691.log.gz 2023-10-08T20:13:30.789 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.705792.log 2023-10-08T20:13:30.789 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.415133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403250.log 2023-10-08T20:13:30.789 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.415133.log.gz 2023-10-08T20:13:30.789 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.705792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411691.log 2023-10-08T20:13:30.789 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.705792.log.gz 2023-10-08T20:13:30.789 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.814441.log 2023-10-08T20:13:30.789 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.403250.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.403250.log.gz 2023-10-08T20:13:30.789 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.411691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293170.log 2023-10-08T20:13:30.790 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411691.log.gz 2023-10-08T20:13:30.790 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.814441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119009.log 2023-10-08T20:13:30.790 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.814441.log.gz 2023-10-08T20:13:30.790 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.293170.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293170.log.gz 2023-10-08T20:13:30.790 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288949.log 2023-10-08T20:13:30.790 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277039.log 2023-10-08T20:13:30.790 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.119009.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.115438.log.gz 2023-10-08T20:13:30.790 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.288949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376351.log 2023-10-08T20:13:30.791 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288949.log.gz 2023-10-08T20:13:30.791 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.277039.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277039.log.gz 2023-10-08T20:13:30.791 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349697.log 2023-10-08T20:13:30.791 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.376351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341914.log 2023-10-08T20:13:30.791 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.376351.log.gz 2023-10-08T20:13:30.791 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.349697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322453.log 2023-10-08T20:13:30.791 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349697.log.gz 2023-10-08T20:13:30.791 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363037.log 2023-10-08T20:13:30.792 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.341914.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341914.log.gz 2023-10-08T20:13:30.792 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.322453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329368.log 2023-10-08T20:13:30.792 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322453.log.gz 2023-10-08T20:13:30.793 INFO:teuthology.orchestra.run.smithi078.stderr: 94.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-08T20:13:31.053 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.363037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.656535.log 2023-10-08T20:13:31.053 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.363037.log.gz 2023-10-08T20:13:31.053 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.329368.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.329368.log.gz--verbose 2023-10-08T20:13:31.053 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.685615.log 2023-10-08T20:13:31.053 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.656535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.681681.log 2023-10-08T20:13:31.054 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.656535.log.gz 2023-10-08T20:13:31.054 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.685615.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685615.log.gz 2023-10-08T20:13:31.054 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275753.log 2023-10-08T20:13:31.054 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.681681.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.681681.log.gz 2023-10-08T20:13:31.054 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331290.log 2023-10-08T20:13:31.054 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.947554.log 2023-10-08T20:13:31.054 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.275753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275753.log.gz 2023-10-08T20:13:31.055 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.331290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.810423.log 2023-10-08T20:13:31.055 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331290.log.gz 2023-10-08T20:13:31.055 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.947554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338758.log 2023-10-08T20:13:31.055 INFO:teuthology.orchestra.run.smithi045.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.947554.log.gz 2023-10-08T20:13:31.055 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.810423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161916.log 2023-10-08T20:13:31.055 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.810423.log.gz 2023-10-08T20:13:31.055 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.338758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697943.log 2023-10-08T20:13:31.055 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338758.log.gz 2023-10-08T20:13:31.056 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.161916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420436.log 2023-10-08T20:13:31.056 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161916.log.gz 2023-10-08T20:13:31.056 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303531.log 2023-10-08T20:13:31.056 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.697943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697943.log.gz 2023-10-08T20:13:31.056 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.420436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.827777.log 2023-10-08T20:13:31.056 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.420436.log.gz 2023-10-08T20:13:31.056 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.303531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655860.log 2023-10-08T20:13:31.056 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303531.log.gz 2023-10-08T20:13:31.057 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692018.log 2023-10-08T20:13:31.057 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.827777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.827777.log.gz 2023-10-08T20:13:31.057 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.655860.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655860.log.gz 2023-10-08T20:13:31.057 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379431.log 2023-10-08T20:13:31.057 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.828224.log 2023-10-08T20:13:31.057 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.692018.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.692018.log.gz 2023-10-08T20:13:31.057 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.379431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.645967.log 2023-10-08T20:13:31.057 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.379431.log.gz 2023-10-08T20:13:31.058 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.828224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373415.log 2023-10-08T20:13:31.058 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.828224.log.gz 2023-10-08T20:13:31.058 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.645967.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.645967.log.gz--verbose 2023-10-08T20:13:31.058 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.381835.log 2023-10-08T20:13:31.058 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.373415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177454.log 2023-10-08T20:13:31.058 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.373415.log.gz 2023-10-08T20:13:31.058 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.381835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294643.log 2023-10-08T20:13:31.058 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381835.log.gz 2023-10-08T20:13:31.059 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.177454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.940820.log 2023-10-08T20:13:31.059 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177454.log.gz 2023-10-08T20:13:31.059 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307395.log 2023-10-08T20:13:31.059 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.294643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294643.log.gz 2023-10-08T20:13:31.059 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.940820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190099.log 2023-10-08T20:13:31.059 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.940820.log.gz 2023-10-08T20:13:31.059 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.307395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220549.log 2023-10-08T20:13:31.059 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307395.log.gz 2023-10-08T20:13:31.059 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170279.log 2023-10-08T20:13:31.060 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.190099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190099.log.gz 2023-10-08T20:13:31.060 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.220549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384546.log 2023-10-08T20:13:31.060 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220549.log.gz 2023-10-08T20:13:31.060 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.170279.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.119009.log.gz 2023-10-08T20:13:31.060 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253115.log 2023-10-08T20:13:31.060 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170279.log.gz 2023-10-08T20:13:31.060 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203842.log 2023-10-08T20:13:31.060 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.384546.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384546.log.gz 2023-10-08T20:13:31.061 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.253115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635339.log 2023-10-08T20:13:31.061 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253115.log.gz 2023-10-08T20:13:31.061 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.203842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340924.log 2023-10-08T20:13:31.061 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.203842.log.gz 2023-10-08T20:13:31.061 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366774.log 2023-10-08T20:13:31.061 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.635339.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635339.log.gz 2023-10-08T20:13:31.061 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.340924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413712.log 2023-10-08T20:13:31.061 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340924.log.gz 2023-10-08T20:13:31.062 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.366774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195438.log 2023-10-08T20:13:31.062 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.366774.log.gz 2023-10-08T20:13:31.062 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357833.log 2023-10-08T20:13:31.062 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.413712.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.413712.log.gz 2023-10-08T20:13:31.062 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.195438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.671464.log 2023-10-08T20:13:31.062 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195438.log.gz 2023-10-08T20:13:31.062 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.357833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176883.log 2023-10-08T20:13:31.062 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357833.log.gz 2023-10-08T20:13:31.063 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297128.log 2023-10-08T20:13:31.063 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.671464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.671464.log.gz 2023-10-08T20:13:31.063 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.176883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.941394.log 2023-10-08T20:13:31.063 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176883.log.gz 2023-10-08T20:13:31.063 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.297128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206002.log 2023-10-08T20:13:31.063 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.297128.log.gz 2023-10-08T20:13:31.063 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369680.log 2023-10-08T20:13:31.063 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.941394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.941394.log.gz 2023-10-08T20:13:31.064 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.206002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245956.log 2023-10-08T20:13:31.064 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206002.log.gz 2023-10-08T20:13:31.064 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.369680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384560.log 2023-10-08T20:13:31.064 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.369680.log.gz 2023-10-08T20:13:31.064 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.948585.log 2023-10-08T20:13:31.064 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.245956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245956.log.gz 2023-10-08T20:13:31.064 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.384560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633925.log 2023-10-08T20:13:31.064 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384560.log.gz 2023-10-08T20:13:31.065 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.948585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394531.log 2023-10-08T20:13:31.065 INFO:teuthology.orchestra.run.smithi045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.948585.log.gz 2023-10-08T20:13:31.065 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.633925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290520.log 2023-10-08T20:13:31.065 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633925.log.gz 2023-10-08T20:13:31.065 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.394531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438309.log 2023-10-08T20:13:31.065 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394531.log.gz 2023-10-08T20:13:31.065 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.290520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276259.log 2023-10-08T20:13:31.065 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290520.log.gz 2023-10-08T20:13:31.065 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282646.log 2023-10-08T20:13:31.066 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.438309.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.438309.log.gz 2023-10-08T20:13:31.066 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.276259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334558.log 2023-10-08T20:13:31.066 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276259.log.gz 2023-10-08T20:13:31.066 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.282646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697470.log 2023-10-08T20:13:31.066 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282646.log.gz 2023-10-08T20:13:31.066 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632312.log 2023-10-08T20:13:31.066 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.334558.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334558.log.gz 2023-10-08T20:13:31.067 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.697470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348677.log 2023-10-08T20:13:31.067 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697470.log.gz 2023-10-08T20:13:31.067 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.632312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.709704.log 2023-10-08T20:13:31.067 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632312.log.gz 2023-10-08T20:13:31.067 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337553.log 2023-10-08T20:13:31.067 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.348677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348677.log.gz 2023-10-08T20:13:31.067 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.709704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303316.log 0.0% 2023-10-08T20:13:31.067 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.709704.log.gz 2023-10-08T20:13:31.068 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.337553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341216.log 0.0% 2023-10-08T20:13:31.068 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.337553.log.gz 2023-10-08T20:13:31.068 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.790555.log 2023-10-08T20:13:31.068 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.303316.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303316.log.gz 2023-10-08T20:13:31.068 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.341216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619009.log 2023-10-08T20:13:31.068 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341216.log.gz 2023-10-08T20:13:31.068 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.790555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367554.log 2023-10-08T20:13:31.068 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.790555.log.gz 2023-10-08T20:13:31.069 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.821081.log 2023-10-08T20:13:31.069 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.619009.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.619009.log.gz 2023-10-08T20:13:31.069 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.367554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.942343.log 2023-10-08T20:13:31.069 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.367554.log.gz 2023-10-08T20:13:31.069 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.821081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.639313.log 2023-10-08T20:13:31.069 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.821081.log.gz 2023-10-08T20:13:31.069 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199850.log 2023-10-08T20:13:31.069 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.942343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.942343.log.gz 2023-10-08T20:13:31.069 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.639313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248152.log 2023-10-08T20:13:31.070 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.639313.log.gz 2023-10-08T20:13:31.070 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.199850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208766.log 2023-10-08T20:13:31.070 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199850.log.gz 2023-10-08T20:13:31.070 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224414.log 2023-10-08T20:13:31.070 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.248152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248152.log.gz 2023-10-08T20:13:31.070 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.208766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.811929.log 2023-10-08T20:13:31.070 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208766.log.gz 2023-10-08T20:13:31.070 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.224414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110987.log 2023-10-08T20:13:31.071 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224414.log.gz 2023-10-08T20:13:31.071 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369457.log 2023-10-08T20:13:31.071 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.811929.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.811929.log.gz 2023-10-08T20:13:31.071 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280632.log 2023-10-08T20:13:31.071 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.369457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193496.log 2023-10-08T20:13:31.071 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.369457.log.gz 2023-10-08T20:13:31.071 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.280632.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280632.log.gz 2023-10-08T20:13:31.071 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110987.log.gz 2023-10-08T20:13:31.072 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.622185.log 2023-10-08T20:13:31.072 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.193496.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193496.log.gz 2023-10-08T20:13:31.072 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407870.log 2023-10-08T20:13:31.072 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.622185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376847.log 2023-10-08T20:13:31.072 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.622185.log.gz 2023-10-08T20:13:31.072 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.407870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382744.log 2023-10-08T20:13:31.072 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407870.log.gz 2023-10-08T20:13:31.072 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.376847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272657.log 2023-10-08T20:13:31.073 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.376847.log.gz 2023-10-08T20:13:31.073 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.382744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630733.log 2023-10-08T20:13:31.073 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382744.log.gz 2023-10-08T20:13:31.073 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477250.log 2023-10-08T20:13:31.073 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.272657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272657.log.gz 2023-10-08T20:13:31.073 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.630733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.942252.log 2023-10-08T20:13:31.073 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630733.log.gz 2023-10-08T20:13:31.073 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.477250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275233.log 2023-10-08T20:13:31.074 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.477250.log.gz 2023-10-08T20:13:31.074 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.942252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260098.log 2023-10-08T20:13:31.074 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.942252.log.gz 2023-10-08T20:13:31.074 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.275233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.698533.log 2023-10-08T20:13:31.074 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275233.log.gz 2023-10-08T20:13:31.074 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.260098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.631566.log 2023-10-08T20:13:31.074 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260098.log.gz 2023-10-08T20:13:31.074 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.698533.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.381821.log -- replaced with /var/log/ceph/ceph-client.admin.698533.log.gz 2023-10-08T20:13:31.074 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-10-08T20:13:31.075 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.631566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296822.log 2023-10-08T20:13:31.075 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.631566.log.gz 2023-10-08T20:13:31.075 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.381821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278559.log 2023-10-08T20:13:31.075 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381821.log.gz 2023-10-08T20:13:31.075 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.296822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340714.log 2023-10-08T20:13:31.075 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.296822.log.gz 2023-10-08T20:13:31.075 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.278559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244348.log 2023-10-08T20:13:31.075 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278559.log.gz 2023-10-08T20:13:31.076 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.340714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286532.log 2023-10-08T20:13:31.076 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340714.log.gz 2023-10-08T20:13:31.076 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.244348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320353.log 2023-10-08T20:13:31.076 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244348.log.gz 2023-10-08T20:13:31.076 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.286532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159068.log 2023-10-08T20:13:31.076 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286532.log.gz 2023-10-08T20:13:31.076 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117429.log 2023-10-08T20:13:31.076 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.320353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320353.log.gz 2023-10-08T20:13:31.077 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.159068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362097.log 2023-10-08T20:13:31.077 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159068.log.gz 2023-10-08T20:13:31.077 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.775651.log 2023-10-08T20:13:31.077 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103937.log 2023-10-08T20:13:31.077 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.362097.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.362097.log.gz 2023-10-08T20:13:31.077 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.775651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328339.log 2023-10-08T20:13:31.077 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.775651.log.gz 2023-10-08T20:13:31.077 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.103937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.696916.log 2023-10-08T20:13:31.078 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319861.log 2023-10-08T20:13:31.078 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.328339.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328339.log.gz 2023-10-08T20:13:31.078 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.696916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.936637.log 2023-10-08T20:13:31.078 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.696916.log.gz 2023-10-08T20:13:31.078 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.319861.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.97564.log 2023-10-08T20:13:31.078 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319861.log.gz 2023-10-08T20:13:31.078 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.679911.log 2023-10-08T20:13:31.078 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.936637.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.936637.log.gz 2023-10-08T20:13:31.079 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph.tmp-client.admin.97564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267836.log 2023-10-08T20:13:31.079 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.97564.log.gz 2023-10-08T20:13:31.079 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.679911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222096.log 2023-10-08T20:13:31.079 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.679911.log.gz 2023-10-08T20:13:31.079 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.617984.log 2023-10-08T20:13:31.080 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.267836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267836.log.gz 2023-10-08T20:13:31.080 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.222096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.647475.log 2023-10-08T20:13:31.080 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222096.log.gz 2023-10-08T20:13:31.080 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.617984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346912.log 2023-10-08T20:13:31.080 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.617984.log.gz 2023-10-08T20:13:31.080 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.647475.log: /var/log/ceph/ceph-client.admin.397921.log 2023-10-08T20:13:31.080 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.647475.log.gz 2023-10-08T20:13:31.081 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.346912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117245.log 2023-10-08T20:13:31.081 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346912.log.gz 2023-10-08T20:13:31.081 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.397921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251121.log 2023-10-08T20:13:31.081 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.397921.log.gz 2023-10-08T20:13:31.081 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478205.log 2023-10-08T20:13:31.081 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117245.log: /var/log/ceph/ceph-client.admin.251121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.939400.log 2023-10-08T20:13:31.081 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251121.log.gz 2023-10-08T20:13:31.082 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165275.log 2023-10-08T20:13:31.082 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.478205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.478205.log.gz 2023-10-08T20:13:31.082 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.939400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320262.log 2023-10-08T20:13:31.082 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.939400.log.gz 2023-10-08T20:13:31.082 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.165275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285534.log 2023-10-08T20:13:31.082 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165275.log.gz 2023-10-08T20:13:31.083 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.320262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.831664.log 2023-10-08T20:13:31.083 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320262.log.gz 2023-10-08T20:13:31.083 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.285534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271601.log 2023-10-08T20:13:31.083 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285534.log.gz 2023-10-08T20:13:31.083 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.831664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.710278.log 2023-10-08T20:13:31.083 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.831664.log.gz 2023-10-08T20:13:31.083 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.271601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279589.log 2023-10-08T20:13:31.084 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271601.log.gz 2023-10-08T20:13:31.084 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.710278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.830077.log 2023-10-08T20:13:31.084 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.710278.log.gz 2023-10-08T20:13:31.084 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.279589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.673976.log 2023-10-08T20:13:31.084 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279589.log.gz 2023-10-08T20:13:31.084 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.830077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628850.log 2023-10-08T20:13:31.084 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.830077.log.gz 2023-10-08T20:13:31.084 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.673976.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.673976.log.gz-5 2023-10-08T20:13:31.085 INFO:teuthology.orchestra.run.smithi045.stderr:--verbose -- /var/log/ceph/ceph-client.admin.642655.log 2023-10-08T20:13:31.085 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.628850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175032.log 2023-10-08T20:13:31.085 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628850.log.gz 2023-10-08T20:13:31.085 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.642655.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.642655.log.gz 2023-10-08T20:13:31.085 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114320.log 2023-10-08T20:13:31.085 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.175032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633463.log 2023-10-08T20:13:31.085 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175032.log.gz 2023-10-08T20:13:31.086 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.114320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.682230.log 2023-10-08T20:13:31.086 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.633463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206232.log 2023-10-08T20:13:31.086 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633463.log.gz 2023-10-08T20:13:31.086 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.682230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366975.log 2023-10-08T20:13:31.086 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.682230.log.gz 2023-10-08T20:13:31.086 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.206232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644417.log 2023-10-08T20:13:31.087 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206232.log.gz 2023-10-08T20:13:31.087 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.366975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.690264.log 2023-10-08T20:13:31.087 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.366975.log.gz 2023-10-08T20:13:31.087 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.644417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115622.log 2023-10-08T20:13:31.087 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.644417.log.gz 2023-10-08T20:13:31.087 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.690264.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.690264.log.gz 2023-10-08T20:13:31.087 INFO:teuthology.orchestra.run.smithi045.stderr:--verbose -- /var/log/ceph/ceph-client.admin.116835.log 2023-10-08T20:13:31.088 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209743.log 2023-10-08T20:13:31.088 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.826955.log 2023-10-08T20:13:31.088 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.209743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.772604.log 2023-10-08T20:13:31.088 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.209743.log.gz 2023-10-08T20:13:31.088 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.826955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406376.log 2023-10-08T20:13:31.088 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.826955.log.gz 2023-10-08T20:13:31.088 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.772604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406153.log 2023-10-08T20:13:31.088 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.772604.log.gz 2023-10-08T20:13:31.089 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.406376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406376.log.gz 2023-10-08T20:13:31.089 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.671751.log 2023-10-08T20:13:31.089 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.406153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274731.log 2023-10-08T20:13:31.089 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406153.log.gz 2023-10-08T20:13:31.089 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.671751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205249.log 2023-10-08T20:13:31.089 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.671751.log.gz 2023-10-08T20:13:31.089 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.274731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266390.log 2023-10-08T20:13:31.090 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274731.log.gz 2023-10-08T20:13:31.090 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.205249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.686624.log 2023-10-08T20:13:31.090 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205249.log.gz 2023-10-08T20:13:31.090 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.266390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.687525.log 2023-10-08T20:13:31.090 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266390.log.gz 2023-10-08T20:13:31.090 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.686624.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.686624.log.gz-5 2023-10-08T20:13:31.090 INFO:teuthology.orchestra.run.smithi045.stderr:--verbose -- /var/log/ceph/ceph-client.admin.344264.log 2023-10-08T20:13:31.091 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.687525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282632.log 2023-10-08T20:13:31.091 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.687525.log.gz 2023-10-08T20:13:31.091 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.344264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198444.log 2023-10-08T20:13:31.091 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344264.log.gz 2023-10-08T20:13:31.091 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.282632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207281.log 2023-10-08T20:13:31.091 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282632.log.gz 2023-10-08T20:13:31.092 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.198444.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.283602.log -- replaced with /var/log/ceph/ceph-client.admin.198444.log.gz 2023-10-08T20:13:31.092 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-10-08T20:13:31.092 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.207281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360785.log 2023-10-08T20:13:31.092 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207281.log.gz 2023-10-08T20:13:31.092 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.283602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286036.log 2023-10-08T20:13:31.092 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283602.log.gz 2023-10-08T20:13:31.093 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.360785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632548.log 2023-10-08T20:13:31.093 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.360785.log.gz 2023-10-08T20:13:31.093 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.286036.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286036.log.gz 2023-10-08T20:13:31.093 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311072.log 2023-10-08T20:13:31.093 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.632548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.813012.log 2023-10-08T20:13:31.093 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632548.log.gz 2023-10-08T20:13:31.093 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.311072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154159.log 2023-10-08T20:13:31.094 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311072.log.gz 2023-10-08T20:13:31.094 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.813012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655922.log 2023-10-08T20:13:31.094 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.813012.log.gz 2023-10-08T20:13:31.094 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.154159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242437.log 2023-10-08T20:13:31.094 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154159.log.gz 2023-10-08T20:13:31.094 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.655922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415210.log 2023-10-08T20:13:31.094 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655922.log.gz 2023-10-08T20:13:31.095 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.242437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.827686.log 2023-10-08T20:13:31.095 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242437.log.gz 2023-10-08T20:13:31.095 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.415210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252629.log 2023-10-08T20:13:31.095 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.415210.log.gz 2023-10-08T20:13:31.095 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.827686.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.827686.log.gz 2023-10-08T20:13:31.095 INFO:teuthology.orchestra.run.smithi045.stderr:--verbose -- /var/log/ceph/ceph-client.admin.656060.log 2023-10-08T20:13:31.096 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.252629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.773831.log 2023-10-08T20:13:31.096 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252629.log.gz 2023-10-08T20:13:31.096 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.656060.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.656060.log.gz 2023-10-08T20:13:31.096 INFO:teuthology.orchestra.run.smithi045.stderr:--verbose -- /var/log/ceph/ceph-client.admin.176500.log 2023-10-08T20:13:31.096 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.773831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201362.log 2023-10-08T20:13:31.096 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.773831.log.gz 2023-10-08T20:13:31.096 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.176500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301623.log 2023-10-08T20:13:31.097 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176500.log.gz 2023-10-08T20:13:31.097 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.201362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335065.log 2023-10-08T20:13:31.097 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201362.log.gz 2023-10-08T20:13:31.097 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.301623.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301623.log.gz 2023-10-08T20:13:31.097 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.948815.log 2023-10-08T20:13:31.097 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.335065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474768.log 2023-10-08T20:13:31.098 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335065.log.gz 2023-10-08T20:13:31.098 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.948815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247617.log 2023-10-08T20:13:31.098 INFO:teuthology.orchestra.run.smithi045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.948815.log.gz 2023-10-08T20:13:31.098 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.474768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.946574.log 2023-10-08T20:13:31.098 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.474768.log.gz 2023-10-08T20:13:31.098 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.247617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.776695.log 2023-10-08T20:13:31.098 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247617.log.gz 2023-10-08T20:13:31.099 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.946574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.786587.log 2023-10-08T20:13:31.099 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.946574.log.gz 2023-10-08T20:13:31.099 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.776695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.776695.log.gz 2023-10-08T20:13:31.099 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.808506.log 2023-10-08T20:13:31.099 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.786587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440001.log 2023-10-08T20:13:31.099 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.786587.log.gz 2023-10-08T20:13:31.099 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.808506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438027.log 2023-10-08T20:13:31.100 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.808506.log.gz 2023-10-08T20:13:31.100 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.440001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253645.log 2023-10-08T20:13:31.100 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.440001.log.gz 2023-10-08T20:13:31.100 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.438027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291071.log 2023-10-08T20:13:31.100 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.438027.log.gz 2023-10-08T20:13:31.100 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.253645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.681311.log 2023-10-08T20:13:31.100 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253645.log.gz 2023-10-08T20:13:31.101 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.291071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.703230.log 2023-10-08T20:13:31.101 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291071.log.gz 2023-10-08T20:13:31.101 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.681311.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.117429.log.gz 2023-10-08T20:13:31.101 INFO:teuthology.orchestra.run.smithi045.stderr:gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.681311.log.gz--verbose 2023-10-08T20:13:31.101 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.385473.log 2023-10-08T20:13:31.101 INFO:teuthology.orchestra.run.smithi045.stderr: 75.9% -- replaced with /var/log/ceph/ceph-client.admin.103937.log.gz 2023-10-08T20:13:31.101 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.703230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259620.log 2023-10-08T20:13:31.102 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.117245.log.gz 2023-10-08T20:13:31.102 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703230.log.gz 2023-10-08T20:13:31.102 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.385473.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385473.log.gz 2023-10-08T20:13:31.102 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339908.log 2023-10-08T20:13:31.102 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.114320.log.gz 2023-10-08T20:13:31.102 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.259620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328550.log 2023-10-08T20:13:31.103 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259620.log.gz 2023-10-08T20:13:31.103 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.339908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.789772.log 2023-10-08T20:13:31.103 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339908.log.gz 2023-10-08T20:13:31.103 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.328550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322229.log 2023-10-08T20:13:31.103 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328550.log.gz 2023-10-08T20:13:31.103 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.789772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.671966.log 2023-10-08T20:13:31.104 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.789772.log.gz 2023-10-08T20:13:31.104 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.322229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475159.log 2023-10-08T20:13:31.104 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322229.log.gz 2023-10-08T20:13:31.104 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.671966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277966.log 2023-10-08T20:13:31.104 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.671966.log.gz 2023-10-08T20:13:31.104 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.475159.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.475159.log.gz--verbose 2023-10-08T20:13:31.104 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.627152.log 2023-10-08T20:13:31.105 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.277966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164824.log 2023-10-08T20:13:31.105 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277966.log.gz 2023-10-08T20:13:31.105 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.627152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176050.log 2023-10-08T20:13:31.105 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.627152.log.gz 2023-10-08T20:13:31.105 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.164824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692895.log 2023-10-08T20:13:31.105 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164824.log.gz 2023-10-08T20:13:31.105 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.176050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104033.log 2023-10-08T20:13:31.106 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176050.log.gz 2023-10-08T20:13:31.106 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.692895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.646955.log 2023-10-08T20:13:31.106 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.692895.log.gz 2023-10-08T20:13:31.106 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.828238.log 2023-10-08T20:13:31.106 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.646955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252143.log 2023-10-08T20:13:31.106 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.646955.log.gz 2023-10-08T20:13:31.106 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.828238.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.828238.log.gz 2023-10-08T20:13:31.107 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261496.log 2023-10-08T20:13:31.107 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.252143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.939951.log 2023-10-08T20:13:31.107 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252143.log.gz 2023-10-08T20:13:31.107 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.261496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.795331.log 2023-10-08T20:13:31.107 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261496.log.gz 2023-10-08T20:13:31.107 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.939951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199374.log 2023-10-08T20:13:31.107 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.939951.log.gz 2023-10-08T20:13:31.108 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.795331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248061.log 0.0% 2023-10-08T20:13:31.108 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.795331.log.gz 2023-10-08T20:13:31.108 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.199374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212952.log 2023-10-08T20:13:31.108 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199374.log.gz 2023-10-08T20:13:31.108 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.248061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337123.log 2023-10-08T20:13:31.108 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248061.log.gz 2023-10-08T20:13:31.108 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.212952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.830154.log 2023-10-08T20:13:31.109 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212952.log.gz 2023-10-08T20:13:31.109 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.337123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.806243.log 2023-10-08T20:13:31.109 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337123.log.gz 2023-10-08T20:13:31.109 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.830154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111816.log 2023-10-08T20:13:31.109 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.830154.log.gz 2023-10-08T20:13:31.109 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.806243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162878.log 2023-10-08T20:13:31.109 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.806243.log.gz 2023-10-08T20:13:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306935.log 2023-10-08T20:13:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.162878.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162878.log.gzgzip 2023-10-08T20:13:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.298137.log 2023-10-08T20:13:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.306935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112158.log 2023-10-08T20:13:31.110 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306935.log.gz 2023-10-08T20:13:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.298137.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.298137.log.gz 2023-10-08T20:13:31.111 INFO:teuthology.orchestra.run.smithi045.stderr:--verbose -- /var/log/ceph/ceph-client.admin.205988.log 2023-10-08T20:13:31.111 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648886.log 2023-10-08T20:13:31.111 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.205988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308792.log 2023-10-08T20:13:31.111 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205988.log.gz 2023-10-08T20:13:31.111 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.648886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339212.log 2023-10-08T20:13:31.111 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648886.log.gz 2023-10-08T20:13:31.111 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.308792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203356.log 2023-10-08T20:13:31.112 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308792.log.gz 2023-10-08T20:13:31.112 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.339212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307911.log 2023-10-08T20:13:31.112 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339212.log.gz 2023-10-08T20:13:31.112 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.203356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203454.log 2023-10-08T20:13:31.112 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.203356.log.gz 2023-10-08T20:13:31.112 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.307911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.662641.log 2023-10-08T20:13:31.113 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307911.log.gz 2023-10-08T20:13:31.113 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.203454.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.203454.log.gz--verbose 2023-10-08T20:13:31.113 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.225476.log 2023-10-08T20:13:31.113 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.662641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.812021.log 2023-10-08T20:13:31.113 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.662641.log.gz 2023-10-08T20:13:31.113 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.225476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211638.log 2023-10-08T20:13:31.114 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225476.log.gz 2023-10-08T20:13:31.114 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.812021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405594.log 2023-10-08T20:13:31.114 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.812021.log.gz 2023-10-08T20:13:31.114 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.211638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.675307.log 2023-10-08T20:13:31.114 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211638.log.gz 2023-10-08T20:13:31.114 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.405594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116640.log 2023-10-08T20:13:31.114 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.405594.log.gz 2023-10-08T20:13:31.115 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.675307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262175.log 2023-10-08T20:13:31.115 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.675307.log.gz 2023-10-08T20:13:31.115 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406062.log 2023-10-08T20:13:31.115 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.262175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302527.log 2023-10-08T20:13:31.115 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262175.log.gz 2023-10-08T20:13:31.115 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.406062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626871.log 2023-10-08T20:13:31.115 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406062.log.gz 2023-10-08T20:13:31.116 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.813514.log 2023-10-08T20:13:31.116 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302527.log.gz 2023-10-08T20:13:31.116 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.626871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.659400.log 2023-10-08T20:13:31.116 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626871.log.gz 2023-10-08T20:13:31.116 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.813514.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.813514.log.gz-- 2023-10-08T20:13:31.117 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.691722.log 2023-10-08T20:13:31.117 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.659400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252643.log 2023-10-08T20:13:31.117 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.659400.log.gz 2023-10-08T20:13:31.117 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.691722.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.691722.log.gz/var/log/ceph/ceph-client.admin.689361.log 2023-10-08T20:13:31.117 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-10-08T20:13:31.117 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.252643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116502.log 2023-10-08T20:13:31.118 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252643.log.gz 2023-10-08T20:13:31.118 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.689361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672057.log 2023-10-08T20:13:31.118 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.689361.log.gz 2023-10-08T20:13:31.118 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172475.log 2023-10-08T20:13:31.118 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.672057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.810500.log 2023-10-08T20:13:31.118 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.672057.log.gz 2023-10-08T20:13:31.118 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.172475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.807553.log 2023-10-08T20:13:31.119 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172475.log.gz 2023-10-08T20:13:31.119 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.810500.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.810500.log.gz 2023-10-08T20:13:31.119 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.823284.log 2023-10-08T20:13:31.119 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.807553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.787302.log 2023-10-08T20:13:31.119 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.807553.log.gz 2023-10-08T20:13:31.119 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.823284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396199.log 2023-10-08T20:13:31.119 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.823284.log.gz 2023-10-08T20:13:31.120 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.787302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112159.log 2023-10-08T20:13:31.120 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.787302.log.gz 2023-10-08T20:13:31.120 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.396199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475470.log 2023-10-08T20:13:31.120 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.396199.log.gz 2023-10-08T20:13:31.120 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298643.log 2023-10-08T20:13:31.120 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.475470.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.475470.log.gz--verbose 2023-10-08T20:13:31.121 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.118817.log 2023-10-08T20:13:31.121 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.298643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.823767.log 2023-10-08T20:13:31.121 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.298643.log.gz 2023-10-08T20:13:31.121 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.118817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373608.log 2023-10-08T20:13:31.121 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.823767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.812432.log 2023-10-08T20:13:31.121 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.823767.log.gz 2023-10-08T20:13:31.122 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.373608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276035.log 2023-10-08T20:13:31.122 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.373608.log.gz 2023-10-08T20:13:31.122 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.812432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.642181.log 2023-10-08T20:13:31.122 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.812432.log.gz 2023-10-08T20:13:31.122 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.276035.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.276035.log.gz 2023-10-08T20:13:31.122 INFO:teuthology.orchestra.run.smithi045.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.308577.log 2023-10-08T20:13:31.122 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.642181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263869.log 2023-10-08T20:13:31.123 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.642181.log.gz 2023-10-08T20:13:31.123 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.308577.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308577.log.gz 2023-10-08T20:13:31.123 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212027.log 2023-10-08T20:13:31.123 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.263869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.660349.log 2023-10-08T20:13:31.123 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263869.log.gz 2023-10-08T20:13:31.124 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.212027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269268.log 2023-10-08T20:13:31.124 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212027.log.gz 2023-10-08T20:13:31.124 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.660349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191568.log 2023-10-08T20:13:31.124 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.660349.log.gz 2023-10-08T20:13:31.124 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.269268.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269268.log.gz 2023-10-08T20:13:31.124 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.784485.log 2023-10-08T20:13:31.125 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111363.log 2023-10-08T20:13:31.125 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.191568.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191568.log.gz 2023-10-08T20:13:31.125 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.784485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.821623.log 2023-10-08T20:13:31.125 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.784485.log.gz 2023-10-08T20:13:31.125 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.773085.log 2023-10-08T20:13:31.125 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213246.log 2023-10-08T20:13:31.125 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.821623.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.821623.log.gz 2023-10-08T20:13:31.126 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.773085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383652.log 2023-10-08T20:13:31.126 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.773085.log.gz 2023-10-08T20:13:31.126 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.213246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194668.log 2023-10-08T20:13:31.126 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213246.log.gz 2023-10-08T20:13:31.126 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270728.log 2023-10-08T20:13:31.126 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.383652.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.383652.log.gz 2023-10-08T20:13:31.126 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.194668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.818714.log 2023-10-08T20:13:31.127 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194668.log.gz 2023-10-08T20:13:31.127 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.270728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104065.log 2023-10-08T20:13:31.127 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270728.log.gz 2023-10-08T20:13:31.127 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414081.log 2023-10-08T20:13:31.127 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.818714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.818714.log.gz 2023-10-08T20:13:31.127 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356367.log 2023-10-08T20:13:31.127 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.414081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250639.log 2023-10-08T20:13:31.128 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.414081.log.gz 2023-10-08T20:13:31.128 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.356367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313023.log 2023-10-08T20:13:31.128 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356367.log.gz 2023-10-08T20:13:31.128 INFO:teuthology.orchestra.run.smithi045.stderr:gzip /var/log/ceph/ceph-client.admin.250639.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.215566.log 2023-10-08T20:13:31.128 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250639.log.gz 2023-10-08T20:13:31.128 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.313023.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313023.log.gz 2023-10-08T20:13:31.129 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265118.log 2023-10-08T20:13:31.129 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103969.log 2023-10-08T20:13:31.129 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.215566.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.215566.log.gz 2023-10-08T20:13:31.129 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.265118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.807539.log 2023-10-08T20:13:31.129 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265118.log.gz 2023-10-08T20:13:31.129 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.103969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.808415.log 2023-10-08T20:13:31.129 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.807539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196099.log 2023-10-08T20:13:31.129 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.807539.log.gz 2023-10-08T20:13:31.130 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.808415.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.808415.log.gz 2023-10-08T20:13:31.130 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473052.log 2023-10-08T20:13:31.130 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199941.log 2023-10-08T20:13:31.130 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.196099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196099.log.gz 2023-10-08T20:13:31.130 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.473052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.656198.log 2023-10-08T20:13:31.130 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.473052.log.gz 2023-10-08T20:13:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377272.log 2023-10-08T20:13:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.199941.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199941.log.gz 2023-10-08T20:13:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.656198.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.656198.log.gz 2023-10-08T20:13:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171934.log 2023-10-08T20:13:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636430.log 2023-10-08T20:13:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.377272.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.377272.log.gz 2023-10-08T20:13:31.132 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.171934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280541.log 2023-10-08T20:13:31.132 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.171934.log.gz 2023-10-08T20:13:31.132 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.636430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402222.log 2023-10-08T20:13:31.132 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636430.log.gz 2023-10-08T20:13:31.132 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.280541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335572.log 2023-10-08T20:13:31.132 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280541.log.gz 2023-10-08T20:13:31.132 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.402222.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.402222.log.gz 2023-10-08T20:13:31.133 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195617.log 2023-10-08T20:13:31.133 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271210.log 2023-10-08T20:13:31.133 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.335572.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335572.log.gz 2023-10-08T20:13:31.133 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.195617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368403.log 2023-10-08T20:13:31.133 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195617.log.gz 2023-10-08T20:13:31.133 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.271210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672755.log 2023-10-08T20:13:31.134 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271210.log.gz 2023-10-08T20:13:31.134 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.368403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.643577.log 2023-10-08T20:13:31.134 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.368403.log.gz 2023-10-08T20:13:31.134 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.672755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285457.log 2023-10-08T20:13:31.134 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.672755.log.gz 2023-10-08T20:13:31.134 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.643577.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.643577.log.gz--verbose 2023-10-08T20:13:31.134 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.692617.log 2023-10-08T20:13:31.135 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.285457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.826203.log 2023-10-08T20:13:31.135 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285457.log.gz 2023-10-08T20:13:31.135 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.692617.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.692617.log.gz--verbose 2023-10-08T20:13:31.135 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.345179.log 2023-10-08T20:13:31.135 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.826203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410567.log 2023-10-08T20:13:31.135 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.826203.log.gz 2023-10-08T20:13:31.136 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.345179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402299.log 2023-10-08T20:13:31.136 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345179.log.gz 2023-10-08T20:13:31.136 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.410567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112553.log 2023-10-08T20:13:31.136 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410567.log.gz 2023-10-08T20:13:31.136 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.402299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202971.log 2023-10-08T20:13:31.136 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.402299.log.gz 2023-10-08T20:13:31.136 INFO:teuthology.orchestra.run.smithi045.stderr:gzip /var/log/ceph/ceph-client.admin.112553.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.394921.log 2023-10-08T20:13:31.137 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.202971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374387.log 2023-10-08T20:13:31.137 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202971.log.gz 2023-10-08T20:13:31.137 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.394921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261482.log 2023-10-08T20:13:31.137 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394921.log.gz 2023-10-08T20:13:31.137 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.374387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.710963.log 2023-10-08T20:13:31.137 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.115622.log.gz 2023-10-08T20:13:31.138 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.374387.log.gz 2023-10-08T20:13:31.138 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 /var/log/ceph/ceph-client.admin.261482.log: --verbose -- /var/log/ceph/ceph-client.admin.349774.log 2023-10-08T20:13:31.138 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261482.log.gz 2023-10-08T20:13:31.138 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.710963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.696525.log 2023-10-08T20:13:31.138 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.710963.log.gz 2023-10-08T20:13:31.138 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.349774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.811212.log 2023-10-08T20:13:31.138 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349774.log.gz 2023-10-08T20:13:31.139 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.696525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.696525.log.gz 2023-10-08T20:13:31.139 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255443.log 2023-10-08T20:13:31.139 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.811212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392667.log 2023-10-08T20:13:31.139 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.811212.log.gz 2023-10-08T20:13:31.139 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.255443.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255443.log.gz 2023-10-08T20:13:31.139 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.771811.log 2023-10-08T20:13:31.139 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.392667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268304.log 2023-10-08T20:13:31.140 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.392667.log.gz 2023-10-08T20:13:31.140 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.771811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223088.log 2023-10-08T20:13:31.140 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.771811.log.gz 2023-10-08T20:13:31.140 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.268304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634002.log 2023-10-08T20:13:31.140 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268304.log.gz 2023-10-08T20:13:31.141 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.223088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223088.log.gz 2023-10-08T20:13:31.141 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258851.log 2023-10-08T20:13:31.141 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.634002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401127.log 2023-10-08T20:13:31.141 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634002.log.gz 2023-10-08T20:13:31.141 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.258851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.814943.log 2023-10-08T20:13:31.141 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258851.log.gz 2023-10-08T20:13:31.142 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.401127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328861.log 2023-10-08T20:13:31.142 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.401127.log.gz 2023-10-08T20:13:31.142 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.814943.log: gzip -5 --verbose 0.0%-- -- replaced with /var/log/ceph/ceph-client.admin.814943.log.gz 2023-10-08T20:13:31.142 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.245744.log 2023-10-08T20:13:31.142 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.328861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623951.log 2023-10-08T20:13:31.142 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328861.log.gz 2023-10-08T20:13:31.143 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.245744.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245744.log.gz 2023-10-08T20:13:31.143 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.678796.log 2023-10-08T20:13:31.143 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.623951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.786049.log 2023-10-08T20:13:31.143 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623951.log.gz 2023-10-08T20:13:31.143 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.678796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326746.log 2023-10-08T20:13:31.143 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.678796.log.gz 2023-10-08T20:13:31.144 INFO:teuthology.orchestra.run.smithi045.stderr:gzip /var/log/ceph/ceph-client.admin.786049.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.206832.log 2023-10-08T20:13:31.144 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.786049.log.gz 2023-10-08T20:13:31.144 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.326746.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.326746.log.gz 2023-10-08T20:13:31.144 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.201348.log 2023-10-08T20:13:31.144 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.206832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281837.log 2023-10-08T20:13:31.144 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206832.log.gz 2023-10-08T20:13:31.145 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.201348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437734.log 2023-10-08T20:13:31.145 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201348.log.gz 2023-10-08T20:13:31.145 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.281837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329784.log 2023-10-08T20:13:31.145 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281837.log.gz 2023-10-08T20:13:31.145 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.437734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269191.log 2023-10-08T20:13:31.145 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.437734.log.gz 2023-10-08T20:13:31.145 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.329784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418958.log 2023-10-08T20:13:31.146 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329784.log.gz 2023-10-08T20:13:31.146 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.269191.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269191.log.gz 2023-10-08T20:13:31.146 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.707144.log 2023-10-08T20:13:31.146 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.418958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191491.log 2023-10-08T20:13:31.147 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.418958.log.gz 2023-10-08T20:13:31.147 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.707144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693394.log 2023-10-08T20:13:31.147 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.707144.log.gz 2023-10-08T20:13:31.147 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.191491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190190.log 2023-10-08T20:13:31.147 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191491.log.gz 2023-10-08T20:13:31.147 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.693394.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.817579.log -- replaced with /var/log/ceph/ceph-client.admin.693394.log.gz 2023-10-08T20:13:31.148 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-10-08T20:13:31.148 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211165.log 2023-10-08T20:13:31.148 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.190190.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190190.log.gz 2023-10-08T20:13:31.148 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.817579.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.310251.log -- replaced with /var/log/ceph/ceph-client.admin.817579.log.gz 2023-10-08T20:13:31.148 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-10-08T20:13:31.148 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.211165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474302.log 2023-10-08T20:13:31.149 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211165.log.gz 2023-10-08T20:13:31.149 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.310251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277249.log 2023-10-08T20:13:31.149 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310251.log.gz 2023-10-08T20:13:31.149 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.474302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111430.log 2023-10-08T20:13:31.149 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.474302.log.gz 2023-10-08T20:13:31.149 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.277249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323247.log 2023-10-08T20:13:31.150 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277249.log.gz 2023-10-08T20:13:31.150 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195150.log 2023-10-08T20:13:31.150 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.323247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.809218.log 2023-10-08T20:13:31.150 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323247.log.gz 2023-10-08T20:13:31.150 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.195150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287945.log 2023-10-08T20:13:31.150 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195150.log.gz 2023-10-08T20:13:31.151 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.809218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.809218.log.gz 2023-10-08T20:13:31.151 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286742.log 2023-10-08T20:13:31.151 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.287945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358230.log 2023-10-08T20:13:31.151 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287945.log.gz 2023-10-08T20:13:31.151 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.286742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.679387.log 2023-10-08T20:13:31.151 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286742.log.gz 2023-10-08T20:13:31.151 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.358230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386132.log 2023-10-08T20:13:31.152 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358230.log.gz 2023-10-08T20:13:31.152 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.679387.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.679387.log.gz 2023-10-08T20:13:31.152 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.689742.log 2023-10-08T20:13:31.152 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413161.log 2023-10-08T20:13:31.152 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.386132.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.386132.log.gz 2023-10-08T20:13:31.152 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.689742.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.689742.log.gzgzip 2023-10-08T20:13:31.152 INFO:teuthology.orchestra.run.smithi045.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.365249.log 2023-10-08T20:13:31.153 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.809706.log 2023-10-08T20:13:31.153 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.413161.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.413161.log.gz 2023-10-08T20:13:31.153 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.365249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420422.log 2023-10-08T20:13:31.153 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.365249.log.gz 2023-10-08T20:13:31.153 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.809706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196797.log 2023-10-08T20:13:31.153 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.809706.log.gz 2023-10-08T20:13:31.153 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.420422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478921.log 2023-10-08T20:13:31.154 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.420422.log.gz 2023-10-08T20:13:31.154 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.196797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.805531.log 2023-10-08T20:13:31.154 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196797.log.gz 2023-10-08T20:13:31.154 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.478921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307409.log 2023-10-08T20:13:31.154 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.478921.log.gz 2023-10-08T20:13:31.154 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.805531.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.805531.log.gz-5 2023-10-08T20:13:31.155 INFO:teuthology.orchestra.run.smithi045.stderr:--verbose -- /var/log/ceph/ceph-client.admin.696242.log 2023-10-08T20:13:31.155 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.307409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620461.log 2023-10-08T20:13:31.155 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307409.log.gz 2023-10-08T20:13:31.155 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.696242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414158.log 2023-10-08T20:13:31.155 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.696242.log.gz 2023-10-08T20:13:31.155 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.620461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286943.log 2023-10-08T20:13:31.155 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620461.log.gz 2023-10-08T20:13:31.156 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.414158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.783581.log 2023-10-08T20:13:31.156 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.414158.log.gz 2023-10-08T20:13:31.156 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.286943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.678874.log 2023-10-08T20:13:31.156 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286943.log.gz 2023-10-08T20:13:31.156 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.783581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267340.log 2023-10-08T20:13:31.156 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.783581.log.gz 2023-10-08T20:13:31.157 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.678874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330085.log 2023-10-08T20:13:31.157 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.678874.log.gz 2023-10-08T20:13:31.157 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.267340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118064.log 2023-10-08T20:13:31.157 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267340.log.gz 2023-10-08T20:13:31.157 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.330085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244271.log 2023-10-08T20:13:31.157 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330085.log.gz 2023-10-08T20:13:31.157 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.118064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367066.log 2023-10-08T20:13:31.158 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.244271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384469.log 2023-10-08T20:13:31.158 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244271.log.gz 2023-10-08T20:13:31.158 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.367066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438601.log 2023-10-08T20:13:31.158 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.367066.log.gz 2023-10-08T20:13:31.158 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.384469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.815746.log 2023-10-08T20:13:31.158 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384469.log.gz 2023-10-08T20:13:31.158 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.438601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644046.log 2023-10-08T20:13:31.159 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.438601.log.gz 2023-10-08T20:13:31.159 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.815746.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.815746.log.gz--verbose 2023-10-08T20:13:31.159 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.174432.log 2023-10-08T20:13:31.159 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.644046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373594.log 2023-10-08T20:13:31.159 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.644046.log.gz 2023-10-08T20:13:31.159 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.174432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366550.log 2023-10-08T20:13:31.160 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174432.log.gz 2023-10-08T20:13:31.160 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.373594.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.373594.log.gz--verbose 2023-10-08T20:13:31.160 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.212570.log 2023-10-08T20:13:31.160 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.366550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319784.log 2023-10-08T20:13:31.160 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.366550.log.gz 2023-10-08T20:13:31.160 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.212570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.821532.log 2023-10-08T20:13:31.160 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212570.log.gz 2023-10-08T20:13:31.161 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.319784.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319784.log.gzgzip 2023-10-08T20:13:31.161 INFO:teuthology.orchestra.run.smithi045.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.276761.log 2023-10-08T20:13:31.161 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.821532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.708888.log 2023-10-08T20:13:31.161 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.821532.log.gz 2023-10-08T20:13:31.161 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.276761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.947263.log 2023-10-08T20:13:31.161 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276761.log.gz 2023-10-08T20:13:31.161 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.708888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.708888.log.gz 2023-10-08T20:13:31.162 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417889.log 2023-10-08T20:13:31.162 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.947263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.812217.log 2023-10-08T20:13:31.162 INFO:teuthology.orchestra.run.smithi045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.947263.log.gz 2023-10-08T20:13:31.162 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.417889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277751.log 2023-10-08T20:13:31.162 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.417889.log.gz 2023-10-08T20:13:31.162 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.812217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400825.log 2023-10-08T20:13:31.163 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.812217.log.gz 2023-10-08T20:13:31.163 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.277751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473750.log 2023-10-08T20:13:31.163 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277751.log.gz 2023-10-08T20:13:31.163 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.400825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172959.log 2023-10-08T20:13:31.163 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.400825.log.gz 2023-10-08T20:13:31.163 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.473750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.473750.log.gz 2023-10-08T20:13:31.163 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.645675.log 2023-10-08T20:13:31.164 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.622514.log 2023-10-08T20:13:31.164 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.172959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172959.log.gz 2023-10-08T20:13:31.164 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.645675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685827.log 2023-10-08T20:13:31.164 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.645675.log.gz 2023-10-08T20:13:31.164 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.622514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260292.log 2023-10-08T20:13:31.164 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.622514.log.gz 2023-10-08T20:13:31.164 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116502.log.gz 2023-10-08T20:13:31.165 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.685827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310237.log 2023-10-08T20:13:31.165 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685827.log.gz 2023-10-08T20:13:31.165 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.116640.log.gz 2023-10-08T20:13:31.165 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.116835.log.gz 2023-10-08T20:13:31.165 INFO:teuthology.orchestra.run.smithi045.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.104033.log.gz/var/log/ceph/ceph-client.admin.260292.log: 2023-10-08T20:13:31.165 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349159.log 2023-10-08T20:13:31.165 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260292.log.gz 2023-10-08T20:13:31.166 INFO:teuthology.orchestra.run.smithi045.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.104065.log.gz 2023-10-08T20:13:31.166 INFO:teuthology.orchestra.run.smithi045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.111363.log.gz 2023-10-08T20:13:31.166 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.310237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385922.log 2023-10-08T20:13:31.166 INFO:teuthology.orchestra.run.smithi045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.111816.log.gz 2023-10-08T20:13:31.166 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310237.log.gz 2023-10-08T20:13:31.166 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.112158.log.gz 2023-10-08T20:13:31.166 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.349159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.827763.log 2023-10-08T20:13:31.167 INFO:teuthology.orchestra.run.smithi045.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.112553.log.gz 2023-10-08T20:13:31.167 INFO:teuthology.orchestra.run.smithi045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.112159.log.gz 2023-10-08T20:13:31.167 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349159.log.gz 2023-10-08T20:13:31.167 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.385922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292362.log 2023-10-08T20:13:31.167 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385922.log.gz 2023-10-08T20:13:31.167 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.827763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222777.log 2023-10-08T20:13:31.168 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.827763.log.gz 2023-10-08T20:13:31.168 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.292362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360326.log 2023-10-08T20:13:31.168 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292362.log.gz 2023-10-08T20:13:31.168 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.222777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163882.log 2023-10-08T20:13:31.168 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222777.log.gz 2023-10-08T20:13:31.168 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.360326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176036.log 2023-10-08T20:13:31.168 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.360326.log.gz 2023-10-08T20:13:31.169 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.163882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104335.log 2023-10-08T20:13:31.169 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163882.log.gz 2023-10-08T20:13:31.169 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.176036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.658996.log 2023-10-08T20:13:31.169 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176036.log.gz 2023-10-08T20:13:31.169 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.812720.log 2023-10-08T20:13:31.169 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.658996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208135.log 2023-10-08T20:13:31.169 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.658996.log.gz 2023-10-08T20:13:31.170 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.812720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476266.log 2023-10-08T20:13:31.170 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.812720.log.gz 2023-10-08T20:13:31.170 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.208135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.820184.log 2023-10-08T20:13:31.170 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208135.log.gz 2023-10-08T20:13:31.170 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.476266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.690799.log 2023-10-08T20:13:31.170 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.476266.log.gz 2023-10-08T20:13:31.170 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.820184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.820184.log.gz 2023-10-08T20:13:31.171 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.698801.log 2023-10-08T20:13:31.171 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.690799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410940.log 2023-10-08T20:13:31.171 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.690799.log.gz 2023-10-08T20:13:31.171 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.698801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284489.log 2023-10-08T20:13:31.171 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.698801.log.gz 2023-10-08T20:13:31.171 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.410940.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.410940.log.gz-5 2023-10-08T20:13:31.171 INFO:teuthology.orchestra.run.smithi045.stderr:--verbose -- /var/log/ceph/ceph-client.admin.392196.log 2023-10-08T20:13:31.172 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.284489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.560211.log 2023-10-08T20:13:31.172 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284489.log.gz 2023-10-08T20:13:31.172 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.392196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.948087.log 2023-10-08T20:13:31.172 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.392196.log.gz 2023-10-08T20:13:31.172 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.560211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356353.log 2023-10-08T20:13:31.172 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.560211.log.gz 2023-10-08T20:13:31.172 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.948087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193901.log 2023-10-08T20:13:31.173 INFO:teuthology.orchestra.run.smithi045.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.948087.log.gz 2023-10-08T20:13:31.173 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.356353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.701117.log 2023-10-08T20:13:31.173 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356353.log.gz 2023-10-08T20:13:31.173 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.193901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193901.log.gz 2023-10-08T20:13:31.173 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222791.log 2023-10-08T20:13:31.173 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.701117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223630.log 2023-10-08T20:13:31.173 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.701117.log.gz 2023-10-08T20:13:31.174 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.222791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.813437.log 2023-10-08T20:13:31.174 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222791.log.gz 2023-10-08T20:13:31.174 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.223630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629241.log 2023-10-08T20:13:31.174 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223630.log.gz 2023-10-08T20:13:31.174 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.813437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325837.log 2023-10-08T20:13:31.174 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.813437.log.gz 2023-10-08T20:13:31.175 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.629241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.680850.log 2023-10-08T20:13:31.175 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629241.log.gz 2023-10-08T20:13:31.175 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.325837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699565.log 2023-10-08T20:13:31.175 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325837.log.gz 2023-10-08T20:13:31.175 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.680850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369996.log 2023-10-08T20:13:31.175 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.680850.log.gz 2023-10-08T20:13:31.175 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.699565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386347.log 2023-10-08T20:13:31.176 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699565.log.gz 2023-10-08T20:13:31.176 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.369996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636916.log 2023-10-08T20:13:31.176 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.369996.log.gz 2023-10-08T20:13:31.176 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.386347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409490.log 2023-10-08T20:13:31.176 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.386347.log.gz 2023-10-08T20:13:31.176 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.636916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.831358.log 2023-10-08T20:13:31.176 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636916.log.gz 2023-10-08T20:13:31.177 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.409490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.687539.log 2023-10-08T20:13:31.177 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409490.log.gz 2023-10-08T20:13:31.177 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.831358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312521.log 2023-10-08T20:13:31.177 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.831358.log.gz 2023-10-08T20:13:31.177 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.687539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118677.log 2023-10-08T20:13:31.177 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.687539.log.gz 2023-10-08T20:13:31.177 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.312521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.812509.log 2023-10-08T20:13:31.177 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312521.log.gz 2023-10-08T20:13:31.178 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.803675.log 2023-10-08T20:13:31.178 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.118677.log: /var/log/ceph/ceph-client.admin.812509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.807462.log 2023-10-08T20:13:31.178 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.812509.log.gz 2023-10-08T20:13:31.178 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.803675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.680759.log 2023-10-08T20:13:31.178 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.803675.log.gz 2023-10-08T20:13:31.178 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.807462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342430.log 2023-10-08T20:13:31.179 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.807462.log.gz 2023-10-08T20:13:31.179 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.680759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250716.log 2023-10-08T20:13:31.179 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.680759.log.gz 2023-10-08T20:13:31.179 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.342430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374310.log 2023-10-08T20:13:31.179 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342430.log.gz 2023-10-08T20:13:31.179 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.250716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174510.log 2023-10-08T20:13:31.179 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250716.log.gz 2023-10-08T20:13:31.180 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.374310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.812935.log 2023-10-08T20:13:31.180 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.374310.log.gz 2023-10-08T20:13:31.180 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.174510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.659203.log 2023-10-08T20:13:31.180 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174510.log.gz 2023-10-08T20:13:31.180 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.812935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350744.log 2023-10-08T20:13:31.180 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.812935.log.gz 2023-10-08T20:13:31.180 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.659203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286050.log 2023-10-08T20:13:31.181 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.659203.log.gz 2023-10-08T20:13:31.181 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.350744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.688368.log 2023-10-08T20:13:31.181 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350744.log.gz 2023-10-08T20:13:31.181 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.286050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196888.log 2023-10-08T20:13:31.181 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286050.log.gz 2023-10-08T20:13:31.181 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.688368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413621.log 2023-10-08T20:13:31.181 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.688368.log.gz 2023-10-08T20:13:31.182 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.196888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.937125.log 2023-10-08T20:13:31.182 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196888.log.gz 2023-10-08T20:13:31.182 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.413621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.822892.log 2023-10-08T20:13:31.182 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.413621.log.gz 2023-10-08T20:13:31.182 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.937125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304288.log 2023-10-08T20:13:31.182 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.937125.log.gz 2023-10-08T20:13:31.183 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.822892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473827.log 2023-10-08T20:13:31.183 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.822892.log.gz 2023-10-08T20:13:31.183 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.304288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343958.log 2023-10-08T20:13:31.183 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304288.log.gz 2023-10-08T20:13:31.183 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.473827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261964.log 2023-10-08T20:13:31.183 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.473827.log.gz 2023-10-08T20:13:31.183 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.343958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275529.log 2023-10-08T20:13:31.183 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343958.log.gz 2023-10-08T20:13:31.184 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.261964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357274.log 2023-10-08T20:13:31.184 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261964.log.gz 2023-10-08T20:13:31.184 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.275529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209285.log 2023-10-08T20:13:31.184 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275529.log.gz 2023-10-08T20:13:31.184 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.357274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192532.log 2023-10-08T20:13:31.184 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357274.log.gz 2023-10-08T20:13:31.184 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.209285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344461.log 2023-10-08T20:13:31.185 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.209285.log.gz 2023-10-08T20:13:31.185 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.192532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.824728.log 2023-10-08T20:13:31.185 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192532.log.gz 2023-10-08T20:13:31.185 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.344461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.949412.log 2023-10-08T20:13:31.185 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344461.log.gz 2023-10-08T20:13:31.185 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.824728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.701194.log 2023-10-08T20:13:31.186 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.824728.log.gz 2023-10-08T20:13:31.186 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.949412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332007.log 2023-10-08T20:13:31.186 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.949412.log.gz 2023-10-08T20:13:31.186 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.701194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110397.log 2023-10-08T20:13:31.186 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.701194.log.gz 2023-10-08T20:13:31.186 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.332007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174736.log 2023-10-08T20:13:31.187 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332007.log.gz 2023-10-08T20:13:31.187 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224129.log 2023-10-08T20:13:31.187 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.174736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192937.log 2023-10-08T20:13:31.187 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174736.log.gz 2023-10-08T20:13:31.187 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.224129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209194.log 2023-10-08T20:13:31.187 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224129.log.gz 2023-10-08T20:13:31.187 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.192937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.817060.log 2023-10-08T20:13:31.188 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192937.log.gz 2023-10-08T20:13:31.188 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.209194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111263.log 2023-10-08T20:13:31.188 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.209194.log.gz 2023-10-08T20:13:31.188 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.817060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336826.log 2023-10-08T20:13:31.188 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.817060.log.gz 2023-10-08T20:13:31.188 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294566.log 2023-10-08T20:13:31.188 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.336826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246539.log 2023-10-08T20:13:31.188 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336826.log.gz 2023-10-08T20:13:31.189 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.294566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306390.log 2023-10-08T20:13:31.189 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294566.log.gz 2023-10-08T20:13:31.189 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.246539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407082.log 2023-10-08T20:13:31.189 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246539.log.gz 2023-10-08T20:13:31.189 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.306390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.669959.log 2023-10-08T20:13:31.189 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306390.log.gz 2023-10-08T20:13:31.189 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.647671.log 2023-10-08T20:13:31.190 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.407082.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407082.log.gz 2023-10-08T20:13:31.190 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.669959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274444.log 2023-10-08T20:13:31.190 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.669959.log.gz 2023-10-08T20:13:31.190 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.647671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637614.log 2023-10-08T20:13:31.190 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.647671.log.gz 2023-10-08T20:13:31.191 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.274444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.776912.log 2023-10-08T20:13:31.191 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274444.log.gz 2023-10-08T20:13:31.191 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.637614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386940.log 2023-10-08T20:13:31.191 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637614.log.gz 2023-10-08T20:13:31.191 INFO:teuthology.orchestra.run.smithi045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.118817.log.gz 2023-10-08T20:13:31.191 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.776912.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.776912.log.gz-- 2023-10-08T20:13:31.191 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.260021.log 2023-10-08T20:13:31.192 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.386940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358787.log 2023-10-08T20:13:31.192 INFO:teuthology.orchestra.run.smithi045.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.103969.log.gz 2023-10-08T20:13:31.192 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.386940.log.gz 2023-10-08T20:13:31.192 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.260021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191973.log 2023-10-08T20:13:31.192 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260021.log.gz 2023-10-08T20:13:31.192 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.358787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350180.log 2023-10-08T20:13:31.192 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358787.log.gz 2023-10-08T20:13:31.193 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.191973.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.104469.log -- replaced with /var/log/ceph/ceph-client.admin.191973.log.gz 2023-10-08T20:13:31.193 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-10-08T20:13:31.193 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.350180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343260.log 2023-10-08T20:13:31.193 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350180.log.gz 2023-10-08T20:13:31.193 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.806960.log 2023-10-08T20:13:31.193 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.343260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271196.log 2023-10-08T20:13:31.193 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343260.log.gz 2023-10-08T20:13:31.194 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.806960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.946187.log 2023-10-08T20:13:31.194 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.806960.log.gz 2023-10-08T20:13:31.194 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.271196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.948447.log 2023-10-08T20:13:31.194 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271196.log.gz 2023-10-08T20:13:31.194 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.946187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198535.log 2023-10-08T20:13:31.194 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.946187.log.gz 2023-10-08T20:13:31.194 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.948447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.656221.log 2023-10-08T20:13:31.195 INFO:teuthology.orchestra.run.smithi045.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.948447.log.gz 2023-10-08T20:13:31.195 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.198535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283043.log 2023-10-08T20:13:31.195 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198535.log.gz 2023-10-08T20:13:31.195 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.656221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336539.log 2023-10-08T20:13:31.195 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.656221.log.gz 2023-10-08T20:13:31.195 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.283043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644508.log 2023-10-08T20:13:31.195 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283043.log.gz 2023-10-08T20:13:31.196 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.336539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294155.log 2023-10-08T20:13:31.196 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336539.log.gz 2023-10-08T20:13:31.196 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.644508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119055.log 2023-10-08T20:13:31.196 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.644508.log.gz 2023-10-08T20:13:31.196 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.294155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113040.log 2023-10-08T20:13:31.196 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294155.log.gz 2023-10-08T20:13:31.196 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.119055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.825266.log 2023-10-08T20:13:31.197 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194383.log 2023-10-08T20:13:31.197 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.113040.log: /var/log/ceph/ceph-client.admin.825266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.641739.log 2023-10-08T20:13:31.197 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.825266.log.gz 2023-10-08T20:13:31.197 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.194383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317362.log 2023-10-08T20:13:31.197 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194383.log.gz 2023-10-08T20:13:31.197 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.641739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158439.log 2023-10-08T20:13:31.197 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.641739.log.gz 2023-10-08T20:13:31.198 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.317362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.656458.log 2023-10-08T20:13:31.198 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317362.log.gz 2023-10-08T20:13:31.198 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.158439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416290.log 2023-10-08T20:13:31.198 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158439.log.gz 2023-10-08T20:13:31.198 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.656458.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.656458.log.gz 2023-10-08T20:13:31.198 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118575.log 2023-10-08T20:13:31.198 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.416290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369981.log 2023-10-08T20:13:31.199 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.416290.log.gz 2023-10-08T20:13:31.199 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.118575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278253.log 2023-10-08T20:13:31.199 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.369981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387871.log 2023-10-08T20:13:31.199 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.369981.log.gz 2023-10-08T20:13:31.199 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.278253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161020.log 2023-10-08T20:13:31.199 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278253.log.gz 2023-10-08T20:13:31.199 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.387871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206323.log 2023-10-08T20:13:31.200 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.387871.log.gz 2023-10-08T20:13:31.200 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.161020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.815020.log 2023-10-08T20:13:31.200 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161020.log.gz 2023-10-08T20:13:31.200 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.206323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305058.log 2023-10-08T20:13:31.200 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206323.log.gz 2023-10-08T20:13:31.200 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.815020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.807763.log 2023-10-08T20:13:31.200 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.815020.log.gz 2023-10-08T20:13:31.201 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.305058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397907.log 2023-10-08T20:13:31.201 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305058.log.gz 2023-10-08T20:13:31.201 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.807763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395984.log 2023-10-08T20:13:31.201 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.807763.log.gz 2023-10-08T20:13:31.201 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.397907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.817297.log 2023-10-08T20:13:31.201 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.397907.log.gz 2023-10-08T20:13:31.201 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174765.log 2023-10-08T20:13:31.202 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.395984.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.395984.log.gz 2023-10-08T20:13:31.202 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.817297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.785633.log 2023-10-08T20:13:31.202 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% 86.9% -- replaced with /var/log/ceph/ceph-client.admin.817297.log.gz -- replaced with /var/log/ceph/ceph-client.admin.111430.log.gz 2023-10-08T20:13:31.202 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-10-08T20:13:31.202 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.174765.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.118064.log.gz 2023-10-08T20:13:31.202 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174765.log.gz 2023-10-08T20:13:31.203 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118677.log.gz 2023-10-08T20:13:31.203 INFO:teuthology.orchestra.run.smithi045.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.104335.log.gz 2023-10-08T20:13:31.203 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337854.log 2023-10-08T20:13:31.203 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.785633.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.785633.log.gz 2023-10-08T20:13:31.203 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244827.log 2023-10-08T20:13:31.203 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.337854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.773754.log 2023-10-08T20:13:31.203 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337854.log.gz 2023-10-08T20:13:31.204 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110397.log.gz 2023-10-08T20:13:31.204 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.244827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405671.log 2023-10-08T20:13:31.204 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244827.log.gz 2023-10-08T20:13:31.204 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.773754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292152.log 2023-10-08T20:13:31.204 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.773754.log.gz 2023-10-08T20:13:31.204 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.405671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305560.log 2023-10-08T20:13:31.205 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.405671.log.gz 2023-10-08T20:13:31.205 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.292152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292152.log.gz 2023-10-08T20:13:31.205 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333893.log 2023-10-08T20:13:31.205 INFO:teuthology.orchestra.run.smithi045.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.111263.log.gz 2023-10-08T20:13:31.205 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204846.log 2023-10-08T20:13:31.205 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.305560.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305560.log.gz 2023-10-08T20:13:31.205 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.333893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.660426.log 2023-10-08T20:13:31.206 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333893.log.gz 2023-10-08T20:13:31.206 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.204846.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.204846.log.gz/var/log/ceph/ceph-client.admin.401601.log 2023-10-08T20:13:31.206 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-10-08T20:13:31.206 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.660426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.673990.log 2023-10-08T20:13:31.206 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.660426.log.gz 2023-10-08T20:13:31.206 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.401601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.646469.log 2023-10-08T20:13:31.207 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.401601.log.gz 2023-10-08T20:13:31.207 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.673990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200410.log 2023-10-08T20:13:31.207 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.673990.log.gz 2023-10-08T20:13:31.207 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.646469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.662944.log 2023-10-08T20:13:31.207 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.646469.log.gz 2023-10-08T20:13:31.207 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.200410.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200410.log.gz 2023-10-08T20:13:31.207 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.662853.log 2023-10-08T20:13:31.208 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.662944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111033.log 2023-10-08T20:13:31.208 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.662944.log.gz 2023-10-08T20:13:31.208 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.662853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264442.log 2023-10-08T20:13:31.208 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.662853.log.gz 2023-10-08T20:13:31.208 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655665.log 2023-10-08T20:13:31.208 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.264442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204307.log 2023-10-08T20:13:31.209 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264442.log.gz 2023-10-08T20:13:31.209 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.655665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.683561.log 2023-10-08T20:13:31.209 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655665.log.gz 2023-10-08T20:13:31.209 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.204307.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.204307.log.gz 2023-10-08T20:13:31.209 INFO:teuthology.orchestra.run.smithi045.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.394998.log 2023-10-08T20:13:31.209 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.683561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112557.log 2023-10-08T20:13:31.210 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.683561.log.gz 2023-10-08T20:13:31.210 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.394998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286441.log 2023-10-08T20:13:31.210 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394998.log.gz 2023-10-08T20:13:31.210 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243349.log 2023-10-08T20:13:31.210 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.286441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279822.log 2023-10-08T20:13:31.210 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286441.log.gz 2023-10-08T20:13:31.211 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.243349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.818101.log 2023-10-08T20:13:31.211 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243349.log.gz 2023-10-08T20:13:31.211 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.279822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314788.log 2023-10-08T20:13:31.211 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279822.log.gz 2023-10-08T20:13:31.211 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.818101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.707622.log 2023-10-08T20:13:31.211 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.818101.log.gz 2023-10-08T20:13:31.212 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.314788.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.314788.log.gz 2023-10-08T20:13:31.212 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346898.log 2023-10-08T20:13:31.212 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207765.log 2023-10-08T20:13:31.212 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.707622.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.707622.log.gz 2023-10-08T20:13:31.212 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699474.log 2023-10-08T20:13:31.212 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.346898.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346898.log.gz 2023-10-08T20:13:31.212 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.207765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383638.log 2023-10-08T20:13:31.213 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207765.log.gz 2023-10-08T20:13:31.213 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.699474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632625.log 2023-10-08T20:13:31.213 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699474.log.gz 2023-10-08T20:13:31.213 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311619.log 2023-10-08T20:13:31.213 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.383638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.383638.log.gz 2023-10-08T20:13:31.213 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.632625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632034.log 2023-10-08T20:13:31.214 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632625.log.gz 2023-10-08T20:13:31.214 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.311619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.948631.log 2023-10-08T20:13:31.214 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311619.log.gz 2023-10-08T20:13:31.214 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.632034.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.637841.log 2023-10-08T20:13:31.214 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.632034.log.gz 2023-10-08T20:13:31.214 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.948631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.774289.log 2023-10-08T20:13:31.214 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.637841.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.948631.log.gz 2023-10-08T20:13:31.215 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637841.log.gz 2023-10-08T20:13:31.215 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391292.log 2023-10-08T20:13:31.215 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.947995.log 2023-10-08T20:13:31.215 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.774289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.774289.log.gz 2023-10-08T20:13:31.215 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.805545.log 2023-10-08T20:13:31.215 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.391292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.391292.log.gz 2023-10-08T20:13:31.215 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.947995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265104.log 2023-10-08T20:13:31.216 INFO:teuthology.orchestra.run.smithi045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.947995.log.gz 2023-10-08T20:13:31.216 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.805545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243828.log 2023-10-08T20:13:31.216 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.805545.log.gz 2023-10-08T20:13:31.216 INFO:teuthology.orchestra.run.smithi045.stderr:gzip /var/log/ceph/ceph-client.admin.265104.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.684104.log 2023-10-08T20:13:31.216 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265104.log.gz 2023-10-08T20:13:31.216 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.243828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.696993.log 2023-10-08T20:13:31.216 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243828.log.gz 2023-10-08T20:13:31.217 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.684104.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.684104.log.gz 2023-10-08T20:13:31.217 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406890.log 2023-10-08T20:13:31.217 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.696993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216533.log 2023-10-08T20:13:31.217 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.696993.log.gz 2023-10-08T20:13:31.217 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.406890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398486.log 2023-10-08T20:13:31.217 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406890.log.gz 2023-10-08T20:13:31.217 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.216533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.770586.log 2023-10-08T20:13:31.218 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216533.log.gz 2023-10-08T20:13:31.218 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.398486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.830543.log 2023-10-08T20:13:31.218 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.398486.log.gz 2023-10-08T20:13:31.218 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.770586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.661966.log 2023-10-08T20:13:31.218 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.770586.log.gz 2023-10-08T20:13:31.218 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.830543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274946.log 2023-10-08T20:13:31.219 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.830543.log.gz 2023-10-08T20:13:31.219 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.661966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118771.log 2023-10-08T20:13:31.219 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.661966.log.gz 2023-10-08T20:13:31.219 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.274946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110482.log 2023-10-08T20:13:31.219 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274946.log.gz 2023-10-08T20:13:31.219 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.118771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325851.log 2023-10-08T20:13:31.219 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619465.log 2023-10-08T20:13:31.220 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.325851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332671.log 2023-10-08T20:13:31.220 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325851.log.gz 2023-10-08T20:13:31.220 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.619465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.619465.log.gz 2023-10-08T20:13:31.220 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112948.log 2023-10-08T20:13:31.220 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.332671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.825732.log 2023-10-08T20:13:31.220 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332671.log.gz 2023-10-08T20:13:31.221 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380421.log 2023-10-08T20:13:31.221 INFO:teuthology.orchestra.run.smithi045.stderr:gzip /var/log/ceph/ceph-client.admin.825732.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.161034.log 2023-10-08T20:13:31.221 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.825732.log.gz 2023-10-08T20:13:31.221 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.380421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.813236.log 2023-10-08T20:13:31.221 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.380421.log.gz 2023-10-08T20:13:31.221 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.161034.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.626551.log 2023-10-08T20:13:31.221 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.161034.log.gz 2023-10-08T20:13:31.222 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.813236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279512.log 2023-10-08T20:13:31.222 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.813236.log.gz 2023-10-08T20:13:31.222 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.626551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259125.log 2023-10-08T20:13:31.222 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626551.log.gz 2023-10-08T20:13:31.222 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.279512.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279512.log.gz 2023-10-08T20:13:31.222 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304489.log 2023-10-08T20:13:31.223 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.938927.log /var/log/ceph/ceph-client.admin.259125.log: 2023-10-08T20:13:31.223 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259125.log.gz 2023-10-08T20:13:31.223 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.304489.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.304489.log.gz--verbose 2023-10-08T20:13:31.223 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.195631.log 2023-10-08T20:13:31.223 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.938927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475236.log 2023-10-08T20:13:31.223 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.938927.log.gz 2023-10-08T20:13:31.223 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.195631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197958.log 2023-10-08T20:13:31.224 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195631.log.gz 2023-10-08T20:13:31.224 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.475236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.943748.log 2023-10-08T20:13:31.224 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.475236.log.gz 2023-10-08T20:13:31.224 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.197958.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197958.log.gz 2023-10-08T20:13:31.224 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369665.log 2023-10-08T20:13:31.224 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.943748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.702044.log 2023-10-08T20:13:31.224 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.943748.log.gz 2023-10-08T20:13:31.225 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.369665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403159.log 2023-10-08T20:13:31.225 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.369665.log.gz 2023-10-08T20:13:31.225 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.702044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349465.log 2023-10-08T20:13:31.225 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702044.log.gz 2023-10-08T20:13:31.225 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.403159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349250.log 2023-10-08T20:13:31.225 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.403159.log.gz 2023-10-08T20:13:31.226 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.349465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366473.log 2023-10-08T20:13:31.226 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349465.log.gz 2023-10-08T20:13:31.226 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.349250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.792738.log 2023-10-08T20:13:31.226 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349250.log.gz 2023-10-08T20:13:31.226 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.366473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644885.log 2023-10-08T20:13:31.226 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.366473.log.gz 2023-10-08T20:13:31.226 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.792738.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.792738.log.gz 2023-10-08T20:13:31.227 INFO:teuthology.orchestra.run.smithi045.stderr:--verbose -- /var/log/ceph/ceph-client.admin.368997.log 2023-10-08T20:13:31.227 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.644885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115668.log 2023-10-08T20:13:31.227 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.644885.log.gz 2023-10-08T20:13:31.227 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.368997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697957.log 2023-10-08T20:13:31.227 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.368997.log.gz 2023-10-08T20:13:31.227 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118111.log 2023-10-08T20:13:31.228 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.697957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366760.log 2023-10-08T20:13:31.228 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697957.log.gz 2023-10-08T20:13:31.228 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.118111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313114.log 2023-10-08T20:13:31.228 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.366760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245942.log 2023-10-08T20:13:31.228 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.366760.log.gz 2023-10-08T20:13:31.228 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.313114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.624147.log 2023-10-08T20:13:31.228 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313114.log.gz 2023-10-08T20:13:31.229 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.245942.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.245942.log.gz--verbose 2023-10-08T20:13:31.229 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.407369.log 2023-10-08T20:13:31.229 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.624147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.935690.log 2023-10-08T20:13:31.229 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.624147.log.gz 2023-10-08T20:13:31.229 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.407369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391734.log 2023-10-08T20:13:31.229 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407369.log.gz 2023-10-08T20:13:31.229 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.935690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.689284.log 2023-10-08T20:13:31.230 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.935690.log.gz 2023-10-08T20:13:31.230 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.391734.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.391734.log.gz 2023-10-08T20:13:31.230 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200886.log 2023-10-08T20:13:31.230 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.689284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299716.log 2023-10-08T20:13:31.230 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.689284.log.gz 2023-10-08T20:13:31.230 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.200886.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200886.log.gz 2023-10-08T20:13:31.231 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.808055.log 2023-10-08T20:13:31.231 INFO:teuthology.orchestra.run.smithi045.stderr:gzip /var/log/ceph/ceph-client.admin.299716.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.176514.log 2023-10-08T20:13:31.231 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299716.log.gz 2023-10-08T20:13:31.231 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.808055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.808055.log.gz 2023-10-08T20:13:31.231 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273049.log 2023-10-08T20:13:31.231 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.176514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373920.log 2023-10-08T20:13:31.231 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176514.log.gz 2023-10-08T20:13:31.232 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.273049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342129.log 2023-10-08T20:13:31.232 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273049.log.gz 2023-10-08T20:13:31.232 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.373920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407383.log 2023-10-08T20:13:31.232 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.373920.log.gz 2023-10-08T20:13:31.232 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.342129.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.475687.log 2023-10-08T20:13:31.232 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.342129.log.gz 2023-10-08T20:13:31.232 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.407383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344964.log 2023-10-08T20:13:31.233 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407383.log.gz 2023-10-08T20:13:31.233 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.475687.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.475687.log.gz 2023-10-08T20:13:31.233 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291358.log 2023-10-08T20:13:31.233 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.344964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165289.log 2023-10-08T20:13:31.233 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344964.log.gz 2023-10-08T20:13:31.233 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.291358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.936161.log 2023-10-08T20:13:31.233 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291358.log.gz 2023-10-08T20:13:31.234 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.165289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343671.log 2023-10-08T20:13:31.234 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165289.log.gz 2023-10-08T20:13:31.234 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.936161.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.316874.log -- replaced with /var/log/ceph/ceph-client.admin.936161.log.gz 2023-10-08T20:13:31.234 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-10-08T20:13:31.234 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.343671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194172.log 2023-10-08T20:13:31.234 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343671.log.gz 2023-10-08T20:13:31.235 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.316874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339714.log 2023-10-08T20:13:31.235 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316874.log.gz 2023-10-08T20:13:31.235 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.194172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.785075.log 2023-10-08T20:13:31.235 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194172.log.gz 2023-10-08T20:13:31.235 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.339714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633084.log 2023-10-08T20:13:31.235 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339714.log.gz 2023-10-08T20:13:31.235 INFO:teuthology.orchestra.run.smithi045.stderr:gzip /var/log/ceph/ceph-client.admin.785075.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.112189.log 2023-10-08T20:13:31.236 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.785075.log.gz 2023-10-08T20:13:31.236 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.633084.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.633084.log.gz 2023-10-08T20:13:31.236 INFO:teuthology.orchestra.run.smithi045.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.948539.log 2023-10-08T20:13:31.236 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.647384.log 2023-10-08T20:13:31.236 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.948539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164810.log 2023-10-08T20:13:31.236 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.948539.log.gz 2023-10-08T20:13:31.236 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.647384.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.647384.log.gz--verbose 2023-10-08T20:13:31.236 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.623005.log 2023-10-08T20:13:31.237 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.164810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164810.log.gz 2023-10-08T20:13:31.237 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634953.log 2023-10-08T20:13:31.237 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.623005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224438.log 2023-10-08T20:13:31.237 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623005.log.gz 2023-10-08T20:13:31.237 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.634953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.806257.log 2023-10-08T20:13:31.237 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634953.log.gz 2023-10-08T20:13:31.237 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.224438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248728.log 2023-10-08T20:13:31.238 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224438.log.gz 2023-10-08T20:13:31.238 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.806257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.806257.log.gz 2023-10-08T20:13:31.238 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417908.log 2023-10-08T20:13:31.238 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.248728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418179.log 2023-10-08T20:13:31.238 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248728.log.gz 2023-10-08T20:13:31.238 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.417908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300201.log 2023-10-08T20:13:31.238 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.417908.log.gz 2023-10-08T20:13:31.239 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.418179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699551.log 2023-10-08T20:13:31.239 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.418179.log.gz 2023-10-08T20:13:31.239 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.300201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.673436.log 2023-10-08T20:13:31.239 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300201.log.gz 2023-10-08T20:13:31.239 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.699551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623860.log 2023-10-08T20:13:31.239 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699551.log.gz 2023-10-08T20:13:31.239 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.673436.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.673436.log.gz-5 2023-10-08T20:13:31.240 INFO:teuthology.orchestra.run.smithi045.stderr:--verbose -- /var/log/ceph/ceph-client.admin.268709.log 2023-10-08T20:13:31.240 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.623860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.806759.log 2023-10-08T20:13:31.240 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623860.log.gz 2023-10-08T20:13:31.240 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.268709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406593.log 2023-10-08T20:13:31.240 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268709.log.gz 2023-10-08T20:13:31.240 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.806759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.806759.log.gz 2023-10-08T20:13:31.240 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.809720.log 2023-10-08T20:13:31.241 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.406593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.790763.log 2023-10-08T20:13:31.241 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406593.log.gz 2023-10-08T20:13:31.241 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.809720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343748.log 2023-10-08T20:13:31.241 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.809720.log.gz 2023-10-08T20:13:31.241 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.790763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473296.log 2023-10-08T20:13:31.241 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.790763.log.gz 2023-10-08T20:13:31.241 INFO:teuthology.orchestra.run.smithi045.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.104469.log.gz 2023-10-08T20:13:31.242 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.343748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450629.log 2023-10-08T20:13:31.242 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343748.log.gz 2023-10-08T20:13:31.242 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.473296.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.473296.log.gz 2023-10-08T20:13:31.242 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118481.log 2023-10-08T20:13:31.242 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.450629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207751.log 2023-10-08T20:13:31.242 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.450629.log.gz 2023-10-08T20:13:31.242 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.118481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.686610.log 2023-10-08T20:13:31.243 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.207751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193419.log 2023-10-08T20:13:31.243 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207751.log.gz 2023-10-08T20:13:31.243 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.686610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341412.log 2023-10-08T20:13:31.243 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.686610.log.gz 2023-10-08T20:13:31.243 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.193419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637127.log 2023-10-08T20:13:31.243 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193419.log.gz 2023-10-08T20:13:31.244 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.341412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222018.log 2023-10-08T20:13:31.244 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341412.log.gz 2023-10-08T20:13:31.244 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.637127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.785647.log 2023-10-08T20:13:31.244 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637127.log.gz 2023-10-08T20:13:31.244 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.222018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312822.log 2023-10-08T20:13:31.244 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222018.log.gz 2023-10-08T20:13:31.244 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.785647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117797.log 2023-10-08T20:13:31.245 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.785647.log.gz 2023-10-08T20:13:31.245 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.312822.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.196600.log 2023-10-08T20:13:31.245 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.312822.log.gz 2023-10-08T20:13:31.245 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335352.log 2023-10-08T20:13:31.245 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.196600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305254.log 2023-10-08T20:13:31.245 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196600.log.gz 2023-10-08T20:13:31.245 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.335352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472850.log 2023-10-08T20:13:31.246 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335352.log.gz 2023-10-08T20:13:31.246 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.305254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.656549.log 2023-10-08T20:13:31.246 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305254.log.gz 2023-10-08T20:13:31.246 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.472850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.805956.log 2023-10-08T20:13:31.246 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.472850.log.gz 2023-10-08T20:13:31.246 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.656549.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.656549.log.gz 2023-10-08T20:13:31.247 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373082.log 2023-10-08T20:13:31.247 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.805956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249180.log 2023-10-08T20:13:31.247 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.805956.log.gz 2023-10-08T20:13:31.247 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.373082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620263.log 2023-10-08T20:13:31.247 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.373082.log.gz 2023-10-08T20:13:31.247 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.249180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202880.log 2023-10-08T20:13:31.247 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249180.log.gz 2023-10-08T20:13:31.247 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.620263.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620263.log.gz 2023-10-08T20:13:31.248 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104337.log 2023-10-08T20:13:31.248 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264351.log 2023-10-08T20:13:31.248 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.202880.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202880.log.gz 2023-10-08T20:13:31.248 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619479.log 2023-10-08T20:13:31.248 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.264351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.786789.log 2023-10-08T20:13:31.248 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264351.log.gz 2023-10-08T20:13:31.248 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.619479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200396.log 2023-10-08T20:13:31.249 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.619479.log.gz 2023-10-08T20:13:31.249 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.786789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.641451.log 2023-10-08T20:13:31.249 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.786789.log.gz 2023-10-08T20:13:31.249 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.200396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110895.log 2023-10-08T20:13:31.249 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200396.log.gz 2023-10-08T20:13:31.249 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.641451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271678.log 2023-10-08T20:13:31.249 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.641451.log.gz 2023-10-08T20:13:31.250 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316783.log 2023-10-08T20:13:31.250 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.271678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.940347.log 2023-10-08T20:13:31.250 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271678.log.gz 2023-10-08T20:13:31.250 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.316783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406139.log 2023-10-08T20:13:31.250 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316783.log.gz 2023-10-08T20:13:31.250 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368681.log 2023-10-08T20:13:31.250 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.940347.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.940347.log.gz 2023-10-08T20:13:31.251 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.406139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196403.log 2023-10-08T20:13:31.251 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406139.log.gz 2023-10-08T20:13:31.251 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.368681.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.368681.log.gz 2023-10-08T20:13:31.251 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221560.log 2023-10-08T20:13:31.251 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163090.log 2023-10-08T20:13:31.251 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.196403.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196403.log.gz 2023-10-08T20:13:31.251 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292668.log 2023-10-08T20:13:31.252 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.221560.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221560.log.gz 2023-10-08T20:13:31.252 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.163090.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.163090.log.gz--verbose 2023-10-08T20:13:31.252 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.820107.log 2023-10-08T20:13:31.252 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396164.log 2023-10-08T20:13:31.252 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.292668.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292668.log.gz 2023-10-08T20:13:31.252 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.820107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304580.log 2023-10-08T20:13:31.252 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.820107.log.gz 2023-10-08T20:13:31.253 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.396164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.829705.log 2023-10-08T20:13:31.253 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.396164.log.gz 2023-10-08T20:13:31.253 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.304580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619977.log 2023-10-08T20:13:31.253 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304580.log.gz 2023-10-08T20:13:31.253 INFO:teuthology.orchestra.run.smithi045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.119055.log.gz 2023-10-08T20:13:31.253 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.829705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292577.log 2023-10-08T20:13:31.254 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.829705.log.gz 2023-10-08T20:13:31.254 INFO:teuthology.orchestra.run.smithi045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.113040.log.gz 2023-10-08T20:13:31.254 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.619977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255520.log 2023-10-08T20:13:31.254 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.619977.log.gz 2023-10-08T20:13:31.254 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.292577.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.118575.log.gz 2023-10-08T20:13:31.254 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.947217.log 2023-10-08T20:13:31.254 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292577.log.gz 2023-10-08T20:13:31.255 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.111033.log.gz 2023-10-08T20:13:31.255 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.255520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277053.log 2023-10-08T20:13:31.255 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255520.log.gz 2023-10-08T20:13:31.255 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.947217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.940897.log 2023-10-08T20:13:31.255 INFO:teuthology.orchestra.run.smithi045.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.947217.log.gz 2023-10-08T20:13:31.255 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.277053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312808.log 2023-10-08T20:13:31.255 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277053.log.gz 2023-10-08T20:13:31.256 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.940897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692004.log 2023-10-08T20:13:31.256 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.940897.log.gz 2023-10-08T20:13:31.256 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.312808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312808.log.gz 2023-10-08T20:13:31.256 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285959.log 2023-10-08T20:13:31.256 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.692004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104602.log 2023-10-08T20:13:31.256 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.692004.log.gz 2023-10-08T20:13:31.256 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.285959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333212.log 2023-10-08T20:13:31.257 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285959.log.gz 2023-10-08T20:13:31.257 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.652511.log 2023-10-08T20:13:31.257 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.333212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110745.log 2023-10-08T20:13:31.257 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333212.log.gz 2023-10-08T20:13:31.257 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.652511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104463.log 2023-10-08T20:13:31.257 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.652511.log.gz 2023-10-08T20:13:31.257 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295159.log 2023-10-08T20:13:31.257 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.936084.log 2023-10-08T20:13:31.258 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.295159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699016.log 2023-10-08T20:13:31.258 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.295159.log.gz 2023-10-08T20:13:31.258 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.936084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256061.log 2023-10-08T20:13:31.258 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.936084.log.gz 2023-10-08T20:13:31.258 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.699016.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699016.log.gz 2023-10-08T20:13:31.258 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247603.log 2023-10-08T20:13:31.259 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.256061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.943762.log 2023-10-08T20:13:31.259 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256061.log.gz 2023-10-08T20:13:31.259 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.247603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.949322.log 2023-10-08T20:13:31.259 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247603.log.gz 2023-10-08T20:13:31.259 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.943762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505781.log 2023-10-08T20:13:31.259 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.943762.log.gz 2023-10-08T20:13:31.259 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.949322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265817.log 2023-10-08T20:13:31.260 INFO:teuthology.orchestra.run.smithi045.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.949322.log.gz 2023-10-08T20:13:31.260 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.505781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623396.log 2023-10-08T20:13:31.260 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.505781.log.gz 2023-10-08T20:13:31.260 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.265817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697007.log 2023-10-08T20:13:31.260 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265817.log.gz 2023-10-08T20:13:31.260 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.623396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246653.log 2023-10-08T20:13:31.260 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623396.log.gz 2023-10-08T20:13:31.261 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.697007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198909.log 2023-10-08T20:13:31.261 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697007.log.gz 2023-10-08T20:13:31.261 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.246653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.808716.log 2023-10-08T20:13:31.261 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246653.log.gz 2023-10-08T20:13:31.261 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.198909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.707416.log 2023-10-08T20:13:31.261 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198909.log.gz 2023-10-08T20:13:31.261 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.808716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.808492.log 2023-10-08T20:13:31.262 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.808716.log.gz 2023-10-08T20:13:31.262 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.707416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.707416.log.gz 2023-10-08T20:13:31.262 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322955.log 2023-10-08T20:13:31.262 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.808492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293653.log 2023-10-08T20:13:31.262 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.808492.log.gz 2023-10-08T20:13:31.262 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.322955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343470.log 2023-10-08T20:13:31.262 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322955.log.gz 2023-10-08T20:13:31.263 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.293653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358536.log 2023-10-08T20:13:31.263 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293653.log.gz 2023-10-08T20:13:31.263 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.343470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249676.log 2023-10-08T20:13:31.263 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343470.log.gz 2023-10-08T20:13:31.263 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.358536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413147.log 2023-10-08T20:13:31.263 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358536.log.gz 2023-10-08T20:13:31.263 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.249676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393987.log 2023-10-08T20:13:31.264 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249676.log.gz 2023-10-08T20:13:31.264 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.413147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115484.log 2023-10-08T20:13:31.264 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.413147.log.gz 2023-10-08T20:13:31.264 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.393987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.704460.log 2023-10-08T20:13:31.264 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393987.log.gz 2023-10-08T20:13:31.264 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280326.log 2023-10-08T20:13:31.264 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.704460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.949091.log 2023-10-08T20:13:31.265 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.704460.log.gz 2023-10-08T20:13:31.265 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.280326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199000.log 2023-10-08T20:13:31.265 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280326.log.gz 2023-10-08T20:13:31.265 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.949091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.114098.log 2023-10-08T20:13:31.265 INFO:teuthology.orchestra.run.smithi045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.949091.log.gz 2023-10-08T20:13:31.265 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.199000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257306.log 2023-10-08T20:13:31.265 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199000.log.gz 2023-10-08T20:13:31.266 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.114098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.828756.log 2023-10-08T20:13:31.266 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.114098.log.gz 2023-10-08T20:13:31.266 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.257306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303029.log 2023-10-08T20:13:31.266 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257306.log.gz 2023-10-08T20:13:31.266 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.828756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307619.log 2023-10-08T20:13:31.266 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.828756.log.gz 2023-10-08T20:13:31.266 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.303029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381744.log 2023-10-08T20:13:31.267 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303029.log.gz 2023-10-08T20:13:31.267 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.307619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.832116.log 2023-10-08T20:13:31.267 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307619.log.gz 2023-10-08T20:13:31.267 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.381744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477236.log 2023-10-08T20:13:31.267 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381744.log.gz 2023-10-08T20:13:31.267 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.832116.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.449744.log 2023-10-08T20:13:31.268 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.832116.log.gz 2023-10-08T20:13:31.268 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.477236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.940438.log 2023-10-08T20:13:31.268 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.477236.log.gz 2023-10-08T20:13:31.268 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.449744.log: gzip -5 0.0%--verbose -- replaced with /var/log/ceph/ceph-client.admin.449744.log.gz-- 2023-10-08T20:13:31.268 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.282143.log 2023-10-08T20:13:31.268 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.940438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.657503.log 2023-10-08T20:13:31.268 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.940438.log.gz 2023-10-08T20:13:31.269 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.282143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305546.log 2023-10-08T20:13:31.269 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282143.log.gz 2023-10-08T20:13:31.269 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.657503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249662.log 2023-10-08T20:13:31.269 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.657503.log.gz 2023-10-08T20:13:31.269 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.305546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.776399.log 2023-10-08T20:13:31.269 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305546.log.gz 2023-10-08T20:13:31.269 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.249662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.828665.log 2023-10-08T20:13:31.270 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249662.log.gz 2023-10-08T20:13:31.270 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.776399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.776399.log.gz 2023-10-08T20:13:31.270 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.941881.log 2023-10-08T20:13:31.270 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.828665.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.828665.log.gz--verbose 2023-10-08T20:13:31.270 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.117291.log 2023-10-08T20:13:31.270 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.941881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685538.log 2023-10-08T20:13:31.270 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.941881.log.gz 2023-10-08T20:13:31.271 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393118.log 2023-10-08T20:13:31.271 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.685538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416213.log 2023-10-08T20:13:31.271 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685538.log.gz 2023-10-08T20:13:31.271 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.393118.log: -- /var/log/ceph/ceph-client.admin.680381.log 2023-10-08T20:13:31.271 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393118.log.gz 2023-10-08T20:13:31.271 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.416213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.806535.log 2023-10-08T20:13:31.271 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.416213.log.gz 2023-10-08T20:13:31.272 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.680381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.708200.log 2023-10-08T20:13:31.272 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.680381.log.gz 2023-10-08T20:13:31.272 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.806535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345270.log 2023-10-08T20:13:31.272 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.806535.log.gz 2023-10-08T20:13:31.272 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.708200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118917.log 2023-10-08T20:13:31.272 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.708200.log.gz 2023-10-08T20:13:31.272 INFO:teuthology.orchestra.run.smithi045.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.112557.log.gz 2023-10-08T20:13:31.273 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.345270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.671555.log 2023-10-08T20:13:31.273 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345270.log.gz 2023-10-08T20:13:31.273 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.673899.log 2023-10-08T20:13:31.273 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.118917.log: /var/log/ceph/ceph-client.admin.671555.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-08T20:13:31.273 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.671555.log.gz 2023-10-08T20:13:31.273 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.673899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172011.log 2023-10-08T20:13:31.273 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.673899.log.gz 2023-10-08T20:13:31.273 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.112948.log.gz 2023-10-08T20:13:31.274 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.829691.log 2023-10-08T20:13:31.274 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391278.log 2023-10-08T20:13:31.274 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.172011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172011.log.gz 2023-10-08T20:13:31.274 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.829691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383561.log 2023-10-08T20:13:31.274 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.829691.log.gz 2023-10-08T20:13:31.274 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.391278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222578.log 2023-10-08T20:13:31.274 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.391278.log.gz 2023-10-08T20:13:31.275 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.383561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326045.log 2023-10-08T20:13:31.275 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.383561.log.gz 2023-10-08T20:13:31.275 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.222578.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.222578.log.gz--verbose 2023-10-08T20:13:31.275 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.416304.log 2023-10-08T20:13:31.275 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.326045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383107.log 2023-10-08T20:13:31.275 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326045.log.gz 2023-10-08T20:13:31.275 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.416304.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.390745.log -- replaced with /var/log/ceph/ceph-client.admin.416304.log.gz 2023-10-08T20:13:31.276 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-10-08T20:13:31.276 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.383107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112165.log 2023-10-08T20:13:31.276 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.383107.log.gz 2023-10-08T20:13:31.276 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.390745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110695.log 2023-10-08T20:13:31.276 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.390745.log.gz 2023-10-08T20:13:31.276 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.642195.log 2023-10-08T20:13:31.276 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334190.log 2023-10-08T20:13:31.276 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.642195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697456.log 2023-10-08T20:13:31.277 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.642195.log.gz 2023-10-08T20:13:31.277 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.334190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.703820.log 2023-10-08T20:13:31.277 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334190.log.gz 2023-10-08T20:13:31.277 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.697456.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697456.log.gz 2023-10-08T20:13:31.277 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217097.log 2023-10-08T20:13:31.277 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.703820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291874.log 2023-10-08T20:13:31.277 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703820.log.gz 2023-10-08T20:13:31.278 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.217097.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.295145.log 2023-10-08T20:13:31.278 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.217097.log.gz 2023-10-08T20:13:31.278 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.291874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.678331.log 2023-10-08T20:13:31.278 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291874.log.gz 2023-10-08T20:13:31.278 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.295145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377889.log 2023-10-08T20:13:31.278 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.295145.log.gz 2023-10-08T20:13:31.279 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.678331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.807261.log 2023-10-08T20:13:31.279 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.678331.log.gz 2023-10-08T20:13:31.279 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.377889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384106.log 2023-10-08T20:13:31.279 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.377889.log.gz 2023-10-08T20:13:31.279 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.807261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.807261.log.gz 2023-10-08T20:13:31.279 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475456.log 2023-10-08T20:13:31.279 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.384106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.706748.log 2023-10-08T20:13:31.279 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384106.log.gz 2023-10-08T20:13:31.280 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.475456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.831372.log 2023-10-08T20:13:31.280 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.475456.log.gz 2023-10-08T20:13:31.280 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.706748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.948493.log 2023-10-08T20:13:31.280 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.706748.log.gz 2023-10-08T20:13:31.280 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.831372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.769351.log 2023-10-08T20:13:31.280 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.831372.log.gz 2023-10-08T20:13:31.280 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.948493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288232.log 2023-10-08T20:13:31.281 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.948493.log.gz 2023-10-08T20:13:31.281 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.769351.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.769351.log.gz 2023-10-08T20:13:31.281 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400902.log 2023-10-08T20:13:31.281 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293849.log 2023-10-08T20:13:31.281 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.288232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288232.log.gz 2023-10-08T20:13:31.281 INFO:teuthology.orchestra.run.smithi045.stderr:gzip /var/log/ceph/ceph-client.admin.400902.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.213051.log 2023-10-08T20:13:31.281 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.400902.log.gz 2023-10-08T20:13:31.282 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.293849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293849.log.gz 2023-10-08T20:13:31.282 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.936560.log 2023-10-08T20:13:31.282 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.213051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310160.log 2023-10-08T20:13:31.282 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213051.log.gz 2023-10-08T20:13:31.282 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.936560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301532.log 2023-10-08T20:13:31.282 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.936560.log.gz 2023-10-08T20:13:31.282 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.310160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213037.log 2023-10-08T20:13:31.283 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310160.log.gz 2023-10-08T20:13:31.283 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.301532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372798.log 2023-10-08T20:13:31.283 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301532.log.gz 2023-10-08T20:13:31.283 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.213037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193208.log 2023-10-08T20:13:31.283 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213037.log.gz 2023-10-08T20:13:31.283 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.372798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241976.log 2023-10-08T20:13:31.283 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.372798.log.gz 2023-10-08T20:13:31.284 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.193208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264833.log 2023-10-08T20:13:31.284 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193208.log.gz 2023-10-08T20:13:31.284 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.241976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268786.log 2023-10-08T20:13:31.284 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241976.log.gz 2023-10-08T20:13:31.284 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.264833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.706479.log 2023-10-08T20:13:31.284 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264833.log.gz 2023-10-08T20:13:31.284 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.268786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.698519.log 2023-10-08T20:13:31.285 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268786.log.gz 2023-10-08T20:13:31.285 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.706479.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.706479.log.gz--verbose 2023-10-08T20:13:31.285 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.618932.log 2023-10-08T20:13:31.285 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.698519.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.115668.log.gz 2023-10-08T20:13:31.285 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.698519.log.gz 2023-10-08T20:13:31.285 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.618932.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618932.log.gz 2023-10-08T20:13:31.285 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396273.log 2023-10-08T20:13:31.286 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110941.log 2023-10-08T20:13:31.286 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.396273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169793.log 2023-10-08T20:13:31.286 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.396273.log.gz 2023-10-08T20:13:31.286 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 /var/log/ceph/ceph-client.admin.110941.log: --verbose -- /var/log/ceph/ceph-client.admin.171471.log 2023-10-08T20:13:31.286 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.169793.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.169793.log.gz--verbose 2023-10-08T20:13:31.286 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.698241.log 2023-10-08T20:13:31.286 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407661.log 2023-10-08T20:13:31.287 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.171471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.171471.log.gz 2023-10-08T20:13:31.287 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.698241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.823844.log 2023-10-08T20:13:31.287 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.698241.log.gz 2023-10-08T20:13:31.287 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.407661.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407661.log.gz 2023-10-08T20:13:31.287 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280037.log 2023-10-08T20:13:31.287 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.823844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.789561.log 2023-10-08T20:13:31.287 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.823844.log.gz 2023-10-08T20:13:31.288 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.280037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672267.log 2023-10-08T20:13:31.288 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280037.log.gz 2023-10-08T20:13:31.288 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.789561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.690355.log 2023-10-08T20:13:31.288 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.789561.log.gz 2023-10-08T20:13:31.288 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.672267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.788478.log 2023-10-08T20:13:31.288 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.672267.log.gz 2023-10-08T20:13:31.288 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.690355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277555.log 2023-10-08T20:13:31.289 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.690355.log.gz 2023-10-08T20:13:31.289 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.788478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636416.log 2023-10-08T20:13:31.289 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.788478.log.gz 2023-10-08T20:13:31.289 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.277555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.691262.log 2023-10-08T20:13:31.289 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277555.log.gz 2023-10-08T20:13:31.289 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.636416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.783248.log 2023-10-08T20:13:31.289 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636416.log.gz 2023-10-08T20:13:31.290 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.691262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273990.log 2023-10-08T20:13:31.290 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.691262.log.gz 2023-10-08T20:13:31.290 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.783248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632326.log 2023-10-08T20:13:31.290 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.783248.log.gz 2023-10-08T20:13:31.290 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.273990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287230.log 2023-10-08T20:13:31.290 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273990.log.gz 2023-10-08T20:13:31.290 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.632326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271119.log 2023-10-08T20:13:31.291 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632326.log.gz 2023-10-08T20:13:31.291 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.287230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116594.log 2023-10-08T20:13:31.291 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287230.log.gz 2023-10-08T20:13:31.291 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.271119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379340.log 2023-10-08T20:13:31.291 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271119.log.gz 2023-10-08T20:13:31.291 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210711.log 2023-10-08T20:13:31.291 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.379340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655337.log 2023-10-08T20:13:31.292 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.379340.log.gz 2023-10-08T20:13:31.292 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.210711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298721.log 2023-10-08T20:13:31.292 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210711.log.gz 2023-10-08T20:13:31.292 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.655337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.680836.log 0.0% 2023-10-08T20:13:31.292 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.655337.log.gz 2023-10-08T20:13:31.292 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.298721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.830620.log 2023-10-08T20:13:31.292 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.298721.log.gz 2023-10-08T20:13:31.293 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.680836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104601.log 2023-10-08T20:13:31.293 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.680836.log.gz 2023-10-08T20:13:31.293 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.830620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437471.log 2023-10-08T20:13:31.293 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.830620.log.gz 2023-10-08T20:13:31.293 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.808041.log 2023-10-08T20:13:31.293 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.437471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158064.log 2023-10-08T20:13:31.293 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.437471.log.gz 2023-10-08T20:13:31.294 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.808041.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.808041.log.gz--verbose 2023-10-08T20:13:31.294 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.706762.log 2023-10-08T20:13:31.294 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.158064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.947309.log 2023-10-08T20:13:31.294 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158064.log.gz 2023-10-08T20:13:31.294 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.706762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.827233.log 2023-10-08T20:13:31.294 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.706762.log.gz 2023-10-08T20:13:31.294 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.947309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.707699.log 2023-10-08T20:13:31.295 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.827233.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.947309.log.gz 2023-10-08T20:13:31.295 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.827233.log.gz 2023-10-08T20:13:31.295 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.702332.log 2023-10-08T20:13:31.295 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.707699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307318.log 2023-10-08T20:13:31.295 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.707699.log.gz 2023-10-08T20:13:31.295 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.702332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626928.log 2023-10-08T20:13:31.295 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702332.log.gz 2023-10-08T20:13:31.296 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.307318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398778.log 2023-10-08T20:13:31.296 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307318.log.gz 2023-10-08T20:13:31.296 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.626928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.791247.log 2023-10-08T20:13:31.296 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626928.log.gz 2023-10-08T20:13:31.296 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.398778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309325.log 0.0% 2023-10-08T20:13:31.296 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.398778.log.gz 2023-10-08T20:13:31.296 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.791247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478698.log 2023-10-08T20:13:31.297 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.791247.log.gz 2023-10-08T20:13:31.297 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.309325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295857.log 2023-10-08T20:13:31.297 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309325.log.gz 2023-10-08T20:13:31.297 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.478698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.478698.log.gz 2023-10-08T20:13:31.297 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362946.log 2023-10-08T20:13:31.297 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.295857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209729.log 2023-10-08T20:13:31.297 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.295857.log.gz 2023-10-08T20:13:31.298 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.362946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407173.log 2023-10-08T20:13:31.298 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.362946.log.gz 2023-10-08T20:13:31.298 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.209729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621479.log 2023-10-08T20:13:31.298 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.209729.log.gz 2023-10-08T20:13:31.298 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.407173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408544.log 2023-10-08T20:13:31.298 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407173.log.gz 2023-10-08T20:13:31.298 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.621479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157601.log 2023-10-08T20:13:31.299 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621479.log.gz 2023-10-08T20:13:31.299 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.408544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116103.log 0.0% 2023-10-08T20:13:31.299 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.408544.log.gz 2023-10-08T20:13:31.299 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.157601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337840.log 2023-10-08T20:13:31.299 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157601.log.gz 2023-10-08T20:13:31.299 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364742.log 2023-10-08T20:13:31.299 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.337840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322152.log 2023-10-08T20:13:31.300 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337840.log.gz 2023-10-08T20:13:31.300 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.364742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.782894.log 2023-10-08T20:13:31.300 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.364742.log.gz 2023-10-08T20:13:31.300 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.322152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328847.log 2023-10-08T20:13:31.300 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322152.log.gz 2023-10-08T20:13:31.300 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.782894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211561.log 2023-10-08T20:13:31.300 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.782894.log.gz 2023-10-08T20:13:31.301 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.328847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331993.log 2023-10-08T20:13:31.301 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328847.log.gz 2023-10-08T20:13:31.301 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.211561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.948723.log 2023-10-08T20:13:31.301 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211561.log.gz 2023-10-08T20:13:31.301 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.331993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387962.log 2023-10-08T20:13:31.301 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331993.log.gz 2023-10-08T20:13:31.302 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.948723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172882.log 2023-10-08T20:13:31.302 INFO:teuthology.orchestra.run.smithi045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.948723.log.gz 2023-10-08T20:13:31.302 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.387962.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.674461.log -- replaced with /var/log/ceph/ceph-client.admin.387962.log.gz 2023-10-08T20:13:31.302 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-10-08T20:13:31.302 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.172882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174817.log 2023-10-08T20:13:31.302 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172882.log.gz 2023-10-08T20:13:31.302 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.674461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.788175.log 2023-10-08T20:13:31.303 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.674461.log.gz 2023-10-08T20:13:31.303 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.174817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377349.log 2023-10-08T20:13:31.303 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174817.log.gz 2023-10-08T20:13:31.303 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.788175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287034.log 2023-10-08T20:13:31.303 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.788175.log.gz 2023-10-08T20:13:31.303 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.377349.log: gzip -5 --verbose 0.0%-- -- replaced with /var/log/ceph/ceph-client.admin.377349.log.gz/var/log/ceph/ceph-client.admin.805454.log 2023-10-08T20:13:31.303 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-10-08T20:13:31.304 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.287034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408621.log 2023-10-08T20:13:31.304 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287034.log.gz 2023-10-08T20:13:31.304 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.805454.log: gzip -5 --verbose 0.0%-- -- replaced with /var/log/ceph/ceph-client.admin.805454.log.gz/var/log/ceph/ceph-client.admin.477429.log 2023-10-08T20:13:31.304 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-10-08T20:13:31.304 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.408621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301139.log 2023-10-08T20:13:31.304 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408621.log.gz 2023-10-08T20:13:31.304 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.477429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.670747.log 2023-10-08T20:13:31.305 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.477429.log.gz 2023-10-08T20:13:31.305 INFO:teuthology.orchestra.run.smithi045.stderr:gzip /var/log/ceph/ceph-client.admin.301139.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.439076.log 2023-10-08T20:13:31.305 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301139.log.gz 2023-10-08T20:13:31.305 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.670747.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.670747.log.gz-- 2023-10-08T20:13:31.305 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.824327.log 2023-10-08T20:13:31.305 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.439076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.640285.log 2023-10-08T20:13:31.305 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.439076.log.gz 2023-10-08T20:13:31.306 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.824327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306009.log 2023-10-08T20:13:31.306 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.824327.log.gz 2023-10-08T20:13:31.306 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.640285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284098.log 2023-10-08T20:13:31.306 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.640285.log.gz 2023-10-08T20:13:31.306 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.306009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207674.log 2023-10-08T20:13:31.306 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306009.log.gz 2023-10-08T20:13:31.307 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.284098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.814226.log 2023-10-08T20:13:31.307 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284098.log.gz 2023-10-08T20:13:31.307 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.207674.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207674.log.gz 2023-10-08T20:13:31.307 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377556.log 2023-10-08T20:13:31.307 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.814226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403236.log 2023-10-08T20:13:31.307 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.814226.log.gz 2023-10-08T20:13:31.307 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.377556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.814532.log 2023-10-08T20:13:31.308 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.377556.log.gz 2023-10-08T20:13:31.308 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.403236.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.403236.log.gz 2023-10-08T20:13:31.308 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257093.log 2023-10-08T20:13:31.308 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.814532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.948355.log 2023-10-08T20:13:31.308 INFO:teuthology.orchestra.run.smithi045.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.104337.log.gz 2023-10-08T20:13:31.308 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.814532.log.gz 2023-10-08T20:13:31.308 INFO:teuthology.orchestra.run.smithi045.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.104463.log.gz 2023-10-08T20:13:31.309 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.257093.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.104601.log.gz 2023-10-08T20:13:31.309 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257093.log.gz 2023-10-08T20:13:31.309 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324890.log 2023-10-08T20:13:31.309 INFO:teuthology.orchestra.run.smithi045.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.118771.log.gz 2023-10-08T20:13:31.309 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110482.log.gz 2023-10-08T20:13:31.309 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.948355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277541.log 2023-10-08T20:13:31.309 INFO:teuthology.orchestra.run.smithi045.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.948355.log.gz 2023-10-08T20:13:31.310 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.324890.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.118917.log.gz 2023-10-08T20:13:31.310 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110695.log.gz 2023-10-08T20:13:31.310 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.324890.log.gz 2023-10-08T20:13:31.310 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342909.log 2023-10-08T20:13:31.310 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.277541.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277541.log.gz 2023-10-08T20:13:31.310 INFO:teuthology.orchestra.run.smithi045.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.104602.log.gz 2023-10-08T20:13:31.311 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.807051.log 2023-10-08T20:13:31.311 INFO:teuthology.orchestra.run.smithi045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.110745.log.gz 2023-10-08T20:13:31.311 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.342909.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342909.log.gz 2023-10-08T20:13:31.311 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403668.log 2023-10-08T20:13:31.311 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289550.log 2023-10-08T20:13:31.311 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.807051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.807051.log.gz 2023-10-08T20:13:31.311 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.403668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312091.log 2023-10-08T20:13:31.312 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.403668.log.gz 2023-10-08T20:13:31.312 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.289550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396250.log 2023-10-08T20:13:31.312 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289550.log.gz 2023-10-08T20:13:31.312 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.312091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.710475.log 2023-10-08T20:13:31.312 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312091.log.gz 2023-10-08T20:13:31.312 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.396250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104450.log 2023-10-08T20:13:31.312 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.396250.log.gz 2023-10-08T20:13:31.313 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.710475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211652.log 2023-10-08T20:13:31.313 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.710475.log.gz 2023-10-08T20:13:31.313 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192726.log 2023-10-08T20:13:31.313 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.211652.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-08T20:13:31.313 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211652.log.gz 2023-10-08T20:13:31.313 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.192726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.694047.log 2023-10-08T20:13:31.313 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192726.log.gz 2023-10-08T20:13:31.314 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321478.log 2023-10-08T20:13:31.314 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.694047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328770.log 2023-10-08T20:13:31.314 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.694047.log.gz 2023-10-08T20:13:31.314 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.321478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.696018.log 2023-10-08T20:13:31.314 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321478.log.gz 2023-10-08T20:13:31.314 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.328770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440417.log 2023-10-08T20:13:31.314 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328770.log.gz 2023-10-08T20:13:31.315 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.696018.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.696018.log.gz--verbose 2023-10-08T20:13:31.315 INFO:teuthology.orchestra.run.smithi045.stderr:-- /var/log/ceph/ceph-client.admin.172398.log 2023-10-08T20:13:31.315 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.440417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395390.log 2023-10-08T20:13:31.315 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.440417.log.gz 2023-10-08T20:13:31.315 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.172398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.788931.log 2023-10-08T20:13:31.315 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172398.log.gz 2023-10-08T20:13:31.316 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.395390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189713.log 2023-10-08T20:13:31.316 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.395390.log.gz 2023-10-08T20:13:31.316 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.788931.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.788931.log.gzgzip 2023-10-08T20:13:31.316 INFO:teuthology.orchestra.run.smithi045.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.198521.log 2023-10-08T20:13:31.316 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.189713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637932.log 2023-10-08T20:13:31.316 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189713.log.gz 2023-10-08T20:13:31.316 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.198521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275739.log 2023-10-08T20:13:31.316 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198521.log.gz 2023-10-08T20:13:31.317 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.637932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.833741.log 2023-10-08T20:13:31.317 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637932.log.gz 2023-10-08T20:13:31.317 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.275739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197565.log 2023-10-08T20:13:31.317 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275739.log.gz 2023-10-08T20:13:31.317 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.833741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220068.log 2023-10-08T20:13:31.317 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.833741.log.gz 2023-10-08T20:13:31.317 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.197565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159569.log 2023-10-08T20:13:31.318 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197565.log.gz 2023-10-08T20:13:31.318 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.220068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160560.log 2023-10-08T20:13:31.318 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220068.log.gz 2023-10-08T20:13:31.318 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.159569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395970.log 2023-10-08T20:13:31.318 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159569.log.gz 2023-10-08T20:13:31.318 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.160560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323719.log 2023-10-08T20:13:31.319 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160560.log.gz 2023-10-08T20:13:31.319 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.395970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254969.log 2023-10-08T20:13:31.319 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.395970.log.gz 2023-10-08T20:13:31.319 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.323719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209652.log 2023-10-08T20:13:31.319 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323719.log.gz 2023-10-08T20:13:31.319 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.254969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254969.log.gz 2023-10-08T20:13:31.321 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.686151.log 2023-10-08T20:13:31.321 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.209652.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.209652.log.gz 2023-10-08T20:13:31.321 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302814.log 2023-10-08T20:13:31.321 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.686151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.659491.log 2023-10-08T20:13:31.321 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.686151.log.gz 2023-10-08T20:13:31.321 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.948953.log 2023-10-08T20:13:31.322 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302814.log.gz 2023-10-08T20:13:31.322 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.659491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410141.log 2023-10-08T20:13:31.322 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.659491.log.gz 2023-10-08T20:13:31.322 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.948953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331797.log 2023-10-08T20:13:31.322 INFO:teuthology.orchestra.run.smithi045.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.948953.log.gz 2023-10-08T20:13:31.322 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.410141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.786510.log 2023-10-08T20:13:31.322 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410141.log.gz 2023-10-08T20:13:31.323 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356845.log 2023-10-08T20:13:31.323 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.331797.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331797.log.gz 2023-10-08T20:13:31.323 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 /var/log/ceph/ceph-client.admin.786510.log: --verbose -- /var/log/ceph/ceph-client.admin.646878.log 2023-10-08T20:13:31.323 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.786510.log.gz 2023-10-08T20:13:31.323 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.356845.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356845.log.gz 2023-10-08T20:13:31.323 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115898.log 2023-10-08T20:13:31.323 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.646878.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.646878.log.gz 2023-10-08T20:13:31.323 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685174.log 2023-10-08T20:13:31.324 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198035.log 2023-10-08T20:13:31.324 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.685174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.640681.log 2023-10-08T20:13:31.324 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685174.log.gz 2023-10-08T20:13:31.324 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.198035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628773.log 2023-10-08T20:13:31.324 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198035.log.gz 2023-10-08T20:13:31.324 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.640681.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.640681.log.gz 2023-10-08T20:13:31.325 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.708123.log 2023-10-08T20:13:31.325 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398122.log 2023-10-08T20:13:31.325 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.628773.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628773.log.gz 2023-10-08T20:13:31.325 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.708123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193992.log 2023-10-08T20:13:31.325 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.708123.log.gz 2023-10-08T20:13:31.325 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.398122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.679608.log 2023-10-08T20:13:31.326 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.398122.log.gz 2023-10-08T20:13:31.326 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449143.log 2023-10-08T20:13:31.326 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.193992.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193992.log.gz 2023-10-08T20:13:31.326 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.679608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173429.log 2023-10-08T20:13:31.326 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.679608.log.gz 2023-10-08T20:13:31.326 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.449143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379933.log 2023-10-08T20:13:31.326 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.449143.log.gz 2023-10-08T20:13:31.326 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192050.log 2023-10-08T20:13:31.327 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.173429.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173429.log.gz 2023-10-08T20:13:31.327 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.379933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.938531.log 2023-10-08T20:13:31.327 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.379933.log.gz 2023-10-08T20:13:31.327 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.192050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655651.log 2023-10-08T20:13:31.327 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192050.log.gz 2023-10-08T20:13:31.327 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439523.log 2023-10-08T20:13:31.327 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.938531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.938531.log.gz 2023-10-08T20:13:31.327 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.655651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632125.log 2023-10-08T20:13:31.328 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655651.log.gz 2023-10-08T20:13:31.328 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.439523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379842.log 2023-10-08T20:13:31.328 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.439523.log.gz 2023-10-08T20:13:31.328 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345649.log 2023-10-08T20:13:31.328 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.632125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632125.log.gz 2023-10-08T20:13:31.328 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.379842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.710264.log 2023-10-08T20:13:31.328 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.379842.log.gz 2023-10-08T20:13:31.328 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.345649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.770568.log 2023-10-08T20:13:31.329 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345649.log.gz 2023-10-08T20:13:31.329 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220457.log 2023-10-08T20:13:31.329 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.710264.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.710264.log.gz 2023-10-08T20:13:31.329 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.770568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324243.log 2023-10-08T20:13:31.329 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.770568.log.gz 2023-10-08T20:13:31.329 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.220457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438985.log 2023-10-08T20:13:31.329 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220457.log.gz 2023-10-08T20:13:31.329 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376260.log 2023-10-08T20:13:31.330 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.324243.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.324243.log.gz 2023-10-08T20:13:31.330 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.438985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634486.log 2023-10-08T20:13:31.330 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.438985.log.gz 2023-10-08T20:13:31.330 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.376260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197761.log 2023-10-08T20:13:31.330 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.376260.log.gz 2023-10-08T20:13:31.330 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371739.log 2023-10-08T20:13:31.330 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.634486.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634486.log.gz 2023-10-08T20:13:31.330 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.197761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224400.log 2023-10-08T20:13:31.331 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197761.log.gz 2023-10-08T20:13:31.331 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.371739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700126.log 2023-10-08T20:13:31.331 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.371739.log.gz 2023-10-08T20:13:31.331 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450241.log 2023-10-08T20:13:31.331 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.224400.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224400.log.gz 2023-10-08T20:13:31.331 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.700126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.643486.log 2023-10-08T20:13:31.331 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700126.log.gz 2023-10-08T20:13:31.331 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.450241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408176.log 2023-10-08T20:13:31.332 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.450241.log.gz 2023-10-08T20:13:31.332 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342923.log 2023-10-08T20:13:31.332 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.643486.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.643486.log.gz 2023-10-08T20:13:31.332 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.408176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170779.log 2023-10-08T20:13:31.332 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408176.log.gz 2023-10-08T20:13:31.332 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.342923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.774673.log 2023-10-08T20:13:31.332 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342923.log.gz 2023-10-08T20:13:31.332 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637431.log 2023-10-08T20:13:31.333 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.170779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170779.log.gz 2023-10-08T20:13:31.333 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.774673.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.774673.log.gz 2023-10-08T20:13:31.333 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.637431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637431.log.gz 2023-10-08T20:13:31.333 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110895.log.gz 2023-10-08T20:13:31.333 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110941.log.gz 2023-10-08T20:13:31.333 INFO:teuthology.orchestra.run.smithi045.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.112165.log.gz 2023-10-08T20:13:31.333 INFO:teuthology.orchestra.run.smithi045.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.112189.log.gz 2023-10-08T20:13:31.333 INFO:teuthology.orchestra.run.smithi045.stderr: 87.2% 87.1% -- replaced with /var/log/ceph/ceph-client.admin.116103.log.gz -- replaced with /var/log/ceph/ceph-client.admin.115484.log.gz 2023-10-08T20:13:31.334 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-10-08T20:13:31.334 INFO:teuthology.orchestra.run.smithi045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.116594.log.gz 2023-10-08T20:13:31.334 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.117291.log.gz 2023-10-08T20:13:31.334 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.118111.log.gz 2023-10-08T20:13:31.334 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118481.log.gz 2023-10-08T20:13:31.334 INFO:teuthology.orchestra.run.smithi045.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.104450.log.gz 2023-10-08T20:13:31.334 INFO:teuthology.orchestra.run.smithi045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.115898.log.gz 2023-10-08T20:13:31.334 INFO:teuthology.orchestra.run.smithi045.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-08T20:13:31.335 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.117797.log.gz 2023-10-08T20:13:32.242 INFO:teuthology.orchestra.run.smithi045.stderr: 95.2% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-08T20:13:34.897 INFO:teuthology.orchestra.run.smithi045.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-08T20:13:37.797 INFO:teuthology.orchestra.run.smithi078.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-08T20:13:46.647 INFO:teuthology.orchestra.run.smithi078.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-08T20:13:47.973 INFO:teuthology.orchestra.run.smithi078.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-08T20:13:51.715 INFO:teuthology.orchestra.run.smithi078.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-08T20:13:51.965 INFO:teuthology.orchestra.run.smithi078.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-08T20:14:32.086 INFO:teuthology.orchestra.run.smithi045.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-08T20:14:42.391 INFO:teuthology.orchestra.run.smithi045.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-08T20:15:02.467 INFO:teuthology.orchestra.run.smithi078.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-08T20:15:15.352 INFO:teuthology.orchestra.run.smithi045.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-08T20:15:19.120 INFO:teuthology.orchestra.run.smithi078.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-08T20:15:19.122 INFO:teuthology.orchestra.run.smithi078.stderr: 2023-10-08T20:15:19.122 INFO:teuthology.orchestra.run.smithi078.stderr:real 1m49.492s 2023-10-08T20:15:19.123 INFO:teuthology.orchestra.run.smithi078.stderr:user 3m26.203s 2023-10-08T20:15:19.123 INFO:teuthology.orchestra.run.smithi078.stderr:sys 0m9.133s 2023-10-08T20:15:31.992 INFO:teuthology.orchestra.run.smithi045.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-08T20:15:31.995 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-10-08T20:15:31.996 INFO:teuthology.orchestra.run.smithi045.stderr:real 2m2.404s 2023-10-08T20:15:31.996 INFO:teuthology.orchestra.run.smithi045.stderr:user 2m54.935s 2023-10-08T20:15:31.996 INFO:teuthology.orchestra.run.smithi045.stderr:sys 0m9.150s 2023-10-08T20:15:31.996 INFO:tasks.ceph:Archiving logs... 2023-10-08T20:15:31.997 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417949/remote/smithi045/log 2023-10-08T20:15:31.998 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T20:26:58.232 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417949/remote/smithi078/log 2023-10-08T20:26:58.233 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T20:32:57.870 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-08T20:32:57.914 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-08T20:32:57.914 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T20:32:57.919 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T20:32:58.120 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-08T20:32:58.134 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-08T20:32:58.134 DEBUG:teuthology.orchestra.run.smithi045:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T20:32:58.138 DEBUG:teuthology.orchestra.run.smithi078:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T20:32:58.155 INFO:teuthology.orchestra.run.smithi045.stderr:bash: ntpq: command not found 2023-10-08T20:32:58.157 INFO:teuthology.orchestra.run.smithi078.stderr:bash: ntpq: command not found 2023-10-08T20:32:58.161 INFO:teuthology.orchestra.run.smithi078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T20:32:58.161 INFO:teuthology.orchestra.run.smithi078.stdout:=============================================================================== 2023-10-08T20:32:58.162 INFO:teuthology.orchestra.run.smithi078.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 53 -1206us[-1213us] +/- 86ms 2023-10-08T20:32:58.162 INFO:teuthology.orchestra.run.smithi078.stdout:^* hv02.front.sepia.ceph.com 3 6 377 45 +89us[ +83us] +/- 51ms 2023-10-08T20:32:58.162 INFO:teuthology.orchestra.run.smithi078.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 8 +745us[ +745us] +/- 67ms 2023-10-08T20:32:58.162 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T20:32:58.241 INFO:teuthology.orchestra.run.smithi045.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T20:32:58.241 INFO:teuthology.orchestra.run.smithi045.stdout:=============================================================================== 2023-10-08T20:32:58.242 INFO:teuthology.orchestra.run.smithi045.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 47 -1199us[-1181us] +/- 87ms 2023-10-08T20:32:58.242 INFO:teuthology.orchestra.run.smithi045.stdout:^* hv02.front.sepia.ceph.com 3 6 377 10 +105us[ +126us] +/- 52ms 2023-10-08T20:32:58.242 INFO:teuthology.orchestra.run.smithi045.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 59 +778us[ +795us] +/- 66ms 2023-10-08T20:32:58.242 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T20:32:58.243 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-08T20:32:58.257 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-08T20:32:58.257 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-08T20:32:58.335 DEBUG:teuthology.orchestra.run.smithi045:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-08T20:32:58.412 DEBUG:teuthology.orchestra.run.smithi078:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-08T20:32:58.579 DEBUG:teuthology.orchestra.run.smithi045:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T20:32:58.615 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T20:32:58.616 DEBUG:teuthology.orchestra.run.smithi078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T20:32:58.650 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T20:32:58.651 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-08T20:32:58.661 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-08T20:32:58.691 INFO:teuthology.task.internal:Duration was 28838.397770 seconds 2023-10-08T20:32:58.692 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-08T20:32:58.712 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-08T20:32:58.712 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T20:32:58.715 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T20:32:58.790 INFO:teuthology.orchestra.run.smithi078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T20:32:58.849 INFO:teuthology.orchestra.run.smithi045.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T20:32:59.102 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-08T20:32:59.102 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi045.front.sepia.ceph.com 2023-10-08T20:32:59.102 DEBUG:teuthology.orchestra.run.smithi045:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T20:32:59.177 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi078.front.sepia.ceph.com 2023-10-08T20:32:59.177 DEBUG:teuthology.orchestra.run.smithi078:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T20:32:59.215 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-08T20:32:59.215 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T20:32:59.218 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T20:32:59.346 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-08T20:32:59.346 DEBUG:teuthology.orchestra.run.smithi045:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T20:32:59.349 DEBUG:teuthology.orchestra.run.smithi078:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T20:32:59.574 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-08T20:32:59.586 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-08T20:32:59.586 DEBUG:teuthology.orchestra.run.smithi045:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T20:32:59.618 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T20:32:59.656 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-08T20:32:59.666 DEBUG:teuthology.orchestra.run.smithi045:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T20:32:59.669 DEBUG:teuthology.orchestra.run.smithi078:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T20:32:59.731 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = core 2023-10-08T20:32:59.835 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = core 2023-10-08T20:32:59.863 DEBUG:teuthology.orchestra.run.smithi045:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T20:32:59.883 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T20:32:59.884 DEBUG:teuthology.orchestra.run.smithi078:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T20:32:59.900 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T20:32:59.900 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-08T20:32:59.910 INFO:teuthology.task.internal:Transferring archived files... 2023-10-08T20:32:59.911 DEBUG:teuthology.misc:Transferring archived files from smithi045:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417949/remote/smithi045 2023-10-08T20:32:59.912 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T20:32:59.996 DEBUG:teuthology.misc:Transferring archived files from smithi078:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417949/remote/smithi078 2023-10-08T20:32:59.996 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T20:33:00.036 INFO:teuthology.task.internal:Removing archive directory... 2023-10-08T20:33:00.036 DEBUG:teuthology.orchestra.run.smithi045:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T20:33:00.038 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T20:33:00.086 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-08T20:33:00.102 INFO:teuthology.task.internal:Not uploading archives. 2023-10-08T20:33:00.102 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-08T20:33:00.156 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-08T20:33:00.157 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T20:33:00.159 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T20:33:00.176 INFO:teuthology.orchestra.run.smithi078.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 20:33 /home/ubuntu/cephtest 2023-10-08T20:33:00.178 INFO:teuthology.orchestra.run.smithi045.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 20:33 /home/ubuntu/cephtest 2023-10-08T20:33:00.180 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-08T20:33:00.192 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-08T20:33:00.284 INFO:teuthology.nuke:Checking targets against current locks 2023-10-08T20:33:00.310 DEBUG:teuthology.nuke:shortname: smithi045 2023-10-08T20:33:00.310 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T20:33:00.335 DEBUG:teuthology.nuke:shortname: smithi078 2023-10-08T20:33:00.335 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T20:33:00.339 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417949', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 12:27:25.033273', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T20:33:00.360 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417949', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 12:27:25.035152', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T20:33:00.393 INFO:teuthology.orchestra.console.smithi045:Power off 2023-10-08T20:33:00.394 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T20:33:00.418 DEBUG:teuthology.orchestra.console.smithi045:power off output: Chassis Power Control: Down/Off 2023-10-08T20:33:00.418 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T20:33:00.434 INFO:teuthology.orchestra.console.smithi078:Power off 2023-10-08T20:33:00.435 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T20:33:00.444 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-10-08T20:33:00.456 DEBUG:teuthology.orchestra.console.smithi078:power off output: Chassis Power Control: Down/Off 2023-10-08T20:33:00.456 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T20:33:00.488 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2023-10-08T20:33:04.445 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T20:33:04.490 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T20:33:04.556 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-10-08T20:33:04.601 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2023-10-08T20:33:08.558 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T20:33:08.601 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T20:33:08.669 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-10-08T20:33:08.712 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2023-10-08T20:33:12.669 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T20:33:12.713 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T20:33:12.780 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off 2023-10-08T20:33:12.824 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2023-10-08T20:33:12.881 INFO:teuthology.orchestra.console.smithi045:Power off completed 2023-10-08T20:33:12.925 INFO:teuthology.orchestra.console.smithi078:Power off completed 2023-10-08T20:33:13.031 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} duration: 28838.397770404816 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default owner: scheduled_pdonnell@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=d3afe7c88191437d8a187db5a991b28f status: fail success: false 2023-10-08T20:33:13.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-08T20:33:13.121 INFO:teuthology.run:FAIL